remove substring occurrence and anything comes after it

dataframe with 'text' column that contains tweets
each tweets has short url in the end i want to remove that url using regex from all rows

string : 'This is Tilly. She's just checking pup on you. Hopes you're doing ok. If not, she's available for pats, snugs, boops, the whole bit. 13/10 https//(short url here i cannot post)'

i need regular expression that deletes 'http' and all that comes after it using regex

archive_clean['text'] = archive_clean['text'].replace('https.', '', regex=True)

output:

This is Tilly. She's just checking pup on you. Hopes you're doing ok. If not, she's available for pats, snugs, boops, the whole bit. 13/10 //(the rest of the url)

It should be as simple as adding a star to the end of that period wildcard you already have. The star matches zero or more repetitions of the preceding item. (Link to python re docs)

Change the code to be

archive_clean['cleaned_text'] = archive_clean['text'].replace('http.*', '', regex=True)

to get rid of everything after the "http" substring.

That being said, with regex there are pretty much always exceptions.

• Do you want to strip the white-space before the "http"? The solution I just provided leaves your example string as "...boops, the whole bit. 13/10 "

• Are you going to have some links with no leading "http" at all?

• Will there ever be another link in the middle of the text that should not be removed? Example:

  "This is Tilly. She's just checking pup on you. Hopes you're doing ok. If not, she's available for pats, snugs, boops, the whole bit. Check her out at https://tillythepup.com. 13/10 https://twitter.com/post/xxxx"
  

  In this case we should change the regex to be "http\S*\Z" which makes sure it only removes the URL that is anchored at the end of the string.

  (Note: URL must be continuous with no whitespace right up to the end of the string. Anything short of this will not remove the URL as expected. Maybe account for this by pre-stripping the column of whitespaces using .str.strip())

  Thanks to mozway in the comments for this suggestion.

There are many ways to handle those edge cases, and maybe you have already thought of them, but the simple case that you outlined in your question is fairly straightforward.

Hope this helps!