How to scrape from Twitter ALL tweets with a specific hashtag?

Question

PHP

The task was given to write a tweet parser for a specific tag. Googled and stumbled upon the class . Connected, configured, received tweets, but the tweets are not quite the same and not all. The parser runs about 180 times in 15 minutes, picking up 100 messages at a time, but all 180 message sets are the same, although there are more than a hundred of them. This should not be, because. the since_id parameter constantly changes to the id of the last tweet.

Answer 1

He himself solved the problem. Was not attentive enough. The parameters for the next request with the next set of tweets are passed to search_metadata->next_results.

Answer 2

I also used this class, but I can't search for Russian hashtags...

Answer 3

We use the Twitter researcher API twitter.sneakin.info They have a paid version of their tweet collection API that you can order. In principle, we are satisfied, it is enough for our tasks. There are other options, for example, you can use the Twitter API or create a network of bots, but this is expensive and not a 100% option.