How to build a data processing and analysis service (read more)?

Question

Computer networks

Good day. (I'll be brief).
1. There are sites, various services and resources that can share data (currency rates, weather, popularity of films and music, etc.). There is a desire to build a semblance of a service that analyzes data, for example, from several sites on films: what films do girls aged 20-45 watch in the time period from 16:00-21:00 from the beginning of September (it is clear that such an analysis can be carried out by my database data, but it needs to be "feeded" with something, and the data should come automatically from the moment the site-(my resource) starts).
2 Yes, perhaps popular resources share such information by providing their Api. In particular, I mean search engines, but how to build an online statistics service is acceptable for agriculture (I see only one option, how to contact sources (100 sources are acceptable) and automate the receipt of data from them)?
PS I apologize for the possibly not quite correct form of submitting questions). All good.

Answer 1

For each source you write your own scraper