Answer the question
In order to leave comments, you need to log in
How are aggregator sites or parser sites arranged?
I worked with desktop parsers or grabbers, whose job was to collect information at the time of launch. But I have come across sites (for example, ka.ru) that are translated (but not necessarily) versions of other sites, there are just aggregators that save data about pages in social networks. Actually the question is: on the server of such sites there is a certain task in the scheduler that launches a parser program that generates html? It is unlikely that at the moment of creating a php session, all these lengthy manipulations take place.
PS I understand that it is unlikely that there are developers of such sites here, but if you cannot answer about the processes in the listed types of sites, then tell me how this can be in theory.
Answer the question
In order to leave comments, you need to log in
Yes, parsing is a background task. Parsing itself is divided into at least two parts, receiving information and processing it. And of course, html is generated not by the parser itself, but by the site engine based on the data received by the parser. All this can be achieved without problems, just by starting to solve a similar problem.
Well, yes. The background task parses and writes its results to the database. And the site reads the database and shows what is happening now.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question