L
L
leon84612021-05-31 16:48:23
PHP
leon8461, 2021-05-31 16:48:23

Interacting with data using multiple servers?

The task is following, I ask not to kick strongly for a question. Parsing, collection, and analysis of data will take place on one server. On another site that will display ready-made information. How to organize data exchange between servers, given that as soon as the data has arrived at the server where the parser is located and has been analyzed, they should immediately get to the main site. In what direction should we move in order to solve the problem?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
S
Stalker_RED, 2021-05-31
@Stalker_RED

Immediately after the analysis, write the data to the database, from where they can be read by the "main site".
When you connect to the database, you specify the address. So, you can write there not only localhost, it also works through the Internet.

V
Vladimir Korotenko, 2021-05-31
@firedragon

See don't optimize ahead of time.
Inserting data is a relatively easy operation in relation to scraping and retrieving pages.
In addition, let's say you have a scraper, you give it a pack of addresses, it does something, then writes it to the database.
Writing to the database will be pretty fast.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question