Y
Y
Yuri2015-01-26 19:52:25
PHP
Yuri, 2015-01-26 19:52:25

How to write a backend for a task?

the task was to write a site that presents data from 30-60 sites in a tabular form ..
some sites have an Xml file - but most do not, and as I understand it, you need to write a parser:
all needs)
2. Is it possible to parse data at different intervals depending on the time of day and update
this data in the database? less than weekdays)
3. When loading a Simple xml site, PHP parses the data and immediately presents it on the site, can I set up parsing of this data first into the database, and already to the site from the database? (I'm sure this should affect the site loading speed? besides, some data change only once a day and there is no need to make requests every time the site is loaded)
please feel free to correct me if I don’t understand something)

Answer the question

In order to leave comments, you need to log in

5 answer(s)
M
Makaveli, 2015-01-26
@Makaveli

1. The one you own better. Or the one that interests you now and that you now have time to study.
2. Yes. For example, you set up a job in cron for the right days.
3. Yes, you can. Make a separate parser that will parse and put what you need into the database at the right time, and a separate tool that will display data from the database.

E
entermix, 2015-01-26
@entermix

1. Any server, such as PHP
2. Yes, a scheduler (cron) to help
3. Why not? Simple xml PHP parses information, and where to send it is up to you.

V
Viktor Vsk, 2015-01-27
@viktorvsk

Made a tool in Ruby for parsing an arbitrary number of sources using JSON format + some pseudo-DSL wrapper over DOM parser (css/xpath selectors + filters). As a bonus - a web admin, more or less simple scaling, some kind of Scheduler. Everything is very raw, but I hope it will be actively developed. To some extent, it is actually being used now.
It must be understood that the parser must remain a parser. And your business logic (what to add where, when to save/cache to the database, when to display what) - should be decided at the application level
Judging by your question, you will need a qualified performer to implement the described. But, perhaps, it will come in handy: https://github.com/victorvsk/apify-kit

K
Kolka is rotten, 2017-11-11
@lukoie

It's called rounded wavy pattern. It was invented by Nina Georgieva (now Geometrieva) from Macedonia (so she said and everyone seemed to believe it, although xs how it really is :)) Cool person, by the way)
https://medium.com/@geometrieva/tutorial-for-that -...
https://www.behance.net/ninageo

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question