E
E
Elio Don2018-02-11 22:14:09
Parsing
Elio Don, 2018-02-11 22:14:09

How to parse companies to a wordpress site?

There is a site with reviews and ratings of companies, as we know there are a lot of companies, how to parse data to a site with kms wordpress, are there any plugins and is it even real?
Or is there a CMS that already has this functionality?
Well, Flump, etc., these are self-written sites, how does this function work in them?
Flam belongs to doublegis, it's clear in principle how it works.

Answer the question

In order to leave comments, you need to log in

3 answer(s)
D
Dimonchik, 2018-02-11
@dimonchik2013

it’s even easy to do it with a Scrapy parser
or another phpsh
- you hire a proger, give him a technical specification

O
Orkhan Hasanli, 2018-02-12
@azerphoenix

It's better to parse with a PHP script.
It is unlikely that the WPGrabber plugin will be useful for you in this case.

M
Mikhail Sisin, 2018-02-14
@JabbaHotep

It's better to separate parsing and importing data into your CMS. By parsing: it depends on how many sites you need to parse, what exactly to take. For example, if you collect some contact information from a bunch of different sites, you can get by with one parser. If heterogeneous data is collected and the site structure is different, then each site will have to write its own parser. If there are dozens or hundreds of parsers, then it is better to have a framework for managing and monitoring, otherwise the problem may start to grow like a snowball, and if everything is not fixed in time (sites change their structure and your parsers stop working correctly), then your system will very quickly come to decline. Also, an important factor when working with a large number of parsers is constant data quality control, otherwise you risk uploading broken data to your database, to do this, most of the verification process needs to be automated. This should also be done by your framework.
In general, this is a rather complicated process, which, if the number of parsers is more than 50, will require a permanent staff in an amount directly dependent on the complexity of the parsers. Why in the state, because in business it is better to do without unnecessary risks.
Another option is to use parsing services that have the necessary functions by default. For example, checking the collected data, scheduled launch, notifications in case of failures, etc.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question