Where and how best to parse a large database of electronic components?

Question

PHP

The question is more of an organizational nature: we are making a large online store, at the moment there are points of sale for power tools, respectively, there is a base from 1c, how to integrate it in principle is clear, but the range of electronic components is quite complex and we have not yet been involved in sales, we are only planning, there are certain suppliers, everything is also quite confusing for them, to start their database in 1s, where some kind of dachnik will have 100 pieces of sku (diff.) this is hell, maybe there are some sites, or organizations that give their database in the form of json or xml? there is an opportunity to parse from Yandex, but they do not have everything. what is the best way to do it? write grabbers?), even if you parse different products from different suppliers, will it be possible to combine all this and how laborious is it?

Answer 1

there are no such sites
if the goods are branded, and not no name - they have a barcode, you can use it to connect sku from different suppliers
. Take product matrices from each supplier and analyze the data (columns with properties).
a) if they can be generalized, make one summary
b) if all tables are different (it happens that the properties are all indicated in the line with the name or not indicated at all), then here: -
perform manipulations with dividing the column data into several (very tedious and inefficient, if there are many such tables)
- put up and upload everything to the site (there will be duplicates) - but you can not upload them to the site, but give priority to one supplier who has more favorable conditions for this product