How to parse a website in python?

Question

Python

you need to parse the site https://koleso.ru/shops/, get data about each store (address, phone, opening hours, coordinates),
but the problem is how to do it? I can not find where the coordinates are taken.
help me please

Answer 1

For some tasks selenium is redundant:

>>> import re
>>> from urllib.request import urlopen
>>> regex = r"createObject\(\"Placemark\",\s?new\sYMaps\.GeoPoint\(([\d\s\.\,]+)\),\s?\"(\w+)\",\s?'([^']+)'\s?\);"
>>> text = str(urlopen("https://koleso.ru/shops/").read(),"windows-1251")
>>> result = [list(x.groups()) for x in re.finditer(regex, text, re.MULTILINE)]
>>> result[0]
['37.834803,55.776082', 'Koleso', '<div><a class="MenuNav_YmapsBalloonPreButton" style="font-size:11px;" href="/shops/3653118/">Карточка магазина</a></div><div class="MenuNav_YmapsBalloonComment"><b>г. Москва</b><br />ш. Энтузиастов, д. 63<br />тел.: [phone]</div>']
>>>

but you need to be able to write a regex

Answer 2

https://scrappy.org/

Answer 3

I myself recently started to study this direction and use Selenium.
Nothing complicated if you have minimal knowledge of HTML, you can, of course, without them