B
B
beckmiller2019-07-25 19:24:17
Python
beckmiller, 2019-07-25 19:24:17

How to get all links to google sites that sell perfumes using BeautifulSoup?

I want to find all sites that sell perfumes. How can I implement what technology to use, tell me? Scrapy, BeautifulSoup with them I know how to find some information from a certain site. But how to find websites that sell perfumes?

import requests
import bs4
res = requests.get('https://www.google.com/search?q=')
soup = bs4.BeautifulSoup(res.text, 'lxml')

for link in soup.find_all('a', href=True):
    print(link['href'])

How can I write a request to get all sites from google response? I do not understand how to implement?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
D
Dimonchik, 2019-07-25
@dimonchik2013

gee, the advice was removed
well on this one:
https://publicwww.com/websites/parfume/

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question