Answer the question
In order to leave comments, you need to log in
Why are some sites scraped without www., and some are not?
The task is to parse text from sites, I load the site via curl, and some sites are not parsed if you specify it like this:
https://test.com/
https://www.test.com
Answer the question
In order to leave comments, you need to log in
C www is a separate subdomain, which is different from the domain. Some set it up as an alias and return the same content in both cases. Some do not add at all, and the site with www does not open. And some - they put a redirect, and it happens in different ways - sometimes they redirect from a subdomain to a domain, and sometimes vice versa.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question