Answer the question
In order to leave comments, you need to log in
What is the easiest language to write a website scraper in?
Parser for downloading site information in a loop.
The array contains url addresses of sections.
Next, the parser in the loop should run through each page of urls and pull out new urls for posts.
Next, in a new subloop, go to each parsed url and parse the contents.
Take the parsed content and send a post request to the php script.
What is the easiest way to make such a program?
Answer the question
In order to leave comments, you need to log in
Ruby example docs.seattlerb.org/mechanize/EXAMPLES_rdoc.html
if you need to parse JS then watir.com/examples & phantomjs
curl / phantom.js depending on the site's AJAX-ness.
UPD: the language is whatever / javascript respectively.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question