Parser in Ruby?

Question

ruby

Guys need help. I wrote a parser on the site, but it collects data from one page, how to make it go to another page and collect data further? I can show the script code

Answer 1

Parse links in the code and add them to the job queue for subsequent parsing.

Answer 2

For not very complex parsing, open-uri and nokogiri are enough.
In a loop, you sort through your array with the necessary pages and save all the links.

array_of_pages.each_with_index do |page_for_parsing, index|
  urls[index] = "http://www.site.com/#{page_for_parsing}"
end

Then you sort through the links and pull out the necessary information with the help of nokogiri.

urls.each_with_index do |url_for_parsing, index|
  page = open urls[index]
  doc = Nokogiri::HTML(page)
  doc.css('.class').each do |stuff|
    # Обрабатываем информацию
  end

If you need something more complicated, then the mechanize gem. There is a small good series of articles on Ruby parsing on Habré.