Monitor site content changes. (C#)

Question

C++ / C#

Hello. I am writing term paper. Tell me what algorithms are suitable for optimal content tracking? At the moment, it has been studied - parsing XML, and comparing image hashes. Tell me sources where you can read about tracking methods and algorithms, if a source with examples would be ideal.
Thank you.

Answer 1

A very interesting question. Are you trying to make a definition for any site or a specific one? If any, then some block on the page or the entire page?
Immediately pop-up pitfalls:
1. What about sites where content is loaded dynamically (Ajax)?
2. If the page has a display of the current time or a state dependent on it (for example: "written 10 minutes ago") - is this considered a change or not? If not, how to universally monitor and ignore?
etc.
Or do you just describe all possible algorithms in your coursework? If so, then you should look towards the algorithms of the cache servers.

Answer 2

You can do it by analogy with a ready-made solution implemented in Python
https://thp.io/2008/urlwatch/
Functionality:
shows changes on a web page line by line, similar to how it is done in a version control system (diff).
It has dynamic content filtering mechanisms.