RSS aggregator like Yandex News?

A

adlermark2016-02-01 22:26:34

RSS

adlermark, 2016-02-01 22:26:34

Hello.
The task is to make an RSS aggregator like Yandex News or Google News.
The site collects RSS feeds from various sources and puts them in its feed. But what if all sources wrote 1 piece of news on the same topic? It turns out that there will be 50-100 identical messages in the feed from different sources.
How to combine them into 1 news and at the same time, so that while reading this news you can view this news from other sources, like in the same Yandex?
Are there ready made solutions for this?

Reply

Answer the question

In order to leave comments, you need to log in

1 answer(s)

S

sim3x, 2016-02-02
@sim3x

Are there ready made solutions for this?

Yes, machine learning or using https://en.wikipedia.org/wiki/Levenshtein_Distance