Finding duplicate pieces of text?

Question

Python

Good afternoon, maybe someone had experience, you need an algorithm / hint in which direction to dig.
There are large correspondences by email, it is necessary to anonymize the correspondence, it is necessary to remove the signatures from the text of the letters:

Вася Пупкин
Менеджер
телефон [phone]
адрес 523645653

It would be possible to collect everything in one text, and isolate the repeating pieces of text, then approximately these would be signatures, but how to find exactly the pieces (several lines) of the repeating text.

Answer 1

Hello. I'm not entirely sure, but maybe regular expressions can help you. Try to work with them, it might work

Answer 2

Maybe the textblob library will help you . Namely, this part: Tutorial: Building a Text Classification System . As an example:

#!/usr/bin/python
from textblob import TextBlob
from textblob.classifiers import NaiveBayesClassifier

train1 = '''
Вася Пупкин
Менеджер
телефон [phone]
адрес 523645653
'''
train2 = '''
Иван Иванов
Менеджер
телефон [phone]
адрес 513665053
'''
train3 = '''
Николас Медведев
Менеджер
телефон [phone]
адрес 526641655
'''
train = [
    (train1, 'pos'),
    (train2, 'pos'),
    (train3, 'pos'),
    ('С уважением, от команды Хабра!', 'neg'),
    ('Купите наших котиков?', 'neg'),
    ('Скидки 120% но Aliexpress.', 'neg'),
]
test = '''
Привет!
Алиса Аксенова
Менеджер
телефон [phone]
адрес 520671655
'''
cl = NaiveBayesClassifier(train)
blob = TextBlob(test, classifier=cl)
for s in blob.sentences:
    print("'{}' - {}".format(s, s.classify()))

Will output this:

'Привет!' - neg
'Алиса Аксенова
Менеджер
телефон [phone]
адрес 520671655' - pos