How to split a 100GB text file into 2GB and remove duplicate lines?

Question

Text Processing Automation

There is a text file with a volume of 100GB
how to split it into smaller parts and remove duplicate lines.
Preferably with priority on speed

Answer 1

a test task in some highload school? And then our rockets fall and the Kursks sink. unix.stackexchange.com/questions/19641/how-to-remo... or external sort