How to clear a huge txt from duplicates?

Question

cmd/bat

you need to clear the .txt file weighing 25GB from the same lines
example:

123
456qwerty
123
jsdgf6

Answer 1

A modified version of Stalker_RED in which, instead of DISTINCT, build a schema with a varchar primary key, in which to enter data from the 1st table using a query
Insert ignore into ... select from ...

Answer 2

download TextPad
https://www.textpad.com/home
then F9
and tick "delete duplicates"
when it opens the file - it freezes, it doesn't have a process line, unlike EmEditor, wait until it opens
if it doesn't open - the computer doesn't pull - then other methods
like this