Fast software for working with large databases?

Question

Database

Prompt software under Windows to work with flat (text) files. Required: subtracting base A from base B, merging two or more bases, searching for and removing duplicates, sorting alphabetically, sorting according to your own criteria, mixing. Files in txt format, one entry per line like this: abcdfgh#1234567. The average file size is 1,000,000 records = 25 MB. It is desirable that the program be 64 bit. Microsoft Excel and Access not to offer. Thanks for answers.

Answer 1

Load into Postgres, learn SQL.

Answer 2

In your case, I think ideally (in terms of processing speed) these tools would be suitable https://www.opennet.ru/docs/RUS/bash_scripting_gui...
to use them under Windows, you can use this babun.github.io

Answer 3

You will not be able to work quickly with text files - any search operation leads to the need to read the file from the beginning.
We can only talk about relatively fast work, for example, while the file fits into the RAM. Your 25 MB is enough for now, but if you plan to increase the volume in the future, then storing in text form will soon become a big brake in processing.
To work with text files, there are a lot of different tools like sed, grep, awk, sort, cmd/ps/bash scripting. But these are all common tools for working with unstructured text. Therefore, you will have to realize your Wishlist yourself, either with the help of these tools, or invent your own.
The best option is to convert to SQL database, as Armenian Radio said

Answer 4

Python.

Answer 5

Thanks for all the replies, but I'm looking for a win 32/64 application that will do one or all of the above. Writing macros, scripts, working with *nix, databases, python, with the Powershell command line is not the focus of my question.
Thanks for understanding.

Answer 6

R