How to optimize the search for matches in a large .txt file?

Question

Passwords

I have a database of passwords in a .txt file, 40 million pieces (1.6 GB). I am writing a program that generates all possible combinations of passwords and each password must be checked against the database, if it is not there, then it is written to a separate file. The challenge is to optimize this as best as possible, because it will take several seconds to find a match among 40 million passwords. And I ideally have a speed of 100 passwords per second. I will work in C#.

Answer 1

Maybe I'm wrong, but I read your other questions, such as this one "Is there a service for collecting data from a Python script?", where you wanted to automatically receive data from "friends" after your exe starts from them. Now - 40 million passwords. Your actions are like...