What PL can quickly process large amounts of information?

Question

Programming languages

The essence is this:
There is a base of mail addresses - 300 million lines (in each line 1 mail). There is a second base of mail addresses - 10 thousand lines (in each line 1 mail).
You need to check the 10k base with the 300kk base and find unique mails in 10k that are not in the main 300kk base.
What is the best language for developing such a program.

Answer 1

Speed ​​comparison of mawk, nawk, gawk system utilities with Java, Python, Perl, C++, Ruby
Don't MAWK AWK – the fastest and most elegant big data munging language!
brenocon.com/blog/2009/09/dont-mawk-awk-the-fastes...

Answer 2

SQL
grep
*(any)

Answer 3

pingvinus.ru/note/compare-files-diff-in-linux

Answer 4

kdb

Answer 5

If the task is one-time, it is best to use Unix command line utilities.
If you need to compare the entire string, fgrep is faster than grep.
If you need to compare large lists - I don't know better comm.