Using BufferedReader and FileReader to read a very large file line by line?

Question

Java

There are log files ranging in size from 1 to 15 GB each. Task: read files line by line, if the line matches the regular expression, we write to the database. How correct is it to use BufferedReader br = new BufferedReader(new FileReader(file)); to read from a file. Can there be memory problems on files of this size. Maybe there is a better way?

Answer 1

That will be the norm. Immediately check the read line for a condition, and if it fits, add it to the jdbc batch. Set the maximum batch limit, for example 200. Filled up? - updateBatch, and continue to read lines.