G
G
grv12017-08-16 10:20:48
Python
grv1, 2017-08-16 10:20:48

What to do if pandas does not fit in 64 GB of RAM?

They gave a script that works with a fairly large amount of memory and everything is spinning on pandas. Now there is a problem that pandas does not have enough 64 GB of RAM.
Unfortunately, I'm not very familiar with Python, but I need to fix it). Trying to optimize the script is not advisable. Perhaps there is a simpler solution?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
R
Roman Kitaev, 2017-08-16
@deliro

pandas-docs.github.io/pandas-docs-travis/io.html#i...

X
x67, 2017-08-16
@x67

split the file into smaller ones and work with each of them separately.
Aren't you confused by the speed with which the processing takes place?

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question