dumpdata needs to load whole tables into memory to dump them
|Reported by:||Owned by:||nobody|
|Has patch:||no||Needs documentation:||no|
|Needs tests:||no||Patch needs improvement:||no|
I was attempting to use dumpdata to dump a 2mil row table so I could import it into another database, when it got to using over 20G of RAM I had to kill it.
The docs should state that it will need to load the whole table and wont serialize as it goes, or dumpdata needs to incrementally write so it doesn't need all the data in memory.