Opened 16 years ago
Closed 16 years ago
#11258 closed (duplicate)
Serializers don't stream
| Reported by: | phaesler | Owned by: | nobody |
|---|---|---|---|
| Component: | Core (Serialization) | Version: | 1.0 |
| Severity: | Keywords: | ||
| Cc: | Triage Stage: | Unreviewed | |
| Has patch: | no | Needs documentation: | no |
| Needs tests: | no | Patch needs improvement: | no |
| Easy pickings: | no | UI/UX: | no |
Description
When you pass a stream and an iterator that returns a large number of objects to a serializer (at least JSON and XML), the serializer doesn't start writing to the file until after the iterator has been exhausted (i.e. until all data has been read into memory.) This places an unnecessarily heavy memory overhead on serialising a large data set.
See #5423 for impact on dumpdata.
Note:
See TracTickets
for help on using tickets.
Duplicate of #5423. We don't need a second ticket describing the same problem.