Large CSV/PARQUET OOM Error

Error: Out of Memory Error: could not allocate block of size 256.0 KiB (3.1 GiB/3.1 GiB used) Database is launched in in-memory mode and no temporary directory is specified. Unused blocks cannot be offloaded to disk. Launch the database with a persistent storage back-end Or set SET temp_directory='/path/to/tmp.tmp'

The Parquet is about 900MB, CSV is about 5GB. Shape is 900, 500000
Happy to upgrade when this is working!

Please authenticate to join the conversation.

Upvoters
Status

In Review

Board
πŸ’‘

Feature Request

Date

8 months ago

Author

Jamie Anderson

Subscribe to post

Get notified by email when there are changes.