Hello list,
sorry for the possibly noob question, I've googled around without much
success looking for an answer. Basically, I am given a series of this huge
Python class (a Simulation object), which contains an enormous amount of
information - when I cPickle it (with highest protocol), it
I would recommend just storing them on disk and let the OS VMM deal with
caching for speed. If you are not constrained for space I would
recommend not zlib-ing it either.
AM
On 12/3/14 1:18 PM, Andrea Gavana wrote:
Hello list,
sorry for the possibly noob question, I've googled around
What do you want to be able to do with the objects? I'd recommed storing
them as files and then referencing the filename in the database.
Ed
On 12/03/2014 04:18 PM, Andrea Gavana wrote:
Hello list,
sorry for the possibly noob question, I've googled around without
much success looking
On Wednesday, December 3, 2014 4:23:31 PM UTC-5, Ams Fwd wrote:
I would recommend just storing them on disk and let the OS VMM deal with
caching for speed. If you are not constrained for space I would
recommend not zlib-ing it either.
I'll second storing them to disk. Large object
On Wednesday, December 3, 2014 10:42:27 PM UTC+1, Jonathan Vanasco wrote:
On Wednesday, December 3, 2014 4:23:31 PM UTC-5, Ams Fwd wrote:
I would recommend just storing them on disk and let the OS VMM deal with
caching for speed. If you are not constrained for space I would
recommend
On Wed, Dec 3, 2014 at 7:23 PM, Andrea Gavana andrea.gav...@gmail.com wrote:
3. As an aside, not zlib-ing the files saves about 5 seconds/simulation
(over a 20 seconds save) but increases the database size by 4 times. I'll
have to check if this is OK.
You can usually specify a compression
On 12/3/14 2:23 PM, Andrea Gavana wrote:
On Wednesday, December 3, 2014 10:42:27 PM UTC+1, Jonathan Vanasco wrote:
On Wednesday, December 3, 2014 4:23:31 PM UTC-5, Ams Fwd wrote:
I would recommend just storing them on disk and let the OS VMM
deal with
caching
Hi,
On Thursday, December 4, 2014 12:02:42 AM UTC+1, Ams Fwd wrote:
On 12/3/14 2:23 PM, Andrea Gavana wrote:
On Wednesday, December 3, 2014 10:42:27 PM UTC+1, Jonathan Vanasco
wrote:
On Wednesday, December 3, 2014 4:23:31 PM UTC-5, Ams Fwd wrote:
I would
If you need to handle large objects, you should look into DBAPI drivers
that can stream results. The only drivers i know that can handle a stream
are psycopg2 (postgres) and oursql (mysql).
There have been a handful of recipes/threads of people using streams for
blobs in the archives.
I
