[sqlalchemy] Handling big Python objects

2014-12-03 Thread Andrea Gavana
Hello list, sorry for the possibly noob question, I've googled around without much success looking for an answer. Basically, I am given a series of this huge Python class (a Simulation object), which contains an enormous amount of information - when I cPickle it (with highest protocol), it

Re: [sqlalchemy] Handling big Python objects

2014-12-03 Thread Andrea Gavana
On Wednesday, December 3, 2014 10:42:27 PM UTC+1, Jonathan Vanasco wrote: On Wednesday, December 3, 2014 4:23:31 PM UTC-5, Ams Fwd wrote: I would recommend just storing them on disk and let the OS VMM deal with caching for speed. If you are not constrained for space I would recommend

Re: [sqlalchemy] Handling big Python objects

2014-12-03 Thread Andrea Gavana
Hi, On Thursday, December 4, 2014 12:02:42 AM UTC+1, Ams Fwd wrote: On 12/3/14 2:23 PM, Andrea Gavana wrote: On Wednesday, December 3, 2014 10:42:27 PM UTC+1, Jonathan Vanasco wrote: On Wednesday, December 3, 2014 4:23:31 PM UTC-5, Ams Fwd wrote: I would

[sqlalchemy] Deleting an object from a database?

2007-03-08 Thread Andrea Gavana
Hi All, at the end, I finally cracked the problem with the tree-structured database with SQLAlchemy. I still have however a problem. I am using a physical database, not an in-memory one. I have declared my Tables as follows: trees = Table('treenodes', metadata,

[sqlalchemy] Re: Deleting an object from a database?

2007-03-08 Thread Andrea Gavana
Hi Svilen, first of all, thank you for your answer. On 3/8/07, svilen wrote: This is the db-file size, which is actual DB-implemenation detail, and which will probably only grow up - depends on the particular db u have. There are many strategies, like paging etc. e.g. some DBs require

[sqlalchemy] Re: Deleting an object from a database?

2007-03-08 Thread Andrea Gavana
Hi Michael, On 3/8/07, Michael Bayer wrote: have you verified that the tables have been deleted from ? if the filesize doesnt shrink, that may be an artifact of sqlite's implementation. Thank you for your answer. Well, I can reproduce it in a small Python script that I attach to my email. At

[sqlalchemy] Re: Deleting an object from a database?

2007-03-08 Thread Andrea Gavana
Hi Michael and All, thank you for your detailed answer, and to have tried the demo I have attached. I understand what you meant and you are perfectly right, but if I can bother you with another small question: On 3/8/07, Michael Bayer wrote: z-eeks-Computer:~/dev/sqlalchemy classic$

[sqlalchemy] Re: Deleting an object from a database?

2007-03-08 Thread Andrea Gavana
Hi Michael, On 3/8/07, Michael Bayer wrote: but the point is, and why its irrelvant to me as the maintainer of SQLAlchemy, is that this is totally an issue with sqlite, and has nothing to do with SQLAlchemy. you should ask on their mailing list about this particular behavior. Sorry, I

[sqlalchemy] Re: Deleting an object from a database?

2007-03-08 Thread Andrea Gavana
Hi Michael and All, On 3/8/07, Michael Bayer wrote: but the point is, and why its irrelvant to me as the maintainer of SQLAlchemy, is that this is totally an issue with sqlite, and has nothing to do with SQLAlchemy. you should ask on their mailing list about this particular behavior.

[sqlalchemy] Compressing cPickled objects == store in DB

2007-03-08 Thread Andrea Gavana
Hi All, I was wondering if it is possible to use zlib.compress() to compress a cPickled object and store it into a database, and then retrieve it using zlib.decompress(). I have tried for a while, but I keep getting errors like: snip File build\bdist.win32\egg\sqlalchemy\engine\base.py,

[sqlalchemy] Re: Problems with select() :-(

2007-03-07 Thread Andrea Gavana
Hi Jonathan and All, first of all, thank you for your answer. On 3/6/07, Jonathan Ellis wrote: it sounds like you inserted a bunch of new objects, but didn't flush, so select() doesn't see them. get() does see it because it checks the identity map before querying the db. Well, at the