Re: [ZODB-Dev] Author ZoDB Books - Packt Publishing.
Erm, sorry for the off the hip namedropping mail, the safety catch was off the Reply-to-all button :-p On May 6, 2010 3:24 PM, Jean Jordaan jean.jord...@gmail.com wrote: A ZODB book would be absolutely wonderful. It is a crying shame that it has been languishing with very sparse and patchy documentation. I'm not deep enough into it technically to write about it. People that are include Shane Hathaway, Kapil Thangavelu, Christian Theune, and Roché Compaan (on throughput). Dieter Maurer and Andreas Jung have used it for very large stores, and Dieter has implemented the best query tools for it. I think you should do a cookbook with a chapter per author, as different people have pushed the ZODB in different directions. On May 6, 2010 3:09 PM, Kshipra Singh kship...@packtpub.com wrote: Hi All, I am ... ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] undo (and storage interface) brokenness
I agree that it's handy, and that people would be upset if it disappeared. But I also agree that people trust it far more than they should, and that it's really only dependable for developers to roll back transactions -- however, for that, I think it's invaluable (i.e. very valuable). So I think *this* undo should not be in Plone's or other user-facing UI. If there is an undo facility, it should be implemented by way of application-level versioning as Hanno says. -- jean . .. //\\\oo///\\ ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] ZODB 3.9.0 released
- should probably be `with` when describing the with statement I don't know what you mean. He means quoting the word with with backticks will make it show up as code. I.e. change the Python (2.5 and later) with statement to the Python (2.5 and later) `with` statement. -- jean . .. //\\\oo///\\ ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] [Checkins] SVN: ZODB/trunk/src/persistent/wref.py Merged the rst formatting to the trunk
-a refernce to it: +a reference to it:: This should be reverted. Agreed, but keep the s/refernce/reference/ fix ;-] -- jean . .. //\\\oo///\\ ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] Backing up Data.fs and blob directory
I mean, you have to install cygwin Unison is also an option .. http://www.cis.upenn.edu/~bcpierce/unison/ I think it can be configured to work very much like rsync. -- jean . .. //\\\oo///\\ ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] Backing up Data.fs and blob directory
Note that at the design stage we imagined that blob directories might become really large making backups unfeasable. I think that has more to do with the speed at which the directory grows than with its size. If it isn't growing too fast, rsync can keep a backup up to date no matter how big. But if you're dumping in hours of raw video every day, then it's a problem. -- jean. .. //\\\oo///\\ ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] Mutating class of an instance
Any chance I can get zeo to tell the other clients about the new class? Speaking purely as an idiot .. can't you tell ZEO the normal way? I.e. just make it think the instance changed. Edit it, or set _p_changed on it. -- jean . .. //\\\oo///\\ ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
[ZODB-Dev] some interesting benchmarks
Hi Martijn, Thanks for the references. A colleague of mine had some comments, I'm forwarding them in case any list members would like to take up the benchmarking gauntlet or further qualify the linked benchmarks: how far can we depend on them? Ashok writes: I can see a couple of areas, where that query he has used for inserting data (in the context of Sqlite) could be speeded up like... the usage of executeMany... I have used it before and for various reasons the performance of that vs a looping insert is much slower. And the other thing is ...the performance of a low footprint db like Sqlite3 can be misleading... since the indexing mechanisms are rudimentary when compared to something like Postgres or Oracle which means once you reach a certain volume of data performance will most certainly drop off steeply .. and the benchmark is really for insertion of data I would be interested in things like indexed retrieval of data... -- jean . .. //\\\oo///\\ ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] Where did self._p_jar._storage._serial go?
Hi Jeremy _tid is what you want. Thank you for the confirmation :-) There isn't a _tid-equivalent when the storage is a ZEO storage server, is there? -- jean ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] Re: Mirrored ZODBs
No problem, but remember this is app specific and still works with the ZODB distributed with Zope 2.7. I recently tweaked it to work with Zope 2.8.7 (remember my query about self._p_jar._storage._serial a week or two ago?) .. The only change needed was s/_serial/_tid/ : def log(self, entry_dict): -t_id = self._p_jar._storage._serial +t_id = self._p_jar._storage._tid if not self._transactions.has_key(t_id): self._transactions[t_id] = ReplogTransaction(t_id) transaction = self._transactions[t_id] We haven't been using this one though, so there may be gremlins lurking. -- jean ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] Where did self._p_jar._storage._serial go?
Yo Chris! If you end up using variables starting with underscores, then either you've missed an api, or the relevent api is defficient... Oh, totally :-] This is for a replication implementation (edit on one Zope, replicates to another), so it does get kinda lowlevel. Possibly it can be cleaned up, but no bandwidth for that now .. It's too app-specific to be generally useful, so we've never released it. I guess we should write up the technique, though .. -- jean ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
[ZODB-Dev] Where did self._p_jar._storage._serial go?
Hi all This may be a bit of a dumb question. I'm looking at some Zope 2.7-era code, which uses 'self._p_jar._storage._serial'. FileStorage in 2.8.7 doesn't have '_serial' any more. Is there something equivalent I can get hold of and use? -- jean ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] Where did self._p_jar._storage._serial go?
Answering myself .. FileStorage in 2.8.7 doesn't have '_serial' any more. Is there something equivalent I can get hold of and use? It looks like '_tid' fits the bill. It's not available when using ZEO though, which took me a while to figure out. -- jean ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] Re: What makes the ZODB slow?
The ZODB is actually very fast. [...] So you're probably observing slowness in the frameworks on top of it. I'll believe this anytime :-] In our case, a transaction may be a workflow state change on say 50 objects. Two or three people try a transaction like that within a couple of seconds of one another, and ConflictErrors crop up. In a log with 402 ConflictErrors, 225 are on BTrees (_IIBTree.IITreeSet, _IOBTree.IOBucket, _OOBTree.OOBTree, _OOBTree.OOBucket all feature). We assume these all relate to catalog indexing. Of the rest, 147 of the 177 are either Products.Transience.Transience.Increaser or Products.Transience.Transience.Length2 The role the framework (Plone, unsurprisingly) is playing in this case, is that it leans hard on the catalog during a transaction lasting a number of seconds. To mitigate this, we want to create a savepoint and then commit more often while iterating and changing workflow, rolling back to the savepoint if necessary. -- jean ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] proposed comments
Just a bit of proofreading .. - _cache is a PickeCache, a cache which can ghostify objects not PickleCache - _added is a dict of oid-obj added explicitely through add(). explicitly _added is used as a sort of preliminary cache until commit time is used as a preliminary cache where objects are all moved to the real _cache. The object are when objects either added by add() or implicitely added (discovered by the implicitly -- jean ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
