; it pretty useless).
If you use the timestamp as the key and you want to retrieve all values
between two timestamps (inclusive), you can do
my_btree.values(min=start, max=end)
--
Benji York
___
For more information about ZODB, see the ZODB Wiki:
h
On Tue, May 11, 2010 at 10:08 AM, Jim Fulton wrote:
> This is an improvement. It's still unsatisfying, but I don't think I'm going
> to
> get satisfaction. :)
Given that PEP 343 explicitly mentions *not* supporting an auto retry
construct, I should thin
ransaction in ZODB.retries(3):
with transaction:
... transaction body ...
ZODB.retries would return an iterator that would raise StopIteration on
the next go-round if the previously yielded context manager exited
without a ConflictError.
--
Benji York
__
in progress at the time of the copy will
simply be ignored when the resulting backup is opened later.
--
Benji York
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zop
e or more (re)connection-time cache corruption
bugs were fixed in ZODB 3.8.1.
--
Benji York
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
https://mail.zope.org/mailman
On Tue, Oct 20, 2009 at 5:41 AM, Vincent Pelletier wrote:
> I'm facing a cache consistency problem in an old Zeo running on 2.8.8
> products.
I don't know what version of ZODB those Zope versions use, but version
3.8.1 of ZODB included several bug fixes in the ZEO cache code
On Wed, Oct 14, 2009 at 3:38 PM, Ross J. Reedstrom wrote:
> On Wed, Oct 14, 2009 at 02:20:50PM -0400, Benji York wrote:
> We're actually set up w/ squid in front of the zope FEs, using IPC to
> talk to them all. The default behavior is just to respond w/ a "CACHE
> MISS&q
f something more like "data" affinity.
Instead of having a big cache that is shared in order to increase the
chance of a request's data being in the cache, you would instead have
many smaller caches (just like ZEO works now) and send the requests to
the process(es) that are most l
On Mon, Sep 14, 2009 at 3:52 PM, Shane Hathaway wrote:
> Benji York wrote:
>>
>> On Mon, Sep 14, 2009 at 2:44 PM, Shane Hathaway
>> wrote:
>>>
>>> People have been looking at these performance charts for quite a while:
>>
>> Are the benchmarks p
On Mon, Sep 14, 2009 at 2:44 PM, Shane Hathaway wrote:
> People have been looking at these performance charts for quite a while:
Are the benchmarks publicly available? I looked through the blog posts
and svn.zope.org but couldn't find them.
--
Benji York
Senior Software Engin
eleted)
> lrwx-- 1 64 2009-06-25 10:09 6 -> /var/tmp/tmp2HUAnn.tbuf (deleted)
> lrwx-- 1 64 2009-06-25 10:09 7 -> /var/tmp/tmpex5QmJ (deleted)
Have you looked at the contents of the files? Once you have an idea of
what is being written you might be able to determine what is do
On Fri, Jun 12, 2009 at 5:22 AM, Jim Fulton wrote:
> I didn't get these and I tested on Ubuntu, although a pretty old
> release.
Tests pass on a more recent release as well (Python 2.4, Ubuntu 8.04.2)
--
Benji York
Senior Software Engineer
Zope
On Mon, May 4, 2009 at 3:03 PM, Jim Fulton wrote:
>
> I've just released the first beta of ZODB 3.9.
> Please try this out and report bugs found.
Is the fact that http://pypi.python.org/pypi/ZODB3/3.9.0b1#compatibility
mentions "ZODB 3.8" and not 3.9 a bug?
--
Be
zes?
It'd be cool if the bucket size could be dynamic (say governed by an
attribute on the BTree), but I suspect that is dramatically out of scope
for what you were planning on doing.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For
On Fri, Oct 24, 2008 at 3:28 PM, Jim Fulton <[EMAIL PROTECTED]> wrote:
>
> On Oct 24, 2008, at 3:24 PM, Benji York wrote:
>
>> Is there a good reason blobs don't support "b" or "t" in the mode
>> strings passed to "open"? I'm re
runner 1.1.0.
Getting distribution for 'zope.testing>=3.6.0'.
Got zope.testing 3.6.0.
Installing test.
Getting distribution for 'zdaemon'.
Got zdaemon 2.0.2.
Getting distribution for 'zope.proxy'.
Got zope.proxy 3.4.2.
Generated script '/tmp/ZODB3-3.8.1b7/bin/t
hread is at
http://mail.zope.org/pipermail/zodb-dev/2007-March/010846.html.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
m a shared filesystem instead?
Maybe, maybe not; the details are important there. My suspicion is that
you wouldn't see much benefit.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http:/
nt versions of Python. If so, you can install two Pythons,
and the correct Python for each app.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev maili
if (self._utility_registrations.get((provided, name)[:2])
> +if (self._utility_registrations.get((provided, name))[:2]
> == (component, info)):
> # already registered
> return
--
Benji York
Senior Software Engineer
Zope Corporation
__
you should expect a larger database once the
indexes are added.
Some advocate keeping indexes in a separate database, especially if they
are a significant fraction of the total database size. That way you can
have different packing schedules, backup plans, storage devices, etc.
--
Benji York
S
a small database by some standards.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
I suppose the directories would be built on-demand, right?
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.z
On Tue, Jun 3, 2008 at 3:45 PM, Sean Allen <[EMAIL PROTECTED]> wrote:
>
> On Jun 3, 2008, at 1:32 PM, Benji York wrote:
>
>> On Tue, Jun 3, 2008 at 1:13 PM, Gary Poster <[EMAIL PROTECTED]> wrote:
>>>
>>> What you *can't* do out of the box is
h I was referring.
In other words: if you want an index of references (or any attribute for
that matter), you have to set it up (just as you would for a RDBMS).
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB,
at attracts the
> attention of people. I will needs some help in that respect.
> organize information into something that new-comers can lear
Hopefully the already underway design effort will help there.
--
Benji York
Senior Software Engineer
Zope Corporation
___
On Fri, May 23, 2008 at 5:45 AM, Anton Stonor <[EMAIL PROTECTED]> wrote:
> Last month I ask for help about hanging zeo clients. I promised to follow
> up.
And thank you for doing so. It's very helpful (for me at least) to see
these sorts of things come to closure.
--
Benji Yor
wouldn't try to build it for you.
A request for such an egg would be best directed to [EMAIL PROTECTED]
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
er than usual -- for still
unknown reasons)
Curious.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://m
dy make fsync pretty fast.
Not to suggest that group commit wouldn't speed things up, but it would
seem that the technique will make the largest improvement for people
that are using a non-lying fsync on inappropriate hardware.
--
Benji York
Senior Soft
David Pratt wrote:
Hi Benji. Have you any settings to recommend or use a default. Many thanks.
For benchmarking? No.
Too high and you'll spend a bunch of time swapping to free up space for
disk cache; too low and you may not have a large enough disk cache to be
effective.
--
Benji
prevent this. I'll check.
If you're on Linux, you can tweak swappiness (/proc/sys/vm/swappiness;
http://lwn.net/Articles/83588/) to affect how much RAM is used for the
page cache and how much for your process.
--
Benji York
Senior Software Engineer
Zope C
h that it is unlikely that two
insertions happen in the same bucket.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.or
. ;)
In other words, the best way to deal with a hot spot is to eliminate it.
That may or may not be possible, but it's a good thing to try.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see
not).
I want to be able to use an OO database without the inconvenience of having
it growing out of control and then having to spend hours packing the
database every once in a while. (I do a lot of writes in my DBs). Do this
Holy grail of databases exist? :-)
Why not put the pack in cron?
--
catalog (or other data
structure) that is slightly out of date. In those, you can ignore the
queued data.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB
Jim Fulton wrote:
On Sep 18, 2007, at 6:46 AM, Manuzhai wrote:
...
What's new in ZODB4?
The ZODB project has been abandoned. Much of the work done in that
project was folded back into ZODB3.
Jim means ZODB *4*. :)
--
Benji York
Senior Software Engineer
Zope Corpor
Christian Zagrodnick wrote:
Not automatically please. You should be aware of that since it may be
just an error and break due to missing locking via nfs or anything. You
never know.
Agreed.
--
Benji York
Senior Software Engineer
Zope Corporation
.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
database each time a non-Persistent element changes (or
an item is added or removed from the list). If the list is of any
appreciably size, that will be bad.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the
ically trying to say). This should work:
svn co svn://svn.zope.org/repos/main/zope.xmlpickle/trunk zope.xmlpickle
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZOD
Alan Runyan wrote:
The website got slashdoted this morning [...]
Just FYI: Varnish didnt go over 3% CPU during the traffic surge; over
200 req/second.
Off topic: 200 requests a second seems a bit light for a slashdotting,
any more details you can divulge there?
--
Benji York
Senior
Zope installations in the world.
In that case it would seem better to just remove the ineffectual code
altogether.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
Jim Fulton wrote:
On Mar 28, 2007, at 6:28 PM, Benji York wrote:
threading.Connection
threading.Condition :)
Yeah, that. :)
What was the time to return the first request after the fix?
I didn't stick around for the post-Linux-kernel-recompile testing, but
when we hacked the P
de-stepping the call to time.sleep altogether.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.
references are
not yet resolved from their persistent form.
If you're using FileStorage without ZEO, then your operating system's
disk cache will act in a way similar to what you're describing as your
L2 cache.
--
Benji York
Senior Software Engineer
Z
Christian Theune wrote:
Am Dienstag, den 27.03.2007, 12:44 -0400 schrieb Benji York:
Christian Theune wrote:
Who's the owner of the machine?
You might know him. A guy by the name of Thomas Lotze. :)
Nope. That's the buildbot that has been offline for ages. ;) The failing
one is &
Christian Theune wrote:
Who's the owner of the machine?
You might know him. A guy by the name of Thomas Lotze. :)
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zop
Gary Poster wrote:
FWIW, It smells more like a 64 bit vs. 32 bit machine/OS question,
but that's just on the basis of fly-by-diagnosis. :-)
Yep, looks like it.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information
xt
Failed example:
blob_size - underlying_size
Expected:
91L
Got:
91
Full test log here:
http://buildbot.zope.org/Zope3%20trunk%202.4%20FreeBSD%20tmiddleton/builds/361/test/0
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more i
Chris Withers wrote:
Benji York wrote:
Chris Withers wrote:
I'm writing/running a bunch on migration processes on a 30GB Data.fs,
I'm hoping it's easier to roll back the Data.fs to before I started my
migration run than it is to grab a new copy on the ZODB from somewhere.
Chris Withers wrote:
I'm writing/running a bunch on migration processes on a 30GB
Data.fs, I'm hoping it's easier to roll back the Data.fs to before I
started my migration run than it is to grab a new copy on the ZODB from
somewhere...
Demostorage, perhaps?
--
Benji York
ZODB project.
It might well be possible that the cost of executable installers is
greater than their value.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB
discussed.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
Stefan H. Holek wrote:
Do we have a history-less (i.e. no-grow) FileStorage?
There have been discussions and implementations of packless storages in
the past. As far as I know none have attained wide adoption.
--
Benji York
Senior Software Engineer
Zope Corporation
Christian Theune wrote:
Your 'python setup.py install' didn't work. You need to have Visual
Studio (2003/.NET) installed to compile ZODB/Python Extensions.
Or get the Windows binary release. Here's the latest:
http://www.zope.org/Products/ZODB3.6.
--
Benji York
Senior So
Juan Pablo Giménez wrote:
El lun, 02-10-2006 a las 14:00 -0400, Benji York escribió:
>> "Data.fs.tmp" usually only contains the last transaction (although,
>> it may not free unused space at the end).
>
> but... that's a bug... why zope keep writing in .tmp fi
ginal Data.fs and the "recovered" one are
identical. This makes me wonder if the same will work for the OP.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wi
rocess that is holding
onto a deleted file.
If this is the case you'll have to get imaginative to recover the file.
Killing the process and immediately attempting to "undelete" it might
work (for some file systems, apparently not ext3).
--
Benji Y
usually only contains the last transaction (although,
it may not free unused space at the end).
but... that's a bug... why zope keep writing in .tmp file if we can't
recover nothing from there?!?!...
Why is it a bug? A .tmp file is just that, temporary. It's not a backu
/adytumsolutions/HowToLoveZODB_PartI
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman
uot; is my persisted object)
>>> p._p_oid
'\x00\x00\x00\x00\x00\x00\x00\x08'
>>> print p._p_oid
>>> p._p_oid is None
False
What would you expect to see if you printed out seven null characters
and a backspace?
--
Benji York
Senior Software Engineer
Zope Corpor
That way when the
primary r/w ZEO server went down, read transactions could still complete
until the second r/w ZEO server could start.
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB
Andreas Jung wrote:
You could use a firewall to allow incoming ZEO connection only from
authorized IP address...should not be more than some lines of iptables
configuration or so.
Similarly, you can use a VPN.
--
Benji York
Senior Software Engineer
Zope Corporation
Chris McDonough wrote:
zodblib-3.6.0.egg (which would include ZODB and ZODB packages).
zodb-3.6.0.egg (which might be an empty "dependency" package that
As Gary noted, I can't see a reason to have these separate. They can
always be separated in the future if a real need ar
;ll add that to my list of things to do next time I have a "buildbot day".
--
Benji York
Senior Software Engineer
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list
66 matches
Mail list logo
