Re: [AOLSERVER] Scaling at the high end

2006-07-05 Thread Bas Scheffers
On 5 Jul 2006, at 19:43, Tom Jackson wrote: performance from an SQL database. However, if you use the BDB database, you will still have to go through some sort of database API, either the one which exists, or a custom designed API. The purpose of the built in API is to share connections acro

Re: [AOLSERVER] Scaling at the high end

2006-07-05 Thread Nathan Folkman
In terms of distributed key/value pair data structures, there are two additional methods we've used here at AOL: * AV (auto variables) * NV (network variables) AV's are a read-only data structure that under the covers is built on a sorted list for quick access, and small size. The files get bu

Re: [AOLSERVER] Scaling at the high end

2006-07-05 Thread Tom Jackson
On Monday 03 July 2006 08:33, John Buckman wrote: > One of the reasons I want to use Berkeley DB is that I'd like every > web page string to be a BDB database lookup, allowing wiki-style > correcting of strings on a web page (ie, anyone can correct, on the > spot, any translated text on any page).

Re: [AOLSERVER] Scaling at the high end (was Re: [AOLSERVER] build nsd w/o locking?)

2006-07-03 Thread Tom Jackson
On Monday 03 July 2006 07:56, Nathan Folkman wrote: > * Network NV (network variables) - Similar to nsv, but allows updates to > be distributed to many clients. Allows you to update variables on a > single NV writer, and have those changes broadcast out to many front-end > readers. > * Network Eva

Re: [AOLSERVER] Scaling at the high end

2006-07-03 Thread John Buckman
that once you cross it, the characteristics of the problem set changes and the optimal (and sometimes only) solutions become very specialized. It's at this end of the spectrum where AOLserver truly shines, but it's a very small set. In general, my experience is that the simplest tool for th

Re: [AOLSERVER] Scaling at the high end (was Re: [AOLSERVER] build nsd w/o locking?)

2006-07-03 Thread Nathan Folkman
Speaking of SOB, we're working on getting the code to our "dci (Digital City) module" ready for release to the Open source community. This module contains the following items which folks may find interesting: * SOB - Dossy described this below. Basically it's what we use at AOL to "forward cac

[AOLSERVER] Scaling at the high end (was Re: [AOLSERVER] build nsd w/o locking?)

2006-07-03 Thread Dossy Shiobara
On 2006.07.03, John Buckman <[EMAIL PROTECTED]> wrote: > In my experience, many applications that use SQL actually only need > key-lookup capability [...] Which is why, at AOL, a large part of the web publishing architecture utilizes Small Object Broker (SOB), which can be set up in a distributed