Re: Building IFI View for Text Queries

2010-01-07 Thread Paul Davis
> Any way to get an insight as to how big the index is?  I can see how > big my database is (78M with ~11k docs) but I'd be curious to know how > big that view is stored in memory. I recently added some extra bits of info to the view information blob but I'm not sure if size made it in. It'd be a

Re: Building IFI View for Text Queries

2010-01-06 Thread Nic Pottier
On Wed, Jan 6, 2010 at 1:01 PM, Chris Anderson wrote: > there is actually a separate index directory called > > .my_db_name_design/ > > inside that directory. within it is 1 index file per design document. > that file size is the actual index size. Ah, sorry, missed the dot file! > we're definit

Re: Building IFI View for Text Queries

2010-01-06 Thread Michael Miller
And please note that you can compact that view index as well. For documents that are frequently updated, you will see a huge gain in both space, build, and query performance by compacting the view indices (at least based on our experiences at cloudant). Also, there was some work on impleme

Re: Building IFI View for Text Queries

2010-01-06 Thread Chris Anderson
On Wed, Jan 6, 2010 at 12:57 PM, Nic Pottier wrote: > On Wed, Jan 6, 2010 at 12:39 PM, Chris Anderson wrote: >>> Any way to get an insight as to how big the index is?  I can see how >>> big my database is (78M with ~11k docs) but I'd be curious to know how >>> big that view is stored in memory. >

Re: Building IFI View for Text Queries

2010-01-06 Thread Nic Pottier
On Wed, Jan 6, 2010 at 12:39 PM, Chris Anderson wrote: >> Any way to get an insight as to how big the index is?  I can see how >> big my database is (78M with ~11k docs) but I'd be curious to know how >> big that view is stored in memory. > > The view is stored on disk. Look in the CouchDB data di

Re: Building IFI View for Text Queries

2010-01-06 Thread Chris Anderson
On Wed, Jan 6, 2010 at 11:10 AM, Nic Pottier wrote: > On Wed, Jan 6, 2010 at 10:48 AM, Chris Anderson wrote: >> The only catch is that you'll end up with a large index file in the >> long run. Lucene's indexes should be more compact on disk. Lucene also >> has more stemming options and will gener

Re: Building IFI View for Text Queries

2010-01-06 Thread Nic Pottier
On Wed, Jan 6, 2010 at 10:48 AM, Chris Anderson wrote: > The only catch is that you'll end up with a large index file in the > long run. Lucene's indexes should be more compact on disk. Lucene also > has more stemming options and will generally be smarter than your > tokenizer. > > That said, if i

Re: Building IFI View for Text Queries

2010-01-06 Thread Chris Anderson
On Wed, Jan 6, 2010 at 10:10 AM, Nic Pottier wrote: > Howdy All, > > New user playing with CouchDB to evaluate whether it will work for our > needs.  I have a good bit of experience with standard SQL and recently > with Amazon's SimpleDB, but I'll admit my brain is stretching a bit to > get the 'c

Building IFI View for Text Queries

2010-01-06 Thread Nic Pottier
Howdy All, New user playing with CouchDB to evaluate whether it will work for our needs. I have a good bit of experience with standard SQL and recently with Amazon's SimpleDB, but I'll admit my brain is stretching a bit to get the 'couch db' way of doing things. Anyways, in my particular case, I