CouchDB 1.0.2 errors under load

2011-02-25 Thread Pasi Eronen
Hi, I had a big batch job (inserting 10M+ documents and generating views for them) that ran just fine for about 6 hours, but then I got this error: [Thu, 24 Feb 2011 19:42:57 GMT] [error] [0.276.0] ** Generic server 0.276.0 terminating ** Last message in was delayed_commit ** When Server state

Re: Help with error

2011-02-25 Thread Paul Freet
Thank you for the pointer. Turns out the file .shell_design was not assigned to the couchdb user. Simple fix. On 2/24/11 9:01 PM, Randall Leeds wrote: It looks like a file permissions error. Perhaps you ran couchdb as root once and got bad permissions on the view index? Check that everything

Re: Design question, article with logs of comments and ratings

2011-02-25 Thread Simon Metson
Hi, Let's say you have a +1 or -1 vote for a given document. You could record this with a document like: { article : article-id, vote: 1, timestamp: now() } or { article : article-id, vote: -1, timestamp: now() } (where now() is some function you run client side to

View for multiple IDs

2011-02-25 Thread Martin Hewitt
Hi all, How would I create a view to retrieve documents with the IDs (i.e. non-numeric, non-sequential): [asdf, powsf, ] I would like the three documents that match these IDs, is this doable in one view or should I just retrieve them individually? Thanks, Martin

Re: Large document design question (updated)

2011-02-25 Thread Nicolas Peeters
Thanks. The update scenario's are as follows: - Either we crawl a whole website and would add a new document for each page (Alt. 1) - either we crawl the whole site, add one document that represents the crawl (with some metadata) (with a reference to the pages documents being updated for every

Re: CouchDB 1.0.2 errors under load

2011-02-25 Thread Paul Davis
On Fri, Feb 25, 2011 at 4:18 AM, Pasi Eronen p...@iki.fi wrote: Hi, I had a big batch job (inserting 10M+ documents and generating views for them) that ran just fine for about 6 hours, but then I got this error: [Thu, 24 Feb 2011 19:42:57 GMT] [error] [0.276.0] ** Generic server 0.276.0

Re: View for multiple IDs

2011-02-25 Thread Simon Metson
you can query the view with a post containing a json document like: {keys: [key1, key2, ...]} See http://wiki.apache.org/couchdb/HTTP_view_API#Querying_Options Sent with Sparrow On Thursday, 24 February 2011 at 10:39, Martin Hewitt wrote: Hi all, How would I create a view to retrieve

Re: View for multiple IDs

2011-02-25 Thread Anup Bishnoi
Though I wonder what purpose it solves to make a view specifically for three documents only, but if so, you could check for doc._id in the view function to be one of those names and emit(doc._id, doc) in that case, doing nothing otherwise On Fri, Feb 25, 2011 at 10:34 PM, Simon Metson

Welcome Adam Kocoloski to the Apache CouchDB PMC

2011-02-25 Thread Damien Katz
Hi everyone, I'm happy to announce Adam Kocoloski as the latest addition to the CouchDB Project Management Committee (PMC). This is long overdue, Adam has been an important committer to the project and member of the community. Please help me in congratulating Adam! -Damien

Re: Welcome Adam Kocoloski to the Apache CouchDB PMC

2011-02-25 Thread Filipe David Manana
Congratulations Adam! Well deserved :) On Fri, Feb 25, 2011 at 5:40 PM, Damien Katz dam...@apache.org wrote: Hi everyone, I'm happy to announce Adam Kocoloski as the latest addition to the CouchDB Project Management Committee (PMC). This is long overdue, Adam has been an important

Re: Welcome Adam Kocoloski to the Apache CouchDB PMC

2011-02-25 Thread Jan Lehnardt
Welcome Adam! :) Cheers Jan -- On 25 Feb 2011, at 18:40, Damien Katz wrote: Hi everyone, I'm happy to announce Adam Kocoloski as the latest addition to the CouchDB Project Management Committee (PMC). This is long overdue, Adam has been an important committer to the project and

Re: Welcome Adam Kocoloski to the Apache CouchDB PMC

2011-02-25 Thread Adam Kocoloski
On Feb 25, 2011, at 12:40 PM, Damien Katz wrote: Hi everyone, I'm happy to announce Adam Kocoloski as the latest addition to the CouchDB Project Management Committee (PMC). This is long overdue, Adam has been an important committer to the project and member of the community. Please

Re: Welcome Adam Kocoloski to the Apache CouchDB PMC

2011-02-25 Thread Toni Thomä
Congratulations! Am 25.02.2011 um 18:40 schrieb Damien Katz: Hi everyone, I'm happy to announce Adam Kocoloski as the latest addition to the CouchDB Project Management Committee (PMC). This is long overdue, Adam has been an important committer to the project and member of the

Re: Welcome Adam Kocoloski to the Apache CouchDB PMC

2011-02-25 Thread dhi...@vlesolutions.com
Congratulations, Adam! I look forward to pleading for help :-) Dan Daniel E. Himes, Ph.D President, VLE Solutions, Inc. Sent from mobile On Feb 25, 2011, at 12:40, Damien Katz dam...@apache.org wrote: Hi everyone, I'm happy to announce Adam Kocoloski as the latest addition to the CouchDB

Re: Welcome Adam Kocoloski to the Apache CouchDB PMC

2011-02-25 Thread Randall Leeds
Woohoo! Congratz, Adam! On Fri, Feb 25, 2011 at 10:22, dhi...@vlesolutions.com dhi...@vlesolutions.com wrote: Congratulations, Adam! I look forward to pleading for help :-) Dan Daniel E. Himes, Ph.D President, VLE Solutions, Inc. Sent from mobile On Feb 25, 2011, at 12:40, Damien Katz

Re: CouchDB 1.0.2 errors under load

2011-02-25 Thread Pasi Eronen
Thanks! I looked at /proc/(pid-of-beam.smp)/fd, and it seems CouchDB is indeed using a lot of file descriptors, and the number is growing. I restarted CouchDB (and my batch job), and after 40 minutes, it was already using 300 fds; an hour later, the figure was 600; half an hour later, almost 700.

Re: CouchDB 1.0.2 errors under load

2011-02-25 Thread Paul Davis
It sounds like your client is doing something funky with shutting down connections to the server. If I were to guess I would say that it looks like you're leaking sockets between a call to shutdown and a call to close. Though to say for certain I'd need to see what state both ends of the socket

RE: Welcome Adam Kocoloski to the Apache CouchDB PMC

2011-02-25 Thread Panop Suvaphrom
Congratulations! You are the best ! From: Toni Thomä [t...@filbert.org] Sent: Saturday, February 26, 2011 12:58 AM To: user@couchdb.apache.org Subject: Re: Welcome Adam Kocoloski to the Apache CouchDB PMC Congratulations! Am 25.02.2011 um 18:40 schrieb

Re: CouchDB 1.0.2 errors under load

2011-02-25 Thread Pasi Eronen
Yes, the client is doing something funky :-) Many of the requests it sends are POSTs with chunked transfer encoding, so it's being hit hard by issue COUCHDB-682. In other words, there's lot of closing and opening of TCP connections going on, and retrying requests that failed due to COUCHDB-682.

Re: CouchDB 1.0.2 errors under load

2011-02-25 Thread Paul J. Davis
On Feb 25, 2011, at 7:31 PM, Pasi Eronen p...@iki.fi wrote: Yes, the client is doing something funky :-) Many of the requests it sends are POSTs with chunked transfer encoding, so it's being hit hard by issue COUCHDB-682. In other words, there's lot of closing and opening of TCP

Re: Design question, article with logs of comments and ratings

2011-02-25 Thread He Shiming
On Fri, Feb 25, 2011 at 9:25 PM, Simon Metson simonmet...@googlemail.com wrote: And query it for a specific article with http://localhost:5984/voting/_design/vote/_view/vote?group=truekey=%22foo%22 Mike Miller did a nice summary of how you could do time binned data for your historical info

Re: Design question, article with logs of comments and ratings

2011-02-25 Thread Aravinda VK
This might help. http://www.cmlenz.net/archives/2007/10/couchdb-joins On Sat, Feb 26, 2011 at 7:46 AM, He Shiming heshim...@gmail.com wrote: On Fri, Feb 25, 2011 at 9:25 PM, Simon Metson simonmet...@googlemail.com wrote: And query it for a specific article with

Re: WinCouch

2011-02-25 Thread Zdravko Gligic
OK, I have downloaded, unzipped, clicked on WinCouch.exe and it all works - which is great! I need to replace WinCouch.exe with an Adobe AIR desktop application - either replace it or somehow transparently embed it within my AIR app. However, I am not sure if it's .NET that provides all of the