Re: Issues with terabytes databases

2014-04-22 Thread Vladimir Ralev
Hi very interesting case, are you sure you are not exceeding the write capacity of the RAID, few MBs per second is actually enough to starve a lot of the older HDDs, remember they have to reposition themselves for almost every write when load is concurrent and out of context, essentially random acc

Re: Issues with terabytes databases

2014-04-22 Thread Adam Kocoloski
Hi Jean-Yves, welcome! Always nice to hear reports from production deployments. Replies inline: On Apr 22, 2014, at 10:09 AM, Jean-Yves Moulin wrote: > Hi everybody, > > we use CouchDB in production for more than two years now. And we are almost > happy with it :-) We have a heavy writing wo

Issues with terabytes databases

2014-04-22 Thread Jean-Yves Moulin
Hi everybody, we use CouchDB in production for more than two years now. And we are almost happy with it :-) We have a heavy writing workload, with very few update, and we never delete data. Some of our databases are terabytes with billions of documents (sometimes 20 millions of doc per day). Bu