CouchDB got 100% slower in the past 3 weeks

2015-08-30 Thread Robert Kowalski
Hi list,

I got pinged as our friends from PouchDB notices that their testsuite
with CouchDB 2 as a backend suddenly takes 100% longer (20mins instead
of 10). [1] Because the diff was so significant I got really curious
and worried about it.

This testsuite just took 10min

https://travis-ci.org/pouchdb/pouchdb/jobs/74585676 (22 days old)

vs

https://travis-ci.org/pouchdb/pouchdb/jobs/77865796 (yesterday)

which took like the other runs these days 20min.

I wasn't really sure, maybe the travis VMs changed. Or Pouch.

Based on the report I created a few flamegraphs to poke around what
changed in CouchDBs internals. They look quite different to the ones I
created in the past weeks:

https://dl.dropboxusercontent.com/u/1809262/flame-couch-epi-update-doc.svg

this flamegraphs shows the update of a doc. couch-epi takes 33% of the
time and blocks.

https://dl.dropboxusercontent.com/u/1809262/flame-epi.svg

in this flamegraph I receive a document. I have 3 blocking calls to
couch_epi, adding up to 21% time of the request.

The report from Nolan (perf decrease of 100% in a timeframe from 3
weeks) fits into the timeframe where we added couch_epi. As almost
every module uses couch_epi the performance decrease of almost all
APIs also fits into the scheme. And I think the flamegraphs show that
the additional time is spent in couch_epi.


- I see that couch_epi uses the codeserver internally, would it be
possible to use faster ETS tables?
- Anything else we could do?

Best,
Robert

[1] https://github.com/pouchdb/pouchdb/issues/4209#issuecomment-135964232


CouchDB replicate ALL databases

2015-08-30 Thread Andy Wenk
Hi all,

I found the question in the subject of this email here:

https://serverfault.com/questions/715273/couchdb-replicate-all-databases/717558#717558

My answer is the one we give always (marketing for CouchDB 2.0 included ;-)
). After reading the recent awesome CouchDB newsletter [1] (thanks
Katharina!) I am wondering if there are some tools available already for
this task. Or does anyone have other solutions? Especially for Sysadmins,
this is a recurring question.

Happy to read your answers in the serverfault thread ... or here!.

All the best

Andy

[1] http://blog.couchdb.org/2015/08/27/couchdb-weekly-news-aug-27-2015/
-- 
Andy Wenk
Hamburg - Germany
RockIt!

GPG fingerprint: C044 8322 9E12 1483 4FEC 9452 B65D 6BE3 9ED3 9588

https://people.apache.org/keys/committer/andywenk.asc