Re: Using CouchDB for transferring user logs via the internet

2017-06-21 Thread Vladimir Kuznetsov
Hi Stefan Thanks for pointing to the /_db_updates feature, I wasn't aware about it. Yes, my only need for central db is to simplify polling for changes. No central views etc. I'll see if I can efficiently poll on multiple databases changes by listening on /_db_updates feed: on each new entry

Re: Using CouchDB for transferring user logs via the internet

2017-06-21 Thread Vladimir Kuznetsov
Hi Carlos, One of the requirements for the system is to be able to work completely offline and sync when there's an internet connectivity. Right, this is a task for a queue, I would use one if I could find any implementation addressing offline replication use case. thanks, --Vovan > On Jun 21

Re: Using CouchDB for transferring user logs via the internet

2017-06-21 Thread Carlos Alonso
Hi Vladimir. I suppose you already have evaluated this option, but just in case... To me this sounds like a task for a queue. Have you thought about having a queue as your central logs storage (instead of the couchdb cluster on cloud you described)? To me it feels a more natural use case. From you

Re: Using CouchDB for transferring user logs via the internet

2017-06-20 Thread Stefan Klein
Hi, commenting on individual topics inline, though i only have experience with CouchDB 1.6, maybe CouchDB 2.0 behaves a bit different. 2017-06-20 20:34 GMT+02:00 Vladimir Kuznetsov : > > Now, I know in couchdb documents are not being really deleted, just marked > as 'deleted' so the database wil

Re: Using CouchDB for transferring user logs via the internet

2017-06-20 Thread Martin Broerse
We use pouch sync (ember-pouch) to couch in a bad sometimes offline wifi situation and it is very reliable. Not sure about your 10G but it should be OK if you have the bandwidth when you are online. We had to implement indicators for users to let them know they are walking outside the wifi connecti

Using CouchDB for transferring user logs via the internet

2017-06-20 Thread Vovan Vovan
Hi guys, I'm new to couchdb. I'm planning to use CouchDB 2.0 to transfer some usage logs from a number of devices based on customer premises to the cloud solution for analysis. By logs I mean a constant stream of small JSON documents(up to 1K), I expect up to 100K of such documents from each devic

Using CouchDB for transferring user logs via the internet

2017-06-20 Thread Vladimir Kuznetsov
Hi guys, I'm new to couchdb. I'm planning to use CouchDB 2.0 to transfer some usage logs from a number of devices based on customer premises to the cloud solution for analysis. By logs I mean a constant stream of small JSON documents(up to 1K), I expect up to 100K of such documents from each d