Re: couchdb 3.X partitioning

2020-07-07 Thread Sharath
Hi Nick, Thanks, from what I understand this sets the database parameters when it is being created. For partitioning to work, it would require all documents to have the _id in the manner : This would still require an ETL of the entire database as Adam mentioned. Sharath On Wed, Jul 8, 2020 a

Re: couchdb 3.X partitioning

2020-07-07 Thread Jan Lehnardt
> On 7. Jul 2020, at 16:42, Nick Vatamaniuc wrote: > > Hi Sharath, > > You can use {"source": ..., "target": ..., "create_target": true, > "create_target_params": {"partitioned": true}, ...} to create > partitioned target dbs. > > The option was there since version 2.2.0 > https://docs.couch

Re: couchdb 3.X partitioning

2020-07-07 Thread Nick Vatamaniuc
Hi Sharath, You can use {"source": ..., "target": ..., "create_target": true, "create_target_params": {"partitioned": true}, ...} to create partitioned target dbs. The option was there since version 2.2.0 https://docs.couchdb.org/en/stable/whatsnew/2.2.html?highlight=create_target_params#features

Re: couchdb 3.X partitioning

2020-07-07 Thread Jan Lehnardt
> On 7. Jul 2020, at 15:19, Sharath wrote: > > Thanks - thats what I thought. Ah yes, I was assuming your _ids were already set up correctly. Best Jan — > > Have to write an ETL job for my hugeish database - would be cool if > replication protocol could be used to achieve the same thing. >

Re: couchdb 3.X partitioning

2020-07-07 Thread Sharath
Thanks - thats what I thought. Have to write an ETL job for my hugeish database - would be cool if replication protocol could be used to achieve the same thing. Sharath On Tue, Jul 7, 2020 at 11:15 PM Adam Kocoloski wrote: > The tricky part is that partitioned databases have a hard requiremen

Re: couchdb 3.X partitioning

2020-07-07 Thread Sharath
Hi Jan, On Tue, Jul 7, 2020 at 10:30 PM Jan Lehnardt wrote: > Hi Sharath, > > > On 7. Jul 2020, at 14:17, Sharath wrote: > > > > Hi, > > > > Got couchdb 3.1 running and migrated my database (replicated) over. > > > > Read about partitioning and have the following questions: > > > > Can a par

Re: couchdb 3.X partitioning

2020-07-07 Thread Adam Kocoloski
The tricky part is that partitioned databases have a hard requirement on document IDs to have a “:” in them to demarcate between the partition and rest of the document ID. Replication can’t change document ID, but if the source database happens to fulfill that requirement for all of its documen

Re: couchdb 3.X partitioning

2020-07-07 Thread Jan Lehnardt
Hi Sharath, > On 7. Jul 2020, at 14:17, Sharath wrote: > > Hi, > > Got couchdb 3.1 running and migrated my database (replicated) over. > > Read about partitioning and have the following questions: > > Can a partitioned database be created when replicating from another couchdb > instance? Do

couchdb 3.X partitioning

2020-07-07 Thread Sharath
Hi, Got couchdb 3.1 running and migrated my database (replicated) over. Read about partitioning and have the following questions: Can a partitioned database be created when replicating from another couchdb instance? [I think not but have to ask] thanks Sharath