Re: What happens to data in an existing type if we update the mapping to specify 'path's for _id and _routing

2014-10-28 Thread Preeti Raj - Buchhada
Any ideas on this? On Monday, October 27, 2014 3:03:16 PM UTC+5:30, Preeti Raj - Buchhada wrote: > > We are using ES 1.3.2. > We have a need to specify custom id and routing values when indexing. > We've been doing this using Java APIs, however we would now like to update

What happens to data in an existing type if we update the mapping to specify 'path's for _id and _routing

2014-10-27 Thread Preeti Raj - Buchhada
We are using ES 1.3.2. We have a need to specify custom id and routing values when indexing. We've been doing this using Java APIs, however we would now like to update the mapping to specify 'path's for _id and _routing. The question we have is: 1) Since this type already has a huge number of doc

Re: Is there a way to "update" ES records using Spark?

2014-10-13 Thread Preeti Raj - Buchhada
Oct 13, 2014 at 12:55 PM, Preeti Raj - Buchhada > > wrote: > > Anyone has an idea? > > At least if I get to know whether this is possible or not, that'll be a > > great help. > > > > Thanks. > > > > > > > > On Wednesday, October

Re: Is there a way to "update" ES records using Spark?

2014-10-13 Thread Preeti Raj - Buchhada
Anyone has an idea? At least if I get to know whether this is possible or not, that'll be a great help. Thanks. On Wednesday, October 1, 2014 3:46:51 PM UTC+5:30, Preeti Raj - Buchhada wrote: > > I am using ES version 1.3.2, and Spark 1.1.0. > I can successfully read and writ

Is there a way to "update" ES records using Spark?

2014-10-01 Thread Preeti Raj - Buchhada
I am using ES version 1.3.2, and Spark 1.1.0. I can successfully read and write records from/to ES using newAPIHadoopRDD() and saveAsNewAPIHadoopDataset(). However, I am struggling to find a way to update records. Even I specify a 'key' in ESOutputFormat it gets ignored, as documented clearly. So