Re: using saveAsNewAPIHadoopFile with OrcOutputFormat

2014-04-17 Thread Nick Pentreath
ES formats are pretty easy to use: Reading: val conf = new Configuration() conf.set("es.resource", "index/type") conf.set("es.query", "?q=*") val rdd = sc.newAPIHadoopRDD( conf, classOf[EsInputFormat[NullWritable, LinkedMapWritable]], classOf[NullWritable], classOf[LinkedMapWritable] ) The only g

Re: using saveAsNewAPIHadoopFile with OrcOutputFormat

2014-04-16 Thread Kostiantyn Kudriavtsev
I’d prefer to find good example of using saveAsNewAPIHadoopFile with different OutputFormat implementations (not only orc, but EsOutputFormat, etc). Any common example On Apr 16, 2014, at 4:51 PM, Brock Bose wrote: > Howdy all, > I recently saw that the OrcInputFormat/OutputFormat's have