Re: Cannot Read Elasticsearch date type with format basic_date_time in Spark

2015-06-01 Thread Nicolas Phung
Hi, It was with Spark 1.2.0-cdh5.3.2 (in Yarn Cluster mode) and Spark 1.3.0 standalone (for developer environment). I have tried with Java 1.7.0_55 and Java 1.8u45. I will try again with Spark 1.3.1 standalone and will raise an issue if it still persists. Thank you for your answer. Nicolas

Re: Cannot Read Elasticsearch date type with format basic_date_time in Spark

2015-06-01 Thread Costin Leau
Hi, This has been fixed in master [1] - please try the latest snapshot. [1] https://github.com/elastic/elasticsearch-hadoop/issues/458 PS - We're moving to https://discuss.elastic.co/, please join us there for any future discussions! On 6/1/15 9:56 PM, Nicolas Phung wrote: Hi, It was with

Re: Cannot Read Elasticsearch date type with format basic_date_time in Spark

2015-05-14 Thread Costin Leau
Looks like a bug. Can you please raise an issue? What is the Spark and Java version you are using? Thanks, On 5/11/15 4:45 PM, Nicolas Phung wrote: Hello, I'm trying to build a RDD from ElasticSearch data with elasticsearch-spark 2.1.0.Beta4. I have the following field mapping : date:

Cannot Read Elasticsearch date type with format basic_date_time in Spark

2015-05-11 Thread Nicolas Phung
Hello, I'm trying to build a RDD from ElasticSearch data with elasticsearch-spark 2.1.0.Beta4. I have the following field mapping : date: {type: date,format: basic_date_time}, But when I'm trying to read it with Spark via this snippet: val rdd = sc.esRDD(analytic/docs, ?q=*) rdd.take(10)