Re: Setting id of document with elasticsearch-hadoop that is not in source document

2014-07-11 Thread Brian Thomas
alternatives that you thought of? Cheers, On 7/7/14 10:48 PM, Brian Thomas wrote: I am trying to update an elasticsearch index using elasticsearch-hadoop. I am aware of the *es.mapping.id* configuration where you can specify that field in the document to use as an id, but in my case

Re: Setting id of document with elasticsearch-hadoop that is not in source document

2014-07-11 Thread Brian Thomas
, On 7/7/14 10:48 PM, Brian Thomas wrote: I am trying to update an elasticsearch index using elasticsearch-hadoop. I am aware of the *es.mapping.id* configuration where you can specify that field in the document to use as an id, but in my case the source document does not have the id (I

Re: java.lang.NoSuchFieldError: ALLOW_UNQUOTED_FIELD_NAMES when trying to query elasticsearch using spark

2014-07-07 Thread Brian Thomas
. On Sunday, July 6, 2014 4:28:56 PM UTC-4, Costin Leau wrote: Hi, Glad to see you sorted out the problem. Out of curiosity what version of jackson were you using and what was pulling it in? Can you share you maven pom/gradle build? On Sun, Jul 6, 2014 at 10:27 PM, Brian Thomas brianjt

Setting id of document with elasticsearch-hadoop that is not in source document

2014-07-07 Thread Brian Thomas
I am trying to update an elasticsearch index using elasticsearch-hadoop. I am aware of the *es.mapping.id* configuration where you can specify that field in the document to use as an id, but in my case the source document does not have the id (I used elasticsearch's autogenerated id when

Re: java.lang.NoSuchFieldError: ALLOW_UNQUOTED_FIELD_NAMES when trying to query elasticsearch using spark

2014-07-06 Thread Brian Thomas
I figured it out, dependency issue in my classpath. Maven was pulling down a very old version of the jackson jar. I added the following line to my dependencies and the error went away: compile 'org.codehaus.jackson:jackson-mapper-asl:1.9.13' On Friday, July 4, 2014 3:22:30 PM UTC-4, Brian

java.lang.NoSuchFieldError: ALLOW_UNQUOTED_FIELD_NAMES when trying to query elasticsearch using spark

2014-07-04 Thread Brian Thomas
I am trying to test querying elasticsearch using Apache Spark using elasticsearch-hadoop. I am just trying to do a query to the elasticsearch server and return the count of results. Below is my test class using the Java API: import org.apache.hadoop.conf.Configuration; import

Re: Indexing nonstandard geo_point field.

2014-06-01 Thread Brian Thomas
Reelsen wrote: Hey, you could index this as a geo shape (as this is valid GeoJSON). If you really need the functionality for a geo_point, you need to change the structure of the data. --Alex On Sat, May 31, 2014 at 3:36 PM, Brian Thomas mynam...@gmail.com javascript: wrote: I am new

Indexing nonstandard geo_point field.

2014-05-31 Thread Brian Thomas
I am new to Elasticsearch and I am trying to index a json document with a nonstandard lat/long format. I know the standard format for a geo_point array is [lon, lat], but the documents I am indexing has format [lat, lon]. This is what the JSON element looks like: geo: { type: Point,