Re: Can't integrate Elasticsearch with Hive

2014-11-28 Thread Atul Paldhikar
Finally I was able to load the data from Hive to Elasticsearch !!! Yes you are right, in the beginning I started with es-hadoop 1..3.x then replaced by 2.0.2. However somewhere in the Hive classpath it remained and caused all this trouble. Now I do have 2 "ex_address" tables. One in "Default" a

Re: Can't integrate Elasticsearch with Hive

2014-11-28 Thread Costin Leau
ESStorageHandler was the name used in es-hadoop 1.3 Beta1 - in 2.0, the name was changed to EsStorageHandler. In case you are using the wrong class, you would get a ClassNotFound Exception - assuming you don't have 1.3 in your classpath. Regarding the error, yes, for some reason Hive since 0.1

Re: Can't integrate Elasticsearch with Hive

2014-11-27 Thread Atul Paldhikar
Hi Costin, Actually even that issue is resolved J There is spelling difference in the sample available on the web, all of them have the storage class as “EsStorageHandler” however only your GitHub post says it is “ESStorageHandler” which is right (https://gist.github.com/costin/8025827) ! Th

Re: Can't integrate Elasticsearch with Hive

2014-11-27 Thread Atul Paldhikar
Hi Costin, thanks for your response. I tried all the cleanup but still no luck :-( Here are the steps I tried 1. Removed the es-hadoop 2.1.x completed from the server 2. Updated the hive-site.xml as below, but didn't work hive.aux.jars.path /apps/sas/elasticsearch-hadoop-2.0.2/dist/elast

Re: Can't integrate Elasticsearch with Hive

2014-11-27 Thread Costin Leau
Hi, The issue is most likely caused by two different versions of es-hadoop within your classpath, probably es-hadoop 2.0.x (2.0.2) and 2.1.x (2.1.0.Beta3). If they are picked up by Hive or Hadoop it means the JVM will have two jars with classes under the same package name. This leads to weird c

Can't integrate Elasticsearch with Hive

2014-11-26 Thread Atul Paldhikar
Hi All, I am using Hive 0.13.1 and trying to create an external table so data can me loaded from Hive to Elasticsearch. However I keep getting the following error. I have tried with following jars but same error. I will really appreciate for any pointers. Thanks - Atul hive.aux.jars.path