Hi, my hadoop version is 1.1.1 and hive version is 0.9.0 (biginsights installation). I am trying to push data from existing hive table(s) into elasticsearch. My job fails with the following error. I copied hive script as well below the error. Not sure what I am doing wrong. Can you help? Many thanks. The es table I am trying to create and the existing hive table have exactly the same schema.
java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"id":1533,"17qnigvs":981,"cpdgolct":4,"8kzzi4te":20,"atbvkhii":174,"xyygmjew":93,"cjtf65bx":35.237512742099895,"fj81mxmy":0.0,"zwewms3g":3386.0} at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:161) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:435) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(AccessController.java:310) at javax.security.auth.Subject.doAs(Subject.java:573) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"id":1533,"17qnigvs":981,"cpdgolct":4,"8kzzi4te":20,"atbvkhii":174,"xyygmjew":93,"cjtf65bx":35.237512742099895,"fj81mxmy":0.0,"zwewms3g":3386.0} at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:548) at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143) ... 8 more Caused by: org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: a valid progressable is required to report status to Hadoop at org.elasticsearch.hadoop.util.Assert.notNull(Assert.java:40) at org.elasticsearch.hadoop.mr.HeartBeat.<init>(HeartBeat.java:44) at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.init(EsOutputFormat.java:189) at org.elasticsearch.hadoop.hive.EsHiveOutputFormat$EsHiveRecordWriter.write(EsHiveOutputFormat.java:58) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:588) at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762) at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84) at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762) at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:83) at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762) at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:529) ... 9 more hive script --------------- add JAR /homes/ibmusr/elasticsearch-hadoop-2.0.1/dist/elasticsearch-hadoop-2.0.1.jar; add JAR /homes/ibmusr/elasticsearch-hadoop-2.0.1/dist/elasticsearch-hadoop-hive-2.0.1.jar; drop table alarmdata2_gba_ID_es; create external table alarmdata2_gba_ID_es( ID int,17qNigvs bigint, cPdgOLct bigint, 8KzZi4Te bigint, ATBVkHiI bigint, xyYGMjEw bigint, CjTF65Bx double, FJ81mxMy double, zWEwms3G double) STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler' TBLPROPERTIES('es.resource' = 'alarmdata/gbid', 'es.mapping.id' = 'id', 'es.index.auto.create' = 'true'); insert overwrite table alarmdata2_gba_ID_es select * from alarmdata2_gba_ID; -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/fcedbc80-3ef6-4001-b30a-5068b48f3481%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.