[
https://issues.apache.org/jira/browse/HIVE-28958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17951670#comment-17951670
]
Ayush Saxena commented on HIVE-28958:
-------------------------------------
I built the binary locally using mvn clean install -DskipTests -Pdist, Deployed
Hadoop-3.4.1 locally using the release tar on hadoop website.
Deployed the Hadoop nodes locally on my Mac & then HiveServer2 with Derby
!HS2-Software_attr.png!
& it still worked for me. [^hive-4-non-docker.rtf], [~zhangbutao] can you
check if I did something different/wrong here
> Tez job failed with: NoClassDefFoundError: org/locationtech/jts/geom/Geometry
> -----------------------------------------------------------------------------
>
> Key: HIVE-28958
> URL: https://issues.apache.org/jira/browse/HIVE-28958
> Project: Hive
> Issue Type: Bug
> Reporter: Butao Zhang
> Priority: Major
> Attachments: HS2-Software_attr.png, hive-4-non-docker.rtf,
> hive-4-tez0.10.5.rtf
>
>
> Tested with Hadoop3.3.6 & Tez0.10.4 & latest Hive master branch:
>
> {code:java}
> create table test1(id int) stored as orc;
> insert into test1 values(11);
> {code}
> Tez job failed with {color:#FF0000}java.lang.NoClassDefFoundError:
> org/locationtech/jts/geom/Geometry{color}
> {code:java}
> ----------------------------------------------------------------------------------------------
> VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING
> FAILED KILLED
> ----------------------------------------------------------------------------------------------
> Map 1 container RUNNING 1 0 0 1
> 4 0
> Reducer 2 container INITED 1 0 0 1
> 0 0
> ----------------------------------------------------------------------------------------------
> VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 736.43 s
> ----------------------------------------------------------------------------------------------
> ERROR : Status: Failed
> ERROR : Vertex failed, vertexName=Map 1,
> vertexId=vertex_1747277688249_0002_1_00, diagnostics=[Task failed,
> taskId=task_1747277688249_0002_1_00_000000, diagnostics=[TaskAttempt 0
> failed, info=[Error: Node: olap-9-13/100.71.9.13 : Error while running task (
> failure ) :
> attempt_1747277688249_0002_1_00_000000_0:java.lang.RuntimeException:
> java.lang.RuntimeException: Map operator initialization failed
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:348)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:276)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:381)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:86)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:72)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:72)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:42)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
> at
> com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:351)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:292)
> ... 16 more
> Caused by: java.lang.NoClassDefFoundError: org/locationtech/jts/geom/Geometry
> at
> org.apache.calcite.sql.type.JavaToSqlTypeConversionRules.<init>(JavaToSqlTypeConversionRules.java:74)
> at
> org.apache.calcite.sql.type.JavaToSqlTypeConversionRules.<clinit>(JavaToSqlTypeConversionRules.java:41)
> at
> org.apache.calcite.jdbc.JavaTypeFactoryImpl.createType(JavaTypeFactoryImpl.java:153)
> at
> org.apache.hadoop.hive.ql.exec.DataSketchesFunctions$SketchFunctionDescriptor.getReturnRelDataType(DataSketchesFunctions.java:245)
> at
> org.apache.hadoop.hive.ql.exec.DataSketchesFunctions.registerAsHiveFunction(DataSketchesFunctions.java:168)
> at
> org.apache.hadoop.hive.ql.exec.DataSketchesFunctions.buildCalciteFns(DataSketchesFunctions.java:130)
> at
> org.apache.hadoop.hive.ql.exec.DataSketchesFunctions.<init>(DataSketchesFunctions.java:99)
> at
> org.apache.hadoop.hive.ql.exec.DataSketchesFunctions.<clinit>(DataSketchesFunctions.java:56)
> at
> org.apache.hadoop.hive.ql.exec.FunctionRegistry.<clinit>(FunctionRegistry.java:580)
> at
> org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.isDeterministic(ExprNodeGenericFuncEvaluator.java:188)
> at
> org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.isConsistentWithinQuery(ExprNodeEvaluator.java:117)
> at
> org.apache.hadoop.hive.ql.exec.ExprNodeEvaluatorFactory.iterate(ExprNodeEvaluatorFactory.java:102)
> at
> org.apache.hadoop.hive.ql.exec.ExprNodeEvaluatorFactory.toCachedEvals(ExprNodeEvaluatorFactory.java:76)
> at
> org.apache.hadoop.hive.ql.exec.SelectOperator.initializeOp(SelectOperator.java:70)
> at
> org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:360)
> at
> org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:549)
> at
> org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:503)
> at
> org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:369)
> at
> org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:511)
> at
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:314)
> ... 17 more
> Caused by: java.lang.ClassNotFoundException:
> org.locationtech.jts.geom.Geometry
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 37 more
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
