[ https://issues.apache.org/jira/browse/HIVE-26980?focusedWorklogId=842432&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-842432 ]
ASF GitHub Bot logged work on HIVE-26980: ----------------------------------------- Author: ASF GitHub Bot Created on: 31/Jan/23 07:02 Start Date: 31/Jan/23 07:02 Worklog Time Spent: 10m Work Description: kasakrisz commented on code in PR #3993: URL: https://github.com/apache/hive/pull/3993#discussion_r1091524011 ########## ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java: ########## @@ -7878,6 +7878,10 @@ protected Operator genFileSinkPlan(String dest, QB qb, Operator input) throw new SemanticException("Unknown destination type: " + destType); } + if (!(destType == QBMetaData.DEST_DFS_FILE && qb.getIsQuery())) { Review Comment: * IIUC when destType=DEST_LOCAL_FILE we are inserting into a local directory and no conversion is required since the target is not an actual table. Example. https://github.com/apache/hive/blob/0a5558d71c474f285c1e6d338a4be93bd1c6ce13/ql/src/test/queries/clientpositive/insert_overwrite_local_directory_1.q#L2 I extended the if condition with checking whether the destinationTable is null and does it has a storage handler. * yes, isQuery should be false for ctas and mv https://github.com/apache/hive/blob/0a5558d71c474f285c1e6d338a4be93bd1c6ce13/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java#L2443-L2444 Issue Time Tracking ------------------- Worklog Id: (was: 842432) Time Spent: 1h 20m (was: 1h 10m) > Creation of materialized view stored by Iceberg fails if source table has > tinyint column > ---------------------------------------------------------------------------------------- > > Key: HIVE-26980 > URL: https://issues.apache.org/jira/browse/HIVE-26980 > Project: Hive > Issue Type: Bug > Components: Iceberg integration > Reporter: Dharmik Thakkar > Assignee: Krisztian Kasa > Priority: Major > Labels: pull-request-available > Time Spent: 1h 20m > Remaining Estimate: 0h > > MV creation using iceberg storage format for Hive table containing tinyint > column fails with error "java.lang.ClassCastException: class java.lang.Byte > cannot be cast to class java.lang.Integer" > Logs > {code:java} > 2023-01-24T21:36:22,153 INFO [pool-2-thread-1] jdbc.TestDriver: Beginning > Test at 2023-01-24 21:36:22,153 > 2023-01-24T21:36:22,154 INFO [pool-2-thread-1] jdbc.TestDriver: BEGIN MAIN > 2023-01-24T21:36:22,155 INFO [pool-38-thread-1] jdbc.TestDriver: Running > SessionGroup{name='SG_TNMECIDQ31', initialDelay=0, repeats=1, repeatDelay=0} > 2023-01-24T21:36:22,155 INFO [pool-38-thread-1] jdbc.TestDriver: Connecting > as user 'hrt_qa' > 2023-01-24T21:36:22,409 INFO [pool-38-thread-1] jdbc.TestDriver: Query: set > hive.cbo.enable=true > 2023-01-24T21:36:22,619 INFO [pool-38-thread-1] jdbc.TestDriver: No output > to verify > 2023-01-24T21:36:22,619 INFO [pool-38-thread-1] jdbc.TestDriver: Query: set > hive.materializedview.rewriting > 2023-01-24T21:36:22,946 INFO [pool-38-thread-1] jdbc.TestDriver: Query: set > iceberg.mr.schema.auto.conversion=true > 2023-01-24T21:36:23,183 INFO [pool-38-thread-1] jdbc.TestDriver: No output > to verify > 2023-01-24T21:36:23,183 INFO [pool-38-thread-1] jdbc.TestDriver: Query: drop > materialized view if exists mv_project > 2023-01-24T21:36:23,243 INFO [Thread-401] jdbc.TestDriver: INFO : Compiling > command(queryId=hive_20230124213623_e80df624-1ca6-4487-9f4b-616f756f91b3): > drop materialized view if exists mv_project > 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : Semantic > Analysis Completed (retrial = false) > 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : Created > Hive schema: Schema(fieldSchemas:null, properties:null) > 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : Completed > compiling > command(queryId=hive_20230124213623_e80df624-1ca6-4487-9f4b-616f756f91b3); > Time taken: 0.03 seconds > 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : Executing > command(queryId=hive_20230124213623_e80df624-1ca6-4487-9f4b-616f756f91b3): > drop materialized view if exists mv_project > 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : Starting > task [Stage-0:DDL] in serial mode > 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : Completed > executing > command(queryId=hive_20230124213623_e80df624-1ca6-4487-9f4b-616f756f91b3); > Time taken: 0.008 seconds > 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : OK > 2023-01-24T21:36:23,423 INFO [pool-38-thread-1] jdbc.TestDriver: No output > to verify > 2023-01-24T21:36:23,423 INFO [pool-38-thread-1] jdbc.TestDriver: Query: > create materialized view mv_project stored by iceberg as select t, si, avg(t) > from all100k where t>115 group by t, si > 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Compiling > command(queryId=hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d): > create materialized view mv_project stored by iceberg as select t, si, avg(t) > from all100k where t>115 group by t, si > 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Semantic > Analysis Completed (retrial = false) > 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Created > Hive schema: Schema(fieldSchemas:[FieldSchema(name:t, type:tinyint, > comment:null), FieldSchema(name:si, type:smallint, comment:null), > FieldSchema(name:_c2, type:double, comment:null)], properties:null) > 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Completed > compiling > command(queryId=hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d); > Time taken: 0.535 seconds > 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Executing > command(queryId=hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d): > create materialized view mv_project stored by iceberg as select t, si, avg(t) > from all100k where t>115 group by t, si > 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Compute > 'qe-vw-dwx-hive-snwh' is active. > 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Query ID > = hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d > 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Total > jobs = 1 > 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Starting > task [Stage-4:DDL] in serial mode > 2023-01-24T21:36:25,697 INFO [Thread-402] jdbc.TestDriver: INFO : Starting > task [Stage-5:DDL] in serial mode > 2023-01-24T21:36:25,697 INFO [Thread-402] jdbc.TestDriver: INFO : Launching > Job 1 out of 1 > 2023-01-24T21:36:25,697 INFO [Thread-402] jdbc.TestDriver: INFO : Starting > task [Stage-1:MAPRED] in serial mode > 2023-01-24T21:36:25,697 INFO [Thread-402] jdbc.TestDriver: INFO : > Subscribed to counters: [] for queryId: > hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d > 2023-01-24T21:36:25,697 INFO [Thread-402] jdbc.TestDriver: INFO : Tez > session hasn't been created yet. Opening session > 2023-01-24T21:36:25,697 INFO [Thread-402] jdbc.TestDriver: INFO : Dag name: > create materialized view mv_project sto...si (Stage-1) > 2023-01-24T21:36:26,257 INFO [Thread-402] jdbc.TestDriver: INFO : HS2 Host: > [hiveserver2-0], Query ID: > [hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d], Dag ID: > [dag_1674594626929_0001_124], DAG Session ID: [application_1674594626929_0001] > 2023-01-24T21:36:26,818 INFO [Thread-402] jdbc.TestDriver: INFO : Status: > Running (Executing on YARN cluster with App id application_1674594626929_0001) > 2023-01-24T21:36:26,818 INFO [Thread-402] jdbc.TestDriver: > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ERROR : Status: > Failed > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ERROR : Vertex > failed, vertexName=Reducer 2, vertexId=vertex_1674594626929_0001_124_01, > diagnostics=[Task failed, taskId=task_1674594626929_0001_124_01_000000, > diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( > failure ) : > attempt_1674594626929_0001_124_01_000000_0:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.security.AccessController.doPrivileged(Native Method) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > java.base/javax.security.auth.Subject.doAs(Subject.java:423) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.lang.Thread.run(Thread.java:829) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ... 15 more > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: Caused by: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing vector batch (tag=0) (vectorizedVertexNum 1) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ... 18 more > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.ClassCastException > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ], TaskAttempt 1 > failed, info=[Error: Error while running task ( failure ) : > attempt_1674594626929_0001_124_01_000000_1:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.security.AccessController.doPrivileged(Native Method) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > java.base/javax.security.auth.Subject.doAs(Subject.java:423) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.lang.Thread.run(Thread.java:829) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ... 15 more > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: Caused by: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing vector batch (tag=0) (vectorizedVertexNum 1) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ... 18 more > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.ClassCastException: class java.lang.Byte cannot be cast to class > java.lang.Integer (java.lang.Byte and java.lang.Integer are in module > java.base of loader 'bootstrap') > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ColumnWriter$2.write(ColumnWriter.java:38) > 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetValueWriters$PrimitiveWriter.write(ParquetValueWriters.java:134) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetValueWriters$OptionWriter.write(ParquetValueWriters.java:342) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetValueWriters$StructWriter.write(ParquetValueWriters.java:562) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetWriter.add(ParquetWriter.java:131) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.DataWriter.write(DataWriter.java:61) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.RollingFileWriter.write(RollingFileWriter.java:86) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.RollingDataWriter.write(RollingDataWriter.java:33) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.ClusteredWriter.write(ClusteredWriter.java:103) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.ClusteredDataWriter.write(ClusteredDataWriter.java:32) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.mr.hive.writer.HiveIcebergRecordWriter.write(HiveIcebergRecordWriter.java:53) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:1168) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:980) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flushOutput(VectorGroupByOperator.java:1305) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.writeGroupRow(VectorGroupByOperator.java:1299) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.access$2300(VectorGroupByOperator.java:81) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeReduceMergePartial.doProcessBatch(VectorGroupByOperator.java:964) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeBase.processBatch(VectorGroupByOperator.java:198) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.process(VectorGroupByOperator.java:1250) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:498) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ... 19 more > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ], TaskAttempt 2 > failed, info=[Error: Error while running task ( failure ) : > attempt_1674594626929_0001_124_01_000000_2:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.security.AccessController.doPrivileged(Native Method) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > java.base/javax.security.auth.Subject.doAs(Subject.java:423) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.lang.Thread.run(Thread.java:829) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ... 15 more > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: Caused by: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing vector batch (tag=0) (vectorizedVertexNum 1) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ... 18 more > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.ClassCastException > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ], TaskAttempt 3 > failed, info=[Error: Error while running task ( failure ) : > attempt_1674594626929_0001_124_01_000000_3:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.security.AccessController.doPrivileged(Native Method) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > java.base/javax.security.auth.Subject.doAs(Subject.java:423) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.lang.Thread.run(Thread.java:829) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ... 15 more > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: Caused by: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing vector batch (tag=0) (vectorizedVertexNum 1) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ... 18 more > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.ClassCastException: class java.lang.Byte cannot be cast to class > java.lang.Integer (java.lang.Byte and java.lang.Integer are in module > java.base of loader 'bootstrap') > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ColumnWriter$2.write(ColumnWriter.java:38) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetValueWriters$PrimitiveWriter.write(ParquetValueWriters.java:134) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetValueWriters$OptionWriter.write(ParquetValueWriters.java:342) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetValueWriters$StructWriter.write(ParquetValueWriters.java:562) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetWriter.add(ParquetWriter.java:131) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.DataWriter.write(DataWriter.java:61) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.RollingFileWriter.write(RollingFileWriter.java:86) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.RollingDataWriter.write(RollingDataWriter.java:33) > 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.ClusteredWriter.write(ClusteredWriter.java:103) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.ClusteredDataWriter.write(ClusteredDataWriter.java:32) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.mr.hive.writer.HiveIcebergRecordWriter.write(HiveIcebergRecordWriter.java:53) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:1168) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:980) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flushOutput(VectorGroupByOperator.java:1305) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.writeGroupRow(VectorGroupByOperator.java:1299) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.access$2300(VectorGroupByOperator.java:81) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeReduceMergePartial.doProcessBatch(VectorGroupByOperator.java:964) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeBase.processBatch(VectorGroupByOperator.java:198) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.process(VectorGroupByOperator.java:1250) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:498) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: ... 19 more > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: ]], Vertex did > not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:1, Vertex > vertex_1674594626929_0001_124_01 [Reducer 2] killed/failed due > to:OWN_TASK_FAILURE] > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: ERROR : Vertex > killed, vertexName=Reducer 3, vertexId=vertex_1674594626929_0001_124_02, > diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not > succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex > vertex_1674594626929_0001_124_02 [Reducer 3] killed/failed due > to:OTHER_VERTEX_FAILURE] > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: ERROR : DAG did > not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > org.apache.tez.common.counters.DAGCounter: > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > NUM_FAILED_TASKS: 7 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > NUM_KILLED_TASKS: 1 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > NUM_SUCCEEDED_TASKS: 1 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > TOTAL_LAUNCHED_TASKS: 9 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > DATA_LOCAL_TASKS: 1 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > AM_CPU_MILLISECONDS: 980 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > AM_GC_TIME_MILLIS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : File > System Counters: > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > FILE_BYTES_READ: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > FILE_BYTES_WRITTEN: 21689 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > FILE_READ_OPS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > FILE_LARGE_READ_OPS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > FILE_WRITE_OPS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > LLAPCACHE_BYTES_READ: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > LLAPCACHE_BYTES_WRITTEN: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > LLAPCACHE_READ_OPS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > LLAPCACHE_LARGE_READ_OPS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > LLAPCACHE_WRITE_OPS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > S3A_BYTES_READ: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > S3A_BYTES_WRITTEN: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > S3A_READ_OPS: 2 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > S3A_LARGE_READ_OPS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > S3A_WRITE_OPS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > org.apache.tez.common.counters.TaskCounter: > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > SPILLED_RECORDS: 4699 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > TASK_DURATION_MILLIS: 115 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > INPUT_RECORDS_PROCESSED: 98 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > INPUT_SPLIT_LENGTH_BYTES: 6193255 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > OUTPUT_RECORDS: 4699 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > OUTPUT_LARGE_RECORDS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > OUTPUT_BYTES: 42310 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > OUTPUT_BYTES_WITH_OVERHEAD: 51720 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > OUTPUT_BYTES_PHYSICAL: 21633 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > ADDITIONAL_SPILLS_BYTES_WRITTEN: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > ADDITIONAL_SPILLS_BYTES_READ: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > ADDITIONAL_SPILL_COUNT: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > SHUFFLE_CHUNK_COUNT: 1 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : HIVE: > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > DESERIALIZE_ERRORS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > RECORDS_IN_Map_1: 100000 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > RECORDS_OUT_INTERMEDIATE_Map_1: 4699 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > RECORDS_OUT_OPERATOR_FIL_19: 4718 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > RECORDS_OUT_OPERATOR_GBY_20: 4699 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > RECORDS_OUT_OPERATOR_MAP_0: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > RECORDS_OUT_OPERATOR_RS_21: 4699 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > RECORDS_OUT_OPERATOR_TS_0: 100000 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > org.apache.hadoop.hive.llap.counters.LlapWmCounters: > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > GUARANTEED_QUEUED_NS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > GUARANTEED_RUNNING_NS: 0 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > SPECULATIVE_QUEUED_NS: 76277 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > SPECULATIVE_RUNNING_NS: 113146858 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable$LlapExecutorCounters: > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > EXECUTOR_CPU_NS: 49230478 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > EXECUTOR_USER_NS: 40000000 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > org.apache.hadoop.hive.ql.exec.tez.HiveInputCounters: > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > GROUPED_INPUT_SPLITS_Map_1: 1 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > INPUT_DIRECTORIES_Map_1: 1 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > INPUT_FILES_Map_1: 1 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : > RAW_INPUT_SPLITS_Map_1: 1 > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: ERROR : FAILED: > Execution Error, return code 2 from > org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Reducer > 2, vertexId=vertex_1674594626929_0001_124_01, diagnostics=[Task failed, > taskId=task_1674594626929_0001_124_01_000000, diagnostics=[TaskAttempt 0 > failed, info=[Error: Error while running task ( failure ) : > attempt_1674594626929_0001_124_01_000000_0:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.security.AccessController.doPrivileged(Native Method) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > java.base/javax.security.auth.Subject.doAs(Subject.java:423) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.lang.Thread.run(Thread.java:829) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 15 more > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing vector batch (tag=0) (vectorizedVertexNum 1) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 18 more > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.ClassCastException > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ], TaskAttempt 1 > failed, info=[Error: Error while running task ( failure ) : > attempt_1674594626929_0001_124_01_000000_1:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.security.AccessController.doPrivileged(Native Method) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > java.base/javax.security.auth.Subject.doAs(Subject.java:423) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.lang.Thread.run(Thread.java:829) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 15 more > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing vector batch (tag=0) (vectorizedVertexNum 1) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 18 more > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.ClassCastException: class java.lang.Byte cannot be cast to class > java.lang.Integer (java.lang.Byte and java.lang.Integer are in module > java.base of loader 'bootstrap') > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ColumnWriter$2.write(ColumnWriter.java:38) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetValueWriters$PrimitiveWriter.write(ParquetValueWriters.java:134) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetValueWriters$OptionWriter.write(ParquetValueWriters.java:342) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetValueWriters$StructWriter.write(ParquetValueWriters.java:562) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetWriter.add(ParquetWriter.java:131) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.DataWriter.write(DataWriter.java:61) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.RollingFileWriter.write(RollingFileWriter.java:86) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.RollingDataWriter.write(RollingDataWriter.java:33) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.ClusteredWriter.write(ClusteredWriter.java:103) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.ClusteredDataWriter.write(ClusteredDataWriter.java:32) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.mr.hive.writer.HiveIcebergRecordWriter.write(HiveIcebergRecordWriter.java:53) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:1168) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:980) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flushOutput(VectorGroupByOperator.java:1305) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.writeGroupRow(VectorGroupByOperator.java:1299) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.access$2300(VectorGroupByOperator.java:81) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeReduceMergePartial.doProcessBatch(VectorGroupByOperator.java:964) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeBase.processBatch(VectorGroupByOperator.java:198) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.process(VectorGroupByOperator.java:1250) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:498) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 19 more > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ], TaskAttempt 2 > failed, info=[Error: Error while running task ( failure ) : > attempt_1674594626929_0001_124_01_000000_2:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.security.AccessController.doPrivileged(Native Method) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > java.base/javax.security.auth.Subject.doAs(Subject.java:423) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.lang.Thread.run(Thread.java:829) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 15 more > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing vector batch (tag=0) (vectorizedVertexNum 1) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400) > 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 18 more > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.ClassCastException > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: ], TaskAttempt 3 > failed, info=[Error: Error while running task ( failure ) : > attempt_1674594626929_0001_124_01_000000_3:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.security.AccessController.doPrivileged(Native Method) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > java.base/javax.security.auth.Subject.doAs(Subject.java:423) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > java.base/java.lang.Thread.run(Thread.java:829) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: ... 15 more > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: Caused by: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing vector batch (tag=0) (vectorizedVertexNum 1) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: ... 18 more > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: Caused by: > java.lang.ClassCastException: class java.lang.Byte cannot be cast to class > java.lang.Integer (java.lang.Byte and java.lang.Integer are in module > java.base of loader 'bootstrap') > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ColumnWriter$2.write(ColumnWriter.java:38) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetValueWriters$PrimitiveWriter.write(ParquetValueWriters.java:134) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetValueWriters$OptionWriter.write(ParquetValueWriters.java:342) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetValueWriters$StructWriter.write(ParquetValueWriters.java:562) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.parquet.ParquetWriter.add(ParquetWriter.java:131) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.DataWriter.write(DataWriter.java:61) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.RollingFileWriter.write(RollingFileWriter.java:86) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.RollingDataWriter.write(RollingDataWriter.java:33) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.ClusteredWriter.write(ClusteredWriter.java:103) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.io.ClusteredDataWriter.write(ClusteredDataWriter.java:32) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.iceberg.mr.hive.writer.HiveIcebergRecordWriter.write(HiveIcebergRecordWriter.java:53) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:1168) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:980) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flushOutput(VectorGroupByOperator.java:1305) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.writeGroupRow(VectorGroupByOperator.java:1299) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.access$2300(VectorGroupByOperator.java:81) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeReduceMergePartial.doProcessBatch(VectorGroupByOperator.java:964) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeBase.processBatch(VectorGroupByOperator.java:198) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.process(VectorGroupByOperator.java:1250) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:498) > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: ... 19 more > 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: ]], Vertex did > not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:1, Vertex > vertex_1674594626929_0001_124_01 [Reducer 2] killed/failed due > to:OWN_TASK_FAILURE]Vertex killed, vertexName=Reducer 3, > vertexId=vertex_1674594626929_0001_124_02, diagnostics=[Vertex received Kill > while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, > failedTasks:0 killedTasks:1, Vertex vertex_1674594626929_0001_124_02 [Reducer > 3] killed/failed due to:OTHER_VERTEX_FAILURE]DAG did not succeed due to > VERTEX_FAILURE. failedVertices:1 killedVertices:1 > 2023-01-24T21:37:00,129 INFO [Thread-402] jdbc.TestDriver: INFO : Completed > executing > command(queryId=hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d); > Time taken: 36.038 seconds > 2023-01-24T21:37:00,129 INFO [Thread-402] jdbc.TestDriver: INFO : OK > 2023-01-24T21:37:00,489 ERROR [pool-38-thread-1] jdbc.TestDriver: Error while > compiling statement: FAILED: Execution Error, return code 2 from > org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Reducer > 2, vertexId=vertex_1674594626929_0001_124_01, diagnostics=[Task failed, > taskId=task_1674594626929_0001_124_01_000000, diagnostics=[TaskAttempt 0 > failed, info=[Error: Error while running task ( failure ) : > attempt_1674594626929_0001_124_01_000000_0:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351) > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374) > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > at java.base/java.security.AccessController.doPrivileged(Native Method) > at java.base/javax.security.auth.Subject.doAs(Subject.java:423) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > at > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118) > at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > at java.base/java.lang.Thread.run(Thread.java:829) > Caused by: java.lang.RuntimeException: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing vector batch (tag=0) (vectorizedVertexNum 1) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318) > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297) > ... 15 more > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime > Error while processing vector batch (tag=0) (vectorizedVertexNum 1) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400) > ... 18 more > Caused by: java.lang.ClassCastException > ], TaskAttempt 1 failed, info=[Error: Error while running task ( failure ) : > attempt_1674594626929_0001_124_01_000000_1:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351) > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374) > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > at java.base/java.security.AccessController.doPrivileged(Native Method) > at java.base/javax.security.auth.Subject.doAs(Subject.java:423) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > at > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118) > at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > at java.base/java.lang.Thread.run(Thread.java:829) > Caused by: java.lang.RuntimeException: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing vector batch (tag=0) (vectorizedVertexNum 1) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318) > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297) > ... 15 more > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime > Error while processing vector batch (tag=0) (vectorizedVertexNum 1) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400) > ... 18 more > Caused by: java.lang.ClassCastException: class java.lang.Byte cannot be cast > to class java.lang.Integer (java.lang.Byte and java.lang.Integer are in > module java.base of loader 'bootstrap') > at org.apache.iceberg.parquet.ColumnWriter$2.write(ColumnWriter.java:38) > at > org.apache.iceberg.parquet.ParquetValueWriters$PrimitiveWriter.write(ParquetValueWriters.java:134) > at > org.apache.iceberg.parquet.ParquetValueWriters$OptionWriter.write(ParquetValueWriters.java:342) > at > org.apache.iceberg.parquet.ParquetValueWriters$StructWriter.write(ParquetValueWriters.java:562) > at org.apache.iceberg.parquet.ParquetWriter.add(ParquetWriter.java:131) > at org.apache.iceberg.io.DataWriter.write(DataWriter.java:61) > at > org.apache.iceberg.io.RollingFileWriter.write(RollingFileWriter.java:86) > at > org.apache.iceberg.io.RollingDataWriter.write(RollingDataWriter.java:33) > at org.apache.iceberg.io.ClusteredWriter.write(ClusteredWriter.java:103) > at > org.apache.iceberg.io.ClusteredDataWriter.write(ClusteredDataWriter.java:32) > at > org.apache.iceberg.mr.hive.writer.HiveIcebergRecordWriter.write(HiveIcebergRecordWriter.java:53) > at > org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:1168) > at > org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111) > at > org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:980) > at > org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158) > at > org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968) > at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flushOutput(VectorGroupByOperator.java:1305) > at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.writeGroupRow(VectorGroupByOperator.java:1299) > at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.access$2300(VectorGroupByOperator.java:81) > at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeReduceMergePartial.doProcessBatch(VectorGroupByOperator.java:964) > at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeBase.processBatch(VectorGroupByOperator.java:198) > at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.process(VectorGroupByOperator.java:1250) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:498) > ... 19 more > ], TaskAttempt 2 failed, info=[Error: Error while running task ( failure ) : > attempt_1674594626929_0001_124_01_000000_2:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351) > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374) > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > at java.base/java.security.AccessController.doPrivileged(Native Method) > at java.base/javax.security.auth.Subject.doAs(Subject.java:423) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > at > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118) > at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > at java.base/java.lang.Thread.run(Thread.java:829) > Caused by: java.lang.RuntimeException: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing vector batch (tag=0) (vectorizedVertexNum 1) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318) > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297) > ... 15 more > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime > Error while processing vector batch (tag=0) (vectorizedVertexNum 1) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400) > ... 18 more > Caused by: java.lang.ClassCastException > ], TaskAttempt 3 failed, info=[Error: Error while running task ( failure ) : > attempt_1674594626929_0001_124_01_000000_3:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum > 1) > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351) > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374) > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > at java.base/java.security.AccessController.doPrivileged(Native Method) > at java.base/javax.security.auth.Subject.doAs(Subject.java:423) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > at > org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118) > at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > at java.base/java.lang.Thread.run(Thread.java:829) > Caused by: java.lang.RuntimeException: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing vector batch (tag=0) (vectorizedVertexNum 1) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318) > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297) > ... 15 more > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime > Error while processing vector batch (tag=0) (vectorizedVertexNum 1) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400) > ... 18 more > Caused by: java.lang.ClassCastException: class java.lang.Byte cannot be cast > to class java.lang.Integer (java.lang.Byte and java.lang.Integer are in > module java.base of loader 'bootstrap') > at org.apache.iceberg.parquet.ColumnWriter$2.write(ColumnWriter.java:38) > at > org.apache.iceberg.parquet.ParquetValueWriters$PrimitiveWriter.write(ParquetValueWriters.java:134) > at > org.apache.iceberg.parquet.ParquetValueWriters$OptionWriter.write(ParquetValueWriters.java:342) > at > org.apache.iceberg.parquet.ParquetValueWriters$StructWriter.write(ParquetValueWriters.java:562) > at org.apache.iceberg.parquet.ParquetWriter.add(ParquetWriter.java:131) > at org.apache.iceberg.io.DataWriter.write(DataWriter.java:61) > at > org.apache.iceberg.io.RollingFileWriter.write(RollingFileWriter.java:86) > at > org.apache.iceberg.io.RollingDataWriter.write(RollingDataWriter.java:33) > at org.apache.iceberg.io.ClusteredWriter.write(ClusteredWriter.java:103) > at > org.apache.iceberg.io.ClusteredDataWriter.write(ClusteredDataWriter.java:32) > at > org.apache.iceberg.mr.hive.writer.HiveIcebergRecordWriter.write(HiveIcebergRecordWriter.java:53) > at > org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:1168) > at > org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111) > at > org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:980) > at > org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158) > at > org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968) > at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flushOutput(VectorGroupByOperator.java:1305) > at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.writeGroupRow(VectorGroupByOperator.java:1299) > at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.access$2300(VectorGroupByOperator.java:81) > at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeReduceMergePartial.doProcessBatch(VectorGroupByOperator.java:964) > at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeBase.processBatch(VectorGroupByOperator.java:198) > at > org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.process(VectorGroupByOperator.java:1250) > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:498) > ... 19 more > ]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 > killedTasks:1, Vertex vertex_1674594626929_0001_124_01 [Reducer 2] > killed/failed due to:OWN_TASK_FAILURE]Vertex killed, vertexName=Reducer 3, > vertexId=vertex_1674594626929_0001_124_02, diagnostics=[Vertex received Kill > while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, > failedTasks:0 killedTasks:1, Vertex vertex_1674594626929_0001_124_02 [Reducer > 3] killed/failed due to:OTHER_VERTEX_FAILURE]DAG did not succeed due to > VERTEX_FAILURE. failedVertices:1 killedVertices:1 > 2023-01-24T21:37:00,520 INFO [pool-2-thread-1] jdbc.TestDriver: Ending Test > at 2023-01-24 21:37:00,520 > 2023-01-24T21:37:00,520 INFO [pool-2-thread-1] jdbc.TestDriver: TEST FAILED > in 38 seconds. > 2023-01-24T21:37:00,520 INFO [pool-2-thread-1] jdbc.TestDriver: Annotations: > [canary_sqlcoverage, canary_complexquery, pvc_ozone]{code} > > SQL Test > {code:java} > !!! annotations canary_sqlcoverage canary_complexquery pvc_ozone > >>> set hive.cbo.enable=true; > >>> set hive.materializedview.rewriting; > hive.materializedview.rewriting=true > >>> set iceberg.mr.schema.auto.conversion=true; > >>> drop materialized view if exists mv_project; > >>> create materialized view mv_project stored by iceberg as select t, si, > >>> avg(t) from all100k where t>115 group by t, si; > No rows affected > >>> analyze table mv_project compute statistics for columns; > No rows affected > >>> set hive.explain.user=false; > >>> explain select t, avg(t) from all100k where t>115 group by t, si; > !!! match row_contains > alias: default.mv_project > >>> drop materialized view mv_project; > {code} > > Source table > {code:java} > create external table all100k_txt( > t tinyint, > si smallint, > i int, > b bigint, > f float, > d double, > s string, > dc decimal(38,18), > bo boolean, > v varchar(25), > c char(25), > ts timestamp, > dt date) > row format delimited > fields terminated by '|' > stored as textfile > location 's3a://dwx-testdata/user/hrt_qa/tgtnv/core/tests/data/all100k'; > create table all100k stored as parquet as select * from all100k_txt;{code} -- This message was sent by Atlassian Jira (v8.20.10#820010)