[
https://issues.apache.org/jira/browse/HIVE-26980?focusedWorklogId=841998&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-841998
]
ASF GitHub Bot logged work on HIVE-26980:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 27/Jan/23 14:29
Start Date: 27/Jan/23 14:29
Worklog Time Spent: 10m
Work Description: kasakrisz opened a new pull request, #3993:
URL: https://github.com/apache/hive/pull/3993
…source table has tinyint column
<!--
Thanks for sending a pull request! Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://cwiki.apache.org/confluence/display/Hive/HowToContribute
2. Ensure that you have created an issue on the Hive project JIRA:
https://issues.apache.org/jira/projects/HIVE/summary
3. Ensure you have added or run the appropriate tests for your PR:
4. If the PR is unfinished, add '[WIP]' in your PR title, e.g.,
'[WIP]HIVE-XXXXX: Your PR title ...'.
5. Be sure to keep the PR description updated to reflect all changes.
6. Please write your PR title to summarize what this PR proposes.
7. If possible, provide a concise example to reproduce the issue for a
faster review.
-->
### What changes were proposed in this pull request?
Some Hive column datatypes are currently not supported by Iceberg. In case
of CTAS statements and materialized views Hive converts some of the source
table column types to a compatible Iceberg column type.
For the conversion a select operator is generated. The number of input and
output columns has to be the same. The number of output columns also depends on
dynamic partitioning but in case of Iceberg target table partitioning is
handled by the storage handler so it should be ignored.
### Why are the changes needed?
To support partitioned materialized view stored by iceberg and to support
ctas statements which create tables stored by Iceberg but the source
table/query has a column datatype which is not supported by Iceberg.
### Does this PR introduce _any_ user-facing change?
No. But such statements runs successfuly.
### How was this patch tested?
```
mvn test -Dtest.output.overwrite -Dtest=TestIcebergCliDriver
-Dqfile=ctas_iceberg_orc.q,mv_iceberg_partitioned_orc.q,mv_iceberg_partitioned_orc2.q
-pl itests/qtest-iceberg -Piceberg -Pitests
```
Issue Time Tracking
-------------------
Worklog Id: (was: 841998)
Remaining Estimate: 0h
Time Spent: 10m
> Creation of materialized view stored by Iceberg fails if source table has
> tinyint column
> ----------------------------------------------------------------------------------------
>
> Key: HIVE-26980
> URL: https://issues.apache.org/jira/browse/HIVE-26980
> Project: Hive
> Issue Type: Bug
> Components: Iceberg integration
> Reporter: Dharmik Thakkar
> Assignee: Krisztian Kasa
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> MV creation using iceberg storage format for Hive table containing tinyint
> column fails with error "java.lang.ClassCastException: class java.lang.Byte
> cannot be cast to class java.lang.Integer"
> Logs
> {code:java}
> 2023-01-24T21:36:22,153 INFO [pool-2-thread-1] jdbc.TestDriver: Beginning
> Test at 2023-01-24 21:36:22,153
> 2023-01-24T21:36:22,154 INFO [pool-2-thread-1] jdbc.TestDriver: BEGIN MAIN
> 2023-01-24T21:36:22,155 INFO [pool-38-thread-1] jdbc.TestDriver: Running
> SessionGroup{name='SG_TNMECIDQ31', initialDelay=0, repeats=1, repeatDelay=0}
> 2023-01-24T21:36:22,155 INFO [pool-38-thread-1] jdbc.TestDriver: Connecting
> as user 'hrt_qa'
> 2023-01-24T21:36:22,409 INFO [pool-38-thread-1] jdbc.TestDriver: Query: set
> hive.cbo.enable=true
> 2023-01-24T21:36:22,619 INFO [pool-38-thread-1] jdbc.TestDriver: No output
> to verify
> 2023-01-24T21:36:22,619 INFO [pool-38-thread-1] jdbc.TestDriver: Query: set
> hive.materializedview.rewriting
> 2023-01-24T21:36:22,946 INFO [pool-38-thread-1] jdbc.TestDriver: Query: set
> iceberg.mr.schema.auto.conversion=true
> 2023-01-24T21:36:23,183 INFO [pool-38-thread-1] jdbc.TestDriver: No output
> to verify
> 2023-01-24T21:36:23,183 INFO [pool-38-thread-1] jdbc.TestDriver: Query: drop
> materialized view if exists mv_project
> 2023-01-24T21:36:23,243 INFO [Thread-401] jdbc.TestDriver: INFO : Compiling
> command(queryId=hive_20230124213623_e80df624-1ca6-4487-9f4b-616f756f91b3):
> drop materialized view if exists mv_project
> 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : Semantic
> Analysis Completed (retrial = false)
> 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : Created
> Hive schema: Schema(fieldSchemas:null, properties:null)
> 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : Completed
> compiling
> command(queryId=hive_20230124213623_e80df624-1ca6-4487-9f4b-616f756f91b3);
> Time taken: 0.03 seconds
> 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : Executing
> command(queryId=hive_20230124213623_e80df624-1ca6-4487-9f4b-616f756f91b3):
> drop materialized view if exists mv_project
> 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : Starting
> task [Stage-0:DDL] in serial mode
> 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : Completed
> executing
> command(queryId=hive_20230124213623_e80df624-1ca6-4487-9f4b-616f756f91b3);
> Time taken: 0.008 seconds
> 2023-01-24T21:36:23,302 INFO [Thread-401] jdbc.TestDriver: INFO : OK
> 2023-01-24T21:36:23,423 INFO [pool-38-thread-1] jdbc.TestDriver: No output
> to verify
> 2023-01-24T21:36:23,423 INFO [pool-38-thread-1] jdbc.TestDriver: Query:
> create materialized view mv_project stored by iceberg as select t, si, avg(t)
> from all100k where t>115 group by t, si
> 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Compiling
> command(queryId=hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d):
> create materialized view mv_project stored by iceberg as select t, si, avg(t)
> from all100k where t>115 group by t, si
> 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Semantic
> Analysis Completed (retrial = false)
> 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Created
> Hive schema: Schema(fieldSchemas:[FieldSchema(name:t, type:tinyint,
> comment:null), FieldSchema(name:si, type:smallint, comment:null),
> FieldSchema(name:_c2, type:double, comment:null)], properties:null)
> 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Completed
> compiling
> command(queryId=hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d);
> Time taken: 0.535 seconds
> 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Executing
> command(queryId=hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d):
> create materialized view mv_project stored by iceberg as select t, si, avg(t)
> from all100k where t>115 group by t, si
> 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Compute
> 'qe-vw-dwx-hive-snwh' is active.
> 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Query ID
> = hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d
> 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Total
> jobs = 1
> 2023-01-24T21:36:24,015 INFO [Thread-402] jdbc.TestDriver: INFO : Starting
> task [Stage-4:DDL] in serial mode
> 2023-01-24T21:36:25,697 INFO [Thread-402] jdbc.TestDriver: INFO : Starting
> task [Stage-5:DDL] in serial mode
> 2023-01-24T21:36:25,697 INFO [Thread-402] jdbc.TestDriver: INFO : Launching
> Job 1 out of 1
> 2023-01-24T21:36:25,697 INFO [Thread-402] jdbc.TestDriver: INFO : Starting
> task [Stage-1:MAPRED] in serial mode
> 2023-01-24T21:36:25,697 INFO [Thread-402] jdbc.TestDriver: INFO :
> Subscribed to counters: [] for queryId:
> hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d
> 2023-01-24T21:36:25,697 INFO [Thread-402] jdbc.TestDriver: INFO : Tez
> session hasn't been created yet. Opening session
> 2023-01-24T21:36:25,697 INFO [Thread-402] jdbc.TestDriver: INFO : Dag name:
> create materialized view mv_project sto...si (Stage-1)
> 2023-01-24T21:36:26,257 INFO [Thread-402] jdbc.TestDriver: INFO : HS2 Host:
> [hiveserver2-0], Query ID:
> [hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d], Dag ID:
> [dag_1674594626929_0001_124], DAG Session ID: [application_1674594626929_0001]
> 2023-01-24T21:36:26,818 INFO [Thread-402] jdbc.TestDriver: INFO : Status:
> Running (Executing on YARN cluster with App id application_1674594626929_0001)
> 2023-01-24T21:36:26,818 INFO [Thread-402] jdbc.TestDriver:
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ERROR : Status:
> Failed
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ERROR : Vertex
> failed, vertexName=Reducer 2, vertexId=vertex_1674594626929_0001_124_01,
> diagnostics=[Task failed, taskId=task_1674594626929_0001_124_01_000000,
> diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task (
> failure ) :
> attempt_1674594626929_0001_124_01_000000_0:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.security.AccessController.doPrivileged(Native Method)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.lang.Thread.run(Thread.java:829)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ... 15 more
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: Caused by:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing vector batch (tag=0) (vectorizedVertexNum 1)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ... 18 more
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.ClassCastException
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ], TaskAttempt 1
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1674594626929_0001_124_01_000000_1:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.security.AccessController.doPrivileged(Native Method)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.lang.Thread.run(Thread.java:829)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ... 15 more
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: Caused by:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing vector batch (tag=0) (vectorizedVertexNum 1)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: ... 18 more
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.ClassCastException: class java.lang.Byte cannot be cast to class
> java.lang.Integer (java.lang.Byte and java.lang.Integer are in module
> java.base of loader 'bootstrap')
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ColumnWriter$2.write(ColumnWriter.java:38)
> 2023-01-24T21:36:59,705 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetValueWriters$PrimitiveWriter.write(ParquetValueWriters.java:134)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetValueWriters$OptionWriter.write(ParquetValueWriters.java:342)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetValueWriters$StructWriter.write(ParquetValueWriters.java:562)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetWriter.add(ParquetWriter.java:131)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.DataWriter.write(DataWriter.java:61)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.RollingFileWriter.write(RollingFileWriter.java:86)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.RollingDataWriter.write(RollingDataWriter.java:33)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.ClusteredWriter.write(ClusteredWriter.java:103)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.ClusteredDataWriter.write(ClusteredDataWriter.java:32)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.mr.hive.writer.HiveIcebergRecordWriter.write(HiveIcebergRecordWriter.java:53)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:1168)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:980)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flushOutput(VectorGroupByOperator.java:1305)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.writeGroupRow(VectorGroupByOperator.java:1299)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.access$2300(VectorGroupByOperator.java:81)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeReduceMergePartial.doProcessBatch(VectorGroupByOperator.java:964)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeBase.processBatch(VectorGroupByOperator.java:198)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.process(VectorGroupByOperator.java:1250)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:498)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ... 19 more
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ], TaskAttempt 2
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1674594626929_0001_124_01_000000_2:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.security.AccessController.doPrivileged(Native Method)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.lang.Thread.run(Thread.java:829)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ... 15 more
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: Caused by:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing vector batch (tag=0) (vectorizedVertexNum 1)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ... 18 more
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.ClassCastException
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ], TaskAttempt 3
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1674594626929_0001_124_01_000000_3:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.security.AccessController.doPrivileged(Native Method)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.lang.Thread.run(Thread.java:829)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ... 15 more
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: Caused by:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing vector batch (tag=0) (vectorizedVertexNum 1)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: ... 18 more
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.ClassCastException: class java.lang.Byte cannot be cast to class
> java.lang.Integer (java.lang.Byte and java.lang.Integer are in module
> java.base of loader 'bootstrap')
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ColumnWriter$2.write(ColumnWriter.java:38)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetValueWriters$PrimitiveWriter.write(ParquetValueWriters.java:134)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetValueWriters$OptionWriter.write(ParquetValueWriters.java:342)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetValueWriters$StructWriter.write(ParquetValueWriters.java:562)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetWriter.add(ParquetWriter.java:131)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.DataWriter.write(DataWriter.java:61)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.RollingFileWriter.write(RollingFileWriter.java:86)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.RollingDataWriter.write(RollingDataWriter.java:33)
> 2023-01-24T21:36:59,706 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.ClusteredWriter.write(ClusteredWriter.java:103)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.ClusteredDataWriter.write(ClusteredDataWriter.java:32)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.mr.hive.writer.HiveIcebergRecordWriter.write(HiveIcebergRecordWriter.java:53)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:1168)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:980)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flushOutput(VectorGroupByOperator.java:1305)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.writeGroupRow(VectorGroupByOperator.java:1299)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.access$2300(VectorGroupByOperator.java:81)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeReduceMergePartial.doProcessBatch(VectorGroupByOperator.java:964)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeBase.processBatch(VectorGroupByOperator.java:198)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.process(VectorGroupByOperator.java:1250)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:498)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: ... 19 more
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: ]], Vertex did
> not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:1, Vertex
> vertex_1674594626929_0001_124_01 [Reducer 2] killed/failed due
> to:OWN_TASK_FAILURE]
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: ERROR : Vertex
> killed, vertexName=Reducer 3, vertexId=vertex_1674594626929_0001_124_02,
> diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not
> succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex
> vertex_1674594626929_0001_124_02 [Reducer 3] killed/failed due
> to:OTHER_VERTEX_FAILURE]
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: ERROR : DAG did
> not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> org.apache.tez.common.counters.DAGCounter:
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> NUM_FAILED_TASKS: 7
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> NUM_KILLED_TASKS: 1
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> NUM_SUCCEEDED_TASKS: 1
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> TOTAL_LAUNCHED_TASKS: 9
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> DATA_LOCAL_TASKS: 1
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> AM_CPU_MILLISECONDS: 980
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> AM_GC_TIME_MILLIS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : File
> System Counters:
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> FILE_BYTES_READ: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> FILE_BYTES_WRITTEN: 21689
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> FILE_READ_OPS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> FILE_LARGE_READ_OPS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> FILE_WRITE_OPS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> LLAPCACHE_BYTES_READ: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> LLAPCACHE_BYTES_WRITTEN: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> LLAPCACHE_READ_OPS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> LLAPCACHE_LARGE_READ_OPS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> LLAPCACHE_WRITE_OPS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> S3A_BYTES_READ: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> S3A_BYTES_WRITTEN: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> S3A_READ_OPS: 2
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> S3A_LARGE_READ_OPS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> S3A_WRITE_OPS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> org.apache.tez.common.counters.TaskCounter:
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> SPILLED_RECORDS: 4699
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> TASK_DURATION_MILLIS: 115
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> INPUT_RECORDS_PROCESSED: 98
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> INPUT_SPLIT_LENGTH_BYTES: 6193255
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> OUTPUT_RECORDS: 4699
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> OUTPUT_LARGE_RECORDS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> OUTPUT_BYTES: 42310
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> OUTPUT_BYTES_WITH_OVERHEAD: 51720
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> OUTPUT_BYTES_PHYSICAL: 21633
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> ADDITIONAL_SPILLS_BYTES_WRITTEN: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> ADDITIONAL_SPILLS_BYTES_READ: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> ADDITIONAL_SPILL_COUNT: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> SHUFFLE_CHUNK_COUNT: 1
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO : HIVE:
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> DESERIALIZE_ERRORS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> RECORDS_IN_Map_1: 100000
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> RECORDS_OUT_INTERMEDIATE_Map_1: 4699
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> RECORDS_OUT_OPERATOR_FIL_19: 4718
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> RECORDS_OUT_OPERATOR_GBY_20: 4699
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> RECORDS_OUT_OPERATOR_MAP_0: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> RECORDS_OUT_OPERATOR_RS_21: 4699
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> RECORDS_OUT_OPERATOR_TS_0: 100000
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> org.apache.hadoop.hive.llap.counters.LlapWmCounters:
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> GUARANTEED_QUEUED_NS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> GUARANTEED_RUNNING_NS: 0
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> SPECULATIVE_QUEUED_NS: 76277
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> SPECULATIVE_RUNNING_NS: 113146858
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable$LlapExecutorCounters:
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> EXECUTOR_CPU_NS: 49230478
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> EXECUTOR_USER_NS: 40000000
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> org.apache.hadoop.hive.ql.exec.tez.HiveInputCounters:
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> GROUPED_INPUT_SPLITS_Map_1: 1
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> INPUT_DIRECTORIES_Map_1: 1
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> INPUT_FILES_Map_1: 1
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: INFO :
> RAW_INPUT_SPLITS_Map_1: 1
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: ERROR : FAILED:
> Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Reducer
> 2, vertexId=vertex_1674594626929_0001_124_01, diagnostics=[Task failed,
> taskId=task_1674594626929_0001_124_01_000000, diagnostics=[TaskAttempt 0
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1674594626929_0001_124_01_000000_0:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.security.AccessController.doPrivileged(Native Method)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> 2023-01-24T21:36:59,707 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.lang.Thread.run(Thread.java:829)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 15 more
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing vector batch (tag=0) (vectorizedVertexNum 1)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 18 more
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.ClassCastException
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ], TaskAttempt 1
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1674594626929_0001_124_01_000000_1:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.security.AccessController.doPrivileged(Native Method)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.lang.Thread.run(Thread.java:829)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 15 more
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing vector batch (tag=0) (vectorizedVertexNum 1)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 18 more
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.ClassCastException: class java.lang.Byte cannot be cast to class
> java.lang.Integer (java.lang.Byte and java.lang.Integer are in module
> java.base of loader 'bootstrap')
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ColumnWriter$2.write(ColumnWriter.java:38)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetValueWriters$PrimitiveWriter.write(ParquetValueWriters.java:134)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetValueWriters$OptionWriter.write(ParquetValueWriters.java:342)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetValueWriters$StructWriter.write(ParquetValueWriters.java:562)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetWriter.add(ParquetWriter.java:131)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.DataWriter.write(DataWriter.java:61)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.RollingFileWriter.write(RollingFileWriter.java:86)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.RollingDataWriter.write(RollingDataWriter.java:33)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.ClusteredWriter.write(ClusteredWriter.java:103)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.ClusteredDataWriter.write(ClusteredDataWriter.java:32)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.mr.hive.writer.HiveIcebergRecordWriter.write(HiveIcebergRecordWriter.java:53)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:1168)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:980)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flushOutput(VectorGroupByOperator.java:1305)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.writeGroupRow(VectorGroupByOperator.java:1299)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.access$2300(VectorGroupByOperator.java:81)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeReduceMergePartial.doProcessBatch(VectorGroupByOperator.java:964)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeBase.processBatch(VectorGroupByOperator.java:198)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.process(VectorGroupByOperator.java:1250)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:498)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 19 more
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ], TaskAttempt 2
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1674594626929_0001_124_01_000000_2:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.security.AccessController.doPrivileged(Native Method)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.lang.Thread.run(Thread.java:829)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 15 more
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: Caused by:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing vector batch (tag=0) (vectorizedVertexNum 1)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400)
> 2023-01-24T21:36:59,708 INFO [Thread-402] jdbc.TestDriver: ... 18 more
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.ClassCastException
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: ], TaskAttempt 3
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1674594626929_0001_124_01_000000_3:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.security.AccessController.doPrivileged(Native Method)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> java.base/java.lang.Thread.run(Thread.java:829)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: ... 15 more
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: Caused by:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing vector batch (tag=0) (vectorizedVertexNum 1)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: ... 18 more
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: Caused by:
> java.lang.ClassCastException: class java.lang.Byte cannot be cast to class
> java.lang.Integer (java.lang.Byte and java.lang.Integer are in module
> java.base of loader 'bootstrap')
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ColumnWriter$2.write(ColumnWriter.java:38)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetValueWriters$PrimitiveWriter.write(ParquetValueWriters.java:134)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetValueWriters$OptionWriter.write(ParquetValueWriters.java:342)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetValueWriters$StructWriter.write(ParquetValueWriters.java:562)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.parquet.ParquetWriter.add(ParquetWriter.java:131)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.DataWriter.write(DataWriter.java:61)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.RollingFileWriter.write(RollingFileWriter.java:86)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.RollingDataWriter.write(RollingDataWriter.java:33)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.ClusteredWriter.write(ClusteredWriter.java:103)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.io.ClusteredDataWriter.write(ClusteredDataWriter.java:32)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.iceberg.mr.hive.writer.HiveIcebergRecordWriter.write(HiveIcebergRecordWriter.java:53)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:1168)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:980)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flushOutput(VectorGroupByOperator.java:1305)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.writeGroupRow(VectorGroupByOperator.java:1299)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.access$2300(VectorGroupByOperator.java:81)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeReduceMergePartial.doProcessBatch(VectorGroupByOperator.java:964)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeBase.processBatch(VectorGroupByOperator.java:198)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.process(VectorGroupByOperator.java:1250)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:498)
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: ... 19 more
> 2023-01-24T21:36:59,709 INFO [Thread-402] jdbc.TestDriver: ]], Vertex did
> not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:1, Vertex
> vertex_1674594626929_0001_124_01 [Reducer 2] killed/failed due
> to:OWN_TASK_FAILURE]Vertex killed, vertexName=Reducer 3,
> vertexId=vertex_1674594626929_0001_124_02, diagnostics=[Vertex received Kill
> while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
> failedTasks:0 killedTasks:1, Vertex vertex_1674594626929_0001_124_02 [Reducer
> 3] killed/failed due to:OTHER_VERTEX_FAILURE]DAG did not succeed due to
> VERTEX_FAILURE. failedVertices:1 killedVertices:1
> 2023-01-24T21:37:00,129 INFO [Thread-402] jdbc.TestDriver: INFO : Completed
> executing
> command(queryId=hive_20230124213623_e6e322e5-fa9b-4fb2-a3cb-ae244699ee5d);
> Time taken: 36.038 seconds
> 2023-01-24T21:37:00,129 INFO [Thread-402] jdbc.TestDriver: INFO : OK
> 2023-01-24T21:37:00,489 ERROR [pool-38-thread-1] jdbc.TestDriver: Error while
> compiling statement: FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Reducer
> 2, vertexId=vertex_1674594626929_0001_124_01, diagnostics=[Task failed,
> taskId=task_1674594626929_0001_124_01_000000, diagnostics=[TaskAttempt 0
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1674594626929_0001_124_01_000000_0:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
> at java.base/java.security.AccessController.doPrivileged(Native Method)
> at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: java.lang.RuntimeException:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing vector batch (tag=0) (vectorizedVertexNum 1)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297)
> ... 15 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime
> Error while processing vector batch (tag=0) (vectorizedVertexNum 1)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400)
> ... 18 more
> Caused by: java.lang.ClassCastException
> ], TaskAttempt 1 failed, info=[Error: Error while running task ( failure ) :
> attempt_1674594626929_0001_124_01_000000_1:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
> at java.base/java.security.AccessController.doPrivileged(Native Method)
> at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: java.lang.RuntimeException:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing vector batch (tag=0) (vectorizedVertexNum 1)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297)
> ... 15 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime
> Error while processing vector batch (tag=0) (vectorizedVertexNum 1)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400)
> ... 18 more
> Caused by: java.lang.ClassCastException: class java.lang.Byte cannot be cast
> to class java.lang.Integer (java.lang.Byte and java.lang.Integer are in
> module java.base of loader 'bootstrap')
> at org.apache.iceberg.parquet.ColumnWriter$2.write(ColumnWriter.java:38)
> at
> org.apache.iceberg.parquet.ParquetValueWriters$PrimitiveWriter.write(ParquetValueWriters.java:134)
> at
> org.apache.iceberg.parquet.ParquetValueWriters$OptionWriter.write(ParquetValueWriters.java:342)
> at
> org.apache.iceberg.parquet.ParquetValueWriters$StructWriter.write(ParquetValueWriters.java:562)
> at org.apache.iceberg.parquet.ParquetWriter.add(ParquetWriter.java:131)
> at org.apache.iceberg.io.DataWriter.write(DataWriter.java:61)
> at
> org.apache.iceberg.io.RollingFileWriter.write(RollingFileWriter.java:86)
> at
> org.apache.iceberg.io.RollingDataWriter.write(RollingDataWriter.java:33)
> at org.apache.iceberg.io.ClusteredWriter.write(ClusteredWriter.java:103)
> at
> org.apache.iceberg.io.ClusteredDataWriter.write(ClusteredDataWriter.java:32)
> at
> org.apache.iceberg.mr.hive.writer.HiveIcebergRecordWriter.write(HiveIcebergRecordWriter.java:53)
> at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:1168)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111)
> at
> org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:980)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158)
> at
> org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flushOutput(VectorGroupByOperator.java:1305)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.writeGroupRow(VectorGroupByOperator.java:1299)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.access$2300(VectorGroupByOperator.java:81)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeReduceMergePartial.doProcessBatch(VectorGroupByOperator.java:964)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeBase.processBatch(VectorGroupByOperator.java:198)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.process(VectorGroupByOperator.java:1250)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:498)
> ... 19 more
> ], TaskAttempt 2 failed, info=[Error: Error while running task ( failure ) :
> attempt_1674594626929_0001_124_01_000000_2:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
> at java.base/java.security.AccessController.doPrivileged(Native Method)
> at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: java.lang.RuntimeException:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing vector batch (tag=0) (vectorizedVertexNum 1)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297)
> ... 15 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime
> Error while processing vector batch (tag=0) (vectorizedVertexNum 1)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400)
> ... 18 more
> Caused by: java.lang.ClassCastException
> ], TaskAttempt 3 failed, info=[Error: Error while running task ( failure ) :
> attempt_1674594626929_0001_124_01_000000_3:java.lang.RuntimeException:
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum
> 1)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
> at java.base/java.security.AccessController.doPrivileged(Native Method)
> at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: java.lang.RuntimeException:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing vector batch (tag=0) (vectorizedVertexNum 1)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:409)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:257)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:297)
> ... 15 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime
> Error while processing vector batch (tag=0) (vectorizedVertexNum 1)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:511)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:400)
> ... 18 more
> Caused by: java.lang.ClassCastException: class java.lang.Byte cannot be cast
> to class java.lang.Integer (java.lang.Byte and java.lang.Integer are in
> module java.base of loader 'bootstrap')
> at org.apache.iceberg.parquet.ColumnWriter$2.write(ColumnWriter.java:38)
> at
> org.apache.iceberg.parquet.ParquetValueWriters$PrimitiveWriter.write(ParquetValueWriters.java:134)
> at
> org.apache.iceberg.parquet.ParquetValueWriters$OptionWriter.write(ParquetValueWriters.java:342)
> at
> org.apache.iceberg.parquet.ParquetValueWriters$StructWriter.write(ParquetValueWriters.java:562)
> at org.apache.iceberg.parquet.ParquetWriter.add(ParquetWriter.java:131)
> at org.apache.iceberg.io.DataWriter.write(DataWriter.java:61)
> at
> org.apache.iceberg.io.RollingFileWriter.write(RollingFileWriter.java:86)
> at
> org.apache.iceberg.io.RollingDataWriter.write(RollingDataWriter.java:33)
> at org.apache.iceberg.io.ClusteredWriter.write(ClusteredWriter.java:103)
> at
> org.apache.iceberg.io.ClusteredDataWriter.write(ClusteredDataWriter.java:32)
> at
> org.apache.iceberg.mr.hive.writer.HiveIcebergRecordWriter.write(HiveIcebergRecordWriter.java:53)
> at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:1168)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111)
> at
> org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:980)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158)
> at
> org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flushOutput(VectorGroupByOperator.java:1305)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.writeGroupRow(VectorGroupByOperator.java:1299)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.access$2300(VectorGroupByOperator.java:81)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeReduceMergePartial.doProcessBatch(VectorGroupByOperator.java:964)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator$ProcessingModeBase.processBatch(VectorGroupByOperator.java:198)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.process(VectorGroupByOperator.java:1250)
> at
> org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:498)
> ... 19 more
> ]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1
> killedTasks:1, Vertex vertex_1674594626929_0001_124_01 [Reducer 2]
> killed/failed due to:OWN_TASK_FAILURE]Vertex killed, vertexName=Reducer 3,
> vertexId=vertex_1674594626929_0001_124_02, diagnostics=[Vertex received Kill
> while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
> failedTasks:0 killedTasks:1, Vertex vertex_1674594626929_0001_124_02 [Reducer
> 3] killed/failed due to:OTHER_VERTEX_FAILURE]DAG did not succeed due to
> VERTEX_FAILURE. failedVertices:1 killedVertices:1
> 2023-01-24T21:37:00,520 INFO [pool-2-thread-1] jdbc.TestDriver: Ending Test
> at 2023-01-24 21:37:00,520
> 2023-01-24T21:37:00,520 INFO [pool-2-thread-1] jdbc.TestDriver: TEST FAILED
> in 38 seconds.
> 2023-01-24T21:37:00,520 INFO [pool-2-thread-1] jdbc.TestDriver: Annotations:
> [canary_sqlcoverage, canary_complexquery, pvc_ozone]{code}
>
> SQL Test
> {code:java}
> !!! annotations canary_sqlcoverage canary_complexquery pvc_ozone
> >>> set hive.cbo.enable=true;
> >>> set hive.materializedview.rewriting;
> hive.materializedview.rewriting=true
> >>> set iceberg.mr.schema.auto.conversion=true;
> >>> drop materialized view if exists mv_project;
> >>> create materialized view mv_project stored by iceberg as select t, si,
> >>> avg(t) from all100k where t>115 group by t, si;
> No rows affected
> >>> analyze table mv_project compute statistics for columns;
> No rows affected
> >>> set hive.explain.user=false;
> >>> explain select t, avg(t) from all100k where t>115 group by t, si;
> !!! match row_contains
> alias: default.mv_project
> >>> drop materialized view mv_project;
> {code}
>
> Source table
> {code:java}
> create external table all100k_txt(
> t tinyint,
> si smallint,
> i int,
> b bigint,
> f float,
> d double,
> s string,
> dc decimal(38,18),
> bo boolean,
> v varchar(25),
> c char(25),
> ts timestamp,
> dt date)
> row format delimited
> fields terminated by '|'
> stored as textfile
> location 's3a://dwx-testdata/user/hrt_qa/tgtnv/core/tests/data/all100k';
> create table all100k stored as parquet as select * from all100k_txt;{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
