Lei Su created HIVE-25094:
-----------------------------
Summary: when easily insert row with hive, got ERROR
exec.StatsTask: Failed to run stats task
Key: HIVE-25094
URL: https://issues.apache.org/jira/browse/HIVE-25094
Project: Hive
Issue Type: Bug
Components: Hive
Affects Versions: 3.1.2
Environment: OS: CentOS 7 based on VMWare 16
MEM:4G
DISK:40G
CPU: hostcpu: interl i5-10gen
HADOOP 3.1.3, one namenode, two datanode
HIVE 3.1.2 with metadata changed to mysql
Reporter: Lei Su
Dear profeesors,
As described, after installing hadoop 3.1.3 and hive 3.1.2, I easily insert one
row into a simple table with SQL
Hive> insert into test2 values ('aaa') ;
I got FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.StatsTask
Then I check into the detailed log, found it seems something wrong with the
hive stats task on coding level, part of the detailed logs as follows for your
reference
would you please kindly take a look and advise ?
thanks in advance and kind regards
Lei
"
2021-05-06T14:30:32,609 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
metastore.RetryingMetaStoreClient: RetryingMetaStoreClient trying reconnect as
root (auth:SIMPLE)
2021-05-06T14:30:32,609 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
metastore.HiveMetaStoreClient: Closed a connection to metastore, current
connections: 1
2021-05-06T14:30:32,610 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
metastore.HiveMetaStoreClient: Trying to connect to metastore with URI
thrift://master:9083
2021-05-06T14:30:32,610 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
metastore.HiveMetaStoreClient: Opened a connection to metastore, current
connections: 2
2021-05-06T14:30:32,611 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
metastore.HiveMetaStoreClient: Connected to metastore.
2021-05-06T14:30:32,657 ERROR [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
exec.StatsTask: Failed to run stats task
org.apache.hadoop.hive.ql.metadata.HiveException:
org.apache.thrift.transport.TTransportException
at
org.apache.hadoop.hive.ql.metadata.Hive.setPartitionColumnStatistics(Hive.java:4423)
~[hive-exec-3.1.2.jar:3.1.2]
at
org.apache.hadoop.hive.ql.stats.ColStatsProcessor.persistColumnStats(ColStatsProcessor.java:179)
~[hive-exec-3.1.2.jar:3.1.2]
at
org.apache.hadoop.hive.ql.stats.ColStatsProcessor.process(ColStatsProcessor.java:83)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.exec.StatsTask.execute(StatsTask.java:108)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:205)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2664)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2335)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2011)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1709)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1703)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:218)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239)
~[hive-cli-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188)
~[hive-cli-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402)
~[hive-cli-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821)
~[hive-cli-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759)
~[hive-cli-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683)
~[hive-cli-3.1.2.jar:3.1.2]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_212]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_212]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
at org.apache.hadoop.util.RunJar.run(RunJar.java:318)
~[hadoop-common-3.1.3.jar:?]
at org.apache.hadoop.util.RunJar.main(RunJar.java:232)
~[hadoop-common-3.1.3.jar:?]
Caused by: org.apache.thrift.transport.TTransportException
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
~[hive-exec-3.1.2.jar:3.1.2]
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
~[hive-exec-3.1.2.jar:3.1.2]
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
~[hive-exec-3.1.2.jar:3.1.2]
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
~[hive-exec-3.1.2.jar:3.1.2]
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_set_aggr_stats_for(ThriftHiveMetastore.java:4104)
~[hive-exec-3.1.2.jar:3.1.2]
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.set_aggr_stats_for(ThriftHiveMetastore.java:4091)
~[hive-exec-3.1.2.jar:3.1.2]
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.setPartitionColumnStatistics(HiveMetaStoreClient.java:1927)
~[hive-exec-3.1.2.jar:3.1.2]
at
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.setPartitionColumnStatistics(SessionHiveMetaStoreClient.java:409)
~[hive-exec-3.1.2.jar:3.1.2]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_212]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_212]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212)
~[hive-exec-3.1.2.jar:3.1.2]
at com.sun.proxy.$Proxy34.setPartitionColumnStatistics(Unknown Source) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_212]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_212]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler.invoke(HiveMetaStoreClient.java:2773)
~[hive-exec-3.1.2.jar:3.1.2]
at com.sun.proxy.$Proxy34.setPartitionColumnStatistics(Unknown Source) ~[?:?]
at
org.apache.hadoop.hive.ql.metadata.Hive.setPartitionColumnStatistics(Hive.java:4420)
~[hive-exec-3.1.2.jar:3.1.2]
... 24 more
2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
reexec.ReOptimizePlugin: ReOptimization: retryPossible: false
2021-05-06T14:30:32,657 ERROR [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
ql.Driver: FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.StatsTask
2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
ql.Driver: MapReduce Jobs Launched:
2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
ql.Driver: Stage-Stage-1: Map: 1 Reduce: 1 Cumulative CPU: 3.66 sec HDFS Read:
13193 HDFS Write: 203 SUCCESS
2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
ql.Driver: Total MapReduce CPU Time Spent: 3 seconds 660 msec
2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
ql.Driver: Completed executing
command(queryId=root_20210506143001_39fbd0ce-3360-40ba-948b-015f2ec166c5); Time
taken: 28.603 seconds
2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-05-06T14:30:32,702 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
conf.HiveConf: Using the default value passed in for log id:
38c1f98d-9d5a-4bb6-b052-e63eda036c08
2021-05-06T14:30:32,702 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main]
session.SessionState: Resetting thread name to main
"
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
