Jeff Tang created TEZ-4414:
------------------------------
Summary: Tez job failed with hudi table query
Key: TEZ-4414
URL: https://issues.apache.org/jira/browse/TEZ-4414
Project: Apache Tez
Issue Type: Bug
Affects Versions: 0.9.2
Environment: hive: 3.1.2
Tez.0.9.2
hudi :0.10.0
Reporter: Jeff Tang
Attachments: image-2022-05-21-12-20-38-686.png,
image-2022-05-21-12-21-18-105.png, image-2022-05-21-12-24-39-135.png
hive on Tez query failed when do aggregation operation on hudi table:
e.g: select count(1) from ods.xxx_saas_audit_aud_cost_check_detail
Error: Error while processing statement: FAILED: Execution Error, return code 2
from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed
attempt_1651137377155_0198_1_00_000004_0 being failed for too many output
errors. failureFraction=1.0, MAX_ALLOWED_OUTPUT_FAILURES_FRACTION=0.1,
uniquefailedOutputReports=1, MAX_ALLOWED_OUTPUT_FAILURES=10,
MAX_ALLOWED_TIME_FOR_TASK_READ_ERROR_SEC=300, readErrorTimespan=0
the hive debug logs shows up interupteException in Tez runtime:
ERROR] [TezChild] |tez.ReduceRecordSource|:
org.apache.tez.runtime.library.api.IOInterruptedException:
java.lang.InterruptedException
at
org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:206)
with simple select column it works fine:
e.g:
select check_value from ods.hope_saas_audit_aud_cost_check_detail limit 5;
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
