Jeff Tang created TEZ-4414: ------------------------------ Summary: Tez job failed with hudi table query Key: TEZ-4414 URL: https://issues.apache.org/jira/browse/TEZ-4414 Project: Apache Tez Issue Type: Bug Affects Versions: 0.9.2 Environment: hive: 3.1.2 Tez.0.9.2 hudi :0.10.0 Reporter: Jeff Tang Attachments: image-2022-05-21-12-20-38-686.png, image-2022-05-21-12-21-18-105.png, image-2022-05-21-12-24-39-135.png
hive on Tez query failed when do aggregation operation on hudi table: e.g: select count(1) from ods.xxx_saas_audit_aud_cost_check_detail Error: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed attempt_1651137377155_0198_1_00_000004_0 being failed for too many output errors. failureFraction=1.0, MAX_ALLOWED_OUTPUT_FAILURES_FRACTION=0.1, uniquefailedOutputReports=1, MAX_ALLOWED_OUTPUT_FAILURES=10, MAX_ALLOWED_TIME_FOR_TASK_READ_ERROR_SEC=300, readErrorTimespan=0 the hive debug logs shows up interupteException in Tez runtime: ERROR] [TezChild] |tez.ReduceRecordSource|: org.apache.tez.runtime.library.api.IOInterruptedException: java.lang.InterruptedException at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:206) with simple select column it works fine: e.g: select check_value from ods.hope_saas_audit_aud_cost_check_detail limit 5; -- This message was sent by Atlassian Jira (v8.20.7#820007)