[jira] [Updated] (PIG-5446) Tez TestPigProgressReporting.testProgressReportingWithStatusMessage failing
[ https://issues.apache.org/jira/browse/PIG-5446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5446: -- Attachment: pig-5446-v01.patch > Tez TestPigProgressReporting.testProgressReportingWithStatusMessage failing > --- > > Key: PIG-5446 > URL: https://issues.apache.org/jira/browse/PIG-5446 > Project: Pig > Issue Type: Bug > Components: tez >Reporter: Koji Noguchi >Assignee: Koji Noguchi >Priority: Major > Attachments: pig-5446-v01.patch > > > {noformat} > Unable to open iterator for alias B. Backend error : Vertex failed, > vertexName=scope-4, vertexId=vertex_1707216362777_0001_1_00, > diagnostics=[Task failed, taskId=task_1707216362777_0001_1_00_00, > diagnostics=[TaskAttempt 0 failed, info=[Attempt failed because it appears to > make no progress for 1ms], TaskAttempt 1 failed, info=[Attempt failed > because it appears to make no progress for 1ms]], Vertex did not succeed > due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex > vertex_1707216362777_0001_1_00 [scope-4] killed/failed due > to:OWN_TASK_FAILURE] DAG did not succeed due to VERTEX_FAILURE. > failedVertices:1 killedVertices:0 > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to > open iterator for alias B. Backend error : Vertex failed, vertexName=scope-4, > vertexId=vertex_1707216362777_0001_1_00, diagnostics=[Task failed, > taskId=task_1707216362777_0001_1_00_00, diagnostics=[TaskAttempt 0 > failed, info=[Attempt failed because it appears to make no progress for > 1ms], TaskAttempt 1 failed, info=[Attempt failed because it appears to > make no progress for 1ms]], Vertex did not succeed due to > OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex > vertex_1707216362777_0001_1_00 [scope-4] killed/failed due > to:OWN_TASK_FAILURE] > DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0 > at org.apache.pig.PigServer.openIterator(PigServer.java:1014) > at > org.apache.pig.test.TestPigProgressReporting.testProgressReportingWithStatusMessage(TestPigProgressReporting.java:58) > Caused by: org.apache.tez.dag.api.TezException: Vertex failed, > vertexName=scope-4, vertexId=vertex_1707216362777_0001_1_00, > diagnostics=[Task failed, taskId=task_1707216362777_0001_1_00_00, > diagnostics=[TaskAttempt 0 failed, info=[Attempt failed because it appears to > make no progress for 1ms], TaskAttempt 1 failed, info=[Attempt failed > because it appears to make no progress for 1ms]], Vertex did not succeed > due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex > vertex_1707216362777_0001_1_00 [scope-4] killed/failed due > to:OWN_TASK_FAILURE] > DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0 > at > org.apache.pig.tools.pigstats.tez.TezPigScriptStats.accumulateStats(TezPigScriptStats.java:204) > at > org.apache.pig.backend.hadoop.executionengine.tez.TezJob.run(TezJob.java:243) > at > org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:212) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > 45.647 {noformat} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PIG-5446) Tez TestPigProgressReporting.testProgressReportingWithStatusMessage failing
[ https://issues.apache.org/jira/browse/PIG-5446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5446: -- It seems like "reporter.progress()" is a no-op in Tez pig. Test started failing after upgrading the dependent Tez version. PIG-4700 only enabled progress reporting after Tez 0.8.5 and after. Attaching a patch that simply calls "context.notifyProgress" for every "reporter.progress()" calls. > Tez TestPigProgressReporting.testProgressReportingWithStatusMessage failing > --- > > Key: PIG-5446 > URL: https://issues.apache.org/jira/browse/PIG-5446 > Project: Pig > Issue Type: Bug > Components: tez >Reporter: Koji Noguchi >Assignee: Koji Noguchi >Priority: Major > > {noformat} > Unable to open iterator for alias B. Backend error : Vertex failed, > vertexName=scope-4, vertexId=vertex_1707216362777_0001_1_00, > diagnostics=[Task failed, taskId=task_1707216362777_0001_1_00_00, > diagnostics=[TaskAttempt 0 failed, info=[Attempt failed because it appears to > make no progress for 1ms], TaskAttempt 1 failed, info=[Attempt failed > because it appears to make no progress for 1ms]], Vertex did not succeed > due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex > vertex_1707216362777_0001_1_00 [scope-4] killed/failed due > to:OWN_TASK_FAILURE] DAG did not succeed due to VERTEX_FAILURE. > failedVertices:1 killedVertices:0 > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to > open iterator for alias B. Backend error : Vertex failed, vertexName=scope-4, > vertexId=vertex_1707216362777_0001_1_00, diagnostics=[Task failed, > taskId=task_1707216362777_0001_1_00_00, diagnostics=[TaskAttempt 0 > failed, info=[Attempt failed because it appears to make no progress for > 1ms], TaskAttempt 1 failed, info=[Attempt failed because it appears to > make no progress for 1ms]], Vertex did not succeed due to > OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex > vertex_1707216362777_0001_1_00 [scope-4] killed/failed due > to:OWN_TASK_FAILURE] > DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0 > at org.apache.pig.PigServer.openIterator(PigServer.java:1014) > at > org.apache.pig.test.TestPigProgressReporting.testProgressReportingWithStatusMessage(TestPigProgressReporting.java:58) > Caused by: org.apache.tez.dag.api.TezException: Vertex failed, > vertexName=scope-4, vertexId=vertex_1707216362777_0001_1_00, > diagnostics=[Task failed, taskId=task_1707216362777_0001_1_00_00, > diagnostics=[TaskAttempt 0 failed, info=[Attempt failed because it appears to > make no progress for 1ms], TaskAttempt 1 failed, info=[Attempt failed > because it appears to make no progress for 1ms]], Vertex did not succeed > due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex > vertex_1707216362777_0001_1_00 [scope-4] killed/failed due > to:OWN_TASK_FAILURE] > DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0 > at > org.apache.pig.tools.pigstats.tez.TezPigScriptStats.accumulateStats(TezPigScriptStats.java:204) > at > org.apache.pig.backend.hadoop.executionengine.tez.TezJob.run(TezJob.java:243) > at > org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:212) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > 45.647 {noformat} -- This message was sent by Atlassian Jira (v8.20.10#820010)