[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120985#comment-15120985 ] Jeff Zhang commented on TEZ-3071: - If you want to remote debug tez in cluster mode, you need to do some configuration, e.g. if you want to debug TEZ AM, configure tez.am.launch.cmd-opts in tez-site.xml as -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xdebug -Xrunjdwp:transport=dt_socket,address=9009,server=y,suspend=y so that I can remote debug your AM using whatever your favorite IDE. for debugging task is the same, just configure tez.task.launch.cmd-opts, But actually tez support local mode, so you can debug it local environment if that is fine with you. > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121295#comment-15121295 ] Lvpenglin commented on TEZ-3071: ok,thank you very much.I have some question want to ask for you,My tez program needs to parse the config file,which is parsed by the dom4j just same as parse the local file.I only set the file path to local path,when run the program on the cluster,I wonder tez whether can load my local file to hdfs and share to the slave to use. > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121302#comment-15121302 ] Lvpenglin commented on TEZ-3071: My program imitates the tez's example, and it can run success on local mode.But when I change to the cluster mode,some objects can't get the correct vaule,and awlays is null,so it occured the NullPointerException. > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts:
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120778#comment-15120778 ] Lvpenglin commented on TEZ-3071: I want to find some information about tez how run on the cluster mode,can you share some information with me?thank you very much. > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 3 > 16/01/24 21:30:02 INFO client.DAGClientImpl:VertexStatus: VertexName: >
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114993#comment-15114993 ] Lvpenglin commented on TEZ-3071: only mail to this address(u...@tez.apache.org) is ok? > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 3 > 16/01/24 21:30:02 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 >
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114947#comment-15114947 ] Jeff Zhang commented on TEZ-3071: - Most likely sddg is null. And you'd better to ask this kind of question in tez user mail list. (u...@tez.apache.org) > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 3 > 16/01/24 21:30:02 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115001#comment-15115001 ] Lvpenglin commented on TEZ-3071: Can I config some information in the eclipse run the code on the cluster mode?I want to debug the code like run on the cluster,is ok? > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 3 > 16/01/24 21:30:02 INFO client.DAGClientImpl:VertexStatus: VertexName:
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115037#comment-15115037 ] Jeff Zhang commented on TEZ-3071: - Yes, user mail list is for discussing user problems, after we confirm it is a bug, you can create jira ticket here. > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 3 > 16/01/24 21:30:02 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114709#comment-15114709 ] Jeff Zhang commented on TEZ-3071: - [~llppll] This seems your user code issue, please check your code line 78 of TezDataGeneratorTest.java > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 3 > 16/01/24 21:30:02 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0%
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[
https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114795#comment-15114795
]
Lvpenglin commented on TEZ-3071:
this is the part code,can you help me look it?thank you.
68 public static class DataGenerationProcessor extends SimpleMRProcessor {
69 public DataGenerationProcessor(ProcessorContext context) {
70super(context);
71// TODO Auto-generated constructor stub
72}
73
74@Override
75public void run() throws Exception {
76ProcessorContext context = getContext();
77String tableName = context.getTaskVertexName();
78BaseTable table = sddg.getTable(tableName);
79
80LOG.info("generating tabel " + tableName + "--->");
81
82Map pRefColGroupValueList =
new HashMap();
List cRefColGroupValue = new
ArrayList();
> run tez task on local mode is success,but run on cluster occurred this
> problem,java.lang.NullPointerException at
> com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78)
> -
>
> Key: TEZ-3071
> URL: https://issues.apache.org/jira/browse/TEZ-3071
> Project: Apache Tez
> Issue Type: Task
> Environment: hadoop2.6.0+tez0.7.0
>Reporter: Lvpenglin
>
> 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running
> 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized:
> CurrentState=Running
> 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
> 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName:
> ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0
> Killed: 0
> 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName:
> SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed:
> 0 Killed: 0
> 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
> 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName:
> ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0
> Killed: 0
> 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName:
> SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed:
> 0 Killed: 0
> 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0
> 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName:
> ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0
> Killed: 0
> 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName:
> SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed:
> 0 Killed: 0
> 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts:
> 1
> 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName:
> ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0
> Killed: 0 FailedTaskAttempts: 1
> 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName:
> SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed:
> 0 Killed: 0
> 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts:
> 1
> 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName:
> ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0
> Killed: 0 FailedTaskAttempts: 1
> 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName:
> SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed:
> 0 Killed: 0
> 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts:
> 2
> 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName:
> ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0
> Killed: 0 FailedTaskAttempts: 2
> 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName:
> SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed:
> 0 Killed: 0
> 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0
