[jira] [Created] (TEZ-3133) many tez tasks only run on one node in cluster
Lvpenglin created TEZ-3133: -- Summary: many tez tasks only run on one node in cluster Key: TEZ-3133 URL: https://issues.apache.org/jira/browse/TEZ-3133 Project: Apache Tez Issue Type: Test Environment: hadoop2.6.0+tez0.7.0 Reporter: Lvpenglin I tested the tez example OrderedWordCount on my cluster.My input file more than 200MB,and it will generate 4 tasks.But I found this 4 tasks all run on one node which is different everytime.My cluster contains one master and two slaves.My idea is this task should be run on different node,for example,there are two Tokenizer tasks should be run on two different nodes.this can show the distribution on the cluster.I don't know how to explain this phenomenon.and I guess if need to modify some configuration or set some information to realize my imaginative distribution. Who can explain why or tell me if need some configuration.Thank you very much -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121295#comment-15121295 ] Lvpenglin commented on TEZ-3071: ok,thank you very much.I have some question want to ask for you,My tez program needs to parse the config file,which is parsed by the dom4j just same as parse the local file.I only set the file path to local path,when run the program on the cluster,I wonder tez whether can load my local file to hdfs and share to the slave to use. > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121302#comment-15121302 ] Lvpenglin commented on TEZ-3071: My program imitates the tez's example, and it can run success on local mode.But when I change to the cluster mode,some objects can't get the correct vaule,and awlays is null,so it occured the NullPointerException. > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts:
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120778#comment-15120778 ] Lvpenglin commented on TEZ-3071: I want to find some information about tez how run on the cluster mode,can you share some information with me?thank you very much. > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 3 > 16/01/24 21:30:02 INFO client.DAGClientImpl:VertexStatus: VertexName: >
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114993#comment-15114993 ] Lvpenglin commented on TEZ-3071: only mail to this address(u...@tez.apache.org) is ok? > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 3 > 16/01/24 21:30:02 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 >
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[ https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115001#comment-15115001 ] Lvpenglin commented on TEZ-3071: Can I config some information in the eclipse run the code on the cluster mode?I want to debug the code like run on the cluster,is ok? > run tez task on local mode is success,but run on cluster occurred this > problem,java.lang.NullPointerException at > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) > - > > Key: TEZ-3071 > URL: https://issues.apache.org/jira/browse/TEZ-3071 > Project: Apache Tez > Issue Type: Task > Environment: hadoop2.6.0+tez0.7.0 >Reporter: Lvpenglin > > 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running > 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: > CurrentState=Running > 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 > Killed: 0 > 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 > 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 1 > 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 > Killed: 0 FailedTaskAttempts: 2 > 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: > SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: > 0 Killed: 0 > 16/01/24 21:30:02 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% > TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: > 3 > 16/01/24 21:30:02 INFO client.DAGClientImpl:VertexStatus: VertexName:
[jira] [Created] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTest$
Lvpenglin created TEZ-3071: -- Summary: run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) Key: TEZ-3071 URL: https://issues.apache.org/jira/browse/TEZ-3071 Project: Apache Tez Issue Type: Task Environment: hadoop2.6.0+tez0.7.0 Reporter: Lvpenglin 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized: CurrentState=Running 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName: SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName: SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName: SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: 1 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: 1 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName: SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: 1 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: 1 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName: SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: 2 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: 2 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName: SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: 2 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: 2 16/01/24 21:29:57 INFO client.DAGClientImpl:VertexStatus: VertexName: SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 16/01/24 21:30:02 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: 3 16/01/24 21:30:02 INFO client.DAGClientImpl:VertexStatus: VertexName: ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts: 3 16/01/24 21:30:02 INFO client.DAGClientImpl:VertexStatus: VertexName: SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0 16/01/24 21:30:04 INFO client.DAGClientImpl: DAG: State: FAILED Progress: 0% TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 1 Killed: 1 FailedTaskAttempts: 4 16/01/24 21:30:04 INFO client.DAGClientImpl:VertexStatus: VertexName: ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 1 Killed: 0 FailedTaskAttempts: 4 16/01/24 21:30:04 INFO client.DAGClientImpl:
[jira] [Commented] (TEZ-3071) run tez task on local mode is success,but run on cluster occurred this problem,java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTes
[
https://issues.apache.org/jira/browse/TEZ-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114795#comment-15114795
]
Lvpenglin commented on TEZ-3071:
this is the part code,can you help me look it?thank you.
68 public static class DataGenerationProcessor extends SimpleMRProcessor {
69 public DataGenerationProcessor(ProcessorContext context) {
70super(context);
71// TODO Auto-generated constructor stub
72}
73
74@Override
75public void run() throws Exception {
76ProcessorContext context = getContext();
77String tableName = context.getTaskVertexName();
78BaseTable table = sddg.getTable(tableName);
79
80LOG.info("generating tabel " + tableName + "--->");
81
82Map pRefColGroupValueList =
new HashMap();
List cRefColGroupValue = new
ArrayList();
> run tez task on local mode is success,but run on cluster occurred this
> problem,java.lang.NullPointerException at
> com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78)
> -
>
> Key: TEZ-3071
> URL: https://issues.apache.org/jira/browse/TEZ-3071
> Project: Apache Tez
> Issue Type: Task
> Environment: hadoop2.6.0+tez0.7.0
>Reporter: Lvpenglin
>
> 16/01/24 21:29:13 INFO client.DAGClientImpl: Waiting for DAG to start running
> 16/01/24 21:29:25 INFO client.DAGClientImpl: DAG initialized:
> CurrentState=Running
> 16/01/24 21:29:26 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
> 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName:
> ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0
> Killed: 0
> 16/01/24 21:29:26 INFO client.DAGClientImpl:VertexStatus: VertexName:
> SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed:
> 0 Killed: 0
> 16/01/24 21:29:32 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
> 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName:
> ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0
> Killed: 0
> 16/01/24 21:29:32 INFO client.DAGClientImpl:VertexStatus: VertexName:
> SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed:
> 0 Killed: 0
> 16/01/24 21:29:37 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0
> 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName:
> ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0
> Killed: 0
> 16/01/24 21:29:37 INFO client.DAGClientImpl:VertexStatus: VertexName:
> SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed:
> 0 Killed: 0
> 16/01/24 21:29:42 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts:
> 1
> 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName:
> ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0
> Killed: 0 FailedTaskAttempts: 1
> 16/01/24 21:29:42 INFO client.DAGClientImpl:VertexStatus: VertexName:
> SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed:
> 0 Killed: 0
> 16/01/24 21:29:47 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts:
> 1
> 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName:
> ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0
> Killed: 0 FailedTaskAttempts: 1
> 16/01/24 21:29:47 INFO client.DAGClientImpl:VertexStatus: VertexName:
> SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed:
> 0 Killed: 0
> 16/01/24 21:29:52 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0 Running: 1 Failed: 0 Killed: 0 FailedTaskAttempts:
> 2
> 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName:
> ASSOCIATE Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 1 Failed: 0
> Killed: 0 FailedTaskAttempts: 2
> 16/01/24 21:29:52 INFO client.DAGClientImpl:VertexStatus: VertexName:
> SALES_TRANSACTION Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed:
> 0 Killed: 0
> 16/01/24 21:29:57 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0%
> TotalTasks: 2 Succeeded: 0
[jira] [Commented] (TEZ-3055) I got this jar is by the mvn package and run it on my cluster,occurred this problem.I can run the example which the tez given successful.But when I run this jar which is
[ https://issues.apache.org/jira/browse/TEZ-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110284#comment-15110284 ] Lvpenglin commented on TEZ-3055: Can you explain what mean this property(tez.aux.uris)?I searched some information,but none can be used.thank you. > I got this jar is by the mvn package and run it on my cluster,occurred this > problem.I can run the example which the tez given successful.But when I run > this jar which is packaged by mvn packsge myself is failed. > --- > > Key: TEZ-3055 > URL: https://issues.apache.org/jira/browse/TEZ-3055 > Project: Apache Tez > Issue Type: Improvement > Environment: this is the tez orderedwordcount example,I want it can > be run on my cluster,but occurred this problem.This code is packaged by > myself.When I run the tez's example jar on my cluster,it's ok.My environment > is hadoop2.6.0+tez0.7.0.Can you give me some suggestion? >Reporter: Lvpenglin > Labels: jar, maven-package, run-example, tez > > Vertex failed, vertexName=ASSOCIATE, vertexId=vertex_1452667827400_0022_1_00, > diagnostics= > Task failed, taskId=task_1452667827400_0022_1_00_00, diagnostics= > TaskAttempt 0 failed, info= > Error: Failure while running > task:org.apache.tez.dag.api.TezUncheckedException: Unable to load class: > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor > at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:45) > at > org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:96) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.createProcessor(LogicalIOProcessorRuntimeTask.java:584) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:202) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:171) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:171) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:167) > at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.ClassNotFoundException: > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > at java.lang.Class.forName0(Native Method) > at java.lang.Class.forName(Class.java:274) > at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:43) > ... 15 more > TaskAttempt 1 failed, info= > Error: Failure while running > task:org.apache.tez.dag.api.TezUncheckedException: Unable to load class: > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor > at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:45) > at > org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:96) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.createProcessor(LogicalIOProcessorRuntimeTask.java:584) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:202) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:171) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:171) > at >
[jira] [Commented] (TEZ-3055) I got this jar is by the mvn package and run it on my cluster,occurred this problem.I can run the example which the tez given successful.But when I run this jar which is
[ https://issues.apache.org/jira/browse/TEZ-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111778#comment-15111778 ] Lvpenglin commented on TEZ-3055: thank you very much.but when I set this property,have some error as the following.I want to ask how to set the tez program which can be run on my cluster,because I only found how to set the program run in local mode,I don't know if need some special set.Can you give some suggestion or data? Vertex failed, vertexName=ASSOCIATE, vertexId=vertex_1453425211412_0004_1_00, diagnostics= Task failed, taskId=task_1453425211412_0004_1_00_00, diagnostics= TaskAttempt 0 failed, info= Error: Failure while running task:java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) at org.apache.tez.runtime.library.processor.SimpleProcessor.run(SimpleProcessor.java:53) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:337) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:179) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:171) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:171) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:167) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) TaskAttempt 1 failed, info= Error: Failure while running task:java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) at org.apache.tez.runtime.library.processor.SimpleProcessor.run(SimpleProcessor.java:53) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:337) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:179) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:171) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:171) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:167) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) TaskAttempt 2 failed, info= Error: Failure while running task:java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) at org.apache.tez.runtime.library.processor.SimpleProcessor.run(SimpleProcessor.java:53) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:337) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:179) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:171) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:171) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:167) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) TaskAttempt 3 failed, info= Error: Failure while running task:java.lang.NullPointerException at com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor.run(TezDataGeneratorTest.java:78) at org.apache.tez.runtime.library.processor.SimpleProcessor.run(SimpleProcessor.java:53) at
[jira] [Commented] (TEZ-3055) I got this jar is by the mvn package and run it on my cluster,occurred this problem.I can run the example which the tez given successful.But when I run this jar which is
[ https://issues.apache.org/jira/browse/TEZ-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111860#comment-15111860 ] Lvpenglin commented on TEZ-3055: no more log can be used.where can find the all default property and description of tez-site.xml?Can you give me some site to study?thank you. > I got this jar is by the mvn package and run it on my cluster,occurred this > problem.I can run the example which the tez given successful.But when I run > this jar which is packaged by mvn packsge myself is failed. > --- > > Key: TEZ-3055 > URL: https://issues.apache.org/jira/browse/TEZ-3055 > Project: Apache Tez > Issue Type: Improvement > Environment: this is the tez orderedwordcount example,I want it can > be run on my cluster,but occurred this problem.This code is packaged by > myself.When I run the tez's example jar on my cluster,it's ok.My environment > is hadoop2.6.0+tez0.7.0.Can you give me some suggestion? >Reporter: Lvpenglin > Labels: jar, maven-package, run-example, tez > > Vertex failed, vertexName=ASSOCIATE, vertexId=vertex_1452667827400_0022_1_00, > diagnostics= > Task failed, taskId=task_1452667827400_0022_1_00_00, diagnostics= > TaskAttempt 0 failed, info= > Error: Failure while running > task:org.apache.tez.dag.api.TezUncheckedException: Unable to load class: > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor > at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:45) > at > org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:96) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.createProcessor(LogicalIOProcessorRuntimeTask.java:584) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:202) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:171) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:171) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:167) > at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.ClassNotFoundException: > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > at java.lang.Class.forName0(Native Method) > at java.lang.Class.forName(Class.java:274) > at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:43) > ... 15 more > TaskAttempt 1 failed, info= > Error: Failure while running > task:org.apache.tez.dag.api.TezUncheckedException: Unable to load class: > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor > at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:45) > at > org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:96) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.createProcessor(LogicalIOProcessorRuntimeTask.java:584) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:202) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:171) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:171) > at
[jira] [Updated] (TEZ-3055) I got this jar is by the mvn package and run it on my cluster,occurred this problem.I can run the example which the tez given successful.But when I run this jar which is pa
[ https://issues.apache.org/jira/browse/TEZ-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lvpenglin updated TEZ-3055: --- Issue Type: Improvement (was: Bug) > I got this jar is by the mvn package and run it on my cluster,occurred this > problem.I can run the example which the tez given successful.But when I run > this jar which is packaged by mvn packsge myself is failed. > --- > > Key: TEZ-3055 > URL: https://issues.apache.org/jira/browse/TEZ-3055 > Project: Apache Tez > Issue Type: Improvement > Environment: this is the tez orderedwordcount example,I want it can > be run on my cluster,but occurred this problem.This code is packaged by > myself.When I run the tez's example jar on my cluster,it's ok.My environment > is hadoop2.6.0+tez0.7.0.Can you give me some suggestion? >Reporter: Lvpenglin > Labels: jar, maven-package, run-example, tez > > Vertex failed, vertexName=ASSOCIATE, vertexId=vertex_1452667827400_0022_1_00, > diagnostics= > Task failed, taskId=task_1452667827400_0022_1_00_00, diagnostics= > TaskAttempt 0 failed, info= > Error: Failure while running > task:org.apache.tez.dag.api.TezUncheckedException: Unable to load class: > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor > at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:45) > at > org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:96) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.createProcessor(LogicalIOProcessorRuntimeTask.java:584) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:202) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:171) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:171) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:167) > at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.ClassNotFoundException: > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > at java.lang.Class.forName0(Native Method) > at java.lang.Class.forName(Class.java:274) > at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:43) > ... 15 more > TaskAttempt 1 failed, info= > Error: Failure while running > task:org.apache.tez.dag.api.TezUncheckedException: Unable to load class: > com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor > at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:45) > at > org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:96) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.createProcessor(LogicalIOProcessorRuntimeTask.java:584) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:202) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:171) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:171) > at > org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:167) > at
[jira] [Created] (TEZ-3055) I got this jar is by the mvn package and run it on my cluster,occurred this problem.I can run the example which the tez given successful.But when I run this jar which is pa
Lvpenglin created TEZ-3055: -- Summary: I got this jar is by the mvn package and run it on my cluster,occurred this problem.I can run the example which the tez given successful.But when I run this jar which is packaged by mvn packsge myself is failed. Key: TEZ-3055 URL: https://issues.apache.org/jira/browse/TEZ-3055 Project: Apache Tez Issue Type: Bug Environment: this is the tez orderedwordcount example,I want it can be run on my cluster,but occurred this problem.This code is packaged by myself.When I run the tez's example jar on my cluster,it's ok.My environment is hadoop2.6.0+tez0.7.0.Can you give me some suggestion? Reporter: Lvpenglin Vertex failed, vertexName=ASSOCIATE, vertexId=vertex_1452667827400_0022_1_00, diagnostics= Task failed, taskId=task_1452667827400_0022_1_00_00, diagnostics= TaskAttempt 0 failed, info= Error: Failure while running task:org.apache.tez.dag.api.TezUncheckedException: Unable to load class: com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:45) at org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:96) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.createProcessor(LogicalIOProcessorRuntimeTask.java:584) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:202) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:171) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:171) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:167) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.ClassNotFoundException: com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:274) at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:43) ... 15 more TaskAttempt 1 failed, info= Error: Failure while running task:org.apache.tez.dag.api.TezUncheckedException: Unable to load class: com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor at org.apache.tez.common.ReflectionUtils.getClazz(ReflectionUtils.java:45) at org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:96) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.createProcessor(LogicalIOProcessorRuntimeTask.java:584) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:202) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:171) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:171) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:167) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.ClassNotFoundException: com.teradata.sddg.sgprocessor.TezDataGeneratorTest$DataGenerationProcessor at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at
[jira] [Created] (TEZ-3034) set tez-ui occured problem
Lvpenglin created TEZ-3034: -- Summary: set tez-ui occured problem Key: TEZ-3034 URL: https://issues.apache.org/jira/browse/TEZ-3034 Project: Apache Tez Issue Type: Bug Components: UI Environment: hadoop2.6.0+tez0.7.0 Reporter: Lvpenglin My environment is hadoop2.6.0+tez0.7.0,when I start yarn timelineserver occurred this problem,I can not solve it ,can you help me or give some suggestion? Thank you very much. 16/01/12 21:37:53 INFO service.AbstractService: Service org.apache.hadoop.yarn.server.timeline.LeveldbTimelineStore failed in state INITED; cause: org.fusesource.leveldbjni.internal.NativeDB$DBException: IO error: /home/td/file:/home/td/temp/yarn/timeline/leveldb-timeline-store.ldb/LOCK: No such file or directory org.fusesource.leveldbjni.internal.NativeDB$DBException: IO error: /home/td/file:/home/td/temp/yarn/timeline/leveldb-timeline-store.ldb/LOCK: No such file or directory at org.fusesource.leveldbjni.internal.NativeDB.checkStatus(NativeDB.java:200) at org.fusesource.leveldbjni.internal.NativeDB.open(NativeDB.java:218) at org.fusesource.leveldbjni.JniDBFactory.open(JniDBFactory.java:168) at org.apache.hadoop.yarn.server.timeline.LeveldbTimelineStore.serviceInit(LeveldbTimelineStore.java:219) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.serviceInit(ApplicationHistoryServer.java:99) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.launchAppHistoryServer(ApplicationHistoryServer.java:157) at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.main(ApplicationHistoryServer.java:167) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
