[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start
[ https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913830#comment-16913830 ] Takanobu Asanuma commented on HDFS-14755: - Thanks for reviewing and committing it, [~xkrogen]! > [Dynamometer] Hadoop-2 DataNode fail to start > - > > Key: HDFS-14755 > URL: https://issues.apache.org/jira/browse/HDFS-14755 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: tools >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Fix For: 3.3.0 > > > When using a fsimage of Hadoop-2 with hadoop-dynamometer, datanodes fail to > start with the following error. > {noformat} > Exception in thread "main" java.lang.IllegalAccessError: tried to access > method > org.apache.hadoop.hdfs.server.datanode.StorageLocation.getUri()Ljava/net/URI; > from class org.apache.hadoop.tools.dynamometer.SimulatedDataNodes > at > org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:113) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88) > ./start-component.sh: line 317: kill: (9876) - No such process > {noformat} > The cause of this error is an incompatibility of StorageLocation. -- This message was sent by Atlassian Jira (v8.3.2#803003) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start
[ https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913590#comment-16913590 ] Hudson commented on HDFS-14755: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17169 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/17169/]) HDFS-14755. [Dynamometer] Enhance compatibility of Dynamometer with (xkrogen: rev 63c295e29840587eb6eb4a0fa258c55002e3229a) * (edit) hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/SimulatedDataNodes.java > [Dynamometer] Hadoop-2 DataNode fail to start > - > > Key: HDFS-14755 > URL: https://issues.apache.org/jira/browse/HDFS-14755 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: tools >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Fix For: 3.3.0 > > > When using a fsimage of Hadoop-2 with hadoop-dynamometer, datanodes fail to > start with the following error. > {noformat} > Exception in thread "main" java.lang.IllegalAccessError: tried to access > method > org.apache.hadoop.hdfs.server.datanode.StorageLocation.getUri()Ljava/net/URI; > from class org.apache.hadoop.tools.dynamometer.SimulatedDataNodes > at > org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:113) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88) > ./start-component.sh: line 317: kill: (9876) - No such process > {noformat} > The cause of this error is an incompatibility of StorageLocation. -- This message was sent by Atlassian Jira (v8.3.2#803003) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start
[ https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913503#comment-16913503 ] Erik Krogen commented on HDFS-14755: +1 on the PR. I just committed this to trunk. Thanks [~tasanuma]! > [Dynamometer] Hadoop-2 DataNode fail to start > - > > Key: HDFS-14755 > URL: https://issues.apache.org/jira/browse/HDFS-14755 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: tools >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > > When using a fsimage of Hadoop-2 with hadoop-dynamometer, datanodes fail to > start with the following error. > {noformat} > Exception in thread "main" java.lang.IllegalAccessError: tried to access > method > org.apache.hadoop.hdfs.server.datanode.StorageLocation.getUri()Ljava/net/URI; > from class org.apache.hadoop.tools.dynamometer.SimulatedDataNodes > at > org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:113) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88) > ./start-component.sh: line 317: kill: (9876) - No such process > {noformat} > The cause of this error is an incompatibility of StorageLocation. -- This message was sent by Atlassian Jira (v8.3.2#803003) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start
[ https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16911483#comment-16911483 ] Erik Krogen commented on HDFS-14755: Interesting! That's good to know. I'll move specific review comments onto the PR, in that case. > [Dynamometer] Hadoop-2 DataNode fail to start > - > > Key: HDFS-14755 > URL: https://issues.apache.org/jira/browse/HDFS-14755 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: tools >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > > When using a fsimage of Hadoop-2 with hadoop-dynamometer, datanodes fail to > start with the following error. > {noformat} > Exception in thread "main" java.lang.IllegalAccessError: tried to access > method > org.apache.hadoop.hdfs.server.datanode.StorageLocation.getUri()Ljava/net/URI; > from class org.apache.hadoop.tools.dynamometer.SimulatedDataNodes > at > org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:113) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88) > ./start-component.sh: line 317: kill: (9876) - No such process > {noformat} > The cause of this error is an incompatibility of StorageLocation. -- This message was sent by Atlassian Jira (v8.3.2#803003) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start
[ https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16911480#comment-16911480 ] Takanobu Asanuma commented on HDFS-14755: - Hi [~xkrogen]. Thanks for your review and providing the information! Actually, when using hadoop-dynamometer(latest trunk) with the patch, I have confirmed that HDP-2.6(hadoop-2.7.3) cluster just runs successfully. Though I haven't confirmed workload jobs yet. > [Dynamometer] Hadoop-2 DataNode fail to start > - > > Key: HDFS-14755 > URL: https://issues.apache.org/jira/browse/HDFS-14755 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: tools >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > > When using a fsimage of Hadoop-2 with hadoop-dynamometer, datanodes fail to > start with the following error. > {noformat} > Exception in thread "main" java.lang.IllegalAccessError: tried to access > method > org.apache.hadoop.hdfs.server.datanode.StorageLocation.getUri()Ljava/net/URI; > from class org.apache.hadoop.tools.dynamometer.SimulatedDataNodes > at > org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:113) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88) > ./start-component.sh: line 317: kill: (9876) - No such process > {noformat} > The cause of this error is an incompatibility of StorageLocation. -- This message was sent by Atlassian Jira (v8.3.2#803003) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start
[ https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16911445#comment-16911445 ] Erik Krogen commented on HDFS-14755: Hi [~tasanuma], thanks for raising an issue. The version of Dynamometer included with mainline Hadoop isn't intended to be used with the Hadoop 2.x line. I suspect even if this issue is resolved, there will be a number of other incompatible issues -- I know because I tried to make the [GitHub version of Dynamometer|https://github.com/linkedin/dynamometer], which primarily supports Hadoop 2.x, have compatibility for both 2.x and 3.x lines and it did not seem feasible. I suggest if you need to run Dynamometer against the 2.x line, you use the GitHub version. > [Dynamometer] Hadoop-2 DataNode fail to start > - > > Key: HDFS-14755 > URL: https://issues.apache.org/jira/browse/HDFS-14755 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: tools >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > > When using a fsimage of Hadoop-2 with hadoop-dynamometer, datanodes fail to > start with the following error. > {noformat} > Exception in thread "main" java.lang.IllegalAccessError: tried to access > method > org.apache.hadoop.hdfs.server.datanode.StorageLocation.getUri()Ljava/net/URI; > from class org.apache.hadoop.tools.dynamometer.SimulatedDataNodes > at > org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:113) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88) > ./start-component.sh: line 317: kill: (9876) - No such process > {noformat} > The cause of this error is an incompatibility of StorageLocation. -- This message was sent by Atlassian Jira (v8.3.2#803003) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org