[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start
[
https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913830#comment-16913830
]
Takanobu Asanuma commented on HDFS-14755:
-
Thanks for reviewing and committing it, [~xkrogen]!
> [Dynamometer] Hadoop-2 DataNode fail to start
> -
>
> Key: HDFS-14755
> URL: https://issues.apache.org/jira/browse/HDFS-14755
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: tools
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Fix For: 3.3.0
>
>
> When using a fsimage of Hadoop-2 with hadoop-dynamometer, datanodes fail to
> start with the following error.
> {noformat}
> Exception in thread "main" java.lang.IllegalAccessError: tried to access
> method
> org.apache.hadoop.hdfs.server.datanode.StorageLocation.getUri()Ljava/net/URI;
> from class org.apache.hadoop.tools.dynamometer.SimulatedDataNodes
> at
> org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:113)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> at
> org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88)
> ./start-component.sh: line 317: kill: (9876) - No such process
> {noformat}
> The cause of this error is an incompatibility of StorageLocation.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start
[
https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913590#comment-16913590
]
Hudson commented on HDFS-14755:
---
FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17169 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/17169/])
HDFS-14755. [Dynamometer] Enhance compatibility of Dynamometer with (xkrogen:
rev 63c295e29840587eb6eb4a0fa258c55002e3229a)
* (edit)
hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/SimulatedDataNodes.java
> [Dynamometer] Hadoop-2 DataNode fail to start
> -
>
> Key: HDFS-14755
> URL: https://issues.apache.org/jira/browse/HDFS-14755
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: tools
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Fix For: 3.3.0
>
>
> When using a fsimage of Hadoop-2 with hadoop-dynamometer, datanodes fail to
> start with the following error.
> {noformat}
> Exception in thread "main" java.lang.IllegalAccessError: tried to access
> method
> org.apache.hadoop.hdfs.server.datanode.StorageLocation.getUri()Ljava/net/URI;
> from class org.apache.hadoop.tools.dynamometer.SimulatedDataNodes
> at
> org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:113)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> at
> org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88)
> ./start-component.sh: line 317: kill: (9876) - No such process
> {noformat}
> The cause of this error is an incompatibility of StorageLocation.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start
[
https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913503#comment-16913503
]
Erik Krogen commented on HDFS-14755:
+1 on the PR. I just committed this to trunk. Thanks [~tasanuma]!
> [Dynamometer] Hadoop-2 DataNode fail to start
> -
>
> Key: HDFS-14755
> URL: https://issues.apache.org/jira/browse/HDFS-14755
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: tools
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
>
> When using a fsimage of Hadoop-2 with hadoop-dynamometer, datanodes fail to
> start with the following error.
> {noformat}
> Exception in thread "main" java.lang.IllegalAccessError: tried to access
> method
> org.apache.hadoop.hdfs.server.datanode.StorageLocation.getUri()Ljava/net/URI;
> from class org.apache.hadoop.tools.dynamometer.SimulatedDataNodes
> at
> org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:113)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> at
> org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88)
> ./start-component.sh: line 317: kill: (9876) - No such process
> {noformat}
> The cause of this error is an incompatibility of StorageLocation.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start
[
https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911483#comment-16911483
]
Erik Krogen commented on HDFS-14755:
Interesting! That's good to know. I'll move specific review comments onto the
PR, in that case.
> [Dynamometer] Hadoop-2 DataNode fail to start
> -
>
> Key: HDFS-14755
> URL: https://issues.apache.org/jira/browse/HDFS-14755
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: tools
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
>
> When using a fsimage of Hadoop-2 with hadoop-dynamometer, datanodes fail to
> start with the following error.
> {noformat}
> Exception in thread "main" java.lang.IllegalAccessError: tried to access
> method
> org.apache.hadoop.hdfs.server.datanode.StorageLocation.getUri()Ljava/net/URI;
> from class org.apache.hadoop.tools.dynamometer.SimulatedDataNodes
> at
> org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:113)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> at
> org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88)
> ./start-component.sh: line 317: kill: (9876) - No such process
> {noformat}
> The cause of this error is an incompatibility of StorageLocation.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start
[
https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911480#comment-16911480
]
Takanobu Asanuma commented on HDFS-14755:
-
Hi [~xkrogen]. Thanks for your review and providing the information!
Actually, when using hadoop-dynamometer(latest trunk) with the patch, I have
confirmed that HDP-2.6(hadoop-2.7.3) cluster just runs successfully. Though I
haven't confirmed workload jobs yet.
> [Dynamometer] Hadoop-2 DataNode fail to start
> -
>
> Key: HDFS-14755
> URL: https://issues.apache.org/jira/browse/HDFS-14755
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: tools
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
>
> When using a fsimage of Hadoop-2 with hadoop-dynamometer, datanodes fail to
> start with the following error.
> {noformat}
> Exception in thread "main" java.lang.IllegalAccessError: tried to access
> method
> org.apache.hadoop.hdfs.server.datanode.StorageLocation.getUri()Ljava/net/URI;
> from class org.apache.hadoop.tools.dynamometer.SimulatedDataNodes
> at
> org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:113)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> at
> org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88)
> ./start-component.sh: line 317: kill: (9876) - No such process
> {noformat}
> The cause of this error is an incompatibility of StorageLocation.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start
[
https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911445#comment-16911445
]
Erik Krogen commented on HDFS-14755:
Hi [~tasanuma], thanks for raising an issue. The version of Dynamometer
included with mainline Hadoop isn't intended to be used with the Hadoop 2.x
line. I suspect even if this issue is resolved, there will be a number of other
incompatible issues -- I know because I tried to make the [GitHub version of
Dynamometer|https://github.com/linkedin/dynamometer], which primarily supports
Hadoop 2.x, have compatibility for both 2.x and 3.x lines and it did not seem
feasible. I suggest if you need to run Dynamometer against the 2.x line, you
use the GitHub version.
> [Dynamometer] Hadoop-2 DataNode fail to start
> -
>
> Key: HDFS-14755
> URL: https://issues.apache.org/jira/browse/HDFS-14755
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: tools
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
>
> When using a fsimage of Hadoop-2 with hadoop-dynamometer, datanodes fail to
> start with the following error.
> {noformat}
> Exception in thread "main" java.lang.IllegalAccessError: tried to access
> method
> org.apache.hadoop.hdfs.server.datanode.StorageLocation.getUri()Ljava/net/URI;
> from class org.apache.hadoop.tools.dynamometer.SimulatedDataNodes
> at
> org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:113)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> at
> org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88)
> ./start-component.sh: line 317: kill: (9876) - No such process
> {noformat}
> The cause of this error is an incompatibility of StorageLocation.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
