[jira] [Commented] (HBASE-5276) PerformanceEvaluation does not set the correct classpath for MR because it lives in the test jar
[ https://issues.apache.org/jira/browse/HBASE-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193021#comment-13193021 ] Tim Robertson commented on HBASE-5276: -- Lars G. points out that Stack has fixed this before https://github.com/apache/hbase/commit/e3f165f8f7327af53427a35f74a450b4df179ccc but seemingly it didn't make it into the CDH3u2 PerformanceEvaluation does not set the correct classpath for MR because it lives in the test jar Key: HBASE-5276 URL: https://issues.apache.org/jira/browse/HBASE-5276 Project: HBase Issue Type: Bug Components: test Affects Versions: 0.90.4 Reporter: Tim Robertson Priority: Minor Note: This was discovered running the CDH version hbase-0.90.4-cdh3u2 Running the PerformanceEvaluation as follows: $HADOOP_HOME/bin/hadoop org.apache.hadoop.hbase.PerformanceEvaluation scan 5 fails because the MR tasks do not get the HBase jar on the CP, and thus hit ClassNotFoundExceptions. The job gets the following only: file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/hbase-0.90.4-cdh3u2-tests.jar file:/Users/tim/dev/hadoop/hadoop-0.20.2-cdh3u2/hadoop-core-0.20.2-cdh3u2.jar file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/lib/zookeeper-3.3.3-cdh3u2.jar The RowCounter etc all work because they live in the HBase jar, not the test jar, and they get the following file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/lib/guava-r06.jar file:/Users/tim/dev/hadoop/hadoop-0.20.2-cdh3u2/hadoop-core-0.20.2-cdh3u2.jar file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/hbase-0.90.4-cdh3u2.jar file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/lib/zookeeper-3.3.3-cdh3u2.jar Presumably this relates to job.setJarByClass(PerformanceEvaluation.class); ... TableMapReduceUtil.addDependencyJars(job); A (cowboy) workaround to run PE is to unpack the jars, and copy the PerformanceEvaluation* classes building a patched jar. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5276) PerformanceEvaluation does not set the correct classpath for MR because it lives in the test jar
[ https://issues.apache.org/jira/browse/HBASE-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193255#comment-13193255 ] stack commented on HBASE-5276: -- @Tim Maybe open issue against CDH and close this one? PerformanceEvaluation does not set the correct classpath for MR because it lives in the test jar Key: HBASE-5276 URL: https://issues.apache.org/jira/browse/HBASE-5276 Project: HBase Issue Type: Bug Components: test Affects Versions: 0.90.4 Reporter: Tim Robertson Priority: Minor Note: This was discovered running the CDH version hbase-0.90.4-cdh3u2 Running the PerformanceEvaluation as follows: $HADOOP_HOME/bin/hadoop org.apache.hadoop.hbase.PerformanceEvaluation scan 5 fails because the MR tasks do not get the HBase jar on the CP, and thus hit ClassNotFoundExceptions. The job gets the following only: file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/hbase-0.90.4-cdh3u2-tests.jar file:/Users/tim/dev/hadoop/hadoop-0.20.2-cdh3u2/hadoop-core-0.20.2-cdh3u2.jar file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/lib/zookeeper-3.3.3-cdh3u2.jar The RowCounter etc all work because they live in the HBase jar, not the test jar, and they get the following file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/lib/guava-r06.jar file:/Users/tim/dev/hadoop/hadoop-0.20.2-cdh3u2/hadoop-core-0.20.2-cdh3u2.jar file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/hbase-0.90.4-cdh3u2.jar file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/lib/zookeeper-3.3.3-cdh3u2.jar Presumably this relates to job.setJarByClass(PerformanceEvaluation.class); ... TableMapReduceUtil.addDependencyJars(job); A (cowboy) workaround to run PE is to unpack the jars, and copy the PerformanceEvaluation* classes building a patched jar. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5276) PerformanceEvaluation does not set the correct classpath for MR because it lives in the test jar
[ https://issues.apache.org/jira/browse/HBASE-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193536#comment-13193536 ] Jonathan Hsieh commented on HBASE-5276: --- Hi Tim, From the HBASE-4688 issue, it looks this isn't in Apache HBase until 0.92.0. If you would like this in a future CDH3 release please file an issue here: https://issues.cloudera.org/browse/DISTRO Since CDH4 is based on Apache HBase 0.92, it will be in the CDH4 HBase. Thanks, Jon. PerformanceEvaluation does not set the correct classpath for MR because it lives in the test jar Key: HBASE-5276 URL: https://issues.apache.org/jira/browse/HBASE-5276 Project: HBase Issue Type: Bug Components: test Affects Versions: 0.90.4 Reporter: Tim Robertson Priority: Minor Note: This was discovered running the CDH version hbase-0.90.4-cdh3u2 Running the PerformanceEvaluation as follows: $HADOOP_HOME/bin/hadoop org.apache.hadoop.hbase.PerformanceEvaluation scan 5 fails because the MR tasks do not get the HBase jar on the CP, and thus hit ClassNotFoundExceptions. The job gets the following only: file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/hbase-0.90.4-cdh3u2-tests.jar file:/Users/tim/dev/hadoop/hadoop-0.20.2-cdh3u2/hadoop-core-0.20.2-cdh3u2.jar file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/lib/zookeeper-3.3.3-cdh3u2.jar The RowCounter etc all work because they live in the HBase jar, not the test jar, and they get the following file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/lib/guava-r06.jar file:/Users/tim/dev/hadoop/hadoop-0.20.2-cdh3u2/hadoop-core-0.20.2-cdh3u2.jar file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/hbase-0.90.4-cdh3u2.jar file:/Users/tim/dev/hadoop/hbase-0.90.4-cdh3u2/lib/zookeeper-3.3.3-cdh3u2.jar Presumably this relates to job.setJarByClass(PerformanceEvaluation.class); ... TableMapReduceUtil.addDependencyJars(job); A (cowboy) workaround to run PE is to unpack the jars, and copy the PerformanceEvaluation* classes building a patched jar. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
