[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629323#comment-13629323 ] Andrew Purtell commented on HBASE-8140: --- IIRC the EC@ jenkins builds stopped working one or two builds prior to this commit. > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.98.0, 0.95.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629228#comment-13629228 ] Nick Dimiduk commented on HBASE-8140: - opened HBASE-8326 to track this issue. > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.98.0, 0.95.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629108#comment-13629108 ] Nick Dimiduk commented on HBASE-8140: - Taking a look. > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.98.0, 0.95.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629101#comment-13629101 ] Lars Hofhansl commented on HBASE-8140: -- It looks like since this change org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan has not passed a single time in the EC2 builds (http://54.241.6.143/job/HBase-0.94/). Change was introduced in Build #72, since then this tests times out (or doesn't finish) > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.98.0, 0.95.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13626342#comment-13626342 ] Hudson commented on HBASE-8140: --- Integrated in HBase-0.94-security #133 (See [https://builds.apache.org/job/HBase-0.94-security/133/]) HBASE-8158. Backport HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465743) Result = SUCCESS apurtell : Files : * /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java * /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.98.0, 0.95.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13626125#comment-13626125 ] Hudson commented on HBASE-8140: --- Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #488 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/488/]) HBASE-8158. Amend HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465746) Result = FAILURE apurtell : Files : * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.98.0, 0.95.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13626051#comment-13626051 ] Lars Hofhansl commented on HBASE-8140: -- bq. Woa! ^^^ :) 0.94 has been stable, so it shouldn't be a total surprise :) > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.98.0, 0.95.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13626039#comment-13626039 ] Hudson commented on HBASE-8140: --- Integrated in hbase-0.95-on-hadoop2 #61 (See [https://builds.apache.org/job/hbase-0.95-on-hadoop2/61/]) HBASE-8158. Amend HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465745) Result = FAILURE apurtell : Files : * /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.98.0, 0.95.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13625963#comment-13625963 ] Hudson commented on HBASE-8140: --- Integrated in HBase-TRUNK #4044 (See [https://builds.apache.org/job/HBase-TRUNK/4044/]) HBASE-8158. Amend HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465746) Result = FAILURE apurtell : Files : * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.98.0, 0.95.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13625946#comment-13625946 ] Nick Dimiduk commented on HBASE-8140: - bq. Result = SUCCESS Woa! ^^^ > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.98.0, 0.95.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13625938#comment-13625938 ] Hudson commented on HBASE-8140: --- Integrated in HBase-0.94 #951 (See [https://builds.apache.org/job/HBase-0.94/951/]) HBASE-8158. Backport HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465743) Result = SUCCESS apurtell : Files : * /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java * /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.98.0, 0.95.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615226#comment-13615226 ] Hudson commented on HBASE-8140: --- Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #466 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/466/]) HBASE-8147. Adds an integration test for HBASE-8140 (issue observed when commitJob was launching another job). (Revision 1461303) Result = FAILURE ddas : Files : * /hbase/trunk/hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestImportTsv.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13615215#comment-13615215 ] Hudson commented on HBASE-8140: --- Integrated in hbase-0.95-on-hadoop2 #45 (See [https://builds.apache.org/job/hbase-0.95-on-hadoop2/45/]) HBASE-8147. Adds an integration test for HBASE-8140 (issue observed when commitJob was launching another job). (Revision 1461304) Result = FAILURE ddas : Files : * /hbase/branches/0.95/hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestImportTsv.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13614912#comment-13614912 ] Hudson commented on HBASE-8140: --- Integrated in hbase-0.95 #109 (See [https://builds.apache.org/job/hbase-0.95/109/]) HBASE-8147. Adds an integration test for HBASE-8140 (issue observed when commitJob was launching another job). (Revision 1461304) Result = FAILURE ddas : Files : * /hbase/branches/0.95/hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestImportTsv.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13614905#comment-13614905 ] Hudson commented on HBASE-8140: --- Integrated in HBase-TRUNK #3996 (See [https://builds.apache.org/job/HBase-TRUNK/3996/]) HBASE-8147. Adds an integration test for HBASE-8140 (issue observed when commitJob was launching another job). (Revision 1461303) Result = FAILURE ddas : Files : * /hbase/trunk/hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestImportTsv.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13608042#comment-13608042 ] Nick Dimiduk commented on HBASE-8140: - Opened HBASE-8158. > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13607231#comment-13607231 ] Hudson commented on HBASE-8140: --- Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #455 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/455/]) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job -- ADDENDUM (Revision 1458545) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job (Revision 1458531) Result = FAILURE stack : Files : * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java stack : Files : * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0, 0.94.7 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13607223#comment-13607223 ] Hudson commented on HBASE-8140: --- Integrated in hbase-0.95-on-hadoop2 #34 (See [https://builds.apache.org/job/hbase-0.95-on-hadoop2/34/]) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job -- ADDENDUM (Revision 1458544) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job (Revision 1458532) Result = FAILURE stack : Files : * /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java stack : Files : * /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java * /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport * /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java * /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport * /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0, 0.94.7 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13607143#comment-13607143 ] Hudson commented on HBASE-8140: --- Integrated in HBase-TRUNK #3975 (See [https://builds.apache.org/job/HBase-TRUNK/3975/]) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job -- ADDENDUM (Revision 1458545) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job (Revision 1458531) Result = FAILURE stack : Files : * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java stack : Files : * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0, 0.94.7 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13607090#comment-13607090 ] Hudson commented on HBASE-8140: --- Integrated in hbase-0.95 #88 (See [https://builds.apache.org/job/hbase-0.95/88/]) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job -- ADDENDUM (Revision 1458544) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job (Revision 1458532) Result = FAILURE stack : Files : * /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java stack : Files : * /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java * /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport * /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java * /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport * /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0, 0.94.7 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606979#comment-13606979 ] Nick Dimiduk commented on HBASE-8140: - It's a sufficient fix, at least for the single use-case. I'm not convinced the OutputCommitter is the correct place to be launching a new job, but that's an HCAT problem. Assuming the JarFinder works, this will at least be more flexible for users, however the pains I'm having on the [integration test|HBASE-8147] warn me of trouble to come. > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0, 0.94.7 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606965#comment-13606965 ] Lars Hofhansl commented on HBASE-8140: -- Seems like a good fix. I have no good handle how risky this is, though. What do you guys think? > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0, 0.94.7 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[
https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606931#comment-13606931
]
Hadoop QA commented on HBASE-8140:
--
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12574420/0001-HBASE-8140-addendum-add-test-category.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 4 new
or modified tests.
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/4898//console
This message is automatically generated.
> TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
>
>
> Key: HBASE-8140
> URL: https://issues.apache.org/jira/browse/HBASE-8140
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
> Fix For: 0.95.0, 0.98.0, 0.94.7
>
> Attachments: 0001-HBASE-8140-addendum-add-test-category.patch,
> 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch
>
>
> TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job
> to make sure dependencies of the job are shipped to the cluster. The code
> depends on finding an actual jar file containing the necessary classes. This
> is not always the case, for instance, when run at the end of another
> mapreduce job. In that case, dependency jars have already been shipped to the
> cluster and expanded in the parent job's run folder. Those dependencies are
> there, just not available as jars.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606921#comment-13606921 ] stack commented on HBASE-8140: -- Committed addendum to 0.95 and trunk. Thanks Nick (and Ted for figuring need of an addendum) > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0, 0.94.7 > > Attachments: 0001-HBASE-8140-addendum-add-test-category.patch, > 8140-port-jarfinder-0.94.patch, 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606908#comment-13606908 ] Nick Dimiduk commented on HBASE-8140: - Blast, [~yuzhih...@gmail.com] is correct. That must be the TestCheckTestClasses issue. I ran it directly, not via the harness. Let me add an addendum making this a SmallTest. > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0, 0.94.7 > > Attachments: 8140-port-jarfinder-0.94.patch, > 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606897#comment-13606897 ] Ted Yu commented on HBASE-8140: --- Looks like TestJarFinder misses test category. > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0, 0.94.7 > > Attachments: 8140-port-jarfinder-0.94.patch, > 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606889#comment-13606889 ] stack commented on HBASE-8140: -- Committed to trunk and 0.95. [~lhofhansl] Want this in 0.94? If not, I'll close as resolved. Thanks Nick. > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0, 0.94.7 > > Attachments: 8140-port-jarfinder-0.94.patch, > 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606883#comment-13606883 ] Nick Dimiduk commented on HBASE-8140: - [~stack] This IT is turning out to be a pain. I've an open question with some MR guys about the behavior I'm seeing. We can add it as a separate ticket. > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0, 0.94.7 > > Attachments: 8140-port-jarfinder-0.94.patch, > 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606870#comment-13606870 ] stack commented on HBASE-8140: -- [~ndimiduk] You want to include the IT test w/ this patch? Can I just commit this? (Is the TestCheckTestClasses because of this patch?) > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 0.95.0, 0.98.0, 0.94.7 > > Attachments: 8140-port-jarfinder-0.94.patch, > 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[
https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606459#comment-13606459
]
Hadoop QA commented on HBASE-8140:
--
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12574357/8140-port-jarfinder-trunk.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 7 new
or modified tests.
{color:green}+1 hadoop2.0{color}. The patch compiles against the hadoop
2.0 profile.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:red}-1 site{color}. The patch appears to cause mvn site goal to
fail.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.TestCheckTestClasses
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/4890//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/4890//console
This message is automatically generated.
> TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
>
>
> Key: HBASE-8140
> URL: https://issues.apache.org/jira/browse/HBASE-8140
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
> Fix For: 0.95.0, 0.98.0, 0.94.7
>
> Attachments: 8140-port-jarfinder-0.94.patch,
> 8140-port-jarfinder-trunk.patch
>
>
> TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job
> to make sure dependencies of the job are shipped to the cluster. The code
> depends on finding an actual jar file containing the necessary classes. This
> is not always the case, for instance, when run at the end of another
> mapreduce job. In that case, dependency jars have already been shipped to the
> cluster and expanded in the parent job's run folder. Those dependencies are
> there, just not available as jars.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-8140) TableMapReduceUtils#addDependencyJar fails when nested inside another MR job
[ https://issues.apache.org/jira/browse/HBASE-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606430#comment-13606430 ] Nick Dimiduk commented on HBASE-8140: - Working on extending an integration test for this, but against trunk only. > TableMapReduceUtils#addDependencyJar fails when nested inside another MR job > > > Key: HBASE-8140 > URL: https://issues.apache.org/jira/browse/HBASE-8140 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Attachments: 8140-port-jarfinder-0.94.patch, > 8140-port-jarfinder-trunk.patch > > > TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job > to make sure dependencies of the job are shipped to the cluster. The code > depends on finding an actual jar file containing the necessary classes. This > is not always the case, for instance, when run at the end of another > mapreduce job. In that case, dependency jars have already been shipped to the > cluster and expanded in the parent job's run folder. Those dependencies are > there, just not available as jars. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
