[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939559#comment-13939559 ] Nick Dimiduk commented on HBASE-10782: -- Patch looks good to me. You ran with the patch and it fixes the failures for you, [~liushaohui]? > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939672#comment-13939672 ] Hadoop QA commented on HBASE-10782: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12635269/HBASE-10782-trunk-v1.diff against trunk revision . ATTACHMENT ID: 12635269 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 3 new or modified tests. {color:green}+1 hadoop1.0{color}. The patch compiles against the hadoop 1.0 profile. {color:green}+1 hadoop1.1{color}. The patch compiles against the hadoop 1.1 profile. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:red}-1 core tests{color}. The patch failed these unit tests: Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/9035//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/9035//console This message is automatically generated. > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13940065#comment-13940065 ] Liu Shaohui commented on HBASE-10782: - [~ndimiduk] Yes , it fixes the failures. Without this patch, the MR tests failed in my dev machine with large probability. I added some debug log and found the problem is wrong history server address. After applied this patch, I ran the tests for server times and they did not failed for this problem. > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13940067#comment-13940067 ] Liu Shaohui commented on HBASE-10782: - I think the failed build 9035 has no relations with this patch and the pre-commit build always failed in recent several builds. > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13940152#comment-13940152 ] Liang Xie commented on HBASE-10782: --- +1, will commit it tomorrow if no objection > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941119#comment-13941119 ] stack commented on HBASE-10782: --- +1 > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941139#comment-13941139 ] Nick Dimiduk commented on HBASE-10782: -- +1 > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941357#comment-13941357 ] Liang Xie commented on HBASE-10782: --- Integreated into trunk and 0.94/0.96/0.98 branches. Thanks [~liushaohui] for your finding and patch! Thanks all for review. > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Fix For: 0.96.2, 0.99.0, 0.94.18, 0.98.2 > > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941375#comment-13941375 ] Liang Xie commented on HBASE-10782: --- Oh, [~lhofhansl] [~saint@gmail.com], sorry for just see your release RC mail, please feel free to change "Fix Version/s" field if it's not correct... > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Fix For: 0.96.2, 0.99.0, 0.94.18, 0.98.2 > > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941378#comment-13941378 ] Lars Hofhansl commented on HBASE-10782: --- no problem. done. > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3 > > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941405#comment-13941405 ] Hudson commented on HBASE-10782: FAILURE: Integrated in HBase-0.94-on-Hadoop-2 #59 (See [https://builds.apache.org/job/HBase-0.94-on-Hadoop-2/59/]) HBASE-10782 Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev 1579523) * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3 > > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941411#comment-13941411 ] Hudson commented on HBASE-10782: SUCCESS: Integrated in HBase-0.94-security #449 (See [https://builds.apache.org/job/HBase-0.94-security/449/]) HBASE-10782 Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev 1579523) * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3 > > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941447#comment-13941447 ] Hudson commented on HBASE-10782: FAILURE: Integrated in HBase-0.94 #1331 (See [https://builds.apache.org/job/HBase-0.94/1331/]) HBASE-10782 Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev 1579523) * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3 > > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941458#comment-13941458 ] Hudson commented on HBASE-10782: FAILURE: Integrated in HBase-0.98 #244 (See [https://builds.apache.org/job/HBase-0.98/244/]) HBASE-10782 Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev 1579522) * /hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3 > > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941464#comment-13941464 ] Hudson commented on HBASE-10782: FAILURE: Integrated in HBase-0.94-JDK7 #94 (See [https://builds.apache.org/job/HBase-0.94-JDK7/94/]) HBASE-10782 Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev 1579523) * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3 > > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941479#comment-13941479 ] Hudson commented on HBASE-10782: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #228 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/228/]) HBASE-10782 Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev 1579522) * /hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3 > > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941489#comment-13941489 ] Hudson commented on HBASE-10782: FAILURE: Integrated in HBase-TRUNK #5026 (See [https://builds.apache.org/job/HBase-TRUNK/5026/]) HBASE-10782 Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev 1579520) * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3 > > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941583#comment-13941583 ] Hudson commented on HBASE-10782: FAILURE: Integrated in hbase-0.96 #363 (See [https://builds.apache.org/job/hbase-0.96/363/]) HBASE-10782 Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev 1579521) * /hbase/branches/0.96/hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3 > > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[ https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941710#comment-13941710 ] Hudson commented on HBASE-10782: FAILURE: Integrated in hbase-0.96-hadoop2 #248 (See [https://builds.apache.org/job/hbase-0.96-hadoop2/248/]) HBASE-10782 Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev 1579521) * /hbase/branches/0.96/hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java > Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is > no set in job conf > > > Key: HBASE-10782 > URL: https://issues.apache.org/jira/browse/HBASE-10782 > Project: HBase > Issue Type: Test >Reporter: Liu Shaohui >Assignee: Liu Shaohui >Priority: Minor > Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3 > > Attachments: HBASE-10782-trunk-v1.diff > > > Hadoop2 MR tests fail occasionally with output like this: > {code} > --- > Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1 > --- > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec > <<< FAILURE! > testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1) > Time elapsed: 50.047 sec <<< ERROR! > java.io.IOException: java.net.ConnectException: Call From > liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection > exception: java.net.ConnectException: Connection refused; For more details > see: http://wiki.apache.org/hadoop/ConnectionRefused > at > org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334) > at > org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419) > at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314) > at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311) > at java.security.AccessController.doPrivileged(Native Method) > ... > {code} > The reason is that when MR job was running, the job client pulled the job > status from AppMaster. When the job is completed, the AppMaster will exit. At > this time, if the job client have not got the job completed event from > AppMaster, it will switch to get job report from history server. > But in HBaseTestingUtility#startMiniMapReduceCluster, the config: > mapreduce.jobhistory.address is not copied to TestUtil's config. > > CRUNCH-249 reported the same problem. -- This message was sent by Atlassian JIRA (v6.2#6252)