[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939559#comment-13939559
]
Nick Dimiduk commented on HBASE-10782:
--
Patch looks good to me. You ran with the patch and it fixes the failures for
you, [~liushaohui]?
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939672#comment-13939672
]
Hadoop QA commented on HBASE-10782:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12635269/HBASE-10782-trunk-v1.diff
against trunk revision .
ATTACHMENT ID: 12635269
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified tests.
{color:green}+1 hadoop1.0{color}. The patch compiles against the hadoop
1.0 profile.
{color:green}+1 hadoop1.1{color}. The patch compiles against the hadoop
1.1 profile.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/9035//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/9035//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/9035//console
This message is automatically generated.
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13940065#comment-13940065
]
Liu Shaohui commented on HBASE-10782:
-
[~ndimiduk]
Yes , it fixes the failures.
Without this patch, the MR tests failed in my dev machine with large
probability. I added some debug log and found the problem is wrong history
server address. After applied this patch, I ran the tests for server times and
they did not failed for this problem.
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13940067#comment-13940067
]
Liu Shaohui commented on HBASE-10782:
-
I think the failed build 9035 has no relations with this patch and the
pre-commit build always failed in recent several builds.
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13940152#comment-13940152
]
Liang Xie commented on HBASE-10782:
---
+1, will commit it tomorrow if no objection
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941119#comment-13941119
]
stack commented on HBASE-10782:
---
+1
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941139#comment-13941139
]
Nick Dimiduk commented on HBASE-10782:
--
+1
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941357#comment-13941357
]
Liang Xie commented on HBASE-10782:
---
Integreated into trunk and 0.94/0.96/0.98 branches. Thanks [~liushaohui] for
your finding and patch! Thanks all for review.
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Fix For: 0.96.2, 0.99.0, 0.94.18, 0.98.2
>
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941375#comment-13941375
]
Liang Xie commented on HBASE-10782:
---
Oh, [~lhofhansl] [~saint@gmail.com], sorry for just see your release RC
mail, please feel free to change "Fix Version/s" field if it's not correct...
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Fix For: 0.96.2, 0.99.0, 0.94.18, 0.98.2
>
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941378#comment-13941378
]
Lars Hofhansl commented on HBASE-10782:
---
no problem. done.
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3
>
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941405#comment-13941405
]
Hudson commented on HBASE-10782:
FAILURE: Integrated in HBase-0.94-on-Hadoop-2 #59 (See
[https://builds.apache.org/job/HBase-0.94-on-Hadoop-2/59/])
HBASE-10782 Hadoop2 MR tests fail occasionally because of
mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev
1579523)
*
/hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3
>
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941411#comment-13941411
]
Hudson commented on HBASE-10782:
SUCCESS: Integrated in HBase-0.94-security #449 (See
[https://builds.apache.org/job/HBase-0.94-security/449/])
HBASE-10782 Hadoop2 MR tests fail occasionally because of
mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev
1579523)
*
/hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3
>
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941447#comment-13941447
]
Hudson commented on HBASE-10782:
FAILURE: Integrated in HBase-0.94 #1331 (See
[https://builds.apache.org/job/HBase-0.94/1331/])
HBASE-10782 Hadoop2 MR tests fail occasionally because of
mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev
1579523)
*
/hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3
>
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941458#comment-13941458
]
Hudson commented on HBASE-10782:
FAILURE: Integrated in HBase-0.98 #244 (See
[https://builds.apache.org/job/HBase-0.98/244/])
HBASE-10782 Hadoop2 MR tests fail occasionally because of
mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev
1579522)
*
/hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3
>
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941464#comment-13941464
]
Hudson commented on HBASE-10782:
FAILURE: Integrated in HBase-0.94-JDK7 #94 (See
[https://builds.apache.org/job/HBase-0.94-JDK7/94/])
HBASE-10782 Hadoop2 MR tests fail occasionally because of
mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev
1579523)
*
/hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3
>
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941479#comment-13941479
]
Hudson commented on HBASE-10782:
FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #228 (See
[https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/228/])
HBASE-10782 Hadoop2 MR tests fail occasionally because of
mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev
1579522)
*
/hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3
>
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941489#comment-13941489
]
Hudson commented on HBASE-10782:
FAILURE: Integrated in HBase-TRUNK #5026 (See
[https://builds.apache.org/job/HBase-TRUNK/5026/])
HBASE-10782 Hadoop2 MR tests fail occasionally because of
mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev
1579520)
*
/hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3
>
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941583#comment-13941583
]
Hudson commented on HBASE-10782:
FAILURE: Integrated in hbase-0.96 #363 (See
[https://builds.apache.org/job/hbase-0.96/363/])
HBASE-10782 Hadoop2 MR tests fail occasionally because of
mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev
1579521)
*
/hbase/branches/0.96/hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3
>
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HBASE-10782) Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[
https://issues.apache.org/jira/browse/HBASE-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941710#comment-13941710
]
Hudson commented on HBASE-10782:
FAILURE: Integrated in hbase-0.96-hadoop2 #248 (See
[https://builds.apache.org/job/hbase-0.96-hadoop2/248/])
HBASE-10782 Hadoop2 MR tests fail occasionally because of
mapreduce.jobhistory.address is no set in job conf (Shaohui Liu) (liangxie: rev
1579521)
*
/hbase/branches/0.96/hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
> Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is
> no set in job conf
>
>
> Key: HBASE-10782
> URL: https://issues.apache.org/jira/browse/HBASE-10782
> Project: HBase
> Issue Type: Test
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
> Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3
>
> Attachments: HBASE-10782-trunk-v1.diff
>
>
> Hadoop2 MR tests fail occasionally with output like this:
> {code}
> ---
> Test set: org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
> ---
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 347.57 sec
> <<< FAILURE!
> testScanEmptyToAPP(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1)
> Time elapsed: 50.047 sec <<< ERROR!
> java.io.IOException: java.net.ConnectException: Call From
> liushaohui-OptiPlex-990/127.0.0.1 to 0.0.0.0:10020 failed on connection
> exception: java.net.ConnectException: Connection refused; For more details
> see: http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:334)
> at
> org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:524)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
> at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> ...
> {code}
> The reason is that when MR job was running, the job client pulled the job
> status from AppMaster. When the job is completed, the AppMaster will exit. At
> this time, if the job client have not got the job completed event from
> AppMaster, it will switch to get job report from history server.
> But in HBaseTestingUtility#startMiniMapReduceCluster, the config:
> mapreduce.jobhistory.address is not copied to TestUtil's config.
>
> CRUNCH-249 reported the same problem.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
