[jira] [Commented] (MAPREDUCE-6298) Job#toString throws an exception when not in state RUNNING
[
https://issues.apache.org/jira/browse/MAPREDUCE-6298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537635#comment-14537635
]
Lars Francke commented on MAPREDUCE-6298:
-
[~ozawa] Thanks for taking a look!
> Job#toString throws an exception when not in state RUNNING
> --
>
> Key: MAPREDUCE-6298
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6298
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Reporter: Lars Francke
>Assignee: Lars Francke
>Priority: Minor
> Labels: BB2015-05-TBR
> Attachments: MAPREDUCE-6298.1.patch
>
>
> Job#toString calls {{ensureState(JobState.RUNNING);}} as the very first
> thing. That method causes an Exception to be thrown which is not nice.
> One thing this breaks is usage of Job on the Scala (e.g. Spark) REPL as that
> calls toString after every invocation and that fails every time.
> I'll attach a patch that checks state and if it's RUNNING prints the original
> message and if not prints something else.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-6298) Job#toString throws an exception when not in state RUNNING
[
https://issues.apache.org/jira/browse/MAPREDUCE-6298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537612#comment-14537612
]
Tsuyoshi Ozawa commented on MAPREDUCE-6298:
---
The fix itself looks good to me.
[~jira.shegalov] I'd like to to listen to your opinion - do you think should we
mark this change as incompatible change? It change the semantics of
Job#toString, but current users don't call toString in not running state.
> Job#toString throws an exception when not in state RUNNING
> --
>
> Key: MAPREDUCE-6298
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6298
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Reporter: Lars Francke
>Assignee: Lars Francke
>Priority: Minor
> Labels: BB2015-05-TBR
> Attachments: MAPREDUCE-6298.1.patch
>
>
> Job#toString calls {{ensureState(JobState.RUNNING);}} as the very first
> thing. That method causes an Exception to be thrown which is not nice.
> One thing this breaks is usage of Job on the Scala (e.g. Spark) REPL as that
> calls toString after every invocation and that fails every time.
> I'll attach a patch that checks state and if it's RUNNING prints the original
> message and if not prints something else.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-2631) Potential resource leaks in BinaryProtocol$TeeOutputStream.java
[
https://issues.apache.org/jira/browse/MAPREDUCE-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sunil G updated MAPREDUCE-2631:
---
Status: Patch Available (was: Open)
Kicking jenkins again.
> Potential resource leaks in BinaryProtocol$TeeOutputStream.java
> ---
>
> Key: MAPREDUCE-2631
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2631
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
>Affects Versions: 0.23.0
>Reporter: Ravi Teja Ch N V
>Assignee: Sunil G
> Labels: BB2015-05-TBR
> Attachments: 0001-MAPREDUCE-2631.patch, MAPREDUCE-2631.02.patch,
> MAPREDUCE-2631.1.patch, MAPREDUCE-2631.2.patch, MAPREDUCE-2631.3.patch,
> MAPREDUCE-2631.patch
>
>
> {code:title=BinaryProtocol$TeeOutputStream.java|borderStyle=solid}
> public void close() throws IOException {
> flush();
> file.close();
> out.close();
> }
> {code}
> In the above code, if the file.close() throws any exception out will not be
> closed.
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-2631) Potential resource leaks in BinaryProtocol$TeeOutputStream.java
[
https://issues.apache.org/jira/browse/MAPREDUCE-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sunil G updated MAPREDUCE-2631:
---
Status: Open (was: Patch Available)
> Potential resource leaks in BinaryProtocol$TeeOutputStream.java
> ---
>
> Key: MAPREDUCE-2631
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2631
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
>Affects Versions: 0.23.0
>Reporter: Ravi Teja Ch N V
>Assignee: Sunil G
> Labels: BB2015-05-TBR
> Attachments: 0001-MAPREDUCE-2631.patch, MAPREDUCE-2631.02.patch,
> MAPREDUCE-2631.1.patch, MAPREDUCE-2631.2.patch, MAPREDUCE-2631.3.patch,
> MAPREDUCE-2631.patch
>
>
> {code:title=BinaryProtocol$TeeOutputStream.java|borderStyle=solid}
> public void close() throws IOException {
> flush();
> file.close();
> out.close();
> }
> {code}
> In the above code, if the file.close() throws any exception out will not be
> closed.
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-6304) Specifying node labels when submitting MR jobs
[
https://issues.apache.org/jira/browse/MAPREDUCE-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537501#comment-14537501
]
Hadoop QA commented on MAPREDUCE-6304:
--
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 14m 38s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 2 new or modified test files. |
| {color:green}+1{color} | javac | 7m 29s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 36s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 22s | The applied patch does
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle | 3m 51s | The applied patch generated
12 new checkstyle issues (total was 497, now 509). |
| {color:red}-1{color} | whitespace | 0m 2s | The patch has 2 line(s) that
end in whitespace. Use git apply --whitespace=fix. |
| {color:green}+1{color} | install | 1m 41s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 33s | The patch built with
eclipse:eclipse. |
| {color:red}-1{color} | findbugs | 2m 53s | The patch appears to introduce 1
new Findbugs (version 2.0.3) warnings. |
| {color:green}+1{color} | mapreduce tests | 9m 30s | Tests passed in
hadoop-mapreduce-client-app. |
| {color:green}+1{color} | mapreduce tests | 1m 38s | Tests passed in
hadoop-mapreduce-client-core. |
| {color:green}+1{color} | mapreduce tests | 108m 46s | Tests passed in
hadoop-mapreduce-client-jobclient. |
| | | 161m 10s | |
\\
\\
|| Reason || Tests ||
| FindBugs | module:hadoop-mapreduce-client-app |
| | Inconsistent synchronization of
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.reduceNodeLabelExpression;
locked 66% of time Unsynchronized access at RMContainerAllocator.java:66% of
time Unsynchronized access at RMContainerAllocator.java:[line 218] |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12731811/MAPREDUCE-6304.20150510-1.patch
|
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 4536399 |
| checkstyle |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5699/artifact/patchprocess/diffcheckstylehadoop-mapreduce-client-core.txt
|
| whitespace |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5699/artifact/patchprocess/whitespace.txt
|
| Findbugs warnings |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5699/artifact/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html
|
| hadoop-mapreduce-client-app test log |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5699/artifact/patchprocess/testrun_hadoop-mapreduce-client-app.txt
|
| hadoop-mapreduce-client-core test log |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5699/artifact/patchprocess/testrun_hadoop-mapreduce-client-core.txt
|
| hadoop-mapreduce-client-jobclient test log |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5699/artifact/patchprocess/testrun_hadoop-mapreduce-client-jobclient.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5699/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5699/console |
This message was automatically generated.
> Specifying node labels when submitting MR jobs
> --
>
> Key: MAPREDUCE-6304
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6304
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
>Reporter: Jian Fang
>Assignee: Naganarasimha G R
> Labels: mapreduce
> Attachments: MAPREDUCE-6304.20150410-1.patch,
> MAPREDUCE-6304.20150411-1.patch, MAPREDUCE-6304.20150501-1.patch,
> MAPREDUCE-6304.20150510-1.patch
>
>
> Per the discussion on YARN-796, we need a mechanism in MAPREDUCE to specify
> node labels when submitting MR jobs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6304) Specifying node labels when submitting MR jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated MAPREDUCE-6304: - Fix Version/s: (was: 2.8.0) Labels: mapreduce (was: ) Status: Patch Available (was: In Progress) > Specifying node labels when submitting MR jobs > -- > > Key: MAPREDUCE-6304 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6304 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Jian Fang >Assignee: Naganarasimha G R > Labels: mapreduce > Attachments: MAPREDUCE-6304.20150410-1.patch, > MAPREDUCE-6304.20150411-1.patch, MAPREDUCE-6304.20150501-1.patch, > MAPREDUCE-6304.20150510-1.patch > > > Per the discussion on YARN-796, we need a mechanism in MAPREDUCE to specify > node labels when submitting MR jobs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6304) Specifying node labels when submitting MR jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated MAPREDUCE-6304: - Attachment: MAPREDUCE-6304.20150510-1.patch Updated the description and tested in 2 NM with 3 labels and also specifying different combination of labels > Specifying node labels when submitting MR jobs > -- > > Key: MAPREDUCE-6304 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6304 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Reporter: Jian Fang >Assignee: Naganarasimha G R > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6304.20150410-1.patch, > MAPREDUCE-6304.20150411-1.patch, MAPREDUCE-6304.20150501-1.patch, > MAPREDUCE-6304.20150510-1.patch > > > Per the discussion on YARN-796, we need a mechanism in MAPREDUCE to specify > node labels when submitting MR jobs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers
[ https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537226#comment-14537226 ] Hudson commented on MAPREDUCE-6353: --- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2139 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2139/]) MAPREDUCE-6353. Divide by zero error in MR AM when calculating available containers. (Anubhav Dhoot via kasha) (kasha: rev 1773aac780585871072960a5863af461e112a030) * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/rm/TestResourceCalculatorUtils.java * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/ResourceCalculatorUtils.java * hadoop-mapreduce-project/CHANGES.txt > Divide by zero error in MR AM when calculating available containers > --- > > Key: MAPREDUCE-6353 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mr-am >Reporter: Anubhav Dhoot >Assignee: Anubhav Dhoot > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6353.001.patch, MAPREDUCE-6353.002.patch, > MAPREDUCE-6353.002.patch > > > When running a sleep job with zero CPU vcores i see the following exception > 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN > CONTACTING RM. > java.lang.ArithmeticException: / by zero > at > org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282) > at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers
[ https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537219#comment-14537219 ] Hudson commented on MAPREDUCE-6353: --- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #191 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/191/]) MAPREDUCE-6353. Divide by zero error in MR AM when calculating available containers. (Anubhav Dhoot via kasha) (kasha: rev 1773aac780585871072960a5863af461e112a030) * hadoop-mapreduce-project/CHANGES.txt * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/ResourceCalculatorUtils.java * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/rm/TestResourceCalculatorUtils.java > Divide by zero error in MR AM when calculating available containers > --- > > Key: MAPREDUCE-6353 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mr-am >Reporter: Anubhav Dhoot >Assignee: Anubhav Dhoot > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6353.001.patch, MAPREDUCE-6353.002.patch, > MAPREDUCE-6353.002.patch > > > When running a sleep job with zero CPU vcores i see the following exception > 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN > CONTACTING RM. > java.lang.ArithmeticException: / by zero > at > org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282) > at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers
[ https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537194#comment-14537194 ] Hudson commented on MAPREDUCE-6353: --- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #181 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/181/]) MAPREDUCE-6353. Divide by zero error in MR AM when calculating available containers. (Anubhav Dhoot via kasha) (kasha: rev 1773aac780585871072960a5863af461e112a030) * hadoop-mapreduce-project/CHANGES.txt * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/rm/TestResourceCalculatorUtils.java * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/ResourceCalculatorUtils.java > Divide by zero error in MR AM when calculating available containers > --- > > Key: MAPREDUCE-6353 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mr-am >Reporter: Anubhav Dhoot >Assignee: Anubhav Dhoot > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6353.001.patch, MAPREDUCE-6353.002.patch, > MAPREDUCE-6353.002.patch > > > When running a sleep job with zero CPU vcores i see the following exception > 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN > CONTACTING RM. > java.lang.ArithmeticException: / by zero > at > org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282) > at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-6359) RM HA setup, "Cluster" tab links populated with AM hostname instead of RM
[ https://issues.apache.org/jira/browse/MAPREDUCE-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537191#comment-14537191 ] Hudson commented on MAPREDUCE-6359: --- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #181 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/181/]) MAPREDUCE-6359. In RM HA setup, Cluster tab links populated with AM hostname instead of RM. Contributed by zhaoyunjiong. (junping_du: rev df36ad0a08261b03c250b6f745b27e5f83e4286e) * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java * hadoop-mapreduce-project/CHANGES.txt > RM HA setup, "Cluster" tab links populated with AM hostname instead of RM > -- > > Key: MAPREDUCE-6359 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6359 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 2.4.0 > Environment: centOS-6.x >Reporter: Aroop Maliakkal >Assignee: zhaoyunjiong >Priority: Minor > Fix For: 2.8.0 > > Attachments: YARN-3423.patch > > > In RM HA setup ( e.g. > http://rm-1.vip.abc.com:50030/proxy/application_1427789305393_0002/ ), go to > the job details and click on the "Cluster tab" on left top side. Click on any > of the links , "About", Applications" , "Scheduler". You can see that the > hyperlink is pointing to http://am-1.vip.abc.com:port/cluster ). > The port details for secure and unsecure cluster is given below :- > 8088 ( DEFAULT_RM_WEBAPP_PORT = 8088 ) > 8090 ( DEFAULT_RM_WEBAPP_HTTPS_PORT = 8090 ) > Ideally, it should have pointed to resourcemanager hostname instead of AM > hostname. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-6359) RM HA setup, "Cluster" tab links populated with AM hostname instead of RM
[ https://issues.apache.org/jira/browse/MAPREDUCE-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537184#comment-14537184 ] Hudson commented on MAPREDUCE-6359: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #2121 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2121/]) MAPREDUCE-6359. In RM HA setup, Cluster tab links populated with AM hostname instead of RM. Contributed by zhaoyunjiong. (junping_du: rev df36ad0a08261b03c250b6f745b27e5f83e4286e) * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java * hadoop-mapreduce-project/CHANGES.txt > RM HA setup, "Cluster" tab links populated with AM hostname instead of RM > -- > > Key: MAPREDUCE-6359 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6359 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 2.4.0 > Environment: centOS-6.x >Reporter: Aroop Maliakkal >Assignee: zhaoyunjiong >Priority: Minor > Fix For: 2.8.0 > > Attachments: YARN-3423.patch > > > In RM HA setup ( e.g. > http://rm-1.vip.abc.com:50030/proxy/application_1427789305393_0002/ ), go to > the job details and click on the "Cluster tab" on left top side. Click on any > of the links , "About", Applications" , "Scheduler". You can see that the > hyperlink is pointing to http://am-1.vip.abc.com:port/cluster ). > The port details for secure and unsecure cluster is given below :- > 8088 ( DEFAULT_RM_WEBAPP_PORT = 8088 ) > 8090 ( DEFAULT_RM_WEBAPP_HTTPS_PORT = 8090 ) > Ideally, it should have pointed to resourcemanager hostname instead of AM > hostname. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers
[ https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537187#comment-14537187 ] Hudson commented on MAPREDUCE-6353: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #2121 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2121/]) MAPREDUCE-6353. Divide by zero error in MR AM when calculating available containers. (Anubhav Dhoot via kasha) (kasha: rev 1773aac780585871072960a5863af461e112a030) * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/rm/TestResourceCalculatorUtils.java * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/ResourceCalculatorUtils.java * hadoop-mapreduce-project/CHANGES.txt > Divide by zero error in MR AM when calculating available containers > --- > > Key: MAPREDUCE-6353 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mr-am >Reporter: Anubhav Dhoot >Assignee: Anubhav Dhoot > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6353.001.patch, MAPREDUCE-6353.002.patch, > MAPREDUCE-6353.002.patch > > > When running a sleep job with zero CPU vcores i see the following exception > 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN > CONTACTING RM. > java.lang.ArithmeticException: / by zero > at > org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282) > at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-6359) RM HA setup, "Cluster" tab links populated with AM hostname instead of RM
[ https://issues.apache.org/jira/browse/MAPREDUCE-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537151#comment-14537151 ] Hudson commented on MAPREDUCE-6359: --- SUCCESS: Integrated in Hadoop-Yarn-trunk #923 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/923/]) MAPREDUCE-6359. In RM HA setup, Cluster tab links populated with AM hostname instead of RM. Contributed by zhaoyunjiong. (junping_du: rev df36ad0a08261b03c250b6f745b27e5f83e4286e) * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java * hadoop-mapreduce-project/CHANGES.txt > RM HA setup, "Cluster" tab links populated with AM hostname instead of RM > -- > > Key: MAPREDUCE-6359 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6359 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 2.4.0 > Environment: centOS-6.x >Reporter: Aroop Maliakkal >Assignee: zhaoyunjiong >Priority: Minor > Fix For: 2.8.0 > > Attachments: YARN-3423.patch > > > In RM HA setup ( e.g. > http://rm-1.vip.abc.com:50030/proxy/application_1427789305393_0002/ ), go to > the job details and click on the "Cluster tab" on left top side. Click on any > of the links , "About", Applications" , "Scheduler". You can see that the > hyperlink is pointing to http://am-1.vip.abc.com:port/cluster ). > The port details for secure and unsecure cluster is given below :- > 8088 ( DEFAULT_RM_WEBAPP_PORT = 8088 ) > 8090 ( DEFAULT_RM_WEBAPP_HTTPS_PORT = 8090 ) > Ideally, it should have pointed to resourcemanager hostname instead of AM > hostname. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers
[ https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537154#comment-14537154 ] Hudson commented on MAPREDUCE-6353: --- SUCCESS: Integrated in Hadoop-Yarn-trunk #923 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/923/]) MAPREDUCE-6353. Divide by zero error in MR AM when calculating available containers. (Anubhav Dhoot via kasha) (kasha: rev 1773aac780585871072960a5863af461e112a030) * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/ResourceCalculatorUtils.java * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/rm/TestResourceCalculatorUtils.java * hadoop-mapreduce-project/CHANGES.txt > Divide by zero error in MR AM when calculating available containers > --- > > Key: MAPREDUCE-6353 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mr-am >Reporter: Anubhav Dhoot >Assignee: Anubhav Dhoot > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6353.001.patch, MAPREDUCE-6353.002.patch, > MAPREDUCE-6353.002.patch > > > When running a sleep job with zero CPU vcores i see the following exception > 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN > CONTACTING RM. > java.lang.ArithmeticException: / by zero > at > org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282) > at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-6359) RM HA setup, "Cluster" tab links populated with AM hostname instead of RM
[ https://issues.apache.org/jira/browse/MAPREDUCE-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537146#comment-14537146 ] Hudson commented on MAPREDUCE-6359: --- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #192 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/192/]) MAPREDUCE-6359. In RM HA setup, Cluster tab links populated with AM hostname instead of RM. Contributed by zhaoyunjiong. (junping_du: rev df36ad0a08261b03c250b6f745b27e5f83e4286e) * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java * hadoop-mapreduce-project/CHANGES.txt > RM HA setup, "Cluster" tab links populated with AM hostname instead of RM > -- > > Key: MAPREDUCE-6359 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6359 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 2.4.0 > Environment: centOS-6.x >Reporter: Aroop Maliakkal >Assignee: zhaoyunjiong >Priority: Minor > Fix For: 2.8.0 > > Attachments: YARN-3423.patch > > > In RM HA setup ( e.g. > http://rm-1.vip.abc.com:50030/proxy/application_1427789305393_0002/ ), go to > the job details and click on the "Cluster tab" on left top side. Click on any > of the links , "About", Applications" , "Scheduler". You can see that the > hyperlink is pointing to http://am-1.vip.abc.com:port/cluster ). > The port details for secure and unsecure cluster is given below :- > 8088 ( DEFAULT_RM_WEBAPP_PORT = 8088 ) > 8090 ( DEFAULT_RM_WEBAPP_HTTPS_PORT = 8090 ) > Ideally, it should have pointed to resourcemanager hostname instead of AM > hostname. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers
[ https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537149#comment-14537149 ] Hudson commented on MAPREDUCE-6353: --- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #192 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/192/]) MAPREDUCE-6353. Divide by zero error in MR AM when calculating available containers. (Anubhav Dhoot via kasha) (kasha: rev 1773aac780585871072960a5863af461e112a030) * hadoop-mapreduce-project/CHANGES.txt * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/ResourceCalculatorUtils.java * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/rm/TestResourceCalculatorUtils.java > Divide by zero error in MR AM when calculating available containers > --- > > Key: MAPREDUCE-6353 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mr-am >Reporter: Anubhav Dhoot >Assignee: Anubhav Dhoot > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6353.001.patch, MAPREDUCE-6353.002.patch, > MAPREDUCE-6353.002.patch > > > When running a sleep job with zero CPU vcores i see the following exception > 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN > CONTACTING RM. > java.lang.ArithmeticException: / by zero > at > org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247) > at > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282) > at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
