[jira] [Updated] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers

2015-05-09 Thread Karthik Kambatla (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Karthik Kambatla updated MAPREDUCE-6353:

Labels:   (was: BB2015-05-RFC)

 Divide by zero error in MR AM when calculating available containers
 ---

 Key: MAPREDUCE-6353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am
Reporter: Anubhav Dhoot
Assignee: Anubhav Dhoot
 Attachments: MAPREDUCE-6353.001.patch, MAPREDUCE-6353.002.patch, 
 MAPREDUCE-6353.002.patch


 When running a sleep job with zero CPU vcores i see the following exception
 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN 
 CONTACTING RM. 
 java.lang.ArithmeticException: / by zero
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282)
 at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers

2015-05-09 Thread Karthik Kambatla (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Karthik Kambatla updated MAPREDUCE-6353:

   Resolution: Fixed
Fix Version/s: 2.8.0
 Hadoop Flags: Reviewed
   Status: Resolved  (was: Patch Available)

Thanks Anubhav for reporting and fixing this. Just committed this to trunk and 
branch-2. 

 Divide by zero error in MR AM when calculating available containers
 ---

 Key: MAPREDUCE-6353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am
Reporter: Anubhav Dhoot
Assignee: Anubhav Dhoot
 Fix For: 2.8.0

 Attachments: MAPREDUCE-6353.001.patch, MAPREDUCE-6353.002.patch, 
 MAPREDUCE-6353.002.patch


 When running a sleep job with zero CPU vcores i see the following exception
 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN 
 CONTACTING RM. 
 java.lang.ArithmeticException: / by zero
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282)
 at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers

2015-05-09 Thread Anubhav Dhoot (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anubhav Dhoot updated MAPREDUCE-6353:
-
Attachment: MAPREDUCE-6353.002.patch

Kick jenkins

 Divide by zero error in MR AM when calculating available containers
 ---

 Key: MAPREDUCE-6353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am
Reporter: Anubhav Dhoot
Assignee: Anubhav Dhoot
  Labels: BB2015-05-RFC
 Attachments: MAPREDUCE-6353.001.patch, MAPREDUCE-6353.002.patch, 
 MAPREDUCE-6353.002.patch


 When running a sleep job with zero CPU vcores i see the following exception
 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN 
 CONTACTING RM. 
 java.lang.ArithmeticException: / by zero
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282)
 at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers

2015-05-08 Thread Anubhav Dhoot (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anubhav Dhoot updated MAPREDUCE-6353:
-
Labels: BB-2015-05-RFC  (was: )

 Divide by zero error in MR AM when calculating available containers
 ---

 Key: MAPREDUCE-6353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am
Reporter: Anubhav Dhoot
Assignee: Anubhav Dhoot
  Labels: BB-2015-05-RFC
 Attachments: MAPREDUCE-6353.001.patch, MAPREDUCE-6353.002.patch


 When running a sleep job with zero CPU vcores i see the following exception
 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN 
 CONTACTING RM. 
 java.lang.ArithmeticException: / by zero
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282)
 at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers

2015-05-08 Thread Anubhav Dhoot (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anubhav Dhoot updated MAPREDUCE-6353:
-
Attachment: MAPREDUCE-6353.002.patch

Addressed feedback. Let me know if there is a better name for the call. 
calculateRatioOrMaxValue is the most descriptive i could think of

 Divide by zero error in MR AM when calculating available containers
 ---

 Key: MAPREDUCE-6353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am
Reporter: Anubhav Dhoot
Assignee: Anubhav Dhoot
 Attachments: MAPREDUCE-6353.001.patch, MAPREDUCE-6353.002.patch


 When running a sleep job with zero CPU vcores i see the following exception
 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN 
 CONTACTING RM. 
 java.lang.ArithmeticException: / by zero
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282)
 at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers

2015-05-08 Thread Anubhav Dhoot (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anubhav Dhoot updated MAPREDUCE-6353:
-
Labels: BB2015-05-RFC  (was: BB-2015-05-RFC)

 Divide by zero error in MR AM when calculating available containers
 ---

 Key: MAPREDUCE-6353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am
Reporter: Anubhav Dhoot
Assignee: Anubhav Dhoot
  Labels: BB2015-05-RFC
 Attachments: MAPREDUCE-6353.001.patch, MAPREDUCE-6353.002.patch


 When running a sleep job with zero CPU vcores i see the following exception
 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN 
 CONTACTING RM. 
 java.lang.ArithmeticException: / by zero
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282)
 at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers

2015-05-06 Thread Anubhav Dhoot (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anubhav Dhoot updated MAPREDUCE-6353:
-
Labels: BB2015-05-RFC  (was: BB2015-05-TBR)

 Divide by zero error in MR AM when calculating available containers
 ---

 Key: MAPREDUCE-6353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am
Reporter: Anubhav Dhoot
Assignee: Anubhav Dhoot
  Labels: BB2015-05-RFC
 Attachments: MAPREDUCE-6353.001.patch


 When running a sleep job with zero CPU vcores i see the following exception
 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN 
 CONTACTING RM. 
 java.lang.ArithmeticException: / by zero
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282)
 at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers

2015-05-06 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated MAPREDUCE-6353:

Labels:   (was: BB2015-05-RFC)

 Divide by zero error in MR AM when calculating available containers
 ---

 Key: MAPREDUCE-6353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am
Reporter: Anubhav Dhoot
Assignee: Anubhav Dhoot
 Attachments: MAPREDUCE-6353.001.patch


 When running a sleep job with zero CPU vcores i see the following exception
 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN 
 CONTACTING RM. 
 java.lang.ArithmeticException: / by zero
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282)
 at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers

2015-05-04 Thread Anubhav Dhoot (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anubhav Dhoot updated MAPREDUCE-6353:
-
Status: Patch Available  (was: Open)

 Divide by zero error in MR AM when calculating available containers
 ---

 Key: MAPREDUCE-6353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am
Reporter: Anubhav Dhoot
Assignee: Anubhav Dhoot
 Attachments: MAPREDUCE-6353.001.patch


 When running a sleep job with zero CPU vcores i see the following exception
 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN 
 CONTACTING RM. 
 java.lang.ArithmeticException: / by zero
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282)
 at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MAPREDUCE-6353) Divide by zero error in MR AM when calculating available containers

2015-05-04 Thread Anubhav Dhoot (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anubhav Dhoot updated MAPREDUCE-6353:
-
Attachment: MAPREDUCE-6353.001.patch

Fix that handles zero resource value

 Divide by zero error in MR AM when calculating available containers
 ---

 Key: MAPREDUCE-6353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am
Reporter: Anubhav Dhoot
Assignee: Anubhav Dhoot
 Attachments: MAPREDUCE-6353.001.patch


 When running a sleep job with zero CPU vcores i see the following exception
 2015-04-30 06:41:06,954 ERROR [RMCommunicator Allocator] 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN 
 CONTACTING RM. 
 java.lang.ArithmeticException: / by zero
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:947)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:840)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:247)
 at 
 org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282)
 at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)