[jira] [Updated] (MAPREDUCE-3944) JobHistory web services are slower then the UI and can easly overload the JH

[Siddharth Seth (Updated) (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Siddharth Seth updated MAPREDUCE-3944:
--

  Resolution: Fixed
   Fix Version/s: 0.23.2
Target Version/s: 0.24.0, 0.23.2  (was: 0.23.2, 0.24.0)
Hadoop Flags: Reviewed
  Status: Resolved  (was: Patch Available)

Committed to trunk, branch-0.23 and branch-0.23.2

> JobHistory web services are slower then the UI and can easly overload the JH
> 
>
> Key: MAPREDUCE-3944
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3944
> Project: Hadoop Map/Reduce
>  Issue Type: Sub-task
>  Components: mrv2
>Affects Versions: 0.23.1, 0.23.2
>Reporter: Robert Joseph Evans
>Assignee: Robert Joseph Evans
>Priority: Blocker
> Fix For: 0.23.2
>
> Attachments: MR-3944.txt, MR-3944.txt
>
>
> When our first customer started using the Job History web services today the 
> History Server ground to a halt.  We found 250 Jetty threads stuck on the 
> following stack trace.
> {noformat}
>java.lang.Thread.State: BLOCKED (on object monitor)
> at 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory.getJob(JobHistory.java:898)
> - waiting to lock <0x2aaab364ba60> (a 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory)
> at 
> org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices.getJobs(HsWebServices.java:188)
> {noformat}
> HsWebServices.java:188 corresponds to the /mapreduce/jobs service.
> Looking at the code there are a number of optimizations that need to be done 
> to improve its performance.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3944) JobHistory web services are slower then the UI and can easly overload the JH

[Robert Joseph Evans (Updated) (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Joseph Evans updated MAPREDUCE-3944:
---

Target Version/s: 0.24.0, 0.23.2  (was: 0.23.2, 0.24.0)
  Status: Patch Available  (was: Open)

> JobHistory web services are slower then the UI and can easly overload the JH
> 
>
> Key: MAPREDUCE-3944
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3944
> Project: Hadoop Map/Reduce
>  Issue Type: Sub-task
>  Components: mrv2
>Affects Versions: 0.23.1, 0.23.2
>Reporter: Robert Joseph Evans
>Assignee: Robert Joseph Evans
>Priority: Blocker
> Attachments: MR-3944.txt, MR-3944.txt
>
>
> When our first customer started using the Job History web services today the 
> History Server ground to a halt.  We found 250 Jetty threads stuck on the 
> following stack trace.
> {noformat}
>java.lang.Thread.State: BLOCKED (on object monitor)
> at 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory.getJob(JobHistory.java:898)
> - waiting to lock <0x2aaab364ba60> (a 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory)
> at 
> org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices.getJobs(HsWebServices.java:188)
> {noformat}
> HsWebServices.java:188 corresponds to the /mapreduce/jobs service.
> Looking at the code there are a number of optimizations that need to be done 
> to improve its performance.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3944) JobHistory web services are slower then the UI and can easly overload the JH

[Robert Joseph Evans (Updated) (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Joseph Evans updated MAPREDUCE-3944:
---

Attachment: MR-3944.txt

Added in the new file

> JobHistory web services are slower then the UI and can easly overload the JH
> 
>
> Key: MAPREDUCE-3944
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3944
> Project: Hadoop Map/Reduce
>  Issue Type: Sub-task
>  Components: mrv2
>Affects Versions: 0.23.1, 0.23.2
>Reporter: Robert Joseph Evans
>Assignee: Robert Joseph Evans
>Priority: Blocker
> Attachments: MR-3944.txt, MR-3944.txt
>
>
> When our first customer started using the Job History web services today the 
> History Server ground to a halt.  We found 250 Jetty threads stuck on the 
> following stack trace.
> {noformat}
>java.lang.Thread.State: BLOCKED (on object monitor)
> at 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory.getJob(JobHistory.java:898)
> - waiting to lock <0x2aaab364ba60> (a 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory)
> at 
> org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices.getJobs(HsWebServices.java:188)
> {noformat}
> HsWebServices.java:188 corresponds to the /mapreduce/jobs service.
> Looking at the code there are a number of optimizations that need to be done 
> to improve its performance.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3944) JobHistory web services are slower then the UI and can easly overload the JH

[Robert Joseph Evans (Updated) (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Joseph Evans updated MAPREDUCE-3944:
---

Target Version/s: 0.24.0, 0.23.2  (was: 0.23.2, 0.24.0)
  Status: Open  (was: Patch Available)

You are correct that I missed it.  Sorry about that.

> JobHistory web services are slower then the UI and can easly overload the JH
> 
>
> Key: MAPREDUCE-3944
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3944
> Project: Hadoop Map/Reduce
>  Issue Type: Sub-task
>  Components: mrv2
>Affects Versions: 0.23.1, 0.23.2
>Reporter: Robert Joseph Evans
>Assignee: Robert Joseph Evans
>Priority: Blocker
> Attachments: MR-3944.txt
>
>
> When our first customer started using the Job History web services today the 
> History Server ground to a halt.  We found 250 Jetty threads stuck on the 
> following stack trace.
> {noformat}
>java.lang.Thread.State: BLOCKED (on object monitor)
> at 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory.getJob(JobHistory.java:898)
> - waiting to lock <0x2aaab364ba60> (a 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory)
> at 
> org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices.getJobs(HsWebServices.java:188)
> {noformat}
> HsWebServices.java:188 corresponds to the /mapreduce/jobs service.
> Looking at the code there are a number of optimizations that need to be done 
> to improve its performance.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3944) JobHistory web services are slower then the UI and can easly overload the JH

[Vinod Kumar Vavilapalli (Updated) (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinod Kumar Vavilapalli updated MAPREDUCE-3944:
---

Issue Type: Sub-task  (was: Bug)
Parent: MAPREDUCE-3973

> JobHistory web services are slower then the UI and can easly overload the JH
> 
>
> Key: MAPREDUCE-3944
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3944
> Project: Hadoop Map/Reduce
>  Issue Type: Sub-task
>  Components: mrv2
>Affects Versions: 0.23.1, 0.23.2
>Reporter: Robert Joseph Evans
>Assignee: Robert Joseph Evans
>Priority: Blocker
> Attachments: MR-3944.txt
>
>
> When our first customer started using the Job History web services today the 
> History Server ground to a halt.  We found 250 Jetty threads stuck on the 
> following stack trace.
> {noformat}
>java.lang.Thread.State: BLOCKED (on object monitor)
> at 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory.getJob(JobHistory.java:898)
> - waiting to lock <0x2aaab364ba60> (a 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory)
> at 
> org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices.getJobs(HsWebServices.java:188)
> {noformat}
> HsWebServices.java:188 corresponds to the /mapreduce/jobs service.
> Looking at the code there are a number of optimizations that need to be done 
> to improve its performance.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3944) JobHistory web services are slower then the UI and can easly overload the JH

[Robert Joseph Evans (Updated) (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Joseph Evans updated MAPREDUCE-3944:
---

Attachment: MR-3944.txt

This changes the Web service to use a partial job, when returning a full list 
of jobs.  I will file a separate JIRA to deal with the locking issues, and a 
separate one to look at how we can update the web service to reduce the load it 
puts on the system, like cursers.

> JobHistory web services are slower then the UI and can easly overload the JH
> 
>
> Key: MAPREDUCE-3944
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3944
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mrv2
>Affects Versions: 0.23.1, 0.23.2
>Reporter: Robert Joseph Evans
>Assignee: Robert Joseph Evans
>Priority: Blocker
> Attachments: MR-3944.txt
>
>
> When our first customer started using the Job History web services today the 
> History Server ground to a halt.  We found 250 Jetty threads stuck on the 
> following stack trace.
> {noformat}
>java.lang.Thread.State: BLOCKED (on object monitor)
> at 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory.getJob(JobHistory.java:898)
> - waiting to lock <0x2aaab364ba60> (a 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory)
> at 
> org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices.getJobs(HsWebServices.java:188)
> {noformat}
> HsWebServices.java:188 corresponds to the /mapreduce/jobs service.
> Looking at the code there are a number of optimizations that need to be done 
> to improve its performance.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3944) JobHistory web services are slower then the UI and can easly overload the JH

[Robert Joseph Evans (Updated) (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Joseph Evans updated MAPREDUCE-3944:
---

Target Version/s: 0.24.0, 0.23.2  (was: 0.23.2, 0.24.0)
  Status: Patch Available  (was: Open)

> JobHistory web services are slower then the UI and can easly overload the JH
> 
>
> Key: MAPREDUCE-3944
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3944
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mrv2
>Affects Versions: 0.23.1, 0.23.2
>Reporter: Robert Joseph Evans
>Assignee: Robert Joseph Evans
>Priority: Blocker
> Attachments: MR-3944.txt
>
>
> When our first customer started using the Job History web services today the 
> History Server ground to a halt.  We found 250 Jetty threads stuck on the 
> following stack trace.
> {noformat}
>java.lang.Thread.State: BLOCKED (on object monitor)
> at 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory.getJob(JobHistory.java:898)
> - waiting to lock <0x2aaab364ba60> (a 
> org.apache.hadoop.mapreduce.v2.hs.JobHistory)
> at 
> org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices.getJobs(HsWebServices.java:188)
> {noformat}
> HsWebServices.java:188 corresponds to the /mapreduce/jobs service.
> Looking at the code there are a number of optimizations that need to be done 
> to improve its performance.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira