[jira] [Updated] (HADOOP-9518) Create Compatibility page in doc with basic information

2013-04-27 Thread Karthik Kambatla (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Karthik Kambatla updated HADOOP-9518:
-

Attachment: base-doc.patch

Copied text over from the wiki page.

 Create Compatibility page in doc with basic information
 ---

 Key: HADOOP-9518
 URL: https://issues.apache.org/jira/browse/HADOOP-9518
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: documentation
Affects Versions: 2.0.4-alpha
Reporter: Karthik Kambatla
Assignee: Karthik Kambatla
 Attachments: base-doc.patch


 Create a doc page that we can iterate upon for individual items.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-9518) Create Compatibility page in doc with basic information

2013-04-27 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created HADOOP-9518:


 Summary: Create Compatibility page in doc with basic information
 Key: HADOOP-9518
 URL: https://issues.apache.org/jira/browse/HADOOP-9518
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: documentation
Affects Versions: 2.0.4-alpha
Reporter: Karthik Kambatla
Assignee: Karthik Kambatla
 Attachments: base-doc.patch

Create a doc page that we can iterate upon for individual items.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9518) Create Compatibility page in doc with basic information

2013-04-27 Thread Karthik Kambatla (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Karthik Kambatla updated HADOOP-9518:
-

Status: Patch Available  (was: Open)

 Create Compatibility page in doc with basic information
 ---

 Key: HADOOP-9518
 URL: https://issues.apache.org/jira/browse/HADOOP-9518
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: documentation
Affects Versions: 2.0.4-alpha
Reporter: Karthik Kambatla
Assignee: Karthik Kambatla
 Attachments: base-doc.patch


 Create a doc page that we can iterate upon for individual items.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9518) Create Compatibility page in doc with basic information

2013-04-27 Thread Karthik Kambatla (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643582#comment-13643582
 ] 

Karthik Kambatla commented on HADOOP-9518:
--

Ideally, we should add information regarding releases and intentions: major, 
minor, point. However, I wasn't sure if we should do that right away in lieu of 
the current numbering scheme.

 Create Compatibility page in doc with basic information
 ---

 Key: HADOOP-9518
 URL: https://issues.apache.org/jira/browse/HADOOP-9518
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: documentation
Affects Versions: 2.0.4-alpha
Reporter: Karthik Kambatla
Assignee: Karthik Kambatla
 Attachments: base-doc.patch


 Create a doc page that we can iterate upon for individual items.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-9519) Define compatibility for Java API

2013-04-27 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created HADOOP-9519:


 Summary: Define compatibility for Java API
 Key: HADOOP-9519
 URL: https://issues.apache.org/jira/browse/HADOOP-9519
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: documentation
Affects Versions: 2.0.4-alpha
Reporter: Karthik Kambatla
Assignee: Karthik Kambatla


Java API compatibility

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9519) Define compatibility for Java API

2013-04-27 Thread Karthik Kambatla (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Karthik Kambatla updated HADOOP-9519:
-

Attachment: hadoop-9519.patch

 Define compatibility for Java API
 -

 Key: HADOOP-9519
 URL: https://issues.apache.org/jira/browse/HADOOP-9519
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: documentation
Affects Versions: 2.0.4-alpha
Reporter: Karthik Kambatla
Assignee: Karthik Kambatla
 Attachments: hadoop-9519.patch


 Java API compatibility

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9518) Create Compatibility page in doc with basic information

2013-04-27 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643590#comment-13643590
 ] 

Hadoop QA commented on HADOOP-9518:
---

{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12580824/base-doc.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+0 tests included{color}.  The patch appears to be a 
documentation patch that doesn't require tests.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-common-project/hadoop-common.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2485//testReport/
Console output: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2485//console

This message is automatically generated.

 Create Compatibility page in doc with basic information
 ---

 Key: HADOOP-9518
 URL: https://issues.apache.org/jira/browse/HADOOP-9518
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: documentation
Affects Versions: 2.0.4-alpha
Reporter: Karthik Kambatla
Assignee: Karthik Kambatla
 Attachments: base-doc.patch


 Create a doc page that we can iterate upon for individual items.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9504) MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo

2013-04-27 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643624#comment-13643624
 ] 

Hudson commented on HADOOP-9504:


Integrated in Hadoop-Yarn-trunk #196 (See 
[https://builds.apache.org/job/Hadoop-Yarn-trunk/196/])
HADOOP-9504. MetricsDynamicMBeanBase has concurrency issues in 
createMBeanInfo. Contributed by Liang Xie (Revision 1476487)

 Result = SUCCESS
jlowe : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476487
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/util/MetricsDynamicMBeanBase.java


 MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo
 -

 Key: HADOOP-9504
 URL: https://issues.apache.org/jira/browse/HADOOP-9504
 Project: Hadoop Common
  Issue Type: Bug
  Components: metrics
Affects Versions: 3.0.0, 2.0.3-alpha
Reporter: Liang Xie
Assignee: Liang Xie
Priority: Critical
 Fix For: 2.0.5-beta, 0.23.8

 Attachments: HADOOP-9504-branch-1.txt, HADOOP-9504.txt, 
 HADOOP-9504-v2.txt


 Please see HBASE-8416 for detail information.
 we need to take care of the synchronization for HashMap put(), otherwise it 
 may lead to spin loop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-9520) _HOST doesn't resolve to bound interface

2013-04-27 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-9520:


 Summary: _HOST doesn't resolve to bound interface
 Key: HADOOP-9520
 URL: https://issues.apache.org/jira/browse/HADOOP-9520
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 2.0.4-alpha
Reporter: Allen Wittenauer


_HOST appears to ignore bound interfaces.  For example, if a host has two 
interfaces such that:

nic0 = gethostname()
nic1 = someothername

and then I configure the namenode or resource manager to use 
someothername:, the system still treats _HOST = nic0.  This is especially 
harmful for Kerberos principals.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-9521) krb5 replay error triggers log file DoS with Safari

2013-04-27 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-9521:


 Summary: krb5 replay error triggers log file DoS with Safari
 Key: HADOOP-9521
 URL: https://issues.apache.org/jira/browse/HADOOP-9521
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 2.0.4-alpha
Reporter: Allen Wittenauer
Priority: Blocker


While investigating YARN-621, looking at the web interface with Safari 
triggered a loop which both filled the log with stack traces as well as left 
the browser in a continual loading situation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9521) krb5 replay error triggers log file DoS with Safari

2013-04-27 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-9521:
-

Component/s: security
Environment: Mac OS X 10.8.3, Safari 6.0.3 (8536.28.10)

 krb5 replay error triggers log file DoS with Safari
 ---

 Key: HADOOP-9521
 URL: https://issues.apache.org/jira/browse/HADOOP-9521
 Project: Hadoop Common
  Issue Type: Bug
  Components: security
Affects Versions: 2.0.4-alpha
 Environment: Mac OS X 10.8.3, Safari 6.0.3 (8536.28.10)
Reporter: Allen Wittenauer
Priority: Blocker

 While investigating YARN-621, looking at the web interface with Safari 
 triggered a loop which both filled the log with stack traces as well as left 
 the browser in a continual loading situation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-9522) web interfaces are not logged until after opening

2013-04-27 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-9522:


 Summary: web interfaces are not logged until after opening
 Key: HADOOP-9522
 URL: https://issues.apache.org/jira/browse/HADOOP-9522
 Project: Hadoop Common
  Issue Type: Improvement
Affects Versions: 2.0.4-alpha
Reporter: Allen Wittenauer


If one mis-configures certain interfaces (in my case 
yarn.resourcemanager.webapp.address), neither Hadoop nor jetty throws any 
errors that the interface doesn't exist. Worse yet, the system appears to be 
hung. It would be better if we logged what hostname:port we were attempting to 
open before we opened it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9512) Add Hadoop-Vaidya to branch2

2013-04-27 Thread nemon lou (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

nemon lou updated HADOOP-9512:
--

Attachment: HADOOP-9512.patch

 Add Hadoop-Vaidya to branch2
 

 Key: HADOOP-9512
 URL: https://issues.apache.org/jira/browse/HADOOP-9512
 Project: Hadoop Common
  Issue Type: New Feature
  Components: tools
Affects Versions: 2.0.4-alpha
Reporter: nemon lou
 Attachments: HADOOP-9512.patch


 Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop 
 branch2.
 The only changes for supporting Hadoop2 are job history perser and job 
 counters ,etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9512) Add Hadoop-Vaidya to branch2

2013-04-27 Thread nemon lou (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

nemon lou updated HADOOP-9512:
--

Status: Patch Available  (was: Open)

Adding hadoop vaidya maven project with new history parser.
Most of the code is the same with hadoop vaidya 1.0.
We can use bin/yarn jar 
share/hadoop/tools/lib/hadoop-vaidya-3.0.0-SNAPSHOT.jar to run this tool.



 Add Hadoop-Vaidya to branch2
 

 Key: HADOOP-9512
 URL: https://issues.apache.org/jira/browse/HADOOP-9512
 Project: Hadoop Common
  Issue Type: New Feature
  Components: tools
Affects Versions: 2.0.4-alpha
Reporter: nemon lou
 Attachments: HADOOP-9512.patch


 Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop 
 branch2.
 The only changes for supporting Hadoop2 are job history perser and job 
 counters ,etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9504) MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo

2013-04-27 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643650#comment-13643650
 ] 

Hudson commented on HADOOP-9504:


Integrated in Hadoop-Hdfs-0.23-Build #594 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/594/])
svn merge -c 1476487 FIXES: HADOOP-9504. MetricsDynamicMBeanBase has 
concurrency issues in createMBeanInfo. Contributed by Liang Xie (Revision 
1476489)

 Result = FAILURE
jlowe : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476489
Files : 
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/util/MetricsDynamicMBeanBase.java


 MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo
 -

 Key: HADOOP-9504
 URL: https://issues.apache.org/jira/browse/HADOOP-9504
 Project: Hadoop Common
  Issue Type: Bug
  Components: metrics
Affects Versions: 3.0.0, 2.0.3-alpha
Reporter: Liang Xie
Assignee: Liang Xie
Priority: Critical
 Fix For: 2.0.5-beta, 0.23.8

 Attachments: HADOOP-9504-branch-1.txt, HADOOP-9504.txt, 
 HADOOP-9504-v2.txt


 Please see HBASE-8416 for detail information.
 we need to take care of the synchronization for HashMap put(), otherwise it 
 may lead to spin loop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9512) Add Hadoop-Vaidya to branch2

2013-04-27 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643652#comment-13643652
 ] 

Hadoop QA commented on HADOOP-9512:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12580833/HADOOP-9512.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 5 new 
or modified test files.

  {color:red}-1 javac{color}.  The applied patch generated 1369 javac 
compiler warnings (more than the trunk's current 1367 warnings).

{color:red}-1 javadoc{color}.  The javadoc tool appears to have generated 5 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:red}-1 findbugs{color}.  The patch appears to introduce 2 new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-tools/hadoop-tools-dist hadoop-tools/hadoop-vaidya.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2486//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2486//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-vaidya.html
Javac warnings: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2486//artifact/trunk/patchprocess/diffJavacWarnings.txt
Console output: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2486//console

This message is automatically generated.

 Add Hadoop-Vaidya to branch2
 

 Key: HADOOP-9512
 URL: https://issues.apache.org/jira/browse/HADOOP-9512
 Project: Hadoop Common
  Issue Type: New Feature
  Components: tools
Affects Versions: 2.0.4-alpha
Reporter: nemon lou
 Attachments: HADOOP-9512.patch


 Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop 
 branch2.
 The only changes for supporting Hadoop2 are job history perser and job 
 counters ,etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9504) MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo

2013-04-27 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643655#comment-13643655
 ] 

Hudson commented on HADOOP-9504:


Integrated in Hadoop-Hdfs-trunk #1385 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1385/])
HADOOP-9504. MetricsDynamicMBeanBase has concurrency issues in 
createMBeanInfo. Contributed by Liang Xie (Revision 1476487)

 Result = FAILURE
jlowe : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476487
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/util/MetricsDynamicMBeanBase.java


 MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo
 -

 Key: HADOOP-9504
 URL: https://issues.apache.org/jira/browse/HADOOP-9504
 Project: Hadoop Common
  Issue Type: Bug
  Components: metrics
Affects Versions: 3.0.0, 2.0.3-alpha
Reporter: Liang Xie
Assignee: Liang Xie
Priority: Critical
 Fix For: 2.0.5-beta, 0.23.8

 Attachments: HADOOP-9504-branch-1.txt, HADOOP-9504.txt, 
 HADOOP-9504-v2.txt


 Please see HBASE-8416 for detail information.
 we need to take care of the synchronization for HashMap put(), otherwise it 
 may lead to spin loop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9512) Add Hadoop-Vaidya to branch2

2013-04-27 Thread nemon lou (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

nemon lou updated HADOOP-9512:
--

Status: Open  (was: Patch Available)

 Add Hadoop-Vaidya to branch2
 

 Key: HADOOP-9512
 URL: https://issues.apache.org/jira/browse/HADOOP-9512
 Project: Hadoop Common
  Issue Type: New Feature
  Components: tools
Affects Versions: 2.0.4-alpha
Reporter: nemon lou
 Attachments: HADOOP-9512.patch


 Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop 
 branch2.
 The only changes for supporting Hadoop2 are job history perser and job 
 counters ,etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9504) MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo

2013-04-27 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643672#comment-13643672
 ] 

Hudson commented on HADOOP-9504:


Integrated in Hadoop-Mapreduce-trunk #1412 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1412/])
HADOOP-9504. MetricsDynamicMBeanBase has concurrency issues in 
createMBeanInfo. Contributed by Liang Xie (Revision 1476487)

 Result = SUCCESS
jlowe : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476487
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/util/MetricsDynamicMBeanBase.java


 MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo
 -

 Key: HADOOP-9504
 URL: https://issues.apache.org/jira/browse/HADOOP-9504
 Project: Hadoop Common
  Issue Type: Bug
  Components: metrics
Affects Versions: 3.0.0, 2.0.3-alpha
Reporter: Liang Xie
Assignee: Liang Xie
Priority: Critical
 Fix For: 2.0.5-beta, 0.23.8

 Attachments: HADOOP-9504-branch-1.txt, HADOOP-9504.txt, 
 HADOOP-9504-v2.txt


 Please see HBASE-8416 for detail information.
 we need to take care of the synchronization for HashMap put(), otherwise it 
 may lead to spin loop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9290) Some tests cannot load native library

2013-04-27 Thread Suresh Srinivas (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643681#comment-13643681
 ] 

Suresh Srinivas commented on HADOOP-9290:
-

+1 for the patch. I have committed it to trunk.

Thank you Chris! Thanks to Arpit and Ivan for reviews as well.

 Some tests cannot load native library
 -

 Key: HADOOP-9290
 URL: https://issues.apache.org/jira/browse/HADOOP-9290
 Project: Hadoop Common
  Issue Type: Bug
  Components: build, native
Affects Versions: 3.0.0
Reporter: Arpit Agarwal
Assignee: Chris Nauroth
 Attachments: HADOOP-9290.2.patch, HADOOP-9290.3.patch, 
 HADOOP-9290.4.patch, HADOOP-9290.patch


 Some tests are unable to load the native DLL on Windows. The culprit appears 
 to be an incorrect PATH configuration for the native-win profile in 
 hadoop-project/pom.xml.
 {code:xml}
 profile
   idnative-win/id
   activation
 os
   familyWindows/family
 /os
   /activation
   build
 plugins
   plugin
 groupIdorg.apache.maven.plugins/groupId
 artifactIdmaven-surefire-plugin/artifactId
 configuration
   environmentVariables
 !-- Specify where to look for the native DLL on Windows --
 
 PATH${env.PATH};${basedir}\..\..\hadoop-common-project\hadoop-common\target\bin;/PATH
   /environmentVariables
 /configuration
   /plugin
 /plugins
   /build
 /profile
 {code}
 This is evaluated independently by each project and the relative path is not 
 always correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9290) Some tests cannot load native library

2013-04-27 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643687#comment-13643687
 ] 

Hudson commented on HADOOP-9290:


Integrated in Hadoop-trunk-Commit #3678 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/3678/])
HADOOP-9290. Some tests cannot load native library on windows. Contributed 
by Chris Nauroth. (Revision 1476586)

 Result = SUCCESS
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476586
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/pom.xml
* /hadoop/common/trunk/hadoop-project/pom.xml
* 
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/pom.xml
* 
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/pom.xml
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/pom.xml


 Some tests cannot load native library
 -

 Key: HADOOP-9290
 URL: https://issues.apache.org/jira/browse/HADOOP-9290
 Project: Hadoop Common
  Issue Type: Bug
  Components: build, native
Affects Versions: 3.0.0
Reporter: Arpit Agarwal
Assignee: Chris Nauroth
 Attachments: HADOOP-9290.2.patch, HADOOP-9290.3.patch, 
 HADOOP-9290.4.patch, HADOOP-9290.patch


 Some tests are unable to load the native DLL on Windows. The culprit appears 
 to be an incorrect PATH configuration for the native-win profile in 
 hadoop-project/pom.xml.
 {code:xml}
 profile
   idnative-win/id
   activation
 os
   familyWindows/family
 /os
   /activation
   build
 plugins
   plugin
 groupIdorg.apache.maven.plugins/groupId
 artifactIdmaven-surefire-plugin/artifactId
 configuration
   environmentVariables
 !-- Specify where to look for the native DLL on Windows --
 
 PATH${env.PATH};${basedir}\..\..\hadoop-common-project\hadoop-common\target\bin;/PATH
   /environmentVariables
 /configuration
   /plugin
 /plugins
   /build
 /profile
 {code}
 This is evaluated independently by each project and the relative path is not 
 always correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9500) TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe

2013-04-27 Thread Suresh Srinivas (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suresh Srinivas updated HADOOP-9500:


   Resolution: Fixed
Fix Version/s: 3.0.0
 Hadoop Flags: Reviewed
   Status: Resolved  (was: Patch Available)

+1. Committed the patch to trunk. 

Thank you Chris. Thanks to Arpit for the review as well.

 TestUserGroupInformation#testGetServerSideGroups fails on Windows due to 
 failure to find winutils.exe
 -

 Key: HADOOP-9500
 URL: https://issues.apache.org/jira/browse/HADOOP-9500
 Project: Hadoop Common
  Issue Type: Bug
  Components: test
Affects Versions: 3.0.0
Reporter: Chris Nauroth
Assignee: Chris Nauroth
 Fix For: 3.0.0

 Attachments: HADOOP-9500.1.patch


 The test attempts to run the winutils groups command, but the initialization 
 logic fails to find the path to winutils.exe.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9413) Introduce common utils for File#setReadable/Writable/Executable and File#canRead/Write/Execute that work cross-platform

2013-04-27 Thread Chris Nauroth (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643710#comment-13643710
 ] 

Chris Nauroth commented on HADOOP-9413:
---

HADOOP-9290 just got committed to fix the native library loading.  Ivan, can we 
proceed with committing HADOOP-9413 now?  (I am still +1 after the recent 
rebase.)

 Introduce common utils for File#setReadable/Writable/Executable and 
 File#canRead/Write/Execute that work cross-platform
 ---

 Key: HADOOP-9413
 URL: https://issues.apache.org/jira/browse/HADOOP-9413
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Ivan Mitic
Assignee: Ivan Mitic
 Fix For: 3.0.0

 Attachments: HADOOP-9413.commonfileutils.2.patch, 
 HADOOP-9413.commonfileutils.3.patch, HADOOP-9413.commonfileutils.4.patch, 
 HADOOP-9413.commonfileutils.patch


 So far, we've seen many unittest and product bugs in Hadoop on Windows 
 because Java's APIs that manipulate with permissions do not work as expected. 
 We've addressed many of these problems on one-by-one basis (by either 
 changing code a bit or disabling the test). While debugging the remaining 
 unittest failures we continue to run into the same patterns of problems, and 
 instead of addressing them one-by-one, I propose that we expose a set of 
 equivalent wrapper APIs that will work well for all platforms.
 Scanning thru the codebase, this will actually be a simple change as there 
 are very few places that use File#setReadable/Writable/Executable and 
 File#canRead/Write/Execute (5 files in Common, 9 files in HDFS).
 HADOOP-8973 contains additional context on the problem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9500) TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe

2013-04-27 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643716#comment-13643716
 ] 

Hudson commented on HADOOP-9500:


Integrated in Hadoop-trunk-Commit #3682 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/3682/])
HADOOP-9500. TestUserGroupInformation#testGetServerSideGroups fails on 
Windows due to failure to find winutils.exe. Contributed by Chris Nauroth. 
(Revision 1476606)

 Result = SUCCESS
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476606
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUserGroupInformation.java


 TestUserGroupInformation#testGetServerSideGroups fails on Windows due to 
 failure to find winutils.exe
 -

 Key: HADOOP-9500
 URL: https://issues.apache.org/jira/browse/HADOOP-9500
 Project: Hadoop Common
  Issue Type: Bug
  Components: test
Affects Versions: 3.0.0
Reporter: Chris Nauroth
Assignee: Chris Nauroth
 Fix For: 3.0.0

 Attachments: HADOOP-9500.1.patch


 The test attempts to run the winutils groups command, but the initialization 
 logic fails to find the path to winutils.exe.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9490) LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename

2013-04-27 Thread Suresh Srinivas (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643719#comment-13643719
 ] 

Suresh Srinivas commented on HADOOP-9490:
-

I think calling {{close()}} in {{LocalFileSystem}} seems fine to me. +1 for the 
patch.

 LocalFileSystem#reportChecksumFailure not closing the checksum file handle 
 before rename
 

 Key: HADOOP-9490
 URL: https://issues.apache.org/jira/browse/HADOOP-9490
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 3.0.0
Reporter: Ivan Mitic
Assignee: Ivan Mitic
 Attachments: HADOOP-9490.patch


 LocalFileSystem#reportChecksumFailure is not closing the open stream on the 
 checksum file before it moves it to the bad_files folder, what causes the 
 operation to fail on Windows.
 TestLocalFileSystem fail on Windows because of this:
 {code}
 testReportChecksumFailure(org.apache.hadoop.fs.TestLocalFileSystem)  Time 
 elapsed: 31 sec   FAILURE!
 java.lang.AssertionError: 
   at org.junit.Assert.fail(Assert.java:91)
   at org.junit.Assert.assertTrue(Assert.java:43)
   at org.junit.Assert.assertTrue(Assert.java:54)
   at 
 org.apache.hadoop.fs.TestLocalFileSystem.testReportChecksumFailure(TestLocalFileSystem.java:335)
 {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9490) LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename

2013-04-27 Thread Suresh Srinivas (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suresh Srinivas updated HADOOP-9490:


   Resolution: Fixed
Fix Version/s: 3.0.0
 Hadoop Flags: Reviewed
   Status: Resolved  (was: Patch Available)

I committed the patch to trunk. 

Thank you Ivan.

 LocalFileSystem#reportChecksumFailure not closing the checksum file handle 
 before rename
 

 Key: HADOOP-9490
 URL: https://issues.apache.org/jira/browse/HADOOP-9490
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 3.0.0
Reporter: Ivan Mitic
Assignee: Ivan Mitic
 Fix For: 3.0.0

 Attachments: HADOOP-9490.patch


 LocalFileSystem#reportChecksumFailure is not closing the open stream on the 
 checksum file before it moves it to the bad_files folder, what causes the 
 operation to fail on Windows.
 TestLocalFileSystem fail on Windows because of this:
 {code}
 testReportChecksumFailure(org.apache.hadoop.fs.TestLocalFileSystem)  Time 
 elapsed: 31 sec   FAILURE!
 java.lang.AssertionError: 
   at org.junit.Assert.fail(Assert.java:91)
   at org.junit.Assert.assertTrue(Assert.java:43)
   at org.junit.Assert.assertTrue(Assert.java:54)
   at 
 org.apache.hadoop.fs.TestLocalFileSystem.testReportChecksumFailure(TestLocalFileSystem.java:335)
 {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9490) LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename

2013-04-27 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643724#comment-13643724
 ] 

Hudson commented on HADOOP-9490:


Integrated in Hadoop-trunk-Commit #3683 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/3683/])
HADOOP-9490. LocalFileSystem#reportChecksumFailure not closing the checksum 
file handle before rename. Contributed by Ivan Mitic. (Revision 1476609)

 Result = SUCCESS
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476609
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/LocalFileSystem.java


 LocalFileSystem#reportChecksumFailure not closing the checksum file handle 
 before rename
 

 Key: HADOOP-9490
 URL: https://issues.apache.org/jira/browse/HADOOP-9490
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 3.0.0
Reporter: Ivan Mitic
Assignee: Ivan Mitic
 Fix For: 3.0.0

 Attachments: HADOOP-9490.patch


 LocalFileSystem#reportChecksumFailure is not closing the open stream on the 
 checksum file before it moves it to the bad_files folder, what causes the 
 operation to fail on Windows.
 TestLocalFileSystem fail on Windows because of this:
 {code}
 testReportChecksumFailure(org.apache.hadoop.fs.TestLocalFileSystem)  Time 
 elapsed: 31 sec   FAILURE!
 java.lang.AssertionError: 
   at org.junit.Assert.fail(Assert.java:91)
   at org.junit.Assert.assertTrue(Assert.java:43)
   at org.junit.Assert.assertTrue(Assert.java:54)
   at 
 org.apache.hadoop.fs.TestLocalFileSystem.testReportChecksumFailure(TestLocalFileSystem.java:335)
 {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9504) MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo

2013-04-27 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643829#comment-13643829
 ] 

stack commented on HADOOP-9504:
---

[~mattf] To add to [~jlowe] 's petition, while this may not alone be 
significant enough to trigger a 1.* patch release, I would suggest it important 
enough to include in any coming 1.* release.  We have experienced a number of 
production hbase installs beyond the one described in hbase-8416 where a server 
starts using all CPUs though effectively idle requiring ops intervention to do 
a node decommission and restart.  Thanks.

 MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo
 -

 Key: HADOOP-9504
 URL: https://issues.apache.org/jira/browse/HADOOP-9504
 Project: Hadoop Common
  Issue Type: Bug
  Components: metrics
Affects Versions: 3.0.0, 2.0.3-alpha
Reporter: Liang Xie
Assignee: Liang Xie
Priority: Critical
 Fix For: 2.0.5-beta, 0.23.8

 Attachments: HADOOP-9504-branch-1.txt, HADOOP-9504.txt, 
 HADOOP-9504-v2.txt


 Please see HBASE-8416 for detail information.
 we need to take care of the synchronization for HashMap put(), otherwise it 
 may lead to spin loop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9512) Add Hadoop-Vaidya to branch2

2013-04-27 Thread nemon lou (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

nemon lou updated HADOOP-9512:
--

Attachment: HADOOP-9512.patch

Fix the warnings

 Add Hadoop-Vaidya to branch2
 

 Key: HADOOP-9512
 URL: https://issues.apache.org/jira/browse/HADOOP-9512
 Project: Hadoop Common
  Issue Type: New Feature
  Components: tools
Affects Versions: 2.0.4-alpha
Reporter: nemon lou
 Attachments: HADOOP-9512.patch, HADOOP-9512.patch


 Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop 
 branch2.
 The only changes for supporting Hadoop2 are job history perser and job 
 counters ,etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9512) Add Hadoop-Vaidya to branch2

2013-04-27 Thread nemon lou (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

nemon lou updated HADOOP-9512:
--

Status: Patch Available  (was: Open)

 Add Hadoop-Vaidya to branch2
 

 Key: HADOOP-9512
 URL: https://issues.apache.org/jira/browse/HADOOP-9512
 Project: Hadoop Common
  Issue Type: New Feature
  Components: tools
Affects Versions: 2.0.4-alpha
Reporter: nemon lou
 Attachments: HADOOP-9512.patch, HADOOP-9512.patch


 Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop 
 branch2.
 The only changes for supporting Hadoop2 are job history perser and job 
 counters ,etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9512) Add Hadoop-Vaidya to branch2

2013-04-27 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643893#comment-13643893
 ] 

Hadoop QA commented on HADOOP-9512:
---

{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12580867/HADOOP-9512.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 5 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-tools/hadoop-tools-dist hadoop-tools/hadoop-vaidya.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2487//testReport/
Console output: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2487//console

This message is automatically generated.

 Add Hadoop-Vaidya to branch2
 

 Key: HADOOP-9512
 URL: https://issues.apache.org/jira/browse/HADOOP-9512
 Project: Hadoop Common
  Issue Type: New Feature
  Components: tools
Affects Versions: 2.0.4-alpha
Reporter: nemon lou
 Attachments: HADOOP-9512.patch, HADOOP-9512.patch


 Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop 
 branch2.
 The only changes for supporting Hadoop2 are job history perser and job 
 counters ,etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira