[jira] [Updated] (HADOOP-9518) Create Compatibility page in doc with basic information
[ https://issues.apache.org/jira/browse/HADOOP-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HADOOP-9518: - Attachment: base-doc.patch Copied text over from the wiki page. Create Compatibility page in doc with basic information --- Key: HADOOP-9518 URL: https://issues.apache.org/jira/browse/HADOOP-9518 Project: Hadoop Common Issue Type: Sub-task Components: documentation Affects Versions: 2.0.4-alpha Reporter: Karthik Kambatla Assignee: Karthik Kambatla Attachments: base-doc.patch Create a doc page that we can iterate upon for individual items. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9518) Create Compatibility page in doc with basic information
Karthik Kambatla created HADOOP-9518: Summary: Create Compatibility page in doc with basic information Key: HADOOP-9518 URL: https://issues.apache.org/jira/browse/HADOOP-9518 Project: Hadoop Common Issue Type: Sub-task Components: documentation Affects Versions: 2.0.4-alpha Reporter: Karthik Kambatla Assignee: Karthik Kambatla Attachments: base-doc.patch Create a doc page that we can iterate upon for individual items. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9518) Create Compatibility page in doc with basic information
[ https://issues.apache.org/jira/browse/HADOOP-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HADOOP-9518: - Status: Patch Available (was: Open) Create Compatibility page in doc with basic information --- Key: HADOOP-9518 URL: https://issues.apache.org/jira/browse/HADOOP-9518 Project: Hadoop Common Issue Type: Sub-task Components: documentation Affects Versions: 2.0.4-alpha Reporter: Karthik Kambatla Assignee: Karthik Kambatla Attachments: base-doc.patch Create a doc page that we can iterate upon for individual items. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9518) Create Compatibility page in doc with basic information
[ https://issues.apache.org/jira/browse/HADOOP-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643582#comment-13643582 ] Karthik Kambatla commented on HADOOP-9518: -- Ideally, we should add information regarding releases and intentions: major, minor, point. However, I wasn't sure if we should do that right away in lieu of the current numbering scheme. Create Compatibility page in doc with basic information --- Key: HADOOP-9518 URL: https://issues.apache.org/jira/browse/HADOOP-9518 Project: Hadoop Common Issue Type: Sub-task Components: documentation Affects Versions: 2.0.4-alpha Reporter: Karthik Kambatla Assignee: Karthik Kambatla Attachments: base-doc.patch Create a doc page that we can iterate upon for individual items. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9519) Define compatibility for Java API
Karthik Kambatla created HADOOP-9519: Summary: Define compatibility for Java API Key: HADOOP-9519 URL: https://issues.apache.org/jira/browse/HADOOP-9519 Project: Hadoop Common Issue Type: Sub-task Components: documentation Affects Versions: 2.0.4-alpha Reporter: Karthik Kambatla Assignee: Karthik Kambatla Java API compatibility -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9519) Define compatibility for Java API
[ https://issues.apache.org/jira/browse/HADOOP-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HADOOP-9519: - Attachment: hadoop-9519.patch Define compatibility for Java API - Key: HADOOP-9519 URL: https://issues.apache.org/jira/browse/HADOOP-9519 Project: Hadoop Common Issue Type: Sub-task Components: documentation Affects Versions: 2.0.4-alpha Reporter: Karthik Kambatla Assignee: Karthik Kambatla Attachments: hadoop-9519.patch Java API compatibility -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9518) Create Compatibility page in doc with basic information
[ https://issues.apache.org/jira/browse/HADOOP-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643590#comment-13643590 ] Hadoop QA commented on HADOOP-9518: --- {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12580824/base-doc.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+0 tests included{color}. The patch appears to be a documentation patch that doesn't require tests. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2485//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2485//console This message is automatically generated. Create Compatibility page in doc with basic information --- Key: HADOOP-9518 URL: https://issues.apache.org/jira/browse/HADOOP-9518 Project: Hadoop Common Issue Type: Sub-task Components: documentation Affects Versions: 2.0.4-alpha Reporter: Karthik Kambatla Assignee: Karthik Kambatla Attachments: base-doc.patch Create a doc page that we can iterate upon for individual items. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9504) MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo
[ https://issues.apache.org/jira/browse/HADOOP-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643624#comment-13643624 ] Hudson commented on HADOOP-9504: Integrated in Hadoop-Yarn-trunk #196 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/196/]) HADOOP-9504. MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo. Contributed by Liang Xie (Revision 1476487) Result = SUCCESS jlowe : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476487 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/util/MetricsDynamicMBeanBase.java MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo - Key: HADOOP-9504 URL: https://issues.apache.org/jira/browse/HADOOP-9504 Project: Hadoop Common Issue Type: Bug Components: metrics Affects Versions: 3.0.0, 2.0.3-alpha Reporter: Liang Xie Assignee: Liang Xie Priority: Critical Fix For: 2.0.5-beta, 0.23.8 Attachments: HADOOP-9504-branch-1.txt, HADOOP-9504.txt, HADOOP-9504-v2.txt Please see HBASE-8416 for detail information. we need to take care of the synchronization for HashMap put(), otherwise it may lead to spin loop. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9520) _HOST doesn't resolve to bound interface
Allen Wittenauer created HADOOP-9520: Summary: _HOST doesn't resolve to bound interface Key: HADOOP-9520 URL: https://issues.apache.org/jira/browse/HADOOP-9520 Project: Hadoop Common Issue Type: Bug Affects Versions: 2.0.4-alpha Reporter: Allen Wittenauer _HOST appears to ignore bound interfaces. For example, if a host has two interfaces such that: nic0 = gethostname() nic1 = someothername and then I configure the namenode or resource manager to use someothername:, the system still treats _HOST = nic0. This is especially harmful for Kerberos principals. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9521) krb5 replay error triggers log file DoS with Safari
Allen Wittenauer created HADOOP-9521: Summary: krb5 replay error triggers log file DoS with Safari Key: HADOOP-9521 URL: https://issues.apache.org/jira/browse/HADOOP-9521 Project: Hadoop Common Issue Type: Bug Affects Versions: 2.0.4-alpha Reporter: Allen Wittenauer Priority: Blocker While investigating YARN-621, looking at the web interface with Safari triggered a loop which both filled the log with stack traces as well as left the browser in a continual loading situation. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9521) krb5 replay error triggers log file DoS with Safari
[ https://issues.apache.org/jira/browse/HADOOP-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-9521: - Component/s: security Environment: Mac OS X 10.8.3, Safari 6.0.3 (8536.28.10) krb5 replay error triggers log file DoS with Safari --- Key: HADOOP-9521 URL: https://issues.apache.org/jira/browse/HADOOP-9521 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions: 2.0.4-alpha Environment: Mac OS X 10.8.3, Safari 6.0.3 (8536.28.10) Reporter: Allen Wittenauer Priority: Blocker While investigating YARN-621, looking at the web interface with Safari triggered a loop which both filled the log with stack traces as well as left the browser in a continual loading situation. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9522) web interfaces are not logged until after opening
Allen Wittenauer created HADOOP-9522: Summary: web interfaces are not logged until after opening Key: HADOOP-9522 URL: https://issues.apache.org/jira/browse/HADOOP-9522 Project: Hadoop Common Issue Type: Improvement Affects Versions: 2.0.4-alpha Reporter: Allen Wittenauer If one mis-configures certain interfaces (in my case yarn.resourcemanager.webapp.address), neither Hadoop nor jetty throws any errors that the interface doesn't exist. Worse yet, the system appears to be hung. It would be better if we logged what hostname:port we were attempting to open before we opened it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9512) Add Hadoop-Vaidya to branch2
[ https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nemon lou updated HADOOP-9512: -- Attachment: HADOOP-9512.patch Add Hadoop-Vaidya to branch2 Key: HADOOP-9512 URL: https://issues.apache.org/jira/browse/HADOOP-9512 Project: Hadoop Common Issue Type: New Feature Components: tools Affects Versions: 2.0.4-alpha Reporter: nemon lou Attachments: HADOOP-9512.patch Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop branch2. The only changes for supporting Hadoop2 are job history perser and job counters ,etc. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9512) Add Hadoop-Vaidya to branch2
[ https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nemon lou updated HADOOP-9512: -- Status: Patch Available (was: Open) Adding hadoop vaidya maven project with new history parser. Most of the code is the same with hadoop vaidya 1.0. We can use bin/yarn jar share/hadoop/tools/lib/hadoop-vaidya-3.0.0-SNAPSHOT.jar to run this tool. Add Hadoop-Vaidya to branch2 Key: HADOOP-9512 URL: https://issues.apache.org/jira/browse/HADOOP-9512 Project: Hadoop Common Issue Type: New Feature Components: tools Affects Versions: 2.0.4-alpha Reporter: nemon lou Attachments: HADOOP-9512.patch Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop branch2. The only changes for supporting Hadoop2 are job history perser and job counters ,etc. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9504) MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo
[ https://issues.apache.org/jira/browse/HADOOP-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643650#comment-13643650 ] Hudson commented on HADOOP-9504: Integrated in Hadoop-Hdfs-0.23-Build #594 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/594/]) svn merge -c 1476487 FIXES: HADOOP-9504. MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo. Contributed by Liang Xie (Revision 1476489) Result = FAILURE jlowe : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476489 Files : * /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/util/MetricsDynamicMBeanBase.java MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo - Key: HADOOP-9504 URL: https://issues.apache.org/jira/browse/HADOOP-9504 Project: Hadoop Common Issue Type: Bug Components: metrics Affects Versions: 3.0.0, 2.0.3-alpha Reporter: Liang Xie Assignee: Liang Xie Priority: Critical Fix For: 2.0.5-beta, 0.23.8 Attachments: HADOOP-9504-branch-1.txt, HADOOP-9504.txt, HADOOP-9504-v2.txt Please see HBASE-8416 for detail information. we need to take care of the synchronization for HashMap put(), otherwise it may lead to spin loop. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9512) Add Hadoop-Vaidya to branch2
[ https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643652#comment-13643652 ] Hadoop QA commented on HADOOP-9512: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12580833/HADOOP-9512.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 5 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 1369 javac compiler warnings (more than the trunk's current 1367 warnings). {color:red}-1 javadoc{color}. The javadoc tool appears to have generated 5 warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-tools/hadoop-tools-dist hadoop-tools/hadoop-vaidya. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2486//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2486//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-vaidya.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2486//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2486//console This message is automatically generated. Add Hadoop-Vaidya to branch2 Key: HADOOP-9512 URL: https://issues.apache.org/jira/browse/HADOOP-9512 Project: Hadoop Common Issue Type: New Feature Components: tools Affects Versions: 2.0.4-alpha Reporter: nemon lou Attachments: HADOOP-9512.patch Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop branch2. The only changes for supporting Hadoop2 are job history perser and job counters ,etc. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9504) MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo
[ https://issues.apache.org/jira/browse/HADOOP-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643655#comment-13643655 ] Hudson commented on HADOOP-9504: Integrated in Hadoop-Hdfs-trunk #1385 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1385/]) HADOOP-9504. MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo. Contributed by Liang Xie (Revision 1476487) Result = FAILURE jlowe : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476487 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/util/MetricsDynamicMBeanBase.java MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo - Key: HADOOP-9504 URL: https://issues.apache.org/jira/browse/HADOOP-9504 Project: Hadoop Common Issue Type: Bug Components: metrics Affects Versions: 3.0.0, 2.0.3-alpha Reporter: Liang Xie Assignee: Liang Xie Priority: Critical Fix For: 2.0.5-beta, 0.23.8 Attachments: HADOOP-9504-branch-1.txt, HADOOP-9504.txt, HADOOP-9504-v2.txt Please see HBASE-8416 for detail information. we need to take care of the synchronization for HashMap put(), otherwise it may lead to spin loop. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9512) Add Hadoop-Vaidya to branch2
[ https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nemon lou updated HADOOP-9512: -- Status: Open (was: Patch Available) Add Hadoop-Vaidya to branch2 Key: HADOOP-9512 URL: https://issues.apache.org/jira/browse/HADOOP-9512 Project: Hadoop Common Issue Type: New Feature Components: tools Affects Versions: 2.0.4-alpha Reporter: nemon lou Attachments: HADOOP-9512.patch Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop branch2. The only changes for supporting Hadoop2 are job history perser and job counters ,etc. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9504) MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo
[ https://issues.apache.org/jira/browse/HADOOP-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643672#comment-13643672 ] Hudson commented on HADOOP-9504: Integrated in Hadoop-Mapreduce-trunk #1412 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1412/]) HADOOP-9504. MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo. Contributed by Liang Xie (Revision 1476487) Result = SUCCESS jlowe : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476487 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/util/MetricsDynamicMBeanBase.java MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo - Key: HADOOP-9504 URL: https://issues.apache.org/jira/browse/HADOOP-9504 Project: Hadoop Common Issue Type: Bug Components: metrics Affects Versions: 3.0.0, 2.0.3-alpha Reporter: Liang Xie Assignee: Liang Xie Priority: Critical Fix For: 2.0.5-beta, 0.23.8 Attachments: HADOOP-9504-branch-1.txt, HADOOP-9504.txt, HADOOP-9504-v2.txt Please see HBASE-8416 for detail information. we need to take care of the synchronization for HashMap put(), otherwise it may lead to spin loop. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9290) Some tests cannot load native library
[ https://issues.apache.org/jira/browse/HADOOP-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643681#comment-13643681 ] Suresh Srinivas commented on HADOOP-9290: - +1 for the patch. I have committed it to trunk. Thank you Chris! Thanks to Arpit and Ivan for reviews as well. Some tests cannot load native library - Key: HADOOP-9290 URL: https://issues.apache.org/jira/browse/HADOOP-9290 Project: Hadoop Common Issue Type: Bug Components: build, native Affects Versions: 3.0.0 Reporter: Arpit Agarwal Assignee: Chris Nauroth Attachments: HADOOP-9290.2.patch, HADOOP-9290.3.patch, HADOOP-9290.4.patch, HADOOP-9290.patch Some tests are unable to load the native DLL on Windows. The culprit appears to be an incorrect PATH configuration for the native-win profile in hadoop-project/pom.xml. {code:xml} profile idnative-win/id activation os familyWindows/family /os /activation build plugins plugin groupIdorg.apache.maven.plugins/groupId artifactIdmaven-surefire-plugin/artifactId configuration environmentVariables !-- Specify where to look for the native DLL on Windows -- PATH${env.PATH};${basedir}\..\..\hadoop-common-project\hadoop-common\target\bin;/PATH /environmentVariables /configuration /plugin /plugins /build /profile {code} This is evaluated independently by each project and the relative path is not always correct. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9290) Some tests cannot load native library
[ https://issues.apache.org/jira/browse/HADOOP-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643687#comment-13643687 ] Hudson commented on HADOOP-9290: Integrated in Hadoop-trunk-Commit #3678 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/3678/]) HADOOP-9290. Some tests cannot load native library on windows. Contributed by Chris Nauroth. (Revision 1476586) Result = SUCCESS suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476586 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/pom.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/pom.xml * /hadoop/common/trunk/hadoop-project/pom.xml * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/pom.xml * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/pom.xml * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/pom.xml Some tests cannot load native library - Key: HADOOP-9290 URL: https://issues.apache.org/jira/browse/HADOOP-9290 Project: Hadoop Common Issue Type: Bug Components: build, native Affects Versions: 3.0.0 Reporter: Arpit Agarwal Assignee: Chris Nauroth Attachments: HADOOP-9290.2.patch, HADOOP-9290.3.patch, HADOOP-9290.4.patch, HADOOP-9290.patch Some tests are unable to load the native DLL on Windows. The culprit appears to be an incorrect PATH configuration for the native-win profile in hadoop-project/pom.xml. {code:xml} profile idnative-win/id activation os familyWindows/family /os /activation build plugins plugin groupIdorg.apache.maven.plugins/groupId artifactIdmaven-surefire-plugin/artifactId configuration environmentVariables !-- Specify where to look for the native DLL on Windows -- PATH${env.PATH};${basedir}\..\..\hadoop-common-project\hadoop-common\target\bin;/PATH /environmentVariables /configuration /plugin /plugins /build /profile {code} This is evaluated independently by each project and the relative path is not always correct. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9500) TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe
[ https://issues.apache.org/jira/browse/HADOOP-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-9500: Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) +1. Committed the patch to trunk. Thank you Chris. Thanks to Arpit for the review as well. TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe - Key: HADOOP-9500 URL: https://issues.apache.org/jira/browse/HADOOP-9500 Project: Hadoop Common Issue Type: Bug Components: test Affects Versions: 3.0.0 Reporter: Chris Nauroth Assignee: Chris Nauroth Fix For: 3.0.0 Attachments: HADOOP-9500.1.patch The test attempts to run the winutils groups command, but the initialization logic fails to find the path to winutils.exe. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9413) Introduce common utils for File#setReadable/Writable/Executable and File#canRead/Write/Execute that work cross-platform
[ https://issues.apache.org/jira/browse/HADOOP-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643710#comment-13643710 ] Chris Nauroth commented on HADOOP-9413: --- HADOOP-9290 just got committed to fix the native library loading. Ivan, can we proceed with committing HADOOP-9413 now? (I am still +1 after the recent rebase.) Introduce common utils for File#setReadable/Writable/Executable and File#canRead/Write/Execute that work cross-platform --- Key: HADOOP-9413 URL: https://issues.apache.org/jira/browse/HADOOP-9413 Project: Hadoop Common Issue Type: Bug Reporter: Ivan Mitic Assignee: Ivan Mitic Fix For: 3.0.0 Attachments: HADOOP-9413.commonfileutils.2.patch, HADOOP-9413.commonfileutils.3.patch, HADOOP-9413.commonfileutils.4.patch, HADOOP-9413.commonfileutils.patch So far, we've seen many unittest and product bugs in Hadoop on Windows because Java's APIs that manipulate with permissions do not work as expected. We've addressed many of these problems on one-by-one basis (by either changing code a bit or disabling the test). While debugging the remaining unittest failures we continue to run into the same patterns of problems, and instead of addressing them one-by-one, I propose that we expose a set of equivalent wrapper APIs that will work well for all platforms. Scanning thru the codebase, this will actually be a simple change as there are very few places that use File#setReadable/Writable/Executable and File#canRead/Write/Execute (5 files in Common, 9 files in HDFS). HADOOP-8973 contains additional context on the problem. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9500) TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe
[ https://issues.apache.org/jira/browse/HADOOP-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643716#comment-13643716 ] Hudson commented on HADOOP-9500: Integrated in Hadoop-trunk-Commit #3682 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/3682/]) HADOOP-9500. TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe. Contributed by Chris Nauroth. (Revision 1476606) Result = SUCCESS suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476606 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUserGroupInformation.java TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe - Key: HADOOP-9500 URL: https://issues.apache.org/jira/browse/HADOOP-9500 Project: Hadoop Common Issue Type: Bug Components: test Affects Versions: 3.0.0 Reporter: Chris Nauroth Assignee: Chris Nauroth Fix For: 3.0.0 Attachments: HADOOP-9500.1.patch The test attempts to run the winutils groups command, but the initialization logic fails to find the path to winutils.exe. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9490) LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename
[ https://issues.apache.org/jira/browse/HADOOP-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643719#comment-13643719 ] Suresh Srinivas commented on HADOOP-9490: - I think calling {{close()}} in {{LocalFileSystem}} seems fine to me. +1 for the patch. LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename Key: HADOOP-9490 URL: https://issues.apache.org/jira/browse/HADOOP-9490 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 3.0.0 Reporter: Ivan Mitic Assignee: Ivan Mitic Attachments: HADOOP-9490.patch LocalFileSystem#reportChecksumFailure is not closing the open stream on the checksum file before it moves it to the bad_files folder, what causes the operation to fail on Windows. TestLocalFileSystem fail on Windows because of this: {code} testReportChecksumFailure(org.apache.hadoop.fs.TestLocalFileSystem) Time elapsed: 31 sec FAILURE! java.lang.AssertionError: at org.junit.Assert.fail(Assert.java:91) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertTrue(Assert.java:54) at org.apache.hadoop.fs.TestLocalFileSystem.testReportChecksumFailure(TestLocalFileSystem.java:335) {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9490) LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename
[ https://issues.apache.org/jira/browse/HADOOP-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-9490: Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) I committed the patch to trunk. Thank you Ivan. LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename Key: HADOOP-9490 URL: https://issues.apache.org/jira/browse/HADOOP-9490 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 3.0.0 Reporter: Ivan Mitic Assignee: Ivan Mitic Fix For: 3.0.0 Attachments: HADOOP-9490.patch LocalFileSystem#reportChecksumFailure is not closing the open stream on the checksum file before it moves it to the bad_files folder, what causes the operation to fail on Windows. TestLocalFileSystem fail on Windows because of this: {code} testReportChecksumFailure(org.apache.hadoop.fs.TestLocalFileSystem) Time elapsed: 31 sec FAILURE! java.lang.AssertionError: at org.junit.Assert.fail(Assert.java:91) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertTrue(Assert.java:54) at org.apache.hadoop.fs.TestLocalFileSystem.testReportChecksumFailure(TestLocalFileSystem.java:335) {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9490) LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename
[ https://issues.apache.org/jira/browse/HADOOP-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643724#comment-13643724 ] Hudson commented on HADOOP-9490: Integrated in Hadoop-trunk-Commit #3683 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/3683/]) HADOOP-9490. LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename. Contributed by Ivan Mitic. (Revision 1476609) Result = SUCCESS suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476609 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/LocalFileSystem.java LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename Key: HADOOP-9490 URL: https://issues.apache.org/jira/browse/HADOOP-9490 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 3.0.0 Reporter: Ivan Mitic Assignee: Ivan Mitic Fix For: 3.0.0 Attachments: HADOOP-9490.patch LocalFileSystem#reportChecksumFailure is not closing the open stream on the checksum file before it moves it to the bad_files folder, what causes the operation to fail on Windows. TestLocalFileSystem fail on Windows because of this: {code} testReportChecksumFailure(org.apache.hadoop.fs.TestLocalFileSystem) Time elapsed: 31 sec FAILURE! java.lang.AssertionError: at org.junit.Assert.fail(Assert.java:91) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertTrue(Assert.java:54) at org.apache.hadoop.fs.TestLocalFileSystem.testReportChecksumFailure(TestLocalFileSystem.java:335) {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9504) MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo
[ https://issues.apache.org/jira/browse/HADOOP-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643829#comment-13643829 ] stack commented on HADOOP-9504: --- [~mattf] To add to [~jlowe] 's petition, while this may not alone be significant enough to trigger a 1.* patch release, I would suggest it important enough to include in any coming 1.* release. We have experienced a number of production hbase installs beyond the one described in hbase-8416 where a server starts using all CPUs though effectively idle requiring ops intervention to do a node decommission and restart. Thanks. MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo - Key: HADOOP-9504 URL: https://issues.apache.org/jira/browse/HADOOP-9504 Project: Hadoop Common Issue Type: Bug Components: metrics Affects Versions: 3.0.0, 2.0.3-alpha Reporter: Liang Xie Assignee: Liang Xie Priority: Critical Fix For: 2.0.5-beta, 0.23.8 Attachments: HADOOP-9504-branch-1.txt, HADOOP-9504.txt, HADOOP-9504-v2.txt Please see HBASE-8416 for detail information. we need to take care of the synchronization for HashMap put(), otherwise it may lead to spin loop. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9512) Add Hadoop-Vaidya to branch2
[ https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nemon lou updated HADOOP-9512: -- Attachment: HADOOP-9512.patch Fix the warnings Add Hadoop-Vaidya to branch2 Key: HADOOP-9512 URL: https://issues.apache.org/jira/browse/HADOOP-9512 Project: Hadoop Common Issue Type: New Feature Components: tools Affects Versions: 2.0.4-alpha Reporter: nemon lou Attachments: HADOOP-9512.patch, HADOOP-9512.patch Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop branch2. The only changes for supporting Hadoop2 are job history perser and job counters ,etc. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9512) Add Hadoop-Vaidya to branch2
[ https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nemon lou updated HADOOP-9512: -- Status: Patch Available (was: Open) Add Hadoop-Vaidya to branch2 Key: HADOOP-9512 URL: https://issues.apache.org/jira/browse/HADOOP-9512 Project: Hadoop Common Issue Type: New Feature Components: tools Affects Versions: 2.0.4-alpha Reporter: nemon lou Attachments: HADOOP-9512.patch, HADOOP-9512.patch Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop branch2. The only changes for supporting Hadoop2 are job history perser and job counters ,etc. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9512) Add Hadoop-Vaidya to branch2
[ https://issues.apache.org/jira/browse/HADOOP-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643893#comment-13643893 ] Hadoop QA commented on HADOOP-9512: --- {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12580867/HADOOP-9512.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 5 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-tools/hadoop-tools-dist hadoop-tools/hadoop-vaidya. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2487//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2487//console This message is automatically generated. Add Hadoop-Vaidya to branch2 Key: HADOOP-9512 URL: https://issues.apache.org/jira/browse/HADOOP-9512 Project: Hadoop Common Issue Type: New Feature Components: tools Affects Versions: 2.0.4-alpha Reporter: nemon lou Attachments: HADOOP-9512.patch, HADOOP-9512.patch Hadoop-Vaidya exists in hadoop1.0 series and we need to add it to hadoop branch2. The only changes for supporting Hadoop2 are job history perser and job counters ,etc. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira