[jira] [Commented] (HADOOP-9176) RawLocalFileSystem.delete unexpected behavior on Windows while running Mapreduce tests with Open JDK 7
[ https://issues.apache.org/jira/browse/HADOOP-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567426#comment-13567426 ] Hadoop QA commented on HADOOP-9176: --- {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12567287/HADOOP-9176.trunk.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2121//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2121//console This message is automatically generated. > RawLocalFileSystem.delete unexpected behavior on Windows while running > Mapreduce tests with Open JDK 7 > -- > > Key: HADOOP-9176 > URL: https://issues.apache.org/jira/browse/HADOOP-9176 > Project: Hadoop Common > Issue Type: Bug > Components: test >Affects Versions: 1.2.0, 3.0.0, 1-win, trunk-win >Reporter: Arpit Agarwal >Assignee: Arpit Agarwal > Fix For: 1.2.0, 3.0.0 > > Attachments: HADOOP-9176.branch-1.patch, HADOOP-9176.patch, > HADOOP-9176.trunk.patch > > > RawLocalFileSystem.delete fails on Windows even when the files are not > expected to be in use. It does not reproduce with Sun JDK 6. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9176) RawLocalFileSystem.delete unexpected behavior on Windows while running Mapreduce tests with Open JDK 7
[ https://issues.apache.org/jira/browse/HADOOP-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-9176: Status: Patch Available (was: Open) > RawLocalFileSystem.delete unexpected behavior on Windows while running > Mapreduce tests with Open JDK 7 > -- > > Key: HADOOP-9176 > URL: https://issues.apache.org/jira/browse/HADOOP-9176 > Project: Hadoop Common > Issue Type: Bug > Components: test >Affects Versions: 1.2.0, 3.0.0, 1-win, trunk-win >Reporter: Arpit Agarwal >Assignee: Arpit Agarwal > Fix For: 1.2.0, 3.0.0 > > Attachments: HADOOP-9176.branch-1.patch, HADOOP-9176.patch, > HADOOP-9176.trunk.patch > > > RawLocalFileSystem.delete fails on Windows even when the files are not > expected to be in use. It does not reproduce with Sun JDK 6. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9267) hadoop -help, -h, --help should show usage instructions
Andrew Wang created HADOOP-9267: --- Summary: hadoop -help, -h, --help should show usage instructions Key: HADOOP-9267 URL: https://issues.apache.org/jira/browse/HADOOP-9267 Project: Hadoop Common Issue Type: Bug Affects Versions: 3.0.0 Reporter: Andrew Wang Assignee: Andrew Wang Priority: Minor It's not friendly for new users when the command line scripts don't show usage instructions when passed the defacto Unix usage flags. Imagine this sequence of commands: {noformat} -> % hadoop --help Error: No command named `--help' was found. Perhaps you meant `hadoop -help' -> % hadoop -help Error: No command named `-help' was found. Perhaps you meant `hadoop help' -> % hadoop help Exception in thread "main" java.lang.NoClassDefFoundError: help Caused by: java.lang.ClassNotFoundException: help at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: help. Program will exit. {noformat} Same applies for the `hdfs` script. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9176) RawLocalFileSystem.delete unexpected behavior on Windows while running Mapreduce tests with Open JDK 7
[ https://issues.apache.org/jira/browse/HADOOP-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HADOOP-9176: -- Attachment: HADOOP-9176.trunk.patch HADOOP-9176.branch-1.patch Thanks Suresh, yes it is. Attached updated patches for branch-1 and trunk. > RawLocalFileSystem.delete unexpected behavior on Windows while running > Mapreduce tests with Open JDK 7 > -- > > Key: HADOOP-9176 > URL: https://issues.apache.org/jira/browse/HADOOP-9176 > Project: Hadoop Common > Issue Type: Bug > Components: test >Affects Versions: 1.2.0, 3.0.0, 1-win, trunk-win >Reporter: Arpit Agarwal >Assignee: Arpit Agarwal > Fix For: 1.2.0, 3.0.0 > > Attachments: HADOOP-9176.branch-1.patch, HADOOP-9176.patch, > HADOOP-9176.trunk.patch > > > RawLocalFileSystem.delete fails on Windows even when the files are not > expected to be in use. It does not reproduce with Sun JDK 6. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9176) RawLocalFileSystem.delete unexpected behavior on Windows while running Mapreduce tests with Open JDK 7
[ https://issues.apache.org/jira/browse/HADOOP-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HADOOP-9176: -- Affects Version/s: trunk-win 3.0.0 > RawLocalFileSystem.delete unexpected behavior on Windows while running > Mapreduce tests with Open JDK 7 > -- > > Key: HADOOP-9176 > URL: https://issues.apache.org/jira/browse/HADOOP-9176 > Project: Hadoop Common > Issue Type: Bug > Components: test >Affects Versions: 1.2.0, 3.0.0, 1-win, trunk-win >Reporter: Arpit Agarwal >Assignee: Arpit Agarwal > Fix For: 1.2.0 > > Attachments: HADOOP-9176.patch > > > RawLocalFileSystem.delete fails on Windows even when the files are not > expected to be in use. It does not reproduce with Sun JDK 6. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9176) RawLocalFileSystem.delete unexpected behavior on Windows while running Mapreduce tests with Open JDK 7
[ https://issues.apache.org/jira/browse/HADOOP-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HADOOP-9176: -- Fix Version/s: 3.0.0 > RawLocalFileSystem.delete unexpected behavior on Windows while running > Mapreduce tests with Open JDK 7 > -- > > Key: HADOOP-9176 > URL: https://issues.apache.org/jira/browse/HADOOP-9176 > Project: Hadoop Common > Issue Type: Bug > Components: test >Affects Versions: 1.2.0, 3.0.0, 1-win, trunk-win >Reporter: Arpit Agarwal >Assignee: Arpit Agarwal > Fix For: 1.2.0, 3.0.0 > > Attachments: HADOOP-9176.patch > > > RawLocalFileSystem.delete fails on Windows even when the files are not > expected to be in use. It does not reproduce with Sun JDK 6. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9253) Capture ulimit info in the logs at service start time
[ https://issues.apache.org/jira/browse/HADOOP-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567249#comment-13567249 ] Hadoop QA commented on HADOOP-9253: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12567274/HADOOP-9253.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2120//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2120//console This message is automatically generated. > Capture ulimit info in the logs at service start time > - > > Key: HADOOP-9253 > URL: https://issues.apache.org/jira/browse/HADOOP-9253 > Project: Hadoop Common > Issue Type: Improvement >Affects Versions: 1.1.1, 2.0.2-alpha >Reporter: Arpit Gupta >Assignee: Arpit Gupta > Attachments: HADOOP-9253.branch-1.patch, HADOOP-9253.branch-1.patch, > HADOOP-9253.branch-1.patch, HADOOP-9253.patch, HADOOP-9253.patch > > > output of ulimit -a is helpful while debugging issues on the system. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8981) TestMetricsSystemImpl fails on Windows
[ https://issues.apache.org/jira/browse/HADOOP-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567241#comment-13567241 ] Hudson commented on HADOOP-8981: Integrated in Hadoop-trunk-Commit #3302 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/3302/]) HADOOP-8981. Merge r1422279 from branch-trunk-win to trunk (Revision 1440780) Result = SUCCESS suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440780 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/metrics2/impl/TestMetricsSystemImpl.java > TestMetricsSystemImpl fails on Windows > -- > > Key: HADOOP-8981 > URL: https://issues.apache.org/jira/browse/HADOOP-8981 > Project: Hadoop Common > Issue Type: Bug > Components: metrics >Affects Versions: 2.0.0-alpha >Reporter: Chris Nauroth >Assignee: Xuan Gong > Fix For: 2.0.3-alpha > > Attachments: HADOOP-8981-branch-trunk-win.1.patch, > HADOOP-8981-branch-trunk-win.2.patch, HADOOP-8981-branch-trunk-win.3.patch, > HADOOP-8981-branch-trunk-win.4.patch, HADOOP-8981-branch-trunk-win.5.patch > > > The test is failing on an expected mock interaction. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8981) TestMetricsSystemImpl fails on Windows
[ https://issues.apache.org/jira/browse/HADOOP-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-8981: Affects Version/s: (was: trunk-win) 2.0.0-alpha Fix Version/s: (was: trunk-win) 2.0.3-alpha I committed the patch to trunk and branch-2 as well. > TestMetricsSystemImpl fails on Windows > -- > > Key: HADOOP-8981 > URL: https://issues.apache.org/jira/browse/HADOOP-8981 > Project: Hadoop Common > Issue Type: Bug > Components: metrics >Affects Versions: 2.0.0-alpha >Reporter: Chris Nauroth >Assignee: Xuan Gong > Fix For: 2.0.3-alpha > > Attachments: HADOOP-8981-branch-trunk-win.1.patch, > HADOOP-8981-branch-trunk-win.2.patch, HADOOP-8981-branch-trunk-win.3.patch, > HADOOP-8981-branch-trunk-win.4.patch, HADOOP-8981-branch-trunk-win.5.patch > > > The test is failing on an expected mock interaction. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9253) Capture ulimit info in the logs at service start time
[ https://issues.apache.org/jira/browse/HADOOP-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta updated HADOOP-9253: Status: Patch Available (was: Open) > Capture ulimit info in the logs at service start time > - > > Key: HADOOP-9253 > URL: https://issues.apache.org/jira/browse/HADOOP-9253 > Project: Hadoop Common > Issue Type: Improvement >Affects Versions: 2.0.2-alpha, 1.1.1 >Reporter: Arpit Gupta >Assignee: Arpit Gupta > Attachments: HADOOP-9253.branch-1.patch, HADOOP-9253.branch-1.patch, > HADOOP-9253.branch-1.patch, HADOOP-9253.patch, HADOOP-9253.patch > > > output of ulimit -a is helpful while debugging issues on the system. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9253) Capture ulimit info in the logs at service start time
[ https://issues.apache.org/jira/browse/HADOOP-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta updated HADOOP-9253: Attachment: HADOOP-9253.patch updated trunk patch > Capture ulimit info in the logs at service start time > - > > Key: HADOOP-9253 > URL: https://issues.apache.org/jira/browse/HADOOP-9253 > Project: Hadoop Common > Issue Type: Improvement >Affects Versions: 1.1.1, 2.0.2-alpha >Reporter: Arpit Gupta >Assignee: Arpit Gupta > Attachments: HADOOP-9253.branch-1.patch, HADOOP-9253.branch-1.patch, > HADOOP-9253.branch-1.patch, HADOOP-9253.patch, HADOOP-9253.patch > > > output of ulimit -a is helpful while debugging issues on the system. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9253) Capture ulimit info in the logs at service start time
[ https://issues.apache.org/jira/browse/HADOOP-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta updated HADOOP-9253: Attachment: HADOOP-9253.branch-1.patch updated branch-1 patch > Capture ulimit info in the logs at service start time > - > > Key: HADOOP-9253 > URL: https://issues.apache.org/jira/browse/HADOOP-9253 > Project: Hadoop Common > Issue Type: Improvement >Affects Versions: 1.1.1, 2.0.2-alpha >Reporter: Arpit Gupta >Assignee: Arpit Gupta > Attachments: HADOOP-9253.branch-1.patch, HADOOP-9253.branch-1.patch, > HADOOP-9253.branch-1.patch, HADOOP-9253.patch, HADOOP-9253.patch > > > output of ulimit -a is helpful while debugging issues on the system. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9176) RawLocalFileSystem.delete unexpected behavior on Windows while running Mapreduce tests with Open JDK 7
[ https://issues.apache.org/jira/browse/HADOOP-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567220#comment-13567220 ] Suresh Srinivas commented on HADOOP-9176: - Is this not relevant to trunk? > RawLocalFileSystem.delete unexpected behavior on Windows while running > Mapreduce tests with Open JDK 7 > -- > > Key: HADOOP-9176 > URL: https://issues.apache.org/jira/browse/HADOOP-9176 > Project: Hadoop Common > Issue Type: Bug > Components: test >Affects Versions: 1.2.0, 1-win >Reporter: Arpit Agarwal >Assignee: Arpit Agarwal > Fix For: 1.2.0 > > Attachments: HADOOP-9176.patch > > > RawLocalFileSystem.delete fails on Windows even when the files are not > expected to be in use. It does not reproduce with Sun JDK 6. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9253) Capture ulimit info in the logs at service start time
[ https://issues.apache.org/jira/browse/HADOOP-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567212#comment-13567212 ] Arpit Gupta commented on HADOOP-9253: - @Andy Sounds good i will change the head to print 30 lines the reason being since i have added about 17 lines in case of an error we will see atleast 10+ lines worth or error log. I will post an update to the trunk and the branch-1 patch. > Capture ulimit info in the logs at service start time > - > > Key: HADOOP-9253 > URL: https://issues.apache.org/jira/browse/HADOOP-9253 > Project: Hadoop Common > Issue Type: Improvement >Affects Versions: 1.1.1, 2.0.2-alpha >Reporter: Arpit Gupta >Assignee: Arpit Gupta > Attachments: HADOOP-9253.branch-1.patch, HADOOP-9253.branch-1.patch, > HADOOP-9253.patch > > > output of ulimit -a is helpful while debugging issues on the system. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8990) Some minor issus in protobuf based ipc
[ https://issues.apache.org/jira/browse/HADOOP-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567132#comment-13567132 ] Sanjay Radia commented on HADOOP-8990: -- bq. so you plan to serialize header and body to some buffer first and then write to socket That is what the current code does. This should be changed to use coded output stream to avoid the buffering; I believe this may require some more code change (not protocol changes) and that this can be done at later point. > Some minor issus in protobuf based ipc > -- > > Key: HADOOP-8990 > URL: https://issues.apache.org/jira/browse/HADOOP-8990 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Binglin Chang >Priority: Minor > > 1. proto file naming > RpcPayloadHeader.proto include not only RpcPayLoadHeaderProto, but also > RpcResponseHeaderProto, which is irrelevant to the file name. > hadoop_rpc.proto only include HadoopRpcRequestProto, and the filename > "hadoop_rpc" is strange comparing to other .proto file names. > How about merge those two file into HadoopRpc.proto? > 2. proto class naming > In rpc request RpcPayloadHeaderProto includes callId, but in rpc response > callId is included in RpcResponseHeaderProto, and there is also > HadoopRpcRequestProto, this is just too confusing. > 3. The rpc system is not fully protobuf based, there are still some Writables: > RpcRequestWritable and RpcResponseWritable. > rpc response exception name and stack trace string. > And RpcRequestWritable uses protobuf style varint32 prefix, but > RpcResponseWritable uses int32 prefix, why this inconsistency? > Currently rpc request is splitted into length, PayLoadHeader and PayLoad, and > response into RpcResponseHeader, response and error message. > I think wrap request and response into single RequstProto and ResponseProto > is better, cause this gives a formal complete wire format definition, > or developer need to look into the source code and hard coding the > communication format. > These issues above make it very confusing and hard for developers to use > these rpc interfaces. > Some of these issues can be solved without breaking compatibility, but some > can not, but at least we need to know what will be changed and what will stay > stable? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8981) TestMetricsSystemImpl fails on Windows
[ https://issues.apache.org/jira/browse/HADOOP-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567103#comment-13567103 ] Suresh Srinivas commented on HADOOP-8981: - Okay, will merge it into trunk. > TestMetricsSystemImpl fails on Windows > -- > > Key: HADOOP-8981 > URL: https://issues.apache.org/jira/browse/HADOOP-8981 > Project: Hadoop Common > Issue Type: Bug > Components: metrics >Affects Versions: trunk-win >Reporter: Chris Nauroth >Assignee: Xuan Gong > Fix For: trunk-win > > Attachments: HADOOP-8981-branch-trunk-win.1.patch, > HADOOP-8981-branch-trunk-win.2.patch, HADOOP-8981-branch-trunk-win.3.patch, > HADOOP-8981-branch-trunk-win.4.patch, HADOOP-8981-branch-trunk-win.5.patch > > > The test is failing on an expected mock interaction. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9266) correct release audit warnings on branch-trunk-win
[ https://issues.apache.org/jira/browse/HADOOP-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567081#comment-13567081 ] Chris Nauroth commented on HADOOP-9266: --- This is the output from a test-patch run: !? /Users/chris/git/hadoop-common/hadoop-common-project/hadoop-common/CHANGES.branch-trunk-win.txt !? /Users/chris/git/hadoop-common/hadoop-common-project/hadoop-common/src/main/winutils/libwinutils.vcxproj !? /Users/chris/git/hadoop-common/hadoop-common-project/hadoop-common/src/main/winutils/winutils.sln !? /Users/chris/git/hadoop-common/hadoop-common-project/hadoop-common/src/main/winutils/winutils.vcxproj !? /Users/chris/git/hadoop-common/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/test-untar.tgz Lines that start with ? in the release audit report indicate files that do not have an Apache license header. > correct release audit warnings on branch-trunk-win > -- > > Key: HADOOP-9266 > URL: https://issues.apache.org/jira/browse/HADOOP-9266 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: trunk-win >Reporter: Chris Nauroth >Assignee: Chris Nauroth > > There are several new release audit warnings reported on branch-trunk-win for > files introduced during the Windows compatibility work. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9266) correct release audit warnings on branch-trunk-win
Chris Nauroth created HADOOP-9266: - Summary: correct release audit warnings on branch-trunk-win Key: HADOOP-9266 URL: https://issues.apache.org/jira/browse/HADOOP-9266 Project: Hadoop Common Issue Type: Bug Components: build Affects Versions: trunk-win Reporter: Chris Nauroth Assignee: Chris Nauroth There are several new release audit warnings reported on branch-trunk-win for files introduced during the Windows compatibility work. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8562) Enhancements to Hadoop for Windows Server and Windows Azure development and runtime environments
[ https://issues.apache.org/jira/browse/HADOOP-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566977#comment-13566977 ] Hadoop QA commented on HADOOP-8562: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12567057/branch-trunk-win.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 32 new or modified test files. {color:red}-1 javac{color}. The applied patch generated 2017 javac compiler warnings (more than the trunk's current 2014 warnings). {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings. {color:red}-1 release audit{color}. The applied patch generated 4 release audit warnings. {color:red}-1 core tests{color}. The patch failed these unit tests in hadoop-assemblies hadoop-common-project/hadoop-common hadoop-dist hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle hadoop-tools/hadoop-streaming hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests: org.apache.hadoop.fs.TestFileUtil org.apache.hadoop.yarn.server.nodemanager.containermanager.TestContainerManager org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2117//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2117//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2117//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-common.html Javac warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2117//artifact/trunk/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2117//console This message is automatically generated. > Enhancements to Hadoop for Windows Server and Windows Azure development and > runtime environments > > > Key: HADOOP-8562 > URL: https://issues.apache.org/jira/browse/HADOOP-8562 > Project: Hadoop Common > Issue Type: New Feature >Affects Versions: 3.0.0 >Reporter: Bikas Saha >Assignee: Bikas Saha > Attachments: branch-trunk-win.patch, branch-trunk-win.patch, > branch-trunk-win.patch, branch-trunk-win.patch, branch-trunk-win.patch, > branch-trunk-win.patch, branch-trunk-win.patch, test-untar.tar, test-untar.tgz > > > This JIRA tracks the work that needs to be done on trunk to enable Hadoop to > run on Windows Server and Azure environments. This incorporates porting > relevant work from the similar effort on branch 1 tracked via HADOOP-8079. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9258) Add stricter tests to FileSystemContractTestBase
[ https://issues.apache.org/jira/browse/HADOOP-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566850#comment-13566850 ] Hadoop QA commented on HADOOP-9258: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12567193/HADOOP-9528-3.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:red}-1 core tests{color}. The patch failed these unit tests in hadoop-common-project/hadoop-common: org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2119//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2119//console This message is automatically generated. > Add stricter tests to FileSystemContractTestBase > > > Key: HADOOP-9258 > URL: https://issues.apache.org/jira/browse/HADOOP-9258 > Project: Hadoop Common > Issue Type: Improvement > Components: test >Affects Versions: 1.1.1, 2.0.3-alpha >Reporter: Steve Loughran >Assignee: Steve Loughran > Attachments: HADOOP-9528-2.patch, HADOOP-9528-3.patch, > HADOOP-9528.patch > > > The File System Contract contains implicit assumptions that aren't checked in > the contract test base. Add more tests to define the contract's assumptions > more rigorously for those filesystems that are tested by this (not Local, BTW) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9261) S3n filesystem can move a directory under itself -and so lose data
[ https://issues.apache.org/jira/browse/HADOOP-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566836#comment-13566836 ] Hadoop QA commented on HADOOP-9261: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12567188/HADOOP-9261.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2118//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2118//console This message is automatically generated. > S3n filesystem can move a directory under itself -and so lose data > -- > > Key: HADOOP-9261 > URL: https://issues.apache.org/jira/browse/HADOOP-9261 > Project: Hadoop Common > Issue Type: Bug > Components: fs/s3 >Affects Versions: 1.1.1, 2.0.2-alpha > Environment: Testing against S3 bucket stored on US West (Read after > Write consistency; eventual for read-after-delete or write-after-write) >Reporter: Steve Loughran > Attachments: HADOOP-9261.patch > > > The S3N filesystem {{rename()}} doesn't make sure that the destination > directory is not a child or other descendant of the source directory. The > files are copied to the new destination, then the source directory is > recursively deleted, so losing data. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9258) Add stricter tests to FileSystemContractTestBase
[ https://issues.apache.org/jira/browse/HADOOP-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-9258: --- Status: Patch Available (was: Open) > Add stricter tests to FileSystemContractTestBase > > > Key: HADOOP-9258 > URL: https://issues.apache.org/jira/browse/HADOOP-9258 > Project: Hadoop Common > Issue Type: Improvement > Components: test >Affects Versions: 1.1.1, 2.0.3-alpha >Reporter: Steve Loughran >Assignee: Steve Loughran > Attachments: HADOOP-9528-2.patch, HADOOP-9528-3.patch, > HADOOP-9528.patch > > > The File System Contract contains implicit assumptions that aren't checked in > the contract test base. Add more tests to define the contract's assumptions > more rigorously for those filesystems that are tested by this (not Local, BTW) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9258) Add stricter tests to FileSystemContractTestBase
[ https://issues.apache.org/jira/browse/HADOOP-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-9258: --- Attachment: HADOOP-9528-3.patch Updated patch # allows subclasses to turn of case sensitivity tests # verifies that any subdir checking logic doesn't cause renames to a dest with the same initial pathname as the src to fail > Add stricter tests to FileSystemContractTestBase > > > Key: HADOOP-9258 > URL: https://issues.apache.org/jira/browse/HADOOP-9258 > Project: Hadoop Common > Issue Type: Improvement > Components: test >Affects Versions: 1.1.1, 2.0.3-alpha >Reporter: Steve Loughran >Assignee: Steve Loughran > Attachments: HADOOP-9528-2.patch, HADOOP-9528-3.patch, > HADOOP-9528.patch > > > The File System Contract contains implicit assumptions that aren't checked in > the contract test base. Add more tests to define the contract's assumptions > more rigorously for those filesystems that are tested by this (not Local, BTW) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9258) Add stricter tests to FileSystemContractTestBase
[ https://issues.apache.org/jira/browse/HADOOP-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-9258: --- Status: Open (was: Patch Available) > Add stricter tests to FileSystemContractTestBase > > > Key: HADOOP-9258 > URL: https://issues.apache.org/jira/browse/HADOOP-9258 > Project: Hadoop Common > Issue Type: Improvement > Components: test >Affects Versions: 1.1.1, 2.0.3-alpha >Reporter: Steve Loughran >Assignee: Steve Loughran > Attachments: HADOOP-9528-2.patch, HADOOP-9528-3.patch, > HADOOP-9528.patch > > > The File System Contract contains implicit assumptions that aren't checked in > the contract test base. Add more tests to define the contract's assumptions > more rigorously for those filesystems that are tested by this (not Local, BTW) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9265) S3 blockstore filesystem breaks part of the Filesystem contract
Steve Loughran created HADOOP-9265: -- Summary: S3 blockstore filesystem breaks part of the Filesystem contract Key: HADOOP-9265 URL: https://issues.apache.org/jira/browse/HADOOP-9265 Project: Hadoop Common Issue Type: Bug Components: fs/s3 Affects Versions: 1.1.1, 3.0.0 Reporter: Steve Loughran The extended tests of HADOOP-9258 show that s3 is failing things which we always expected an FS to do # {{getFileStatus("/")}} to return a {{FileStatus}} -currently it returns a {{FileNotFoundException}}. # {{rename("somedir","somedir/childdir")}} to fail. currently it returns true after deleting all the data in {{somedir/}} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9261) S3n filesystem can move a directory under itself -and so lose data
[ https://issues.apache.org/jira/browse/HADOOP-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-9261: --- Attachment: HADOOP-9261.patch With this patch, s3n passes the extended tests of HADOOP-9528 > S3n filesystem can move a directory under itself -and so lose data > -- > > Key: HADOOP-9261 > URL: https://issues.apache.org/jira/browse/HADOOP-9261 > Project: Hadoop Common > Issue Type: Bug > Components: fs/s3 >Affects Versions: 1.1.1, 2.0.2-alpha > Environment: Testing against S3 bucket stored on US West (Read after > Write consistency; eventual for read-after-delete or write-after-write) >Reporter: Steve Loughran > Attachments: HADOOP-9261.patch > > > The S3N filesystem {{rename()}} doesn't make sure that the destination > directory is not a child or other descendant of the source directory. The > files are copied to the new destination, then the source directory is > recursively deleted, so losing data. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9261) S3n filesystem can move a directory under itself -and so lose data
[ https://issues.apache.org/jira/browse/HADOOP-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-9261: --- Status: Patch Available (was: Open) Tests are in HADOOP-5928, not this patch. Targeting branch-1 and trunk > S3n filesystem can move a directory under itself -and so lose data > -- > > Key: HADOOP-9261 > URL: https://issues.apache.org/jira/browse/HADOOP-9261 > Project: Hadoop Common > Issue Type: Bug > Components: fs/s3 >Affects Versions: 2.0.2-alpha, 1.1.1 > Environment: Testing against S3 bucket stored on US West (Read after > Write consistency; eventual for read-after-delete or write-after-write) >Reporter: Steve Loughran > Attachments: HADOOP-9261.patch > > > The S3N filesystem {{rename()}} doesn't make sure that the destination > directory is not a child or other descendant of the source directory. The > files are copied to the new destination, then the source directory is > recursively deleted, so losing data. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9261) S3n filesystem can move a directory under itself -and so lose data
[ https://issues.apache.org/jira/browse/HADOOP-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-9261: --- Description: The S3N filesystem {{rename()}} doesn't make sure that the destination directory is not a child or other descendant of the source directory. The files are copied to the new destination, then the source directory is recursively deleted, so losing data. (was: In the S3 filesystem clients, {{rename()}} doesn't make sure that the destination directory is not a child or other descendant of the source directory. The files are copied to the new destination, then the source directory is recursively deleted, so losing data.) > S3n filesystem can move a directory under itself -and so lose data > -- > > Key: HADOOP-9261 > URL: https://issues.apache.org/jira/browse/HADOOP-9261 > Project: Hadoop Common > Issue Type: Bug > Components: fs/s3 >Affects Versions: 1.1.1, 2.0.2-alpha > Environment: Testing against S3 bucket stored on US West (Read after > Write consistency; eventual for read-after-delete or write-after-write) >Reporter: Steve Loughran > > The S3N filesystem {{rename()}} doesn't make sure that the destination > directory is not a child or other descendant of the source directory. The > files are copied to the new destination, then the source directory is > recursively deleted, so losing data. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9261) S3n filesystem can move a directory under itself -and so lose data
[ https://issues.apache.org/jira/browse/HADOOP-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-9261: --- Summary: S3n filesystem can move a directory under itself -and so lose data (was: S3 and S3 filesystems can move a directory under itself -and so lose data) > S3n filesystem can move a directory under itself -and so lose data > -- > > Key: HADOOP-9261 > URL: https://issues.apache.org/jira/browse/HADOOP-9261 > Project: Hadoop Common > Issue Type: Bug > Components: fs/s3 >Affects Versions: 1.1.1, 2.0.2-alpha > Environment: Testing against S3 bucket stored on US West (Read after > Write consistency; eventual for read-after-delete or write-after-write) >Reporter: Steve Loughran > > In the S3 filesystem clients, {{rename()}} doesn't make sure that the > destination directory is not a child or other descendant of the source > directory. The files are copied to the new destination, then the source > directory is recursively deleted, so losing data. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9264) port change to use Java untar API on Windows from branch-1-win to trunk
Chris Nauroth created HADOOP-9264: - Summary: port change to use Java untar API on Windows from branch-1-win to trunk Key: HADOOP-9264 URL: https://issues.apache.org/jira/browse/HADOOP-9264 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 3.0.0 Reporter: Chris Nauroth HADOOP-8847 originally introduced this change on branch-1-win. HADOOP-9081 ported the change to branch-trunk-win. This should be simple to port to trunk, which would simplify the merge and test activity happening on HADOOP-8562. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9221) Convert remaining xdocs to APT
[ https://issues.apache.org/jira/browse/HADOOP-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated HADOOP-9221: -- Fix Version/s: 0.23.7 > Convert remaining xdocs to APT > -- > > Key: HADOOP-9221 > URL: https://issues.apache.org/jira/browse/HADOOP-9221 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.0.0, 2.0.2-alpha >Reporter: Andy Isaacson >Assignee: Andy Isaacson > Fix For: 2.0.3-alpha, 0.23.7 > > Attachments: hadoop9221-1.txt, hadoop9221-2.txt, hadoop9221.txt > > > The following Forrest XML documents are still present in trunk: > {noformat} > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/faultinject_framework.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_editsviewer.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_imageviewer.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_permissions_guide.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_quota_admin_guide.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_user_guide.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hftp.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/libhdfs.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/webhdfs.xml > {noformat} > Several of them are leftover cruft, and all of them are out of date to one > degree or another, but it's easiest to simply convert them all to APT and > move forward with editing thereafter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9221) Convert remaining xdocs to APT
[ https://issues.apache.org/jira/browse/HADOOP-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566702#comment-13566702 ] Thomas Graves commented on HADOOP-9221: --- Are all the new docs linked from somewhere? I expected to see them linked from the top level menu like http://hadoop.apache.org/docs/current/ but I only see the hadoop commands manual and the Filesystem shell. It used to be you clicked on say the commands manual and you would go to the old style documentation where it had a menu with links to the Superusers, native libraries, etc, but I don't see that any more since converted. Is there perhaps a new menu I'm missing? > Convert remaining xdocs to APT > -- > > Key: HADOOP-9221 > URL: https://issues.apache.org/jira/browse/HADOOP-9221 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.0.0, 2.0.2-alpha >Reporter: Andy Isaacson >Assignee: Andy Isaacson > Fix For: 2.0.3-alpha > > Attachments: hadoop9221-1.txt, hadoop9221-2.txt, hadoop9221.txt > > > The following Forrest XML documents are still present in trunk: > {noformat} > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/faultinject_framework.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_editsviewer.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_imageviewer.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_permissions_guide.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_quota_admin_guide.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_user_guide.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hftp.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/libhdfs.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/webhdfs.xml > {noformat} > Several of them are leftover cruft, and all of them are out of date to one > degree or another, but it's easiest to simply convert them all to APT and > move forward with editing thereafter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9263) findbugs reports extra warnings on branch-1
[ https://issues.apache.org/jira/browse/HADOOP-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566704#comment-13566704 ] Chris Nauroth commented on HADOOP-9263: --- The easiest way to see the problem is to run ant test-patch with a no-op (empty) patch file: touch /tmp/empty && ant -Dforrest.home=/Users/chris/apache-forrest-0.9 -Dfindbugs.home=/Users/chris/findbugs-1.3.9 -Dpatch.file=/tmp/empty test-patch [exec] -1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] -1 tests included. The patch doesn't appear to include any new or modified tests. [exec] Please justify why no tests are needed for this patch. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] -1 findbugs. The patch appears to introduce 14 new Findbugs (version 1.3.9) warnings. > findbugs reports extra warnings on branch-1 > --- > > Key: HADOOP-9263 > URL: https://issues.apache.org/jira/browse/HADOOP-9263 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 1.1.2 >Reporter: Chris Nauroth > > Currently on branch-1, src/test/test-patch.properties defines > {{OK_FINDBUGS_WARNINGS=211}}, but findbugs actually finds 225 warnings. This > means that any patch will get -1 from ant test-patch due to 14 new findbugs > warnings, even though the warnings are unrelated to that patch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-9263) findbugs reports extra warnings on branch-1
Chris Nauroth created HADOOP-9263: - Summary: findbugs reports extra warnings on branch-1 Key: HADOOP-9263 URL: https://issues.apache.org/jira/browse/HADOOP-9263 Project: Hadoop Common Issue Type: Bug Components: build Affects Versions: 1.1.2 Reporter: Chris Nauroth Currently on branch-1, src/test/test-patch.properties defines {{OK_FINDBUGS_WARNINGS=211}}, but findbugs actually finds 225 warnings. This means that any patch will get -1 from ant test-patch due to 14 new findbugs warnings, even though the warnings are unrelated to that patch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9260) Hadoop version may be not correct when starting name node or data node
[ https://issues.apache.org/jira/browse/HADOOP-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566619#comment-13566619 ] Jason Lowe commented on HADOOP-9260: Agree that we should move the source jars off the classpath. +1 for taking just the source jars portion of HADOOP-9116 in the short term to fix this issue, then HADOOP-9116 can complete the move of test jars off the classpath when we decide how to resolve the running of tests issue. > Hadoop version may be not correct when starting name node or data node > -- > > Key: HADOOP-9260 > URL: https://issues.apache.org/jira/browse/HADOOP-9260 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: trunk-win >Reporter: Jerry Chen >Priority: Critical > > 1. Check out the trunk from > http://svn.apache.org/repos/asf/hadoop/common/trunk/ -r 1439752 > 2. Compile package >m2 package -Pdist -Psrc -Pnative -Dtar -DskipTests > 3. Hadoop version of compiled dist shows the following: > Hadoop ${pom.version} > Subversion ${version-info.scm.uri} -r ${version-info.scm.commit} > Compiled by ${user.name} on ${version-info.build.time} > From source with checksum ${version-info.source.md5} > And in a real cluster, the log in name node shows: > 2013-01-29 15:23:42,738 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: > STARTUP_MSG: > / > STARTUP_MSG: Starting NameNode > STARTUP_MSG: host = bdpe01.sh.intel.com/10.239.47.101 > STARTUP_MSG: args = [] > STARTUP_MSG: version = ${pom.version} > STARTUP_MSG: classpath = ... > STARTUP_MSG: build = ${version-info.scm.uri} -r ${version-info.scm.commit}; > compiled by '${user.name}' on ${version-info.build.time} > STARTUP_MSG: java = 1.6.0_33 > While some data nodes with the same binary shows the correct version > information. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8723) Remove tests and tests-sources jars from classpath
[ https://issues.apache.org/jira/browse/HADOOP-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HADOOP-8723: --- Resolution: Duplicate Target Version/s: 2.0.2-alpha, 3.0.0 (was: 3.0.0, 2.0.2-alpha) Status: Resolved (was: Patch Available) > Remove tests and tests-sources jars from classpath > -- > > Key: HADOOP-8723 > URL: https://issues.apache.org/jira/browse/HADOOP-8723 > Project: Hadoop Common > Issue Type: Improvement >Affects Versions: 2.0.0-alpha >Reporter: Jason Lowe >Assignee: Jason Lowe > Attachments: HADOOP-8723.patch > > > Currently {{hadoop-config.sh}} is including any tests and tests-sources jars > in the default classpath, as those jars are shipped in the dist tarball next > to the main jars and the script is globbing everything in that directory. > The tests and tests-sources jars aren't required to run Hadoop, but they can > cause breakage when inadvertently picked up. See HDFS-3831 as an example. > Ideally we should not be adding these jars to the classpath. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9260) Hadoop version may be not correct when starting name node or data node
[ https://issues.apache.org/jira/browse/HADOOP-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566595#comment-13566595 ] Chris Nauroth commented on HADOOP-9260: --- Jerry, thank you for the details. That helps clarify the problem. I would not expect the HADOOP-9246 patch to fix the problem that you're seeing. I think we need to revisit HADOOP-8723 (patch from [~jlowe]) or HADOOP-9116 (patch from [~tucu00]). The goal of both of these issues is to remove the test and source jars from the runtime classpath, because they can cause odd problems like this. There was some question about those patches potentially making it more awkward to run tests, so they haven't been committed yet. If we need a compromise, then maybe we could just move the source jar out of the way for now and revisit moving the test jar off of the classpath later. We only need to move the source jar out of the way to resolve HADOOP-9260, and it's definitely not correct to have the source jar on the classpath. > Hadoop version may be not correct when starting name node or data node > -- > > Key: HADOOP-9260 > URL: https://issues.apache.org/jira/browse/HADOOP-9260 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: trunk-win >Reporter: Jerry Chen >Priority: Critical > > 1. Check out the trunk from > http://svn.apache.org/repos/asf/hadoop/common/trunk/ -r 1439752 > 2. Compile package >m2 package -Pdist -Psrc -Pnative -Dtar -DskipTests > 3. Hadoop version of compiled dist shows the following: > Hadoop ${pom.version} > Subversion ${version-info.scm.uri} -r ${version-info.scm.commit} > Compiled by ${user.name} on ${version-info.build.time} > From source with checksum ${version-info.source.md5} > And in a real cluster, the log in name node shows: > 2013-01-29 15:23:42,738 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: > STARTUP_MSG: > / > STARTUP_MSG: Starting NameNode > STARTUP_MSG: host = bdpe01.sh.intel.com/10.239.47.101 > STARTUP_MSG: args = [] > STARTUP_MSG: version = ${pom.version} > STARTUP_MSG: classpath = ... > STARTUP_MSG: build = ${version-info.scm.uri} -r ${version-info.scm.commit}; > compiled by '${user.name}' on ${version-info.build.time} > STARTUP_MSG: java = 1.6.0_33 > While some data nodes with the same binary shows the correct version > information. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-8545: --- Priority: Major (was: Minor) Assignee: Dmitry Mezhensky Added Dmitry to contributor group, assigned issue to him, raised priority to major > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Assignee: Dmitry Mezhensky > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566547#comment-13566547 ] Steve Loughran commented on HADOOP-8545: Dmitry: release audit was about some missing headers; I can do that {code} !? src/test/org/apache/hadoop/fs/swift/NativeSwiftFileSystemContractBaseTest.java !? src/test/org/apache/hadoop/fs/swift/snative/SwiftFileSystemForFunctionalTests.java !? src/test/org/apache/hadoop/fs/swift/functional/tests/SwiftFileSystemTest.java !? src/test/org/apache/hadoop/fs/swift/InMemorySwiftNativeStore.java !? src/test/org/apache/hadoop/fs/swift/TestSwiftConfig.java !? src/test/org/apache/hadoop/fs/swift/TestSwiftObjectPath.java !? src/core/org/apache/hadoop/fs/swift/snative/SwiftNativeFileSystemStore.java !? src/core/org/apache/hadoop/fs/swift/block/SwiftBlockInputStream.java {code} I'll look at that > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566520#comment-13566520 ] Hadoop QA commented on HADOOP-8545: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12567143/HADOOP-8545-6.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 13 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:red}-1 release audit{color}. The applied patch generated 8 release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/2116//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/2116//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/2116//console This message is automatically generated. > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
[ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Mezhensky updated HADOOP-8545: - Attachment: HADOOP-8545-6.patch - Support non-alphabetic symbols in path name. - Bug fixing > Filesystem Implementation for OpenStack Swift > - > > Key: HADOOP-8545 > URL: https://issues.apache.org/jira/browse/HADOOP-8545 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 2.0.3-alpha, 1.1.2 >Reporter: Tim Miller >Priority: Minor > Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, > HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, > HADOOP-8545-6.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, > HADOOP-8545.patch > > > Add a filesystem implementation for OpenStack Swift object store, similar to > the one which exists today for S3. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9221) Convert remaining xdocs to APT
[ https://issues.apache.org/jira/browse/HADOOP-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566496#comment-13566496 ] Hudson commented on HADOOP-9221: Integrated in Hadoop-Mapreduce-trunk #1329 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1329/]) Move HADOOP-9221 to correct section of CHANGES.txt. (Revision 1440248) HADOOP-9221. Convert remaining xdocs to APT. Contributed by Andy Isaacson. (Revision 1440245) Result = SUCCESS atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440248 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440245 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/faultinject_framework.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_editsviewer.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_imageviewer.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_permissions_guide.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_quota_admin_guide.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_user_guide.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hftp.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/libhdfs.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/FaultInjectFramework.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsEditsViewer.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsImageViewer.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsPermissionsGuide.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsQuotaAdminGuide.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/Hftp.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/LibHdfs.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/SLGUserGuide.apt.vm > Convert remaining xdocs to APT > -- > > Key: HADOOP-9221 > URL: https://issues.apache.org/jira/browse/HADOOP-9221 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.0.0, 2.0.2-alpha >Reporter: Andy Isaacson >Assignee: Andy Isaacson > Fix For: 2.0.3-alpha > > Attachments: hadoop9221-1.txt, hadoop9221-2.txt, hadoop9221.txt > > > The following Forrest XML documents are still present in trunk: > {noformat} > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml > hadoop-hdfs-p
[jira] [Commented] (HADOOP-9249) hadoop-maven-plugins version-info goal causes build failure when running with Clover
[ https://issues.apache.org/jira/browse/HADOOP-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566497#comment-13566497 ] Hudson commented on HADOOP-9249: Integrated in Hadoop-Mapreduce-trunk #1329 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1329/]) HADOOP-9249. hadoop-maven-plugins version-info goal causes build failure when running with Clover. Contributed by Chris Nauroth. (Revision 1440200) Result = SUCCESS suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440200 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-maven-plugins/pom.xml > hadoop-maven-plugins version-info goal causes build failure when running with > Clover > > > Key: HADOOP-9249 > URL: https://issues.apache.org/jira/browse/HADOOP-9249 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 3.0.0 >Reporter: Chris Nauroth >Assignee: Chris Nauroth > Fix For: 3.0.0 > > Attachments: HADOOP-9249.1.patch > > > Running Maven with the -Pclover option for code coverage causes the build to > fail because of not finding a Clover class while running hadoop-maven-plugins > version-info. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9221) Convert remaining xdocs to APT
[ https://issues.apache.org/jira/browse/HADOOP-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566443#comment-13566443 ] Hudson commented on HADOOP-9221: Integrated in Hadoop-Hdfs-trunk #1301 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1301/]) Move HADOOP-9221 to correct section of CHANGES.txt. (Revision 1440248) HADOOP-9221. Convert remaining xdocs to APT. Contributed by Andy Isaacson. (Revision 1440245) Result = SUCCESS atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440248 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440245 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/faultinject_framework.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_editsviewer.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_imageviewer.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_permissions_guide.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_quota_admin_guide.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_user_guide.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hftp.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/libhdfs.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/FaultInjectFramework.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsEditsViewer.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsImageViewer.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsPermissionsGuide.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsQuotaAdminGuide.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/Hftp.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/LibHdfs.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/SLGUserGuide.apt.vm > Convert remaining xdocs to APT > -- > > Key: HADOOP-9221 > URL: https://issues.apache.org/jira/browse/HADOOP-9221 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.0.0, 2.0.2-alpha >Reporter: Andy Isaacson >Assignee: Andy Isaacson > Fix For: 2.0.3-alpha > > Attachments: hadoop9221-1.txt, hadoop9221-2.txt, hadoop9221.txt > > > The following Forrest XML documents are still present in trunk: > {noformat} > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml > hadoop-hdfs-project/had
[jira] [Commented] (HADOOP-9249) hadoop-maven-plugins version-info goal causes build failure when running with Clover
[ https://issues.apache.org/jira/browse/HADOOP-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566444#comment-13566444 ] Hudson commented on HADOOP-9249: Integrated in Hadoop-Hdfs-trunk #1301 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1301/]) HADOOP-9249. hadoop-maven-plugins version-info goal causes build failure when running with Clover. Contributed by Chris Nauroth. (Revision 1440200) Result = SUCCESS suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440200 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-maven-plugins/pom.xml > hadoop-maven-plugins version-info goal causes build failure when running with > Clover > > > Key: HADOOP-9249 > URL: https://issues.apache.org/jira/browse/HADOOP-9249 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 3.0.0 >Reporter: Chris Nauroth >Assignee: Chris Nauroth > Fix For: 3.0.0 > > Attachments: HADOOP-9249.1.patch > > > Running Maven with the -Pclover option for code coverage causes the build to > fail because of not finding a Clover class while running hadoop-maven-plugins > version-info. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9190) packaging docs is broken
[ https://issues.apache.org/jira/browse/HADOOP-9190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566424#comment-13566424 ] Hudson commented on HADOOP-9190: Integrated in Hadoop-Hdfs-0.23-Build #510 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/510/]) HADOOP-9190. packaging docs is broken. (Andy Isaacson via tgraves) (Revision 1439941) Result = SUCCESS tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1439941 Files : * /hadoop/common/branches/branch-0.23/BUILDING.txt * /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/docs/forrest.properties * /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/forrest.properties * /hadoop/common/branches/branch-0.23/hadoop-project-dist/pom.xml > packaging docs is broken > > > Key: HADOOP-9190 > URL: https://issues.apache.org/jira/browse/HADOOP-9190 > Project: Hadoop Common > Issue Type: Bug > Components: documentation >Affects Versions: 3.0.0, 2.0.3-alpha, 0.23.6 >Reporter: Thomas Graves >Assignee: Andy Isaacson > Fix For: 3.0.0, 2.0.3-alpha, 0.23.7 > > Attachments: hadoop9190-1.txt, hadoop9190.txt > > > It looks like after the docs got converted to apt format in HADOOP-8427, mvn > site package -Pdist,docs no longer works. If you run mvn site or mvn > site:stage by itself they work fine, its when you go to package it that it > breaks. > The error is with broken links, here is one of them: > broken-links> >message="hadoop-common-project/hadoop-common/target/docs-src/src/documentation/content/xdocs/HttpAuthentication.xml > (No such file or directory)" uri="HttpAuthentication.html"> > > > > > > > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9221) Convert remaining xdocs to APT
[ https://issues.apache.org/jira/browse/HADOOP-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566361#comment-13566361 ] Hudson commented on HADOOP-9221: Integrated in Hadoop-Yarn-trunk #112 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/112/]) Move HADOOP-9221 to correct section of CHANGES.txt. (Revision 1440248) HADOOP-9221. Convert remaining xdocs to APT. Contributed by Andy Isaacson. (Revision 1440245) Result = SUCCESS atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440248 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440245 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/faultinject_framework.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_editsviewer.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_imageviewer.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_permissions_guide.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_quota_admin_guide.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_user_guide.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hftp.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/libhdfs.xml * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/FaultInjectFramework.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsEditsViewer.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsImageViewer.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsPermissionsGuide.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsQuotaAdminGuide.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/Hftp.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/LibHdfs.apt.vm * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/SLGUserGuide.apt.vm > Convert remaining xdocs to APT > -- > > Key: HADOOP-9221 > URL: https://issues.apache.org/jira/browse/HADOOP-9221 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.0.0, 2.0.2-alpha >Reporter: Andy Isaacson >Assignee: Andy Isaacson > Fix For: 2.0.3-alpha > > Attachments: hadoop9221-1.txt, hadoop9221-2.txt, hadoop9221.txt > > > The following Forrest XML documents are still present in trunk: > {noformat} > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml > hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml > hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml > hadoop-hdfs-project/hadoo
[jira] [Commented] (HADOOP-9249) hadoop-maven-plugins version-info goal causes build failure when running with Clover
[ https://issues.apache.org/jira/browse/HADOOP-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566362#comment-13566362 ] Hudson commented on HADOOP-9249: Integrated in Hadoop-Yarn-trunk #112 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/112/]) HADOOP-9249. hadoop-maven-plugins version-info goal causes build failure when running with Clover. Contributed by Chris Nauroth. (Revision 1440200) Result = SUCCESS suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440200 Files : * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-maven-plugins/pom.xml > hadoop-maven-plugins version-info goal causes build failure when running with > Clover > > > Key: HADOOP-9249 > URL: https://issues.apache.org/jira/browse/HADOOP-9249 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 3.0.0 >Reporter: Chris Nauroth >Assignee: Chris Nauroth > Fix For: 3.0.0 > > Attachments: HADOOP-9249.1.patch > > > Running Maven with the -Pclover option for code coverage causes the build to > fail because of not finding a Clover class while running hadoop-maven-plugins > version-info. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9260) Hadoop version may be not correct when starting name node or data node
[ https://issues.apache.org/jira/browse/HADOOP-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566271#comment-13566271 ] Jerry Chen commented on HADOOP-9260: The incorrect version would cause more problems when running MapReduce jobs even if the cluster seems to start as normal. For example, when running Hive queries, the query failed at random and the log shows: 2013-01-30 15:45:37,080 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.RuntimeException: java.lang.reflect.InvocationTargetException at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:128) at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:66) at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42) at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:370) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:402) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:158) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1452) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:153) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:126) ... 10 more Caused by: java.lang.NumberFormatException: For input string: "${pom" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48) at java.lang.Integer.parseInt(Integer.java:449) at java.lang.Integer.parseInt(Integer.java:499) at org.apache.hadoop.hive.shims.ShimLoader.getMajorVersion(ShimLoader.java:125) at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:92) at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:66) at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat$CombineHiveInputSplit.(CombineHiveInputFormat.java:85) ... 15 more > Hadoop version may be not correct when starting name node or data node > -- > > Key: HADOOP-9260 > URL: https://issues.apache.org/jira/browse/HADOOP-9260 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: trunk-win >Reporter: Jerry Chen >Priority: Critical > > 1. Check out the trunk from > http://svn.apache.org/repos/asf/hadoop/common/trunk/ -r 1439752 > 2. Compile package >m2 package -Pdist -Psrc -Pnative -Dtar -DskipTests > 3. Hadoop version of compiled dist shows the following: > Hadoop ${pom.version} > Subversion ${version-info.scm.uri} -r ${version-info.scm.commit} > Compiled by ${user.name} on ${version-info.build.time} > From source with checksum ${version-info.source.md5} > And in a real cluster, the log in name node shows: > 2013-01-29 15:23:42,738 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: > STARTUP_MSG: > / > STARTUP_MSG: Starting NameNode > STARTUP_MSG: host = bdpe01.sh.intel.com/10.239.47.101 > STARTUP_MSG: args = [] > STARTUP_MSG: version = ${pom.version} > STARTUP_MSG: classpath = ... > STARTUP_MSG: build = ${version-info.scm.uri} -r ${version-info.scm.commit}; > compiled by '${user.name}' on ${version-info.build.time} > STARTUP_MSG: java = 1.6.0_33 > While some data nodes with the same binary shows the correct version > information. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira