[jira] [Commented] (HADOOP-9176) RawLocalFileSystem.delete unexpected behavior on Windows while running Mapreduce tests with Open JDK 7

2013-01-30 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567426#comment-13567426
 ] 

Hadoop QA commented on HADOOP-9176:
---

{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  
http://issues.apache.org/jira/secure/attachment/12567287/HADOOP-9176.trunk.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 1 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2121//testReport/
Console output: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2121//console

This message is automatically generated.

> RawLocalFileSystem.delete unexpected behavior on Windows while running 
> Mapreduce tests with Open JDK 7
> --
>
> Key: HADOOP-9176
> URL: https://issues.apache.org/jira/browse/HADOOP-9176
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: test
>Affects Versions: 1.2.0, 3.0.0, 1-win, trunk-win
>Reporter: Arpit Agarwal
>Assignee: Arpit Agarwal
> Fix For: 1.2.0, 3.0.0
>
> Attachments: HADOOP-9176.branch-1.patch, HADOOP-9176.patch, 
> HADOOP-9176.trunk.patch
>
>
> RawLocalFileSystem.delete fails on Windows even when the files are not 
> expected to be in use. It does not reproduce with Sun JDK 6.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9176) RawLocalFileSystem.delete unexpected behavior on Windows while running Mapreduce tests with Open JDK 7

2013-01-30 Thread Suresh Srinivas (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suresh Srinivas updated HADOOP-9176:


Status: Patch Available  (was: Open)

> RawLocalFileSystem.delete unexpected behavior on Windows while running 
> Mapreduce tests with Open JDK 7
> --
>
> Key: HADOOP-9176
> URL: https://issues.apache.org/jira/browse/HADOOP-9176
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: test
>Affects Versions: 1.2.0, 3.0.0, 1-win, trunk-win
>Reporter: Arpit Agarwal
>Assignee: Arpit Agarwal
> Fix For: 1.2.0, 3.0.0
>
> Attachments: HADOOP-9176.branch-1.patch, HADOOP-9176.patch, 
> HADOOP-9176.trunk.patch
>
>
> RawLocalFileSystem.delete fails on Windows even when the files are not 
> expected to be in use. It does not reproduce with Sun JDK 6.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-9267) hadoop -help, -h, --help should show usage instructions

2013-01-30 Thread Andrew Wang (JIRA)
Andrew Wang created HADOOP-9267:
---

 Summary: hadoop -help, -h, --help should show usage instructions
 Key: HADOOP-9267
 URL: https://issues.apache.org/jira/browse/HADOOP-9267
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 3.0.0
Reporter: Andrew Wang
Assignee: Andrew Wang
Priority: Minor


It's not friendly for new users when the command line scripts don't show usage 
instructions when passed the defacto Unix usage flags. Imagine this sequence of 
commands:

{noformat}
-> % hadoop --help
Error: No command named `--help' was found. Perhaps you meant `hadoop -help'
-> % hadoop -help
Error: No command named `-help' was found. Perhaps you meant `hadoop help'
-> % hadoop help
Exception in thread "main" java.lang.NoClassDefFoundError: help
Caused by: java.lang.ClassNotFoundException: help
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: help.  Program will exit.
{noformat}

Same applies for the `hdfs` script.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9176) RawLocalFileSystem.delete unexpected behavior on Windows while running Mapreduce tests with Open JDK 7

2013-01-30 Thread Arpit Agarwal (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arpit Agarwal updated HADOOP-9176:
--

Attachment: HADOOP-9176.trunk.patch
HADOOP-9176.branch-1.patch

Thanks Suresh, yes it is.

Attached updated patches for branch-1 and trunk.

> RawLocalFileSystem.delete unexpected behavior on Windows while running 
> Mapreduce tests with Open JDK 7
> --
>
> Key: HADOOP-9176
> URL: https://issues.apache.org/jira/browse/HADOOP-9176
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: test
>Affects Versions: 1.2.0, 3.0.0, 1-win, trunk-win
>Reporter: Arpit Agarwal
>Assignee: Arpit Agarwal
> Fix For: 1.2.0, 3.0.0
>
> Attachments: HADOOP-9176.branch-1.patch, HADOOP-9176.patch, 
> HADOOP-9176.trunk.patch
>
>
> RawLocalFileSystem.delete fails on Windows even when the files are not 
> expected to be in use. It does not reproduce with Sun JDK 6.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9176) RawLocalFileSystem.delete unexpected behavior on Windows while running Mapreduce tests with Open JDK 7

2013-01-30 Thread Arpit Agarwal (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arpit Agarwal updated HADOOP-9176:
--

Affects Version/s: trunk-win
   3.0.0

> RawLocalFileSystem.delete unexpected behavior on Windows while running 
> Mapreduce tests with Open JDK 7
> --
>
> Key: HADOOP-9176
> URL: https://issues.apache.org/jira/browse/HADOOP-9176
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: test
>Affects Versions: 1.2.0, 3.0.0, 1-win, trunk-win
>Reporter: Arpit Agarwal
>Assignee: Arpit Agarwal
> Fix For: 1.2.0
>
> Attachments: HADOOP-9176.patch
>
>
> RawLocalFileSystem.delete fails on Windows even when the files are not 
> expected to be in use. It does not reproduce with Sun JDK 6.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9176) RawLocalFileSystem.delete unexpected behavior on Windows while running Mapreduce tests with Open JDK 7

2013-01-30 Thread Arpit Agarwal (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arpit Agarwal updated HADOOP-9176:
--

Fix Version/s: 3.0.0

> RawLocalFileSystem.delete unexpected behavior on Windows while running 
> Mapreduce tests with Open JDK 7
> --
>
> Key: HADOOP-9176
> URL: https://issues.apache.org/jira/browse/HADOOP-9176
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: test
>Affects Versions: 1.2.0, 3.0.0, 1-win, trunk-win
>Reporter: Arpit Agarwal
>Assignee: Arpit Agarwal
> Fix For: 1.2.0, 3.0.0
>
> Attachments: HADOOP-9176.patch
>
>
> RawLocalFileSystem.delete fails on Windows even when the files are not 
> expected to be in use. It does not reproduce with Sun JDK 6.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9253) Capture ulimit info in the logs at service start time

2013-01-30 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567249#comment-13567249
 ] 

Hadoop QA commented on HADOOP-9253:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12567274/HADOOP-9253.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-common-project/hadoop-common.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2120//testReport/
Console output: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2120//console

This message is automatically generated.

> Capture ulimit info in the logs at service start time
> -
>
> Key: HADOOP-9253
> URL: https://issues.apache.org/jira/browse/HADOOP-9253
> Project: Hadoop Common
>  Issue Type: Improvement
>Affects Versions: 1.1.1, 2.0.2-alpha
>Reporter: Arpit Gupta
>Assignee: Arpit Gupta
> Attachments: HADOOP-9253.branch-1.patch, HADOOP-9253.branch-1.patch, 
> HADOOP-9253.branch-1.patch, HADOOP-9253.patch, HADOOP-9253.patch
>
>
> output of ulimit -a is helpful while debugging issues on the system.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-8981) TestMetricsSystemImpl fails on Windows

2013-01-30 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567241#comment-13567241
 ] 

Hudson commented on HADOOP-8981:


Integrated in Hadoop-trunk-Commit #3302 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/3302/])
HADOOP-8981. Merge r1422279 from branch-trunk-win to trunk (Revision 
1440780)

 Result = SUCCESS
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440780
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/metrics2/impl/TestMetricsSystemImpl.java


> TestMetricsSystemImpl fails on Windows
> --
>
> Key: HADOOP-8981
> URL: https://issues.apache.org/jira/browse/HADOOP-8981
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: metrics
>Affects Versions: 2.0.0-alpha
>Reporter: Chris Nauroth
>Assignee: Xuan Gong
> Fix For: 2.0.3-alpha
>
> Attachments: HADOOP-8981-branch-trunk-win.1.patch, 
> HADOOP-8981-branch-trunk-win.2.patch, HADOOP-8981-branch-trunk-win.3.patch, 
> HADOOP-8981-branch-trunk-win.4.patch, HADOOP-8981-branch-trunk-win.5.patch
>
>
> The test is failing on an expected mock interaction.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-8981) TestMetricsSystemImpl fails on Windows

2013-01-30 Thread Suresh Srinivas (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suresh Srinivas updated HADOOP-8981:


Affects Version/s: (was: trunk-win)
   2.0.0-alpha
Fix Version/s: (was: trunk-win)
   2.0.3-alpha

I committed the patch to trunk and branch-2 as well.

> TestMetricsSystemImpl fails on Windows
> --
>
> Key: HADOOP-8981
> URL: https://issues.apache.org/jira/browse/HADOOP-8981
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: metrics
>Affects Versions: 2.0.0-alpha
>Reporter: Chris Nauroth
>Assignee: Xuan Gong
> Fix For: 2.0.3-alpha
>
> Attachments: HADOOP-8981-branch-trunk-win.1.patch, 
> HADOOP-8981-branch-trunk-win.2.patch, HADOOP-8981-branch-trunk-win.3.patch, 
> HADOOP-8981-branch-trunk-win.4.patch, HADOOP-8981-branch-trunk-win.5.patch
>
>
> The test is failing on an expected mock interaction.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9253) Capture ulimit info in the logs at service start time

2013-01-30 Thread Arpit Gupta (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arpit Gupta updated HADOOP-9253:


Status: Patch Available  (was: Open)

> Capture ulimit info in the logs at service start time
> -
>
> Key: HADOOP-9253
> URL: https://issues.apache.org/jira/browse/HADOOP-9253
> Project: Hadoop Common
>  Issue Type: Improvement
>Affects Versions: 2.0.2-alpha, 1.1.1
>Reporter: Arpit Gupta
>Assignee: Arpit Gupta
> Attachments: HADOOP-9253.branch-1.patch, HADOOP-9253.branch-1.patch, 
> HADOOP-9253.branch-1.patch, HADOOP-9253.patch, HADOOP-9253.patch
>
>
> output of ulimit -a is helpful while debugging issues on the system.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9253) Capture ulimit info in the logs at service start time

2013-01-30 Thread Arpit Gupta (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arpit Gupta updated HADOOP-9253:


Attachment: HADOOP-9253.patch

updated trunk patch

> Capture ulimit info in the logs at service start time
> -
>
> Key: HADOOP-9253
> URL: https://issues.apache.org/jira/browse/HADOOP-9253
> Project: Hadoop Common
>  Issue Type: Improvement
>Affects Versions: 1.1.1, 2.0.2-alpha
>Reporter: Arpit Gupta
>Assignee: Arpit Gupta
> Attachments: HADOOP-9253.branch-1.patch, HADOOP-9253.branch-1.patch, 
> HADOOP-9253.branch-1.patch, HADOOP-9253.patch, HADOOP-9253.patch
>
>
> output of ulimit -a is helpful while debugging issues on the system.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9253) Capture ulimit info in the logs at service start time

2013-01-30 Thread Arpit Gupta (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arpit Gupta updated HADOOP-9253:


Attachment: HADOOP-9253.branch-1.patch

updated branch-1 patch

> Capture ulimit info in the logs at service start time
> -
>
> Key: HADOOP-9253
> URL: https://issues.apache.org/jira/browse/HADOOP-9253
> Project: Hadoop Common
>  Issue Type: Improvement
>Affects Versions: 1.1.1, 2.0.2-alpha
>Reporter: Arpit Gupta
>Assignee: Arpit Gupta
> Attachments: HADOOP-9253.branch-1.patch, HADOOP-9253.branch-1.patch, 
> HADOOP-9253.branch-1.patch, HADOOP-9253.patch, HADOOP-9253.patch
>
>
> output of ulimit -a is helpful while debugging issues on the system.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9176) RawLocalFileSystem.delete unexpected behavior on Windows while running Mapreduce tests with Open JDK 7

2013-01-30 Thread Suresh Srinivas (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567220#comment-13567220
 ] 

Suresh Srinivas commented on HADOOP-9176:
-

Is this not relevant to trunk?

> RawLocalFileSystem.delete unexpected behavior on Windows while running 
> Mapreduce tests with Open JDK 7
> --
>
> Key: HADOOP-9176
> URL: https://issues.apache.org/jira/browse/HADOOP-9176
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: test
>Affects Versions: 1.2.0, 1-win
>Reporter: Arpit Agarwal
>Assignee: Arpit Agarwal
> Fix For: 1.2.0
>
> Attachments: HADOOP-9176.patch
>
>
> RawLocalFileSystem.delete fails on Windows even when the files are not 
> expected to be in use. It does not reproduce with Sun JDK 6.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9253) Capture ulimit info in the logs at service start time

2013-01-30 Thread Arpit Gupta (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567212#comment-13567212
 ] 

Arpit Gupta commented on HADOOP-9253:
-

@Andy

Sounds good i will change the head to print 30 lines the reason being since i 
have added about 17 lines in case of an error we will see atleast 10+ lines 
worth or error log.

I will post an update to the trunk and the branch-1 patch. 

> Capture ulimit info in the logs at service start time
> -
>
> Key: HADOOP-9253
> URL: https://issues.apache.org/jira/browse/HADOOP-9253
> Project: Hadoop Common
>  Issue Type: Improvement
>Affects Versions: 1.1.1, 2.0.2-alpha
>Reporter: Arpit Gupta
>Assignee: Arpit Gupta
> Attachments: HADOOP-9253.branch-1.patch, HADOOP-9253.branch-1.patch, 
> HADOOP-9253.patch
>
>
> output of ulimit -a is helpful while debugging issues on the system.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-8990) Some minor issus in protobuf based ipc

2013-01-30 Thread Sanjay Radia (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567132#comment-13567132
 ] 

Sanjay Radia commented on HADOOP-8990:
--

bq. so you plan to serialize header and body to some buffer first and then 
write to socket
That is what the current code does. This should be changed to use coded output 
stream to avoid the buffering; I believe this may require some more code change 
(not protocol changes) and that this can be done at later point.

> Some minor issus in protobuf based ipc
> --
>
> Key: HADOOP-8990
> URL: https://issues.apache.org/jira/browse/HADOOP-8990
> Project: Hadoop Common
>  Issue Type: Improvement
>Reporter: Binglin Chang
>Priority: Minor
>
> 1. proto file naming
> RpcPayloadHeader.proto include not only RpcPayLoadHeaderProto, but also 
> RpcResponseHeaderProto, which is irrelevant to the file name.
> hadoop_rpc.proto only include HadoopRpcRequestProto, and the filename 
> "hadoop_rpc" is strange comparing to other .proto file names.
> How about merge those two file into HadoopRpc.proto?
> 2. proto class naming
> In rpc request RpcPayloadHeaderProto includes callId, but in rpc response 
> callId is included in RpcResponseHeaderProto, and there is also 
> HadoopRpcRequestProto, this is just too confusing.
> 3. The rpc system is not fully protobuf based, there are still some Writables:
> RpcRequestWritable and RpcResponseWritable.
> rpc response exception name and stack trace string.
> And RpcRequestWritable uses protobuf style varint32 prefix, but 
> RpcResponseWritable uses int32 prefix, why this inconsistency?
> Currently rpc request is splitted into length, PayLoadHeader and PayLoad, and 
> response into RpcResponseHeader, response and error message. 
> I think wrap request and response into single RequstProto and ResponseProto 
> is better, cause this gives a formal complete wire format definition, 
> or developer need to look into the source code and hard coding the 
> communication format.
> These issues above make it very confusing and hard for developers to use 
> these rpc interfaces.
> Some of these issues can be solved without breaking compatibility, but some 
> can not, but at least we need to know what will be changed and what will stay 
> stable?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-8981) TestMetricsSystemImpl fails on Windows

2013-01-30 Thread Suresh Srinivas (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567103#comment-13567103
 ] 

Suresh Srinivas commented on HADOOP-8981:
-

Okay, will merge it into trunk.

> TestMetricsSystemImpl fails on Windows
> --
>
> Key: HADOOP-8981
> URL: https://issues.apache.org/jira/browse/HADOOP-8981
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: metrics
>Affects Versions: trunk-win
>Reporter: Chris Nauroth
>Assignee: Xuan Gong
> Fix For: trunk-win
>
> Attachments: HADOOP-8981-branch-trunk-win.1.patch, 
> HADOOP-8981-branch-trunk-win.2.patch, HADOOP-8981-branch-trunk-win.3.patch, 
> HADOOP-8981-branch-trunk-win.4.patch, HADOOP-8981-branch-trunk-win.5.patch
>
>
> The test is failing on an expected mock interaction.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9266) correct release audit warnings on branch-trunk-win

2013-01-30 Thread Chris Nauroth (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567081#comment-13567081
 ] 

Chris Nauroth commented on HADOOP-9266:
---

This is the output from a test-patch run:

 !? 
/Users/chris/git/hadoop-common/hadoop-common-project/hadoop-common/CHANGES.branch-trunk-win.txt
 !? 
/Users/chris/git/hadoop-common/hadoop-common-project/hadoop-common/src/main/winutils/libwinutils.vcxproj
 !? 
/Users/chris/git/hadoop-common/hadoop-common-project/hadoop-common/src/main/winutils/winutils.sln
 !? 
/Users/chris/git/hadoop-common/hadoop-common-project/hadoop-common/src/main/winutils/winutils.vcxproj
 !? 
/Users/chris/git/hadoop-common/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/test-untar.tgz
Lines that start with ? in the release audit report indicate files that do 
not have an Apache license header.


> correct release audit warnings on branch-trunk-win
> --
>
> Key: HADOOP-9266
> URL: https://issues.apache.org/jira/browse/HADOOP-9266
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: trunk-win
>Reporter: Chris Nauroth
>Assignee: Chris Nauroth
>
> There are several new release audit warnings reported on branch-trunk-win for 
> files introduced during the Windows compatibility work.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-9266) correct release audit warnings on branch-trunk-win

2013-01-30 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-9266:
-

 Summary: correct release audit warnings on branch-trunk-win
 Key: HADOOP-9266
 URL: https://issues.apache.org/jira/browse/HADOOP-9266
 Project: Hadoop Common
  Issue Type: Bug
  Components: build
Affects Versions: trunk-win
Reporter: Chris Nauroth
Assignee: Chris Nauroth


There are several new release audit warnings reported on branch-trunk-win for 
files introduced during the Windows compatibility work.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-8562) Enhancements to Hadoop for Windows Server and Windows Azure development and runtime environments

2013-01-30 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566977#comment-13566977
 ] 

Hadoop QA commented on HADOOP-8562:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  
http://issues.apache.org/jira/secure/attachment/12567057/branch-trunk-win.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 32 new 
or modified test files.

  {color:red}-1 javac{color}.  The applied patch generated 2017 javac 
compiler warnings (more than the trunk's current 2014 warnings).

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:red}-1 findbugs{color}.  The patch appears to introduce 1 new 
Findbugs (version 1.3.9) warnings.

{color:red}-1 release audit{color}.  The applied patch generated 4 
release audit warnings.

{color:red}-1 core tests{color}.  The patch failed these unit tests in 
hadoop-assemblies hadoop-common-project/hadoop-common hadoop-dist 
hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-httpfs 
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app 
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient
 
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle
 hadoop-tools/hadoop-streaming hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager
 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests:

  org.apache.hadoop.fs.TestFileUtil
  
org.apache.hadoop.yarn.server.nodemanager.containermanager.TestContainerManager
  
org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown
  
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch
  
org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2117//testReport/
Release audit warnings: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2117//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2117//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-common.html
Javac warnings: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2117//artifact/trunk/patchprocess/diffJavacWarnings.txt
Console output: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2117//console

This message is automatically generated.

> Enhancements to Hadoop for Windows Server and Windows Azure development and 
> runtime environments
> 
>
> Key: HADOOP-8562
> URL: https://issues.apache.org/jira/browse/HADOOP-8562
> Project: Hadoop Common
>  Issue Type: New Feature
>Affects Versions: 3.0.0
>Reporter: Bikas Saha
>Assignee: Bikas Saha
> Attachments: branch-trunk-win.patch, branch-trunk-win.patch, 
> branch-trunk-win.patch, branch-trunk-win.patch, branch-trunk-win.patch, 
> branch-trunk-win.patch, branch-trunk-win.patch, test-untar.tar, test-untar.tgz
>
>
> This JIRA tracks the work that needs to be done on trunk to enable Hadoop to 
> run on Windows Server and Azure environments. This incorporates porting 
> relevant work from the similar effort on branch 1 tracked via HADOOP-8079.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9258) Add stricter tests to FileSystemContractTestBase

2013-01-30 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566850#comment-13566850
 ] 

Hadoop QA commented on HADOOP-9258:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12567193/HADOOP-9528-3.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 1 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:red}-1 core tests{color}.  The patch failed these unit tests in 
hadoop-common-project/hadoop-common:

  
org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract
  org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2119//testReport/
Console output: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2119//console

This message is automatically generated.

> Add stricter tests to FileSystemContractTestBase
> 
>
> Key: HADOOP-9258
> URL: https://issues.apache.org/jira/browse/HADOOP-9258
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: test
>Affects Versions: 1.1.1, 2.0.3-alpha
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Attachments: HADOOP-9528-2.patch, HADOOP-9528-3.patch, 
> HADOOP-9528.patch
>
>
> The File System Contract contains implicit assumptions that aren't checked in 
> the contract test base. Add more tests to define the contract's assumptions 
> more rigorously for those filesystems that are tested by this (not Local, BTW)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9261) S3n filesystem can move a directory under itself -and so lose data

2013-01-30 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566836#comment-13566836
 ] 

Hadoop QA commented on HADOOP-9261:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12567188/HADOOP-9261.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-common-project/hadoop-common.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2118//testReport/
Console output: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2118//console

This message is automatically generated.

> S3n filesystem can move a directory under itself -and so lose data
> --
>
> Key: HADOOP-9261
> URL: https://issues.apache.org/jira/browse/HADOOP-9261
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: fs/s3
>Affects Versions: 1.1.1, 2.0.2-alpha
> Environment: Testing against S3 bucket stored on US West (Read after 
> Write consistency; eventual for read-after-delete or write-after-write)
>Reporter: Steve Loughran
> Attachments: HADOOP-9261.patch
>
>
> The S3N filesystem {{rename()}} doesn't make sure that the destination 
> directory is not a child or other descendant of the source directory. The 
> files are copied to the new destination, then the source directory is 
> recursively deleted, so losing data.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9258) Add stricter tests to FileSystemContractTestBase

2013-01-30 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated HADOOP-9258:
---

Status: Patch Available  (was: Open)

> Add stricter tests to FileSystemContractTestBase
> 
>
> Key: HADOOP-9258
> URL: https://issues.apache.org/jira/browse/HADOOP-9258
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: test
>Affects Versions: 1.1.1, 2.0.3-alpha
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Attachments: HADOOP-9528-2.patch, HADOOP-9528-3.patch, 
> HADOOP-9528.patch
>
>
> The File System Contract contains implicit assumptions that aren't checked in 
> the contract test base. Add more tests to define the contract's assumptions 
> more rigorously for those filesystems that are tested by this (not Local, BTW)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9258) Add stricter tests to FileSystemContractTestBase

2013-01-30 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated HADOOP-9258:
---

Attachment: HADOOP-9528-3.patch

Updated patch
# allows subclasses to turn of case sensitivity tests
# verifies that any subdir checking logic doesn't cause renames to a dest with 
the same initial pathname as the src to fail

> Add stricter tests to FileSystemContractTestBase
> 
>
> Key: HADOOP-9258
> URL: https://issues.apache.org/jira/browse/HADOOP-9258
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: test
>Affects Versions: 1.1.1, 2.0.3-alpha
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Attachments: HADOOP-9528-2.patch, HADOOP-9528-3.patch, 
> HADOOP-9528.patch
>
>
> The File System Contract contains implicit assumptions that aren't checked in 
> the contract test base. Add more tests to define the contract's assumptions 
> more rigorously for those filesystems that are tested by this (not Local, BTW)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9258) Add stricter tests to FileSystemContractTestBase

2013-01-30 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated HADOOP-9258:
---

Status: Open  (was: Patch Available)

> Add stricter tests to FileSystemContractTestBase
> 
>
> Key: HADOOP-9258
> URL: https://issues.apache.org/jira/browse/HADOOP-9258
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: test
>Affects Versions: 1.1.1, 2.0.3-alpha
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Attachments: HADOOP-9528-2.patch, HADOOP-9528-3.patch, 
> HADOOP-9528.patch
>
>
> The File System Contract contains implicit assumptions that aren't checked in 
> the contract test base. Add more tests to define the contract's assumptions 
> more rigorously for those filesystems that are tested by this (not Local, BTW)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-9265) S3 blockstore filesystem breaks part of the Filesystem contract

2013-01-30 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-9265:
--

 Summary: S3 blockstore filesystem breaks part of the Filesystem 
contract
 Key: HADOOP-9265
 URL: https://issues.apache.org/jira/browse/HADOOP-9265
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs/s3
Affects Versions: 1.1.1, 3.0.0
Reporter: Steve Loughran


The extended tests of HADOOP-9258 show that s3 is failing things which we 
always expected an FS to do

# {{getFileStatus("/")}} to return a {{FileStatus}} -currently it returns a 
{{FileNotFoundException}}.
# {{rename("somedir","somedir/childdir")}} to fail. currently it returns true 
after deleting all the data in {{somedir/}}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9261) S3n filesystem can move a directory under itself -and so lose data

2013-01-30 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated HADOOP-9261:
---

Attachment: HADOOP-9261.patch

With this patch, s3n passes the extended tests of HADOOP-9528

> S3n filesystem can move a directory under itself -and so lose data
> --
>
> Key: HADOOP-9261
> URL: https://issues.apache.org/jira/browse/HADOOP-9261
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: fs/s3
>Affects Versions: 1.1.1, 2.0.2-alpha
> Environment: Testing against S3 bucket stored on US West (Read after 
> Write consistency; eventual for read-after-delete or write-after-write)
>Reporter: Steve Loughran
> Attachments: HADOOP-9261.patch
>
>
> The S3N filesystem {{rename()}} doesn't make sure that the destination 
> directory is not a child or other descendant of the source directory. The 
> files are copied to the new destination, then the source directory is 
> recursively deleted, so losing data.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9261) S3n filesystem can move a directory under itself -and so lose data

2013-01-30 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated HADOOP-9261:
---

Status: Patch Available  (was: Open)

Tests are in HADOOP-5928, not this patch. Targeting branch-1 and trunk

> S3n filesystem can move a directory under itself -and so lose data
> --
>
> Key: HADOOP-9261
> URL: https://issues.apache.org/jira/browse/HADOOP-9261
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: fs/s3
>Affects Versions: 2.0.2-alpha, 1.1.1
> Environment: Testing against S3 bucket stored on US West (Read after 
> Write consistency; eventual for read-after-delete or write-after-write)
>Reporter: Steve Loughran
> Attachments: HADOOP-9261.patch
>
>
> The S3N filesystem {{rename()}} doesn't make sure that the destination 
> directory is not a child or other descendant of the source directory. The 
> files are copied to the new destination, then the source directory is 
> recursively deleted, so losing data.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9261) S3n filesystem can move a directory under itself -and so lose data

2013-01-30 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated HADOOP-9261:
---

Description: The S3N filesystem {{rename()}} doesn't make sure that the 
destination directory is not a child or other descendant of the source 
directory. The files are copied to the new destination, then the source 
directory is recursively deleted, so losing data.  (was: In the S3 filesystem 
clients, {{rename()}} doesn't make sure that the destination directory is not a 
child or other descendant of the source directory. The files are copied to the 
new destination, then the source directory is recursively deleted, so losing 
data.)

> S3n filesystem can move a directory under itself -and so lose data
> --
>
> Key: HADOOP-9261
> URL: https://issues.apache.org/jira/browse/HADOOP-9261
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: fs/s3
>Affects Versions: 1.1.1, 2.0.2-alpha
> Environment: Testing against S3 bucket stored on US West (Read after 
> Write consistency; eventual for read-after-delete or write-after-write)
>Reporter: Steve Loughran
>
> The S3N filesystem {{rename()}} doesn't make sure that the destination 
> directory is not a child or other descendant of the source directory. The 
> files are copied to the new destination, then the source directory is 
> recursively deleted, so losing data.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9261) S3n filesystem can move a directory under itself -and so lose data

2013-01-30 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated HADOOP-9261:
---

Summary: S3n filesystem can move a directory under itself -and so lose data 
 (was: S3 and S3 filesystems can move a directory under itself -and so lose 
data)

> S3n filesystem can move a directory under itself -and so lose data
> --
>
> Key: HADOOP-9261
> URL: https://issues.apache.org/jira/browse/HADOOP-9261
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: fs/s3
>Affects Versions: 1.1.1, 2.0.2-alpha
> Environment: Testing against S3 bucket stored on US West (Read after 
> Write consistency; eventual for read-after-delete or write-after-write)
>Reporter: Steve Loughran
>
> In the S3 filesystem clients, {{rename()}} doesn't make sure that the 
> destination directory is not a child or other descendant of the source 
> directory. The files are copied to the new destination, then the source 
> directory is recursively deleted, so losing data.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-9264) port change to use Java untar API on Windows from branch-1-win to trunk

2013-01-30 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-9264:
-

 Summary: port change to use Java untar API on Windows from 
branch-1-win to trunk
 Key: HADOOP-9264
 URL: https://issues.apache.org/jira/browse/HADOOP-9264
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 3.0.0
Reporter: Chris Nauroth


HADOOP-8847 originally introduced this change on branch-1-win.  HADOOP-9081 
ported the change to branch-trunk-win.  This should be simple to port to trunk, 
which would simplify the merge and test activity happening on HADOOP-8562.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-9221) Convert remaining xdocs to APT

2013-01-30 Thread Thomas Graves (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas Graves updated HADOOP-9221:
--

Fix Version/s: 0.23.7

> Convert remaining xdocs to APT
> --
>
> Key: HADOOP-9221
> URL: https://issues.apache.org/jira/browse/HADOOP-9221
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: 3.0.0, 2.0.2-alpha
>Reporter: Andy Isaacson
>Assignee: Andy Isaacson
> Fix For: 2.0.3-alpha, 0.23.7
>
> Attachments: hadoop9221-1.txt, hadoop9221-2.txt, hadoop9221.txt
>
>
> The following Forrest XML documents are still present in trunk:
> {noformat}
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/faultinject_framework.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_editsviewer.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_imageviewer.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_permissions_guide.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_quota_admin_guide.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_user_guide.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hftp.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/libhdfs.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/webhdfs.xml
> {noformat}
> Several of them are leftover cruft, and all of them are out of date to one 
> degree or another, but it's easiest to simply convert them all to APT and 
> move forward with editing thereafter.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9221) Convert remaining xdocs to APT

2013-01-30 Thread Thomas Graves (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566702#comment-13566702
 ] 

Thomas Graves commented on HADOOP-9221:
---

Are all the new docs linked from somewhere? 

I expected to see them linked from the top level menu like 
http://hadoop.apache.org/docs/current/ but I only see the hadoop commands 
manual and the Filesystem shell.  It used to be you clicked on say the commands 
manual and you would go to the old style documentation where it had a menu with 
links to the Superusers, native libraries, etc, but I don't see that any more 
since converted.  Is there perhaps a new menu I'm missing?

> Convert remaining xdocs to APT
> --
>
> Key: HADOOP-9221
> URL: https://issues.apache.org/jira/browse/HADOOP-9221
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: 3.0.0, 2.0.2-alpha
>Reporter: Andy Isaacson
>Assignee: Andy Isaacson
> Fix For: 2.0.3-alpha
>
> Attachments: hadoop9221-1.txt, hadoop9221-2.txt, hadoop9221.txt
>
>
> The following Forrest XML documents are still present in trunk:
> {noformat}
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/faultinject_framework.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_editsviewer.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_imageviewer.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_permissions_guide.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_quota_admin_guide.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_user_guide.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hftp.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/libhdfs.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/webhdfs.xml
> {noformat}
> Several of them are leftover cruft, and all of them are out of date to one 
> degree or another, but it's easiest to simply convert them all to APT and 
> move forward with editing thereafter.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9263) findbugs reports extra warnings on branch-1

2013-01-30 Thread Chris Nauroth (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566704#comment-13566704
 ] 

Chris Nauroth commented on HADOOP-9263:
---

The easiest way to see the problem is to run ant test-patch with a no-op 
(empty) patch file:

touch /tmp/empty && ant -Dforrest.home=/Users/chris/apache-forrest-0.9 
-Dfindbugs.home=/Users/chris/findbugs-1.3.9 -Dpatch.file=/tmp/empty test-patch

 [exec] -1 overall.  
 [exec] 
 [exec] +1 @author.  The patch does not contain any @author tags.
 [exec] 
 [exec] -1 tests included.  The patch doesn't appear to include any new 
or modified tests.
 [exec] Please justify why no tests are needed for 
this patch.
 [exec] 
 [exec] +1 javadoc.  The javadoc tool did not generate any warning 
messages.
 [exec] 
 [exec] +1 javac.  The applied patch does not increase the total number 
of javac compiler warnings.
 [exec] 
 [exec] -1 findbugs.  The patch appears to introduce 14 new Findbugs 
(version 1.3.9) warnings.


> findbugs reports extra warnings on branch-1
> ---
>
> Key: HADOOP-9263
> URL: https://issues.apache.org/jira/browse/HADOOP-9263
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: 1.1.2
>Reporter: Chris Nauroth
>
> Currently on branch-1, src/test/test-patch.properties defines 
> {{OK_FINDBUGS_WARNINGS=211}}, but findbugs actually finds 225 warnings.  This 
> means that any patch will get -1 from ant test-patch due to 14 new findbugs 
> warnings, even though the warnings are unrelated to that patch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-9263) findbugs reports extra warnings on branch-1

2013-01-30 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-9263:
-

 Summary: findbugs reports extra warnings on branch-1
 Key: HADOOP-9263
 URL: https://issues.apache.org/jira/browse/HADOOP-9263
 Project: Hadoop Common
  Issue Type: Bug
  Components: build
Affects Versions: 1.1.2
Reporter: Chris Nauroth


Currently on branch-1, src/test/test-patch.properties defines 
{{OK_FINDBUGS_WARNINGS=211}}, but findbugs actually finds 225 warnings.  This 
means that any patch will get -1 from ant test-patch due to 14 new findbugs 
warnings, even though the warnings are unrelated to that patch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9260) Hadoop version may be not correct when starting name node or data node

2013-01-30 Thread Jason Lowe (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566619#comment-13566619
 ] 

Jason Lowe commented on HADOOP-9260:


Agree that we should move the source jars off the classpath.  +1 for taking 
just the source jars portion of HADOOP-9116 in the short term to fix this 
issue, then HADOOP-9116 can complete the move of test jars off the classpath 
when we decide how to resolve the running of tests issue.


> Hadoop version may be not correct when starting name node or data node
> --
>
> Key: HADOOP-9260
> URL: https://issues.apache.org/jira/browse/HADOOP-9260
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: trunk-win
>Reporter: Jerry Chen
>Priority: Critical
>
> 1. Check out the trunk from 
> http://svn.apache.org/repos/asf/hadoop/common/trunk/ -r 1439752
> 2. Compile package
>m2 package -Pdist -Psrc -Pnative -Dtar -DskipTests
> 3. Hadoop version of compiled dist shows the following:
> Hadoop ${pom.version}
> Subversion ${version-info.scm.uri} -r ${version-info.scm.commit}
> Compiled by ${user.name} on ${version-info.build.time}
> From source with checksum ${version-info.source.md5}
> And in a real cluster, the log in name node shows:
> 2013-01-29 15:23:42,738 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: 
> STARTUP_MSG: 
> /
> STARTUP_MSG: Starting NameNode
> STARTUP_MSG:   host = bdpe01.sh.intel.com/10.239.47.101
> STARTUP_MSG:   args = []
> STARTUP_MSG:   version = ${pom.version}
> STARTUP_MSG:   classpath = ...
> STARTUP_MSG:   build = ${version-info.scm.uri} -r ${version-info.scm.commit}; 
> compiled by '${user.name}' on ${version-info.build.time}
> STARTUP_MSG:   java = 1.6.0_33
> While some data nodes with the same binary shows the correct version 
> information.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-8723) Remove tests and tests-sources jars from classpath

2013-01-30 Thread Jason Lowe (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Lowe updated HADOOP-8723:
---

  Resolution: Duplicate
Target Version/s: 2.0.2-alpha, 3.0.0  (was: 3.0.0, 2.0.2-alpha)
  Status: Resolved  (was: Patch Available)

> Remove tests and tests-sources jars from classpath
> --
>
> Key: HADOOP-8723
> URL: https://issues.apache.org/jira/browse/HADOOP-8723
> Project: Hadoop Common
>  Issue Type: Improvement
>Affects Versions: 2.0.0-alpha
>Reporter: Jason Lowe
>Assignee: Jason Lowe
> Attachments: HADOOP-8723.patch
>
>
> Currently {{hadoop-config.sh}} is including any tests and tests-sources jars 
> in the default classpath, as those jars are shipped in the dist tarball next 
> to the main jars and the script is globbing everything in that directory.
> The tests and tests-sources jars aren't required to run Hadoop, but they can 
> cause breakage when inadvertently picked up.  See HDFS-3831 as an example.  
> Ideally we should not be adding these jars to the classpath.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9260) Hadoop version may be not correct when starting name node or data node

2013-01-30 Thread Chris Nauroth (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566595#comment-13566595
 ] 

Chris Nauroth commented on HADOOP-9260:
---

Jerry, thank you for the details.  That helps clarify the problem.  I would not 
expect the HADOOP-9246 patch to fix the problem that you're seeing.

I think we need to revisit HADOOP-8723 (patch from [~jlowe]) or HADOOP-9116 
(patch from [~tucu00]).  The goal of both of these issues is to remove the test 
and source jars from the runtime classpath, because they can cause odd problems 
like this.  There was some question about those patches potentially making it 
more awkward to run tests, so they haven't been committed yet.  If we need a 
compromise, then maybe we could just move the source jar out of the way for now 
and revisit moving the test jar off of the classpath later.  We only need to 
move the source jar out of the way to resolve HADOOP-9260, and it's definitely 
not correct to have the source jar on the classpath.


> Hadoop version may be not correct when starting name node or data node
> --
>
> Key: HADOOP-9260
> URL: https://issues.apache.org/jira/browse/HADOOP-9260
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: trunk-win
>Reporter: Jerry Chen
>Priority: Critical
>
> 1. Check out the trunk from 
> http://svn.apache.org/repos/asf/hadoop/common/trunk/ -r 1439752
> 2. Compile package
>m2 package -Pdist -Psrc -Pnative -Dtar -DskipTests
> 3. Hadoop version of compiled dist shows the following:
> Hadoop ${pom.version}
> Subversion ${version-info.scm.uri} -r ${version-info.scm.commit}
> Compiled by ${user.name} on ${version-info.build.time}
> From source with checksum ${version-info.source.md5}
> And in a real cluster, the log in name node shows:
> 2013-01-29 15:23:42,738 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: 
> STARTUP_MSG: 
> /
> STARTUP_MSG: Starting NameNode
> STARTUP_MSG:   host = bdpe01.sh.intel.com/10.239.47.101
> STARTUP_MSG:   args = []
> STARTUP_MSG:   version = ${pom.version}
> STARTUP_MSG:   classpath = ...
> STARTUP_MSG:   build = ${version-info.scm.uri} -r ${version-info.scm.commit}; 
> compiled by '${user.name}' on ${version-info.build.time}
> STARTUP_MSG:   java = 1.6.0_33
> While some data nodes with the same binary shows the correct version 
> information.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-8545) Filesystem Implementation for OpenStack Swift

2013-01-30 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated HADOOP-8545:
---

Priority: Major  (was: Minor)
Assignee: Dmitry Mezhensky

Added Dmitry to contributor group, assigned issue to him, raised priority to 
major

> Filesystem Implementation for OpenStack Swift
> -
>
> Key: HADOOP-8545
> URL: https://issues.apache.org/jira/browse/HADOOP-8545
> Project: Hadoop Common
>  Issue Type: New Feature
>  Components: fs
>Affects Versions: 2.0.3-alpha, 1.1.2
>Reporter: Tim Miller
>Assignee: Dmitry Mezhensky
> Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, 
> HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, 
> HADOOP-8545-6.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, 
> HADOOP-8545.patch
>
>
> Add a filesystem implementation for OpenStack Swift object store, similar to 
> the one which exists today for S3.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift

2013-01-30 Thread Steve Loughran (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566547#comment-13566547
 ] 

Steve Loughran commented on HADOOP-8545:


Dmitry: release audit was about some missing headers; I can do that
{code}
 !? 
src/test/org/apache/hadoop/fs/swift/NativeSwiftFileSystemContractBaseTest.java
 !? 
src/test/org/apache/hadoop/fs/swift/snative/SwiftFileSystemForFunctionalTests.java
 !? 
src/test/org/apache/hadoop/fs/swift/functional/tests/SwiftFileSystemTest.java
 !? src/test/org/apache/hadoop/fs/swift/InMemorySwiftNativeStore.java
 !? src/test/org/apache/hadoop/fs/swift/TestSwiftConfig.java
 !? src/test/org/apache/hadoop/fs/swift/TestSwiftObjectPath.java
 !? 
src/core/org/apache/hadoop/fs/swift/snative/SwiftNativeFileSystemStore.java
 !? src/core/org/apache/hadoop/fs/swift/block/SwiftBlockInputStream.java
{code}
I'll look at that

> Filesystem Implementation for OpenStack Swift
> -
>
> Key: HADOOP-8545
> URL: https://issues.apache.org/jira/browse/HADOOP-8545
> Project: Hadoop Common
>  Issue Type: New Feature
>  Components: fs
>Affects Versions: 2.0.3-alpha, 1.1.2
>Reporter: Tim Miller
>Priority: Minor
> Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, 
> HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, 
> HADOOP-8545-6.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, 
> HADOOP-8545.patch
>
>
> Add a filesystem implementation for OpenStack Swift object store, similar to 
> the one which exists today for S3.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift

2013-01-30 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566520#comment-13566520
 ] 

Hadoop QA commented on HADOOP-8545:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12567143/HADOOP-8545-6.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 13 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:red}-1 release audit{color}.  The applied patch generated 8 
release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in .

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2116//testReport/
Release audit warnings: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2116//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt
Console output: 
https://builds.apache.org/job/PreCommit-HADOOP-Build/2116//console

This message is automatically generated.

> Filesystem Implementation for OpenStack Swift
> -
>
> Key: HADOOP-8545
> URL: https://issues.apache.org/jira/browse/HADOOP-8545
> Project: Hadoop Common
>  Issue Type: New Feature
>  Components: fs
>Affects Versions: 2.0.3-alpha, 1.1.2
>Reporter: Tim Miller
>Priority: Minor
> Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, 
> HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, 
> HADOOP-8545-6.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, 
> HADOOP-8545.patch
>
>
> Add a filesystem implementation for OpenStack Swift object store, similar to 
> the one which exists today for S3.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HADOOP-8545) Filesystem Implementation for OpenStack Swift

2013-01-30 Thread Dmitry Mezhensky (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dmitry Mezhensky updated HADOOP-8545:
-

Attachment: HADOOP-8545-6.patch

- Support non-alphabetic symbols in path name.
- Bug fixing



> Filesystem Implementation for OpenStack Swift
> -
>
> Key: HADOOP-8545
> URL: https://issues.apache.org/jira/browse/HADOOP-8545
> Project: Hadoop Common
>  Issue Type: New Feature
>  Components: fs
>Affects Versions: 2.0.3-alpha, 1.1.2
>Reporter: Tim Miller
>Priority: Minor
> Attachments: HADOOP-8545-1.patch, HADOOP-8545-2.patch, 
> HADOOP-8545-3.patch, HADOOP-8545-4.patch, HADOOP-8545-5.patch, 
> HADOOP-8545-6.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch, 
> HADOOP-8545.patch
>
>
> Add a filesystem implementation for OpenStack Swift object store, similar to 
> the one which exists today for S3.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9221) Convert remaining xdocs to APT

2013-01-30 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566496#comment-13566496
 ] 

Hudson commented on HADOOP-9221:


Integrated in Hadoop-Mapreduce-trunk #1329 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1329/])
Move HADOOP-9221 to correct section of CHANGES.txt. (Revision 1440248)
HADOOP-9221. Convert remaining xdocs to APT. Contributed by Andy Isaacson. 
(Revision 1440245)

 Result = SUCCESS
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440248
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt

atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440245
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/faultinject_framework.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_editsviewer.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_imageviewer.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_permissions_guide.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_quota_admin_guide.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_user_guide.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hftp.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/libhdfs.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/FaultInjectFramework.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsEditsViewer.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsImageViewer.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsPermissionsGuide.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsQuotaAdminGuide.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/Hftp.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/LibHdfs.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/SLGUserGuide.apt.vm


> Convert remaining xdocs to APT
> --
>
> Key: HADOOP-9221
> URL: https://issues.apache.org/jira/browse/HADOOP-9221
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: 3.0.0, 2.0.2-alpha
>Reporter: Andy Isaacson
>Assignee: Andy Isaacson
> Fix For: 2.0.3-alpha
>
> Attachments: hadoop9221-1.txt, hadoop9221-2.txt, hadoop9221.txt
>
>
> The following Forrest XML documents are still present in trunk:
> {noformat}
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml
> hadoop-hdfs-p

[jira] [Commented] (HADOOP-9249) hadoop-maven-plugins version-info goal causes build failure when running with Clover

2013-01-30 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566497#comment-13566497
 ] 

Hudson commented on HADOOP-9249:


Integrated in Hadoop-Mapreduce-trunk #1329 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1329/])
HADOOP-9249. hadoop-maven-plugins version-info goal causes build failure 
when running with Clover. Contributed by Chris Nauroth. (Revision 1440200)

 Result = SUCCESS
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440200
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-maven-plugins/pom.xml


> hadoop-maven-plugins version-info goal causes build failure when running with 
> Clover
> 
>
> Key: HADOOP-9249
> URL: https://issues.apache.org/jira/browse/HADOOP-9249
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: 3.0.0
>Reporter: Chris Nauroth
>Assignee: Chris Nauroth
> Fix For: 3.0.0
>
> Attachments: HADOOP-9249.1.patch
>
>
> Running Maven with the -Pclover option for code coverage causes the build to 
> fail because of not finding a Clover class while running hadoop-maven-plugins 
> version-info.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9221) Convert remaining xdocs to APT

2013-01-30 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566443#comment-13566443
 ] 

Hudson commented on HADOOP-9221:


Integrated in Hadoop-Hdfs-trunk #1301 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1301/])
Move HADOOP-9221 to correct section of CHANGES.txt. (Revision 1440248)
HADOOP-9221. Convert remaining xdocs to APT. Contributed by Andy Isaacson. 
(Revision 1440245)

 Result = SUCCESS
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440248
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt

atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440245
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/faultinject_framework.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_editsviewer.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_imageviewer.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_permissions_guide.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_quota_admin_guide.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_user_guide.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hftp.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/libhdfs.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/FaultInjectFramework.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsEditsViewer.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsImageViewer.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsPermissionsGuide.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsQuotaAdminGuide.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/Hftp.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/LibHdfs.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/SLGUserGuide.apt.vm


> Convert remaining xdocs to APT
> --
>
> Key: HADOOP-9221
> URL: https://issues.apache.org/jira/browse/HADOOP-9221
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: 3.0.0, 2.0.2-alpha
>Reporter: Andy Isaacson
>Assignee: Andy Isaacson
> Fix For: 2.0.3-alpha
>
> Attachments: hadoop9221-1.txt, hadoop9221-2.txt, hadoop9221.txt
>
>
> The following Forrest XML documents are still present in trunk:
> {noformat}
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml
> hadoop-hdfs-project/had

[jira] [Commented] (HADOOP-9249) hadoop-maven-plugins version-info goal causes build failure when running with Clover

2013-01-30 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566444#comment-13566444
 ] 

Hudson commented on HADOOP-9249:


Integrated in Hadoop-Hdfs-trunk #1301 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1301/])
HADOOP-9249. hadoop-maven-plugins version-info goal causes build failure 
when running with Clover. Contributed by Chris Nauroth. (Revision 1440200)

 Result = SUCCESS
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440200
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-maven-plugins/pom.xml


> hadoop-maven-plugins version-info goal causes build failure when running with 
> Clover
> 
>
> Key: HADOOP-9249
> URL: https://issues.apache.org/jira/browse/HADOOP-9249
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: 3.0.0
>Reporter: Chris Nauroth
>Assignee: Chris Nauroth
> Fix For: 3.0.0
>
> Attachments: HADOOP-9249.1.patch
>
>
> Running Maven with the -Pclover option for code coverage causes the build to 
> fail because of not finding a Clover class while running hadoop-maven-plugins 
> version-info.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9190) packaging docs is broken

2013-01-30 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566424#comment-13566424
 ] 

Hudson commented on HADOOP-9190:


Integrated in Hadoop-Hdfs-0.23-Build #510 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/510/])
HADOOP-9190. packaging docs is broken. (Andy Isaacson via tgraves) 
(Revision 1439941)

 Result = SUCCESS
tgraves : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1439941
Files : 
* /hadoop/common/branches/branch-0.23/BUILDING.txt
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/docs/forrest.properties
* 
/hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/forrest.properties
* /hadoop/common/branches/branch-0.23/hadoop-project-dist/pom.xml


> packaging docs is broken
> 
>
> Key: HADOOP-9190
> URL: https://issues.apache.org/jira/browse/HADOOP-9190
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.0.0, 2.0.3-alpha, 0.23.6
>Reporter: Thomas Graves
>Assignee: Andy Isaacson
> Fix For: 3.0.0, 2.0.3-alpha, 0.23.7
>
> Attachments: hadoop9190-1.txt, hadoop9190.txt
>
>
> It looks like after the docs got converted to apt format in HADOOP-8427, mvn 
> site package -Pdist,docs no longer works.   If you run mvn site or mvn 
> site:stage by itself they work fine, its when you go to package it that it 
> breaks.
> The error is with broken links, here is one of them:
> broken-links>
>message="hadoop-common-project/hadoop-common/target/docs-src/src/documentation/content/xdocs/HttpAuthentication.xml
>  (No such file or directory)" uri="HttpAuthentication.html">
> 
> 
> 
> 
> 
> 
> 
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9221) Convert remaining xdocs to APT

2013-01-30 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566361#comment-13566361
 ] 

Hudson commented on HADOOP-9221:


Integrated in Hadoop-Yarn-trunk #112 (See 
[https://builds.apache.org/job/Hadoop-Yarn-trunk/112/])
Move HADOOP-9221 to correct section of CHANGES.txt. (Revision 1440248)
HADOOP-9221. Convert remaining xdocs to APT. Contributed by Andy Isaacson. 
(Revision 1440245)

 Result = SUCCESS
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440248
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt

atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440245
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/faultinject_framework.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_editsviewer.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_imageviewer.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_permissions_guide.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_quota_admin_guide.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hdfs_user_guide.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/hftp.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/libhdfs.xml
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/FaultInjectFramework.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsEditsViewer.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsImageViewer.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsPermissionsGuide.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsQuotaAdminGuide.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/Hftp.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/LibHdfs.apt.vm
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/SLGUserGuide.apt.vm


> Convert remaining xdocs to APT
> --
>
> Key: HADOOP-9221
> URL: https://issues.apache.org/jira/browse/HADOOP-9221
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: 3.0.0, 2.0.2-alpha
>Reporter: Andy Isaacson
>Assignee: Andy Isaacson
> Fix For: 2.0.3-alpha
>
> Attachments: hadoop9221-1.txt, hadoop9221-2.txt, hadoop9221.txt
>
>
> The following Forrest XML documents are still present in trunk:
> {noformat}
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/Superusers.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/deployment_layout.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/native_libraries.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/service_level_auth.xml
> hadoop-common-project/hadoop-common/src/main/docs/src/documentation/content/xdocs/single_node_setup.xml
> hadoop-hdfs-project/hadoop-hdfs/src/main/docs/src/documentation/content/xdocs/SLG_user_guide.xml
> hadoop-hdfs-project/hadoo

[jira] [Commented] (HADOOP-9249) hadoop-maven-plugins version-info goal causes build failure when running with Clover

2013-01-30 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566362#comment-13566362
 ] 

Hudson commented on HADOOP-9249:


Integrated in Hadoop-Yarn-trunk #112 (See 
[https://builds.apache.org/job/Hadoop-Yarn-trunk/112/])
HADOOP-9249. hadoop-maven-plugins version-info goal causes build failure 
when running with Clover. Contributed by Chris Nauroth. (Revision 1440200)

 Result = SUCCESS
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1440200
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-maven-plugins/pom.xml


> hadoop-maven-plugins version-info goal causes build failure when running with 
> Clover
> 
>
> Key: HADOOP-9249
> URL: https://issues.apache.org/jira/browse/HADOOP-9249
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: 3.0.0
>Reporter: Chris Nauroth
>Assignee: Chris Nauroth
> Fix For: 3.0.0
>
> Attachments: HADOOP-9249.1.patch
>
>
> Running Maven with the -Pclover option for code coverage causes the build to 
> fail because of not finding a Clover class while running hadoop-maven-plugins 
> version-info.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9260) Hadoop version may be not correct when starting name node or data node

2013-01-30 Thread Jerry Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566271#comment-13566271
 ] 

Jerry Chen commented on HADOOP-9260:


The incorrect version would cause more problems when running MapReduce jobs 
even if the cluster seems to start as normal. For example, when running Hive 
queries, the query failed at random and the log shows:

2013-01-30 15:45:37,080 WARN [main] org.apache.hadoop.mapred.YarnChild: 
Exception running child : java.lang.RuntimeException: 
java.lang.reflect.InvocationTargetException
at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:128)
at 
org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:66)
at 
org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42)
at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:370)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:402)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:158)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1452)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:153)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:126)
... 10 more
Caused by: java.lang.NumberFormatException: For input string: "${pom"
at 
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.Integer.parseInt(Integer.java:449)
at java.lang.Integer.parseInt(Integer.java:499)
at 
org.apache.hadoop.hive.shims.ShimLoader.getMajorVersion(ShimLoader.java:125)
at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:92)
at 
org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:66)
at 
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat$CombineHiveInputSplit.(CombineHiveInputFormat.java:85)
... 15 more


> Hadoop version may be not correct when starting name node or data node
> --
>
> Key: HADOOP-9260
> URL: https://issues.apache.org/jira/browse/HADOOP-9260
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: trunk-win
>Reporter: Jerry Chen
>Priority: Critical
>
> 1. Check out the trunk from 
> http://svn.apache.org/repos/asf/hadoop/common/trunk/ -r 1439752
> 2. Compile package
>m2 package -Pdist -Psrc -Pnative -Dtar -DskipTests
> 3. Hadoop version of compiled dist shows the following:
> Hadoop ${pom.version}
> Subversion ${version-info.scm.uri} -r ${version-info.scm.commit}
> Compiled by ${user.name} on ${version-info.build.time}
> From source with checksum ${version-info.source.md5}
> And in a real cluster, the log in name node shows:
> 2013-01-29 15:23:42,738 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: 
> STARTUP_MSG: 
> /
> STARTUP_MSG: Starting NameNode
> STARTUP_MSG:   host = bdpe01.sh.intel.com/10.239.47.101
> STARTUP_MSG:   args = []
> STARTUP_MSG:   version = ${pom.version}
> STARTUP_MSG:   classpath = ...
> STARTUP_MSG:   build = ${version-info.scm.uri} -r ${version-info.scm.commit}; 
> compiled by '${user.name}' on ${version-info.build.time}
> STARTUP_MSG:   java = 1.6.0_33
> While some data nodes with the same binary shows the correct version 
> information.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira