[jira] [Commented] (HDFS-13970) CacheManager Directives Map

2018-10-09 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643122#comment-16643122
 ] 

Akira Ajisaka commented on HDFS-13970:
--

LGTM. +1 pending Jenkins.

> CacheManager Directives Map
> ---
>
> Key: HDFS-13970
> URL: https://issues.apache.org/jira/browse/HDFS-13970
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: caching, hdfs
>Affects Versions: 3.2.0
>Reporter: BELUGA BEHR
>Assignee: BELUGA BEHR
>Priority: Minor
> Attachments: HDFS-13970.1.patch, HDFS-13970.2.patch
>
>
> # Use Guava Multimap to simplify code
>  ## Currently, code uses a mix of LinkedList and ArrayList - just pick one
>  ## Currently, {{directivesByPath}} structure is sorted but never used in a 
> sorted way, it only performs remove and add operations, no iteration - use a 
> {{Set}} instead of a {{List}} for values to support faster remove operation.  
> Use a {{HashSet}} instead of a {{TreeSet}} for keys since it doesn't appear 
> that order really matters.
>  # The {{CacheDirective}} class needs a better hashcode implementation since 
> it will be used in a Set.  Do not instantiate a {{HashBuilder}} object every 
> time {{hashcode}} is called. Ouch.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13944) [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module

2018-10-02 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13944:
-
   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: 3.3.0
   Status: Resolved  (was: Patch Available)

Committed this to trunk. Thanks [~elgoiri] for the fix!

> [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module
> 
>
> Key: HDFS-13944
> URL: https://issues.apache.org/jira/browse/HDFS-13944
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Affects Versions: 3.1.1
>Reporter: Akira Ajisaka
>Assignee: Íñigo Goiri
>Priority: Major
> Fix For: 3.3.0
>
> Attachments: HDFS-13944.000.patch, HDFS-13944.001.patch, 
> HDFS-13944.002.patch, HDFS-13944.003.patch, HDFS-13944.004.patch, 
> javadoc-rbf-000.log, javadoc-rbf.log
>
>
> There are 34 errors in hadoop-hdfs-rbf module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13944) [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module

2018-10-02 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636331#comment-16636331
 ] 

Akira Ajisaka commented on HDFS-13944:
--

+1 pending Jenkins for the v4 patch. Thanks!

> [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module
> 
>
> Key: HDFS-13944
> URL: https://issues.apache.org/jira/browse/HDFS-13944
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Affects Versions: 3.1.1
>Reporter: Akira Ajisaka
>Assignee: Íñigo Goiri
>Priority: Major
> Attachments: HDFS-13944.000.patch, HDFS-13944.001.patch, 
> HDFS-13944.002.patch, HDFS-13944.003.patch, HDFS-13944.004.patch, 
> javadoc-rbf-000.log, javadoc-rbf.log
>
>
> There are 34 errors in hadoop-hdfs-rbf module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13944) [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module

2018-10-02 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636318#comment-16636318
 ] 

Akira Ajisaka commented on HDFS-13944:
--

Found a typo 'authrozied' in RouterAdminServer.java.

> [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module
> 
>
> Key: HDFS-13944
> URL: https://issues.apache.org/jira/browse/HDFS-13944
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Affects Versions: 3.1.1
>Reporter: Akira Ajisaka
>Assignee: Íñigo Goiri
>Priority: Major
> Attachments: HDFS-13944.000.patch, HDFS-13944.001.patch, 
> HDFS-13944.002.patch, HDFS-13944.003.patch, javadoc-rbf-000.log, 
> javadoc-rbf.log
>
>
> There are 34 errors in hadoop-hdfs-rbf module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13944) [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module

2018-10-02 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636315#comment-16636315
 ] 

Akira Ajisaka commented on HDFS-13944:
--

Thank you for updating the patch!

There is a javadoc error in RecordStore.java. Would you fix this?
{noformat}
[ERROR] 
/Users/aajisaka/git/hadoop/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/store/RecordStore.java:64:
 error: @param name not found
[ERROR]* @param  The type of the record to store by this interface.
{noformat}

bq. I'm not sure how to handle the checkstyle, if I split the line, javadoc 
complains, if I don't, checkstyle complains.
I prefer to fixing javadoc warnings rather than fixing checkstyle.

> [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module
> 
>
> Key: HDFS-13944
> URL: https://issues.apache.org/jira/browse/HDFS-13944
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Affects Versions: 3.1.1
>Reporter: Akira Ajisaka
>Assignee: Íñigo Goiri
>Priority: Major
> Attachments: HDFS-13944.000.patch, HDFS-13944.001.patch, 
> HDFS-13944.002.patch, javadoc-rbf-000.log, javadoc-rbf.log
>
>
> There are 34 errors in hadoop-hdfs-rbf module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13943) [JDK10] Fix javadoc errors in hadoop-hdfs-client module

2018-10-01 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633630#comment-16633630
 ] 

Akira Ajisaka commented on HDFS-13943:
--

Thanks [~tasanuma0829] for reviewing my patch.

bq. ClientProtocol: It would be better to format the paragraphs more.
Fixed in 02 patch.

bq. ClientProtocol, DFSUtilClient: For the generics in the javadoc, It would be 
better to use the escape codes(lt and gt) instead of deleting them.
The return paramater type is automatically documented in the javadoc, so I 
think we can remove this.

bq. StripedBlockUtil: IIUC, the ascii arts are for developers who are reading 
source codes directly. So I suggest we leave them as they are. How about using 
just comments instead of javadoc?
Agreed. Fixed in 02 patch.

> [JDK10] Fix javadoc errors in hadoop-hdfs-client module
> ---
>
> Key: HDFS-13943
> URL: https://issues.apache.org/jira/browse/HDFS-13943
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
> Attachments: HDFS-13943.01.patch, HDFS-13943.02.patch
>
>
> There are 85 errors in hadoop-hdfs-client module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13943) [JDK10] Fix javadoc errors in hadoop-hdfs-client module

2018-09-30 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13943:
-
Attachment: HDFS-13943.02.patch

> [JDK10] Fix javadoc errors in hadoop-hdfs-client module
> ---
>
> Key: HDFS-13943
> URL: https://issues.apache.org/jira/browse/HDFS-13943
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
> Attachments: HDFS-13943.01.patch, HDFS-13943.02.patch
>
>
> There are 85 errors in hadoop-hdfs-client module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13944) [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module

2018-09-30 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13944:
-
Attachment: javadoc-rbf-000.log

> [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module
> 
>
> Key: HDFS-13944
> URL: https://issues.apache.org/jira/browse/HDFS-13944
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
> Attachments: HDFS-13944.000.patch, javadoc-rbf-000.log, 
> javadoc-rbf.log
>
>
> There are 34 errors in hadoop-hdfs-rbf module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13944) [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module

2018-09-30 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633617#comment-16633617
 ] 

Akira Ajisaka commented on HDFS-13944:
--

Thans [~elgoiri] for the patch.
The fix looks good to me, but there are still 18 errors. Attaching the log.
We must fix all the javadoc errors to run {{mvn package}} successfully, and we 
don't need to fix all the warnings.

> [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module
> 
>
> Key: HDFS-13944
> URL: https://issues.apache.org/jira/browse/HDFS-13944
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
> Attachments: HDFS-13944.000.patch, javadoc-rbf.log
>
>
> There are 34 errors in hadoop-hdfs-rbf module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13938) Add a missing "break" in BaseTestHttpFSWith

2018-09-28 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13938:
-
Component/s: test

> Add a missing "break" in BaseTestHttpFSWith
> ---
>
> Key: HDFS-13938
> URL: https://issues.apache.org/jira/browse/HDFS-13938
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: httpfs, test
>Affects Versions: 3.2.0
>Reporter: Siyao Meng
>Assignee: Siyao Meng
>Priority: Minor
> Fix For: 3.2.0
>
> Attachments: HDFS-13938.001.patch, HDFS-13938.001.patch, 
> HDFS-13938.002.patch
>
>
> In BaseTestHttpFSWith:
> {code:java}
> case DISALLOW_SNAPSHOT:
>   testDisallowSnapshot();
>   break;
> case DISALLOW_SNAPSHOT_EXCEPTION:
>   testDisallowSnapshotException();
>   // Missed a "break" here.
> case FILE_STATUS_ATTR:
>   testFileStatusAttr();
>   break;
> {code}
> The missing "break" won't cause any bugs though. Just the fact that 
> testFileStatusAttr() will be run a second time after 
> testDisallowSnapshotException() finishes. :P



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13938) Add a missing "break" in BaseTestHttpFSWith

2018-09-28 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13938:
-
Priority: Minor  (was: Trivial)

> Add a missing "break" in BaseTestHttpFSWith
> ---
>
> Key: HDFS-13938
> URL: https://issues.apache.org/jira/browse/HDFS-13938
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: httpfs, test
>Affects Versions: 3.2.0
>Reporter: Siyao Meng
>Assignee: Siyao Meng
>Priority: Minor
> Fix For: 3.2.0
>
> Attachments: HDFS-13938.001.patch, HDFS-13938.001.patch, 
> HDFS-13938.002.patch
>
>
> In BaseTestHttpFSWith:
> {code:java}
> case DISALLOW_SNAPSHOT:
>   testDisallowSnapshot();
>   break;
> case DISALLOW_SNAPSHOT_EXCEPTION:
>   testDisallowSnapshotException();
>   // Missed a "break" here.
> case FILE_STATUS_ATTR:
>   testFileStatusAttr();
>   break;
> {code}
> The missing "break" won't cause any bugs though. Just the fact that 
> testFileStatusAttr() will be run a second time after 
> testDisallowSnapshotException() finishes. :P



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13938) Add a missing "break" in BaseTestHttpFSWith

2018-09-28 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13938:
-
   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: 3.2.0
   Status: Resolved  (was: Patch Available)

+1, committed this to trunk. Thanks [~smeng] for the contribution and thanks 
[~jojochuang] and [~linyiqun] for the reviews.

> Add a missing "break" in BaseTestHttpFSWith
> ---
>
> Key: HDFS-13938
> URL: https://issues.apache.org/jira/browse/HDFS-13938
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: httpfs, test
>Affects Versions: 3.2.0
>Reporter: Siyao Meng
>Assignee: Siyao Meng
>Priority: Trivial
> Fix For: 3.2.0
>
> Attachments: HDFS-13938.001.patch, HDFS-13938.001.patch, 
> HDFS-13938.002.patch
>
>
> In BaseTestHttpFSWith:
> {code:java}
> case DISALLOW_SNAPSHOT:
>   testDisallowSnapshot();
>   break;
> case DISALLOW_SNAPSHOT_EXCEPTION:
>   testDisallowSnapshotException();
>   // Missed a "break" here.
> case FILE_STATUS_ATTR:
>   testFileStatusAttr();
>   break;
> {code}
> The missing "break" won't cause any bugs though. Just the fact that 
> testFileStatusAttr() will be run a second time after 
> testDisallowSnapshotException() finishes. :P



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13932) [JDK 11] Casts to BlockStoragePolicy[] in unit tests raise ClassCastExceptions

2018-09-26 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13932:
-
   Resolution: Fixed
 Assignee: Andrew Purtell
 Hadoop Flags: Reviewed
Fix Version/s: 3.2.0
   Status: Resolved  (was: Patch Available)

Committed this to trunk. Thank you [~apurtell] for trying the latest Java 
version!

> [JDK 11] Casts to BlockStoragePolicy[] in unit tests raise 
> ClassCastExceptions 
> ---
>
> Key: HDFS-13932
> URL: https://issues.apache.org/jira/browse/HDFS-13932
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Minor
> Fix For: 3.2.0
>
> Attachments: HDFS-13932.patch, HDFS-13932.patch
>
>
> For example
> java.lang.ClassCastException: class [Ljava.lang.Object; cannot be cast to 
> class [Lorg.apache.hadoop.hdfs.protocol.BlockStoragePolicy; 
> ([Ljava.lang.Object; is in module java.base of loader 'bootstrap'; 
> [Lorg.apache.hadoop.hdfs.protocol.BlockStoragePolicy; is in unnamed module of 
> loader 'app')
>   at 
> org.apache.hadoop.hdfs.web.TestWebHDFS.testStoragePolicy(TestWebHDFS.java:1391)
> This is with Java 11+28. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13932) [JDK 11] Casts to BlockStoragePolicy[] in unit tests raise ClassCastExceptions

2018-09-26 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629678#comment-16629678
 ] 

Akira Ajisaka commented on HDFS-13932:
--

+1, committing this.

> [JDK 11] Casts to BlockStoragePolicy[] in unit tests raise 
> ClassCastExceptions 
> ---
>
> Key: HDFS-13932
> URL: https://issues.apache.org/jira/browse/HDFS-13932
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Andrew Purtell
>Priority: Minor
> Attachments: HDFS-13932.patch, HDFS-13932.patch
>
>
> For example
> java.lang.ClassCastException: class [Ljava.lang.Object; cannot be cast to 
> class [Lorg.apache.hadoop.hdfs.protocol.BlockStoragePolicy; 
> ([Ljava.lang.Object; is in module java.base of loader 'bootstrap'; 
> [Lorg.apache.hadoop.hdfs.protocol.BlockStoragePolicy; is in unnamed module of 
> loader 'app')
>   at 
> org.apache.hadoop.hdfs.web.TestWebHDFS.testStoragePolicy(TestWebHDFS.java:1391)
> This is with Java 11+28. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13932) [JDK 11] Casts to BlockStoragePolicy[] in unit tests raise ClassCastExceptions

2018-09-26 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629677#comment-16629677
 ] 

Akira Ajisaka commented on HDFS-13932:
--

It seems that Jenkins failed to comment the result. 
https://builds.apache.org/job/PreCommit-HDFS-Build/25142/artifact/out/jiracommentfile

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
22s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 2 new or modified test 
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
10s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 17m 
25s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m 
58s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  1m 
 1s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green}  1m 
41s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 
12m 41s{color} | {color:green} branch has no errors when building and testing 
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  2m 
29s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  1m 
12s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
8s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  1m 
23s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  3m  
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  3m  
0s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}  
0m 54s{color} | {color:orange} hadoop-hdfs-project: The patch generated 1 new + 
72 unchanged - 0 fixed = 73 total (was 72) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green}  1m 
28s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 
11m  9s{color} | {color:green} patch has no errors when building and testing 
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  2m 
42s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  1m 
10s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}102m 33s{color} 
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  4m 
50s{color} | {color:green} hadoop-hdfs-httpfs in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
33s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}169m  9s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hdfs.server.balancer.TestBalancer |
|   | hadoop.hdfs.qjournal.server.TestJournalNodeSync |
|   | hadoop.hdfs.web.TestWebHdfsTimeouts |
|   | hadoop.hdfs.client.impl.TestBlockReaderLocal |
|   | hadoop.hdfs.TestLeaseRecovery2 |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:4b8c2b1 |
| JIRA Issue | HDFS-13932 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12941447/HDFS-13932.patch |
| Optional Tests |  dupname  asflicense  compile  javac  javadoc  mvninstall  
mvnsite  unit  shadedclient  findbugs  checkstyle  |
| uname | Linux 

[jira] [Updated] (HDFS-13943) [JDK10] Fix javadoc errors in hadoop-hdfs-client module

2018-09-26 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13943:
-
Attachment: HDFS-13943.01.patch

> [JDK10] Fix javadoc errors in hadoop-hdfs-client module
> ---
>
> Key: HDFS-13943
> URL: https://issues.apache.org/jira/browse/HDFS-13943
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
> Attachments: HDFS-13943.01.patch
>
>
> There are 85 errors in hadoop-hdfs-client module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13943) [JDK10] Fix javadoc errors in hadoop-hdfs-client module

2018-09-26 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13943:
-
Status: Patch Available  (was: Open)

> [JDK10] Fix javadoc errors in hadoop-hdfs-client module
> ---
>
> Key: HDFS-13943
> URL: https://issues.apache.org/jira/browse/HDFS-13943
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
> Attachments: HDFS-13943.01.patch
>
>
> There are 85 errors in hadoop-hdfs-client module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13944) [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module

2018-09-26 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629675#comment-16629675
 ] 

Akira Ajisaka commented on HDFS-13944:
--

Attached.
Now I'm not sure why Yetus is not reporting much about javadocs.

> [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module
> 
>
> Key: HDFS-13944
> URL: https://issues.apache.org/jira/browse/HDFS-13944
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
> Attachments: javadoc-rbf.log
>
>
> There are 34 errors in hadoop-hdfs-rbf module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13944) [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module

2018-09-26 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13944:
-
Attachment: javadoc-rbf.log

> [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module
> 
>
> Key: HDFS-13944
> URL: https://issues.apache.org/jira/browse/HDFS-13944
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
> Attachments: javadoc-rbf.log
>
>
> There are 34 errors in hadoop-hdfs-rbf module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13939) [JDK10] Javadoc build fails on JDK 10 in hadoop-hdfs-project

2018-09-26 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629581#comment-16629581
 ] 

Akira Ajisaka commented on HDFS-13939:
--

Created sub-tasks.

> [JDK10] Javadoc build fails on JDK 10 in hadoop-hdfs-project
> 
>
> Key: HDFS-13939
> URL: https://issues.apache.org/jira/browse/HDFS-13939
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: build, documentation
>Reporter: Takanobu Asanuma
>Priority: Major
>
> There are many javadoc errors on JDK 10 in hadoop-hdfs-project. Let's fix 
> them per project or module.
>  * hadoop-hdfs-project/hadoop-hdfs: 212 errors
>  * hadoop-hdfs-project/hadoop-hdfs-client: 85 errors
>  * hadoop-hdfs-project/hadoop-hdfs-rbf: 34 errors
> We can confirm the errors by below command.
> {noformat}
> $ mvn javadoc:javadoc --projects hadoop-hdfs-project/hadoop-hdfs-client
> {noformat}
> See also: HADOOP-15785



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Assigned] (HDFS-13943) [JDK10] Fix javadoc errors in hadoop-hdfs-client module

2018-09-26 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka reassigned HDFS-13943:


Assignee: Akira Ajisaka

> [JDK10] Fix javadoc errors in hadoop-hdfs-client module
> ---
>
> Key: HDFS-13943
> URL: https://issues.apache.org/jira/browse/HDFS-13943
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
>
> There are 85 errors in hadoop-hdfs-client module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13944) [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module

2018-09-26 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13944:
-
Summary: [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module  (was: Fix 
javadoc errors in hadoop-hdfs-rbf module)

> [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module
> 
>
> Key: HDFS-13944
> URL: https://issues.apache.org/jira/browse/HDFS-13944
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
>
> There are 34 errors in hadoop-hdfs-rbf module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Created] (HDFS-13944) Fix javadoc errors in hadoop-hdfs-rbf module

2018-09-26 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-13944:


 Summary: Fix javadoc errors in hadoop-hdfs-rbf module
 Key: HDFS-13944
 URL: https://issues.apache.org/jira/browse/HDFS-13944
 Project: Hadoop HDFS
  Issue Type: Sub-task
  Components: documentation
Reporter: Akira Ajisaka


There are 34 errors in hadoop-hdfs-rbf module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Created] (HDFS-13943) [JDK10] Fix javadoc errors in hadoop-hdfs-client module

2018-09-26 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-13943:


 Summary: [JDK10] Fix javadoc errors in hadoop-hdfs-client module
 Key: HDFS-13943
 URL: https://issues.apache.org/jira/browse/HDFS-13943
 Project: Hadoop HDFS
  Issue Type: Sub-task
  Components: documentation
Reporter: Akira Ajisaka


There are 85 errors in hadoop-hdfs-client module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13942) [JDK10] Fix javadoc errors in hadoop-hdfs module

2018-09-26 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13942:
-
Summary: [JDK10] Fix javadoc errors in hadoop-hdfs module  (was: [JDK10] 
Fix javadocs errors in hadoop-hdfs module)

> [JDK10] Fix javadoc errors in hadoop-hdfs module
> 
>
> Key: HDFS-13942
> URL: https://issues.apache.org/jira/browse/HDFS-13942
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
>
> There are 212 errors in hadoop-hdfs module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Created] (HDFS-13942) [JDK10] Fix javadocs errors in hadoop-hdfs module

2018-09-26 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-13942:


 Summary: [JDK10] Fix javadocs errors in hadoop-hdfs module
 Key: HDFS-13942
 URL: https://issues.apache.org/jira/browse/HDFS-13942
 Project: Hadoop HDFS
  Issue Type: Sub-task
  Components: documentation
Reporter: Akira Ajisaka


There are 212 errors in hadoop-hdfs module.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13939) [JDK10] Javadoc build fails on JDK 10 in hadoop-hdfs-project

2018-09-25 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13939:
-
Component/s: documentation

> [JDK10] Javadoc build fails on JDK 10 in hadoop-hdfs-project
> 
>
> Key: HDFS-13939
> URL: https://issues.apache.org/jira/browse/HDFS-13939
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: build, documentation
>Reporter: Takanobu Asanuma
>Priority: Major
>
> There are many javadoc errors on JDK 10 in hadoop-hdfs-project. Let's fix 
> them per project or module.
>  * hadoop-hdfs-project/hadoop-hdfs: 212 errors
>  * hadoop-hdfs-project/hadoop-hdfs-client: 85 errors
>  * hadoop-hdfs-project/hadoop-hdfs-rbf: 34 errors
> We can confirm the errors by below command.
> {noformat}
> $ mvn javadoc:javadoc --projects hadoop-hdfs-project/hadoop-hdfs-client
> {noformat}
> See also: HADOOP-15785



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2018-09-25 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627055#comment-16627055
 ] 

Akira Ajisaka commented on HDFS-12319:
--

Backported this to branch-2.7. Thanks [~brahmareddy] for the comment.

> DirectoryScanner will throw IllegalStateException when Multiple BP's are 
> present
> 
>
> Key: HDFS-12319
> URL: https://issues.apache.org/jira/browse/HDFS-12319
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Fix For: 2.9.0, 3.0.0-beta1, 2.8.2, 2.7.8
>
> Attachments: HDFS-12319-001.patch, HDFS-12319-002.patch, 
> TestCase_to_Reproduce.patch
>
>
> *Scenario:*
> Configure "*dfs.datanode.directoryscan.interval*" as *60* and start federated 
> cluster atleast with two nameservices.
> {noformat}
> 2017-08-18 19:06:37,150 
> [java.util.concurrent.ThreadPoolExecutor$Worker@37d68b4e[State = -1, empty 
> queue]] ERROR datanode.DirectoryScanner 
> (DirectoryScanner.java:getDiskReport(551)) - Error compiling report for the 
> volume, StorageId: DS-258b5e16-caa3-48c8-a0c8-b16934eb8a0c
> java.util.concurrent.ExecutionException: java.lang.IllegalStateException: 
> StopWatch is already running
>   at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>   at java.util.concurrent.FutureTask.get(FutureTask.java:192)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner.getDiskReport(DirectoryScanner.java:542)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner.scan(DirectoryScanner.java:392)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner.reconcile(DirectoryScanner.java:373)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner.run(DirectoryScanner.java:318)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>   at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
>   at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
>   at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalStateException: StopWatch is already running
>   at org.apache.hadoop.util.StopWatch.start(StopWatch.java:49)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner$ReportCompiler.call(DirectoryScanner.java:612)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner$ReportCompiler.call(DirectoryScanner.java:579)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   ... 3 more
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2018-09-25 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-12319:
-
Fix Version/s: 2.7.8

> DirectoryScanner will throw IllegalStateException when Multiple BP's are 
> present
> 
>
> Key: HDFS-12319
> URL: https://issues.apache.org/jira/browse/HDFS-12319
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Fix For: 2.9.0, 3.0.0-beta1, 2.8.2, 2.7.8
>
> Attachments: HDFS-12319-001.patch, HDFS-12319-002.patch, 
> TestCase_to_Reproduce.patch
>
>
> *Scenario:*
> Configure "*dfs.datanode.directoryscan.interval*" as *60* and start federated 
> cluster atleast with two nameservices.
> {noformat}
> 2017-08-18 19:06:37,150 
> [java.util.concurrent.ThreadPoolExecutor$Worker@37d68b4e[State = -1, empty 
> queue]] ERROR datanode.DirectoryScanner 
> (DirectoryScanner.java:getDiskReport(551)) - Error compiling report for the 
> volume, StorageId: DS-258b5e16-caa3-48c8-a0c8-b16934eb8a0c
> java.util.concurrent.ExecutionException: java.lang.IllegalStateException: 
> StopWatch is already running
>   at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>   at java.util.concurrent.FutureTask.get(FutureTask.java:192)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner.getDiskReport(DirectoryScanner.java:542)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner.scan(DirectoryScanner.java:392)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner.reconcile(DirectoryScanner.java:373)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner.run(DirectoryScanner.java:318)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>   at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
>   at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
>   at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalStateException: StopWatch is already running
>   at org.apache.hadoop.util.StopWatch.start(StopWatch.java:49)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner$ReportCompiler.call(DirectoryScanner.java:612)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner$ReportCompiler.call(DirectoryScanner.java:579)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   ... 3 more
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2018-09-25 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626921#comment-16626921
 ] 

Akira Ajisaka commented on HDFS-12319:
--

I'm thinking this patch should be backported to branch-2.7 as well. What do you 
think, [~brahmareddy]?

> DirectoryScanner will throw IllegalStateException when Multiple BP's are 
> present
> 
>
> Key: HDFS-12319
> URL: https://issues.apache.org/jira/browse/HDFS-12319
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Fix For: 2.9.0, 3.0.0-beta1, 2.8.2
>
> Attachments: HDFS-12319-001.patch, HDFS-12319-002.patch, 
> TestCase_to_Reproduce.patch
>
>
> *Scenario:*
> Configure "*dfs.datanode.directoryscan.interval*" as *60* and start federated 
> cluster atleast with two nameservices.
> {noformat}
> 2017-08-18 19:06:37,150 
> [java.util.concurrent.ThreadPoolExecutor$Worker@37d68b4e[State = -1, empty 
> queue]] ERROR datanode.DirectoryScanner 
> (DirectoryScanner.java:getDiskReport(551)) - Error compiling report for the 
> volume, StorageId: DS-258b5e16-caa3-48c8-a0c8-b16934eb8a0c
> java.util.concurrent.ExecutionException: java.lang.IllegalStateException: 
> StopWatch is already running
>   at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>   at java.util.concurrent.FutureTask.get(FutureTask.java:192)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner.getDiskReport(DirectoryScanner.java:542)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner.scan(DirectoryScanner.java:392)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner.reconcile(DirectoryScanner.java:373)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner.run(DirectoryScanner.java:318)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>   at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
>   at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
>   at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalStateException: StopWatch is already running
>   at org.apache.hadoop.util.StopWatch.start(StopWatch.java:49)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner$ReportCompiler.call(DirectoryScanner.java:612)
>   at 
> org.apache.hadoop.hdfs.server.datanode.DirectoryScanner$ReportCompiler.call(DirectoryScanner.java:579)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   ... 3 more
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13932) [JDK 11] Casts to BlockStoragePolicy[] in unit tests raise ClassCastExceptions

2018-09-21 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624451#comment-16624451
 ] 

Akira Ajisaka commented on HDFS-13932:
--

Thank you, [~apurtell]. Would you remove unused imports? I'm +1 if that is 
addressed.

> [JDK 11] Casts to BlockStoragePolicy[] in unit tests raise 
> ClassCastExceptions 
> ---
>
> Key: HDFS-13932
> URL: https://issues.apache.org/jira/browse/HDFS-13932
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: test
>Reporter: Andrew Purtell
>Priority: Minor
> Attachments: HDFS-13932.patch
>
>
> For example
> java.lang.ClassCastException: class [Ljava.lang.Object; cannot be cast to 
> class [Lorg.apache.hadoop.hdfs.protocol.BlockStoragePolicy; 
> ([Ljava.lang.Object; is in module java.base of loader 'bootstrap'; 
> [Lorg.apache.hadoop.hdfs.protocol.BlockStoragePolicy; is in unnamed module of 
> loader 'app')
>   at 
> org.apache.hadoop.hdfs.web.TestWebHDFS.testStoragePolicy(TestWebHDFS.java:1391)
> This is with Java 11+28. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Comment Edited] (HDFS-11610) sun.net.spi.nameservice.NameService has moved to a new location

2018-08-03 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568509#comment-16568509
 ] 

Akira Ajisaka edited comment on HDFS-11610 at 8/3/18 5:32 PM:
--

Thanks [~tasanuma0829] for your first commit as a committer!


was (Author: ajisakaa):
Thanks [~tasanuma0829] for your first commit!

> sun.net.spi.nameservice.NameService has moved to a new location
> ---
>
> Key: HDFS-11610
> URL: https://issues.apache.org/jira/browse/HDFS-11610
> Project: Hadoop HDFS
>  Issue Type: Task
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
> Attachments: HDFS-11610.001.patch, HDFS-11610.002.patch
>
>
> sun.net.spi.nameservice.NameService was moved to 
> java.net.InetAddress$NameService in Java 9. TestDFSClientFailover uses this 
> class to spy nameservice.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-11610) sun.net.spi.nameservice.NameService has moved to a new location

2018-08-03 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568509#comment-16568509
 ] 

Akira Ajisaka commented on HDFS-11610:
--

Thanks [~tasanuma0829] for your first commit!

> sun.net.spi.nameservice.NameService has moved to a new location
> ---
>
> Key: HDFS-11610
> URL: https://issues.apache.org/jira/browse/HDFS-11610
> Project: Hadoop HDFS
>  Issue Type: Task
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
> Attachments: HDFS-11610.001.patch, HDFS-11610.002.patch
>
>
> sun.net.spi.nameservice.NameService was moved to 
> java.net.InetAddress$NameService in Java 9. TestDFSClientFailover uses this 
> class to spy nameservice.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13729) Fix broken links to RBF documentation

2018-07-12 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13729:
-
   Resolution: Fixed
Fix Version/s: 2.9.2
   2.10.0
   Status: Resolved  (was: Patch Available)

Committed this to branch-2 and branch-2.9. Thanks [~gabor.bota]!

> Fix broken links to RBF documentation
> -
>
> Key: HDFS-13729
> URL: https://issues.apache.org/jira/browse/HDFS-13729
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: jwhitter
>Assignee: Gabor Bota
>Priority: Minor
> Fix For: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.4
>
> Attachments: HADOOP-15589.001.patch, HDFS-13729-branch-2.001.patch, 
> hadoop_broken_link.png
>
>
> A broken link on the page [http://hadoop.apache.org/docs/current/]
>  * HDFS
>  ** HDFS Router based federation. See the [user 
> documentation|http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSRouterFederation.html]
>  for more details.
> The link for user documentation 
> [http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSRouterFederation.html]
>  is not found.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13729) Fix broken links to RBF documentation

2018-07-12 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16542011#comment-16542011
 ] 

Akira Ajisaka commented on HDFS-13729:
--

LGTM, +1

> Fix broken links to RBF documentation
> -
>
> Key: HDFS-13729
> URL: https://issues.apache.org/jira/browse/HDFS-13729
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: jwhitter
>Assignee: Gabor Bota
>Priority: Minor
> Fix For: 3.2.0, 3.1.1, 3.0.4
>
> Attachments: HADOOP-15589.001.patch, HDFS-13729-branch-2.001.patch, 
> hadoop_broken_link.png
>
>
> A broken link on the page [http://hadoop.apache.org/docs/current/]
>  * HDFS
>  ** HDFS Router based federation. See the [user 
> documentation|http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSRouterFederation.html]
>  for more details.
> The link for user documentation 
> [http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSRouterFederation.html]
>  is not found.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13729) Fix broken links to RBF documentation

2018-07-11 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13729:
-
Fix Version/s: 3.0.4
   3.1.1
   3.2.0

Thank you for your contribution, [~gabor.bota]! Committed this to trunk, 
branch-3.1, and branch-3.0. Would you rebase the patch for branch-2 and 
branch-2.9?

> Fix broken links to RBF documentation
> -
>
> Key: HDFS-13729
> URL: https://issues.apache.org/jira/browse/HDFS-13729
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: jwhitter
>Assignee: Gabor Bota
>Priority: Minor
> Fix For: 3.2.0, 3.1.1, 3.0.4
>
> Attachments: HADOOP-15589.001.patch, hadoop_broken_link.png
>
>
> A broken link on the page [http://hadoop.apache.org/docs/current/]
>  * HDFS
>  ** HDFS Router based federation. See the [user 
> documentation|http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSRouterFederation.html]
>  for more details.
> The link for user documentation 
> [http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSRouterFederation.html]
>  is not found.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13729) Fix broken links to RBF documentation

2018-07-11 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13729:
-
Summary: Fix broken links to RBF documentation  (was: Broken link within 
documentation - http://hadoop.apache.org/docs/current/)

> Fix broken links to RBF documentation
> -
>
> Key: HDFS-13729
> URL: https://issues.apache.org/jira/browse/HDFS-13729
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: jwhitter
>Assignee: Gabor Bota
>Priority: Minor
> Attachments: HADOOP-15589.001.patch, hadoop_broken_link.png
>
>
> A broken link on the page [http://hadoop.apache.org/docs/current/]
>  * HDFS
>  ** HDFS Router based federation. See the [user 
> documentation|http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSRouterFederation.html]
>  for more details.
> The link for user documentation 
> [http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSRouterFederation.html]
>  is not found.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Moved] (HDFS-13729) Broken link within documentation - http://hadoop.apache.org/docs/current/

2018-07-11 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka moved HADOOP-15589 to HDFS-13729:
---

Component/s: (was: documentation)
 documentation
Key: HDFS-13729  (was: HADOOP-15589)
Project: Hadoop HDFS  (was: Hadoop Common)

> Broken link within documentation - http://hadoop.apache.org/docs/current/
> -
>
> Key: HDFS-13729
> URL: https://issues.apache.org/jira/browse/HDFS-13729
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: jwhitter
>Assignee: Gabor Bota
>Priority: Minor
> Attachments: HADOOP-15589.001.patch, hadoop_broken_link.png
>
>
> A broken link on the page [http://hadoop.apache.org/docs/current/]
>  * HDFS
>  ** HDFS Router based federation. See the [user 
> documentation|http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSRouterFederation.html]
>  for more details.
> The link for user documentation 
> [http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSRouterFederation.html]
>  is not found.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13621) Upgrade common-lang version to 3.7 in hadoop-hdfs-project

2018-06-18 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13621:
-
   Resolution: Fixed
Fix Version/s: 3.2.0
   Status: Resolved  (was: Patch Available)

Committed to trunk. Thanks [~tasanuma0829]!

> Upgrade common-lang version to 3.7 in hadoop-hdfs-project
> -
>
> Key: HDFS-13621
> URL: https://issues.apache.org/jira/browse/HDFS-13621
> Project: Hadoop HDFS
>  Issue Type: Improvement
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Fix For: 3.2.0
>
> Attachments: HDFS-13621.1.patch, HDFS-13621.2.patch
>
>
> commons-lang 2.6 is widely used. Let's upgrade to 3.6.
> This jira is separated from HADOOP-10783.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13621) Upgrade common-lang version to 3.7 in hadoop-hdfs-project

2018-06-18 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13621:
-
Hadoop Flags: Reviewed
 Summary: Upgrade common-lang version to 3.7 in hadoop-hdfs-project  
(was: Upgrade common-langs version to 3.7 in hadoop-hdfs-project)

> Upgrade common-lang version to 3.7 in hadoop-hdfs-project
> -
>
> Key: HDFS-13621
> URL: https://issues.apache.org/jira/browse/HDFS-13621
> Project: Hadoop HDFS
>  Issue Type: Improvement
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Attachments: HDFS-13621.1.patch, HDFS-13621.2.patch
>
>
> commons-lang 2.6 is widely used. Let's upgrade to 3.6.
> This jira is separated from HADOOP-10783.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13621) Upgrade common-langs version to 3.7 in hadoop-hdfs-project

2018-06-18 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516035#comment-16516035
 ] 

Akira Ajisaka commented on HDFS-13621:
--

+1, thanks Takanobu.

> Upgrade common-langs version to 3.7 in hadoop-hdfs-project
> --
>
> Key: HDFS-13621
> URL: https://issues.apache.org/jira/browse/HDFS-13621
> Project: Hadoop HDFS
>  Issue Type: Improvement
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Attachments: HDFS-13621.1.patch, HDFS-13621.2.patch
>
>
> commons-lang 2.6 is widely used. Let's upgrade to 3.6.
> This jira is separated from HADOOP-10783.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13621) Upgrade common-langs version to 3.7 in hadoop-hdfs-project

2018-06-17 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515030#comment-16515030
 ] 

Akira Ajisaka commented on HDFS-13621:
--

LGTM. Would you rebase the patch?

> Upgrade common-langs version to 3.7 in hadoop-hdfs-project
> --
>
> Key: HDFS-13621
> URL: https://issues.apache.org/jira/browse/HDFS-13621
> Project: Hadoop HDFS
>  Issue Type: Improvement
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Attachments: HDFS-13621.1.patch
>
>
> commons-lang 2.6 is widely used. Let's upgrade to 3.6.
> This jira is separated from HADOOP-10783.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13545) "guarded" is misspelled as "gaurded" in FSPermissionChecker.java

2018-06-05 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13545:
-
Component/s: (was: hdfs)
 documentation

>  "guarded" is misspelled as "gaurded" in FSPermissionChecker.java
> -
>
> Key: HDFS-13545
> URL: https://issues.apache.org/jira/browse/HDFS-13545
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Jianchao Jia
>Assignee: Jianchao Jia
>Priority: Trivial
> Fix For: 3.2.0, 3.1.1, 3.0.4
>
> Attachments: HDFS-13545.001.patch, HDFS-13545.002.patch
>
>
>  "guarded" is misspelled as "gaurded"



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13545) "guarded" is misspelled as "gaurded" in FSPermissionChecker.java

2018-06-05 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13545:
-
   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: 3.0.4
   3.1.1
   3.2.0
   Status: Resolved  (was: Patch Available)

Committed this to trunk, branch-3.1, and branch-3.0. Thanks [~jianchao jia]!

>  "guarded" is misspelled as "gaurded" in FSPermissionChecker.java
> -
>
> Key: HDFS-13545
> URL: https://issues.apache.org/jira/browse/HDFS-13545
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Jianchao Jia
>Assignee: Jianchao Jia
>Priority: Trivial
> Fix For: 3.2.0, 3.1.1, 3.0.4
>
> Attachments: HDFS-13545.001.patch, HDFS-13545.002.patch
>
>
>  "guarded" is misspelled as "gaurded"



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13545) "guarded" is misspelled as "gaurded" in FSPermissionChecker.java

2018-06-05 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-13545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16501499#comment-16501499
 ] 

Akira Ajisaka commented on HDFS-13545:
--

+1

>  "guarded" is misspelled as "gaurded" in FSPermissionChecker.java
> -
>
> Key: HDFS-13545
> URL: https://issues.apache.org/jira/browse/HDFS-13545
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs
>Reporter: Jianchao Jia
>Assignee: Jianchao Jia
>Priority: Trivial
> Attachments: HDFS-13545.001.patch, HDFS-13545.002.patch
>
>
>  "guarded" is misspelled as "gaurded"



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Assigned] (HDFS-13545) "guarded" is misspelled as "gaurded" in FSPermissionChecker.java

2018-06-05 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka reassigned HDFS-13545:


Assignee: Jianchao Jia

>  "guarded" is misspelled as "gaurded" in FSPermissionChecker.java
> -
>
> Key: HDFS-13545
> URL: https://issues.apache.org/jira/browse/HDFS-13545
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs
>Reporter: Jianchao Jia
>Assignee: Jianchao Jia
>Priority: Trivial
> Attachments: HDFS-13545.001.patch, HDFS-13545.002.patch
>
>
>  "guarded" is misspelled as "gaurded"



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDDS-126) Fix findbugs warning in MetadataKeyFilters.java

2018-06-04 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDDS-126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500521#comment-16500521
 ] 

Akira Ajisaka commented on HDDS-126:


Thank you, [~xyao]!

> Fix findbugs warning in MetadataKeyFilters.java
> ---
>
> Key: HDDS-126
> URL: https://issues.apache.org/jira/browse/HDDS-126
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
>  Labels: newbie, reviewed
> Fix For: 0.2.1
>
> Attachments: HDDS-126.01.patch, HDDS-126.02.patch
>
>
> {noformat}
> module:hadoop-hdds/common 
>Found reliance on default encoding in 
> org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
> byte[], byte[]):in 
> org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
> byte[], byte[]): String.getBytes() At MetadataKeyFilters.java:[line 97] 
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDDS-126) Fix findbugs warning in MetadataKeyFilters.java

2018-06-04 Thread Akira Ajisaka (JIRA)


[ 
https://issues.apache.org/jira/browse/HDDS-126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500109#comment-16500109
 ] 

Akira Ajisaka commented on HDDS-126:


Thanks [~xyao] for reviewing this. Updated.

> Fix findbugs warning in MetadataKeyFilters.java
> ---
>
> Key: HDDS-126
> URL: https://issues.apache.org/jira/browse/HDDS-126
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
>  Labels: newbie
> Fix For: 0.2.1
>
> Attachments: HDDS-126.01.patch, HDDS-126.02.patch
>
>
> {noformat}
> module:hadoop-hdds/common 
>Found reliance on default encoding in 
> org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
> byte[], byte[]):in 
> org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
> byte[], byte[]): String.getBytes() At MetadataKeyFilters.java:[line 97] 
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-126) Fix findbugs warning in MetadataKeyFilters.java

2018-06-04 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDDS-126:
---
Attachment: HDDS-126.02.patch

> Fix findbugs warning in MetadataKeyFilters.java
> ---
>
> Key: HDDS-126
> URL: https://issues.apache.org/jira/browse/HDDS-126
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
>  Labels: newbie
> Fix For: 0.2.1
>
> Attachments: HDDS-126.01.patch, HDDS-126.02.patch
>
>
> {noformat}
> module:hadoop-hdds/common 
>Found reliance on default encoding in 
> org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
> byte[], byte[]):in 
> org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
> byte[], byte[]): String.getBytes() At MetadataKeyFilters.java:[line 97] 
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-126) Fix findbugs warning in MetadataKeyFilters.java

2018-05-31 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDDS-126:
---
Status: Patch Available  (was: Open)

> Fix findbugs warning in MetadataKeyFilters.java
> ---
>
> Key: HDDS-126
> URL: https://issues.apache.org/jira/browse/HDDS-126
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Akira Ajisaka
>Priority: Major
>  Labels: newbie
> Attachments: HDDS-126.01.patch
>
>
> {noformat}
> module:hadoop-hdds/common 
>Found reliance on default encoding in 
> org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
> byte[], byte[]):in 
> org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
> byte[], byte[]): String.getBytes() At MetadataKeyFilters.java:[line 97] 
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-126) Fix findbugs warning in MetadataKeyFilters.java

2018-05-31 Thread Akira Ajisaka (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDDS-126:
---
Attachment: HDDS-126.01.patch

> Fix findbugs warning in MetadataKeyFilters.java
> ---
>
> Key: HDDS-126
> URL: https://issues.apache.org/jira/browse/HDDS-126
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Akira Ajisaka
>Priority: Major
>  Labels: newbie
> Attachments: HDDS-126.01.patch
>
>
> {noformat}
> module:hadoop-hdds/common 
>Found reliance on default encoding in 
> org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
> byte[], byte[]):in 
> org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
> byte[], byte[]): String.getBytes() At MetadataKeyFilters.java:[line 97] 
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Created] (HDDS-126) Fix findbugs warning in MetadataKeyFilters.java

2018-05-28 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDDS-126:
--

 Summary: Fix findbugs warning in MetadataKeyFilters.java
 Key: HDDS-126
 URL: https://issues.apache.org/jira/browse/HDDS-126
 Project: Hadoop Distributed Data Store
  Issue Type: Bug
Reporter: Akira Ajisaka


{noformat}
module:hadoop-hdds/common 
   Found reliance on default encoding in 
org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
byte[], byte[]):in 
org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
byte[], byte[]): String.getBytes() At MetadataKeyFilters.java:[line 97] 
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13628) Update Archival Storage doc for Provided Storage

2018-05-28 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13628:
-
   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: 3.1.1
   3.2.0
   Status: Resolved  (was: Patch Available)

Committed this to trunk and branch-3.1. Thanks [~tasanuma0829]!

> Update Archival Storage doc for Provided Storage
> 
>
> Key: HDFS-13628
> URL: https://issues.apache.org/jira/browse/HDFS-13628
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 3.1.0
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Fix For: 3.2.0, 3.1.1
>
> Attachments: HADOOP-15491.1.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13628) Update Archival Storage doc for Provided Storage

2018-05-28 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492484#comment-16492484
 ] 

Akira Ajisaka commented on HDFS-13628:
--

LGTM, +1

> Update Archival Storage doc for Provided Storage
> 
>
> Key: HDFS-13628
> URL: https://issues.apache.org/jira/browse/HDFS-13628
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 3.1.0
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Attachments: HADOOP-15491.1.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Moved] (HDFS-13628) Update Archival Storage doc for Provided Storage

2018-05-28 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka moved HADOOP-15491 to HDFS-13628:
---

Affects Version/s: (was: 3.1.0)
   3.1.0
 Target Version/s:   (was: 3.2.0, 3.1.1)
  Component/s: (was: documentation)
   documentation
  Key: HDFS-13628  (was: HADOOP-15491)
  Project: Hadoop HDFS  (was: Hadoop Common)

> Update Archival Storage doc for Provided Storage
> 
>
> Key: HDFS-13628
> URL: https://issues.apache.org/jira/browse/HDFS-13628
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 3.1.0
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Attachments: HADOOP-15491.1.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13494) Configure serialFilter to avoid UnrecoverableKeyException caused by JDK-8189997

2018-05-16 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16477649#comment-16477649
 ] 

Akira Ajisaka commented on HDFS-13494:
--

Thanks [~gabor.bota] for updating the patch! Some comments:
* Would you add the default value in CommonConfigurationKeysPublic.java as 
well? That way we don't need comment that default value added to 
core-default.xml in the source code.
* This change is in hadoop-common, so I'll move this issue to Hadoop Common 
project shortly. Would you update the issue id in the patch?
* In the description of the new parameter, would you document how the new 
parameter work in Apache Hadoop KeyProvider?

bq. The default pattern allows java.lang.Enum, java.security.KeyRep, 
java.security.KeyRep$Type, and javax.crypto.spec.SecretKeySpec but rejects all 
the others.
In this case, "the default pattern" is misunderstanding. It looks to be the 
default value of the new parameter.

> Configure serialFilter to avoid UnrecoverableKeyException caused by 
> JDK-8189997
> ---
>
> Key: HDFS-13494
> URL: https://issues.apache.org/jira/browse/HDFS-13494
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: kms
>Affects Versions: 2.7.6, 3.0.2
> Environment: JDK 8u171
>Reporter: Gabor Bota
>Assignee: Gabor Bota
>Priority: Critical
> Attachments: HDFS-13494.001.patch, HDFS-13494.002.patch, 
> HDFS-13494.003.patch, org.apache.hadoop.crypto.key.TestKeyProviderFactory.txt
>
>
> There is a new feature in JDK 8u171 called Enhanced KeyStore Mechanisms 
> (http://www.oracle.com/technetwork/java/javase/8u171-relnotes-430.html#JDK-8189997).
> This is the cause of the following errors in the TestKeyProviderFactory:
> {noformat}
> Caused by: java.security.UnrecoverableKeyException: Rejected by the 
> jceks.key.serialFilter or jdk.serialFilter property
>   at com.sun.crypto.provider.KeyProtector.unseal(KeyProtector.java:352)
>   at 
> com.sun.crypto.provider.JceKeyStore.engineGetKey(JceKeyStore.java:136)
>   at java.security.KeyStore.getKey(KeyStore.java:1023)
>   at 
> org.apache.hadoop.crypto.key.JavaKeyStoreProvider.getMetadata(JavaKeyStoreProvider.java:410)
>   ... 28 more
> {noformat}
> This issue causes errors and failures in hbase tests right now (using hdfs) 
> and could affect other products running on this new Java version.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13494) Configure serialFilter to avoid UnrecoverableKeyException caused by JDK-8189997

2018-05-11 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13494:
-
 Environment: JDK 8u171
Hadoop Flags:   (was: Reviewed)
 Summary: Configure serialFilter to avoid UnrecoverableKeyException 
caused by JDK-8189997  (was: Set empty value to serialFilter to avoid 
UnrecoverableKeyException on JDK 8u171)

> Configure serialFilter to avoid UnrecoverableKeyException caused by 
> JDK-8189997
> ---
>
> Key: HDFS-13494
> URL: https://issues.apache.org/jira/browse/HDFS-13494
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: kms
>Affects Versions: 2.7.6, 3.0.2
> Environment: JDK 8u171
>Reporter: Gabor Bota
>Assignee: Gabor Bota
>Priority: Critical
> Attachments: HDFS-13494.001.patch, HDFS-13494.002.patch, 
> org.apache.hadoop.crypto.key.TestKeyProviderFactory.txt
>
>
> There is a new feature in JDK 8u171 called Enhanced KeyStore Mechanisms 
> (http://www.oracle.com/technetwork/java/javase/8u171-relnotes-430.html#JDK-8189997).
> This could be the cause the following errors in the TestKeyProviderFactory:
> {noformat}
> Caused by: java.security.UnrecoverableKeyException: Rejected by the 
> jceks.key.serialFilter or jdk.serialFilter property
>   at com.sun.crypto.provider.KeyProtector.unseal(KeyProtector.java:352)
>   at 
> com.sun.crypto.provider.JceKeyStore.engineGetKey(JceKeyStore.java:136)
>   at java.security.KeyStore.getKey(KeyStore.java:1023)
>   at 
> org.apache.hadoop.crypto.key.JavaKeyStoreProvider.getMetadata(JavaKeyStoreProvider.java:410)
>   ... 28 more
> {noformat}
> This issue causes errors and failures in hbase tests right now (using hdfs) 
> and could affect other products running on this new Java version.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13494) Set empty value to serialFilter to avoid UnrecoverableKeyException on JDK 8u171

2018-05-11 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472381#comment-16472381
 ] 

Akira Ajisaka commented on HDFS-13494:
--

bq. The filter pattern uses the same format as jdk.serialFilter. The default 
pattern allows java.lang.Enum, java.security.KeyRep, java.security.KeyRep$Type, 
and javax.crypto.spec.SecretKeySpec but rejects all the others.

In Apache Hadoop, JavaKeyStoreProvider stores secret key inside 
org.apache.hadoop.crypto.key.JavaKeyStoreProvider$KeyMetadata and 
serialize/deserialize it, and the class is not allowed by default. Therefore 
the test fails.

This configuration passes the test.
{code}
System.setProperty("jceks.key.serialFilter", 
"java.lang.Enum;java.security.KeyRep;java.security.KeyRep$Type;javax.crypto.spec.SecretKeySpec;org.apache.hadoop.crypto.key.JavaKeyStoreProvider$KeyMetadata;!*");
{code}

It would be better we can configure this parameter instead of using hard-coded 
value in KeyProvider.java. What do you think, [~gabor.bota]?

> Set empty value to serialFilter to avoid UnrecoverableKeyException on JDK 
> 8u171
> ---
>
> Key: HDFS-13494
> URL: https://issues.apache.org/jira/browse/HDFS-13494
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: kms
>Affects Versions: 2.7.6, 3.0.2
>Reporter: Gabor Bota
>Assignee: Gabor Bota
>Priority: Critical
> Attachments: HDFS-13494.001.patch, HDFS-13494.002.patch, 
> org.apache.hadoop.crypto.key.TestKeyProviderFactory.txt
>
>
> There is a new feature in JDK 8u171 called Enhanced KeyStore Mechanisms 
> (http://www.oracle.com/technetwork/java/javase/8u171-relnotes-430.html#JDK-8189997).
> This could be the cause the following errors in the TestKeyProviderFactory:
> {noformat}
> Caused by: java.security.UnrecoverableKeyException: Rejected by the 
> jceks.key.serialFilter or jdk.serialFilter property
>   at com.sun.crypto.provider.KeyProtector.unseal(KeyProtector.java:352)
>   at 
> com.sun.crypto.provider.JceKeyStore.engineGetKey(JceKeyStore.java:136)
>   at java.security.KeyStore.getKey(KeyStore.java:1023)
>   at 
> org.apache.hadoop.crypto.key.JavaKeyStoreProvider.getMetadata(JavaKeyStoreProvider.java:410)
>   ... 28 more
> {noformat}
> This issue causes errors and failures in hbase tests right now (using hdfs) 
> and could affect other products running on this new Java version.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13494) Set empty value to serialFilter to avoid UnrecoverableKeyException on JDK 8u171

2018-05-11 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13494:
-
Priority: Critical  (was: Major)
Hadoop Flags: Reviewed
 Summary: Set empty value to serialFilter to avoid 
UnrecoverableKeyException on JDK 8u171  (was: TestKeyProviderFactory test 
errors on JDK 8u171 (java.security.UnrecoverableKeyException))

> Set empty value to serialFilter to avoid UnrecoverableKeyException on JDK 
> 8u171
> ---
>
> Key: HDFS-13494
> URL: https://issues.apache.org/jira/browse/HDFS-13494
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: kms
>Affects Versions: 2.7.6, 3.0.2
>Reporter: Gabor Bota
>Assignee: Gabor Bota
>Priority: Critical
> Attachments: HDFS-13494.001.patch, HDFS-13494.002.patch, 
> org.apache.hadoop.crypto.key.TestKeyProviderFactory.txt
>
>
> There is a new feature in JDK 8u171 called Enhanced KeyStore Mechanisms 
> (http://www.oracle.com/technetwork/java/javase/8u171-relnotes-430.html#JDK-8189997).
> This could be the cause the following errors in the TestKeyProviderFactory:
> {noformat}
> Caused by: java.security.UnrecoverableKeyException: Rejected by the 
> jceks.key.serialFilter or jdk.serialFilter property
>   at com.sun.crypto.provider.KeyProtector.unseal(KeyProtector.java:352)
>   at 
> com.sun.crypto.provider.JceKeyStore.engineGetKey(JceKeyStore.java:136)
>   at java.security.KeyStore.getKey(KeyStore.java:1023)
>   at 
> org.apache.hadoop.crypto.key.JavaKeyStoreProvider.getMetadata(JavaKeyStoreProvider.java:410)
>   ... 28 more
> {noformat}
> This issue causes errors and failures in hbase tests right now (using hdfs) 
> and could affect other products running on this new Java version.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13494) TestKeyProviderFactory test errors on JDK 8u171 (java.security.UnrecoverableKeyException)

2018-05-11 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472112#comment-16472112
 ] 

Akira Ajisaka commented on HDFS-13494:
--

+1, thanks!

> TestKeyProviderFactory test errors on JDK 8u171 
> (java.security.UnrecoverableKeyException)
> -
>
> Key: HDFS-13494
> URL: https://issues.apache.org/jira/browse/HDFS-13494
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: kms
>Affects Versions: 2.7.6, 3.0.2
>Reporter: Gabor Bota
>Assignee: Gabor Bota
>Priority: Major
> Attachments: HDFS-13494.001.patch, HDFS-13494.002.patch, 
> org.apache.hadoop.crypto.key.TestKeyProviderFactory.txt
>
>
> There is a new feature in JDK 8u171 called Enhanced KeyStore Mechanisms 
> (http://www.oracle.com/technetwork/java/javase/8u171-relnotes-430.html#JDK-8189997).
> This could be the cause the following errors in the TestKeyProviderFactory:
> {noformat}
> Caused by: java.security.UnrecoverableKeyException: Rejected by the 
> jceks.key.serialFilter or jdk.serialFilter property
>   at com.sun.crypto.provider.KeyProtector.unseal(KeyProtector.java:352)
>   at 
> com.sun.crypto.provider.JceKeyStore.engineGetKey(JceKeyStore.java:136)
>   at java.security.KeyStore.getKey(KeyStore.java:1023)
>   at 
> org.apache.hadoop.crypto.key.JavaKeyStoreProvider.getMetadata(JavaKeyStoreProvider.java:410)
>   ... 28 more
> {noformat}
> This issue causes errors and failures in hbase tests right now (using hdfs) 
> and could affect other products running on this new Java version.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13494) TestKeyProviderFactory test errors on JDK 8u171 (java.security.UnrecoverableKeyException)

2018-05-11 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471535#comment-16471535
 ] 

Akira Ajisaka commented on HDFS-13494:
--

Thanks [~gabor.bota] for reporting and fixing this. I'm okay with this fix. 
Would you add a comment for this change?

> TestKeyProviderFactory test errors on JDK 8u171 
> (java.security.UnrecoverableKeyException)
> -
>
> Key: HDFS-13494
> URL: https://issues.apache.org/jira/browse/HDFS-13494
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: kms
>Affects Versions: 2.7.6, 3.0.2
>Reporter: Gabor Bota
>Assignee: Gabor Bota
>Priority: Major
> Attachments: HDFS-13494.001.patch, 
> org.apache.hadoop.crypto.key.TestKeyProviderFactory.txt
>
>
> There is a new feature in JDK 8u171 called Enhanced KeyStore Mechanisms 
> (http://www.oracle.com/technetwork/java/javase/8u171-relnotes-430.html#JDK-8189997).
> This could be the cause the following errors in the TestKeyProviderFactory:
> {noformat}
> Caused by: java.security.UnrecoverableKeyException: Rejected by the 
> jceks.key.serialFilter or jdk.serialFilter property
>   at com.sun.crypto.provider.KeyProtector.unseal(KeyProtector.java:352)
>   at 
> com.sun.crypto.provider.JceKeyStore.engineGetKey(JceKeyStore.java:136)
>   at java.security.KeyStore.getKey(KeyStore.java:1023)
>   at 
> org.apache.hadoop.crypto.key.JavaKeyStoreProvider.getMetadata(JavaKeyStoreProvider.java:410)
>   ... 28 more
> {noformat}
> This issue causes errors and failures in hbase tests right now (using hdfs) 
> and could affect other products running on this new Java version.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-11934) Add assertion to TestDefaultNameNodePort#testGetAddressFromConf

2018-05-02 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-11934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460726#comment-16460726
 ] 

Akira Ajisaka commented on HDFS-11934:
--

Thanks [~legend-hua] for the patch.
The change looks good to me. Would you reverse the order of the arguments of 
assertEquals(expected, actual) in the class? I'm +1 if that is addressed.

> Add assertion to TestDefaultNameNodePort#testGetAddressFromConf
> ---
>
> Key: HDFS-11934
> URL: https://issues.apache.org/jira/browse/HDFS-11934
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: hdfs
>Affects Versions: 3.0.0-alpha4
>Reporter: legend
>Priority: Minor
> Attachments: HDFS-11934.patch
>
>
> Add an additional assertion to TestDefaultNameNodePort, verify that 
> testGetAddressFromConf returns 555 if setDefaultUri(conf, "foo:555").



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13464) Fix javadoc in FsVolumeList#handleVolumeFailures

2018-04-18 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13464:
-
Component/s: documentation

> Fix javadoc in FsVolumeList#handleVolumeFailures
> 
>
> Key: HDFS-13464
> URL: https://issues.apache.org/jira/browse/HDFS-13464
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Minor
> Attachments: HDFS-13464.000.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13464) Fix javadoc in FsVolumeList#handleVolumeFailures

2018-04-18 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442024#comment-16442024
 ] 

Akira Ajisaka commented on HDFS-13464:
--

+1

> Fix javadoc in FsVolumeList#handleVolumeFailures
> 
>
> Key: HDFS-13464
> URL: https://issues.apache.org/jira/browse/HDFS-13464
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Minor
> Attachments: HDFS-13464.000.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-12828) OIV ReverseXML Processor fails with escaped characters

2018-04-17 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-12828:
-
   Resolution: Fixed
Fix Version/s: 2.8.5
   3.0.3
   2.9.2
   3.1.1
   3.2.0
   2.10.0
   Status: Resolved  (was: Patch Available)

Committed this to trunk, branch-3.1, branch-3.0, branch-2, branch-2.9, and 
branch-2.8. Thanks [~xkrogen] for the contribution!

> OIV ReverseXML Processor fails with escaped characters
> --
>
> Key: HDFS-12828
> URL: https://issues.apache.org/jira/browse/HDFS-12828
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs
>Affects Versions: 2.8.0
>Reporter: Erik Krogen
>Assignee: Erik Krogen
>Priority: Critical
> Fix For: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 2.8.5
>
> Attachments: HDFS-12828.000.patch, fsimage_008.xml
>
>
> The HDFS OIV ReverseXML processor fails if the XML file contains escaped 
> characters:
> {code}
> ekrogen at ekrogen-ld1 in 
> ~/dev/hadoop/trunk/hadoop-dist/target/hadoop-3.0.0-beta1-SNAPSHOT on trunk!
> ± $HADOOP_HOME/bin/hdfs dfs -fs hdfs://localhost:9000/ -ls /
> Found 4 items
> drwxr-xr-x   - ekrogen supergroup  0 2017-11-16 14:48 /foo
> drwxr-xr-x   - ekrogen supergroup  0 2017-11-16 14:49 /foo"
> drwxr-xr-x   - ekrogen supergroup  0 2017-11-16 14:50 /foo`
> drwxr-xr-x   - ekrogen supergroup  0 2017-11-16 14:49 /foo&
> {code}
> Then after doing {{saveNamespace}} on that NameNode...
> {code}
> ekrogen at ekrogen-ld1 in 
> ~/dev/hadoop/trunk/hadoop-dist/target/hadoop-3.0.0-beta1-SNAPSHOT on trunk!
> ± $HADOOP_HOME/bin/hdfs oiv -i 
> /tmp/hadoop-ekrogen/dfs/name/current/fsimage_008 -o 
> /tmp/hadoop-ekrogen/dfs/name/current/fsimage_008.xml -p XML
> ekrogen at ekrogen-ld1 in 
> ~/dev/hadoop/trunk/hadoop-dist/target/hadoop-3.0.0-beta1-SNAPSHOT on trunk!
> ± $HADOOP_HOME/bin/hdfs oiv -i 
> /tmp/hadoop-ekrogen/dfs/name/current/fsimage_008.xml -o 
> /tmp/hadoop-ekrogen/dfs/name/current/fsimage_008.xml.rev -p 
> ReverseXML
> OfflineImageReconstructor failed: unterminated entity ref starting with &
> org.apache.hadoop.hdfs.util.XMLUtils$UnmanglingError: unterminated entity ref 
> starting with &
> at 
> org.apache.hadoop.hdfs.util.XMLUtils.unmangleXmlString(XMLUtils.java:232)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.loadNodeChildrenHelper(OfflineImageReconstructor.java:383)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.loadNodeChildrenHelper(OfflineImageReconstructor.java:379)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.loadNodeChildren(OfflineImageReconstructor.java:418)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.access$1000(OfflineImageReconstructor.java:95)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor$INodeSectionProcessor.process(OfflineImageReconstructor.java:524)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.processXml(OfflineImageReconstructor.java:1710)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.run(OfflineImageReconstructor.java:1765)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageViewerPB.run(OfflineImageViewerPB.java:191)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageViewerPB.main(OfflineImageViewerPB.java:134)
> {code}
> See attachments for relevant fsimage XML file.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-12828) OIV ReverseXML Processor fails with escaped characters

2018-04-17 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-12828:
-
Priority: Critical  (was: Major)
Hadoop Flags: Reviewed
 Summary: OIV ReverseXML Processor fails with escaped characters  (was: 
OIV ReverseXML Processor Fails With Escaped Characters)

> OIV ReverseXML Processor fails with escaped characters
> --
>
> Key: HDFS-12828
> URL: https://issues.apache.org/jira/browse/HDFS-12828
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs
>Affects Versions: 2.8.0
>Reporter: Erik Krogen
>Assignee: Erik Krogen
>Priority: Critical
> Attachments: HDFS-12828.000.patch, fsimage_008.xml
>
>
> The HDFS OIV ReverseXML processor fails if the XML file contains escaped 
> characters:
> {code}
> ekrogen at ekrogen-ld1 in 
> ~/dev/hadoop/trunk/hadoop-dist/target/hadoop-3.0.0-beta1-SNAPSHOT on trunk!
> ± $HADOOP_HOME/bin/hdfs dfs -fs hdfs://localhost:9000/ -ls /
> Found 4 items
> drwxr-xr-x   - ekrogen supergroup  0 2017-11-16 14:48 /foo
> drwxr-xr-x   - ekrogen supergroup  0 2017-11-16 14:49 /foo"
> drwxr-xr-x   - ekrogen supergroup  0 2017-11-16 14:50 /foo`
> drwxr-xr-x   - ekrogen supergroup  0 2017-11-16 14:49 /foo&
> {code}
> Then after doing {{saveNamespace}} on that NameNode...
> {code}
> ekrogen at ekrogen-ld1 in 
> ~/dev/hadoop/trunk/hadoop-dist/target/hadoop-3.0.0-beta1-SNAPSHOT on trunk!
> ± $HADOOP_HOME/bin/hdfs oiv -i 
> /tmp/hadoop-ekrogen/dfs/name/current/fsimage_008 -o 
> /tmp/hadoop-ekrogen/dfs/name/current/fsimage_008.xml -p XML
> ekrogen at ekrogen-ld1 in 
> ~/dev/hadoop/trunk/hadoop-dist/target/hadoop-3.0.0-beta1-SNAPSHOT on trunk!
> ± $HADOOP_HOME/bin/hdfs oiv -i 
> /tmp/hadoop-ekrogen/dfs/name/current/fsimage_008.xml -o 
> /tmp/hadoop-ekrogen/dfs/name/current/fsimage_008.xml.rev -p 
> ReverseXML
> OfflineImageReconstructor failed: unterminated entity ref starting with &
> org.apache.hadoop.hdfs.util.XMLUtils$UnmanglingError: unterminated entity ref 
> starting with &
> at 
> org.apache.hadoop.hdfs.util.XMLUtils.unmangleXmlString(XMLUtils.java:232)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.loadNodeChildrenHelper(OfflineImageReconstructor.java:383)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.loadNodeChildrenHelper(OfflineImageReconstructor.java:379)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.loadNodeChildren(OfflineImageReconstructor.java:418)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.access$1000(OfflineImageReconstructor.java:95)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor$INodeSectionProcessor.process(OfflineImageReconstructor.java:524)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.processXml(OfflineImageReconstructor.java:1710)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.run(OfflineImageReconstructor.java:1765)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageViewerPB.run(OfflineImageViewerPB.java:191)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageViewerPB.main(OfflineImageViewerPB.java:134)
> {code}
> See attachments for relevant fsimage XML file.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-12828) OIV ReverseXML Processor Fails With Escaped Characters

2018-04-17 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-12828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441925#comment-16441925
 ] 

Akira Ajisaka commented on HDFS-12828:
--

+1, nice catch!

> OIV ReverseXML Processor Fails With Escaped Characters
> --
>
> Key: HDFS-12828
> URL: https://issues.apache.org/jira/browse/HDFS-12828
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hdfs
>Affects Versions: 2.8.0
>Reporter: Erik Krogen
>Assignee: Erik Krogen
>Priority: Major
> Attachments: HDFS-12828.000.patch, fsimage_008.xml
>
>
> The HDFS OIV ReverseXML processor fails if the XML file contains escaped 
> characters:
> {code}
> ekrogen at ekrogen-ld1 in 
> ~/dev/hadoop/trunk/hadoop-dist/target/hadoop-3.0.0-beta1-SNAPSHOT on trunk!
> ± $HADOOP_HOME/bin/hdfs dfs -fs hdfs://localhost:9000/ -ls /
> Found 4 items
> drwxr-xr-x   - ekrogen supergroup  0 2017-11-16 14:48 /foo
> drwxr-xr-x   - ekrogen supergroup  0 2017-11-16 14:49 /foo"
> drwxr-xr-x   - ekrogen supergroup  0 2017-11-16 14:50 /foo`
> drwxr-xr-x   - ekrogen supergroup  0 2017-11-16 14:49 /foo&
> {code}
> Then after doing {{saveNamespace}} on that NameNode...
> {code}
> ekrogen at ekrogen-ld1 in 
> ~/dev/hadoop/trunk/hadoop-dist/target/hadoop-3.0.0-beta1-SNAPSHOT on trunk!
> ± $HADOOP_HOME/bin/hdfs oiv -i 
> /tmp/hadoop-ekrogen/dfs/name/current/fsimage_008 -o 
> /tmp/hadoop-ekrogen/dfs/name/current/fsimage_008.xml -p XML
> ekrogen at ekrogen-ld1 in 
> ~/dev/hadoop/trunk/hadoop-dist/target/hadoop-3.0.0-beta1-SNAPSHOT on trunk!
> ± $HADOOP_HOME/bin/hdfs oiv -i 
> /tmp/hadoop-ekrogen/dfs/name/current/fsimage_008.xml -o 
> /tmp/hadoop-ekrogen/dfs/name/current/fsimage_008.xml.rev -p 
> ReverseXML
> OfflineImageReconstructor failed: unterminated entity ref starting with &
> org.apache.hadoop.hdfs.util.XMLUtils$UnmanglingError: unterminated entity ref 
> starting with &
> at 
> org.apache.hadoop.hdfs.util.XMLUtils.unmangleXmlString(XMLUtils.java:232)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.loadNodeChildrenHelper(OfflineImageReconstructor.java:383)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.loadNodeChildrenHelper(OfflineImageReconstructor.java:379)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.loadNodeChildren(OfflineImageReconstructor.java:418)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.access$1000(OfflineImageReconstructor.java:95)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor$INodeSectionProcessor.process(OfflineImageReconstructor.java:524)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.processXml(OfflineImageReconstructor.java:1710)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageReconstructor.run(OfflineImageReconstructor.java:1765)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageViewerPB.run(OfflineImageViewerPB.java:191)
> at 
> org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageViewerPB.main(OfflineImageViewerPB.java:134)
> {code}
> See attachments for relevant fsimage XML file.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13436) Fix javadoc of package-info.java

2018-04-12 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13436:
-
   Resolution: Fixed
Fix Version/s: 3.0.3
   3.1.1
   3.2.0
   Status: Resolved  (was: Patch Available)

Committed this to trunk, branch-3.1, and branch-3.0. Thanks [~arpitagarwal] for 
the review!

> Fix javadoc of package-info.java
> 
>
> Key: HDFS-13436
> URL: https://issues.apache.org/jira/browse/HDFS-13436
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
> Fix For: 3.2.0, 3.1.1, 3.0.3
>
> Attachments: HDFS-13436.01.patch
>
>
> Javadoc should exist before {{package org.apache.hadoop}}, not after.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Comment Edited] (HDFS-7101) Potential null dereference in DFSck#doWork()

2018-04-12 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16435169#comment-16435169
 ] 

Akira Ajisaka edited comment on HDFS-7101 at 4/12/18 8:50 AM:
--

Committed this to trunk, branch-3.1, branch-2, and branch-2.9. Thanks 
[~rsk13th] and [~yuzhih...@gmail.com] for the contribution.


was (Author: ajisakaa):
Committed this to trunk. Thanks [~rsk13th] and [~yuzhih...@gmail.com] for the 
contribution.

> Potential null dereference in DFSck#doWork()
> 
>
> Key: HDFS-7101
> URL: https://issues.apache.org/jira/browse/HDFS-7101
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 2.5.1
>Reporter: Ted Yu
>Assignee: skrho
>Priority: Minor
>  Labels: BB2015-05-TBR
> Fix For: 2.10.0, 3.2.0, 3.1.1, 2.9.2
>
> Attachments: HDFS-7101.v1.patch, HDFS-7101_001.patch
>
>
> {code}
> String lastLine = null;
> int errCode = -1;
> try {
>   while ((line = input.readLine()) != null) {
> ...
> if (lastLine.endsWith(NamenodeFsck.HEALTHY_STATUS)) {
>   errCode = 0;
> {code}
> If the input stream is empty, lastLine is kept null, leading to NPE.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-7101) Potential null dereference in DFSck#doWork()

2018-04-12 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-7101:

   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: 2.9.2
   3.1.1
   3.2.0
   2.10.0
   Status: Resolved  (was: Patch Available)

Committed this to trunk. Thanks [~rsk13th] and [~yuzhih...@gmail.com] for the 
contribution.

> Potential null dereference in DFSck#doWork()
> 
>
> Key: HDFS-7101
> URL: https://issues.apache.org/jira/browse/HDFS-7101
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 2.5.1
>Reporter: Ted Yu
>Assignee: skrho
>Priority: Minor
>  Labels: BB2015-05-TBR
> Fix For: 2.10.0, 3.2.0, 3.1.1, 2.9.2
>
> Attachments: HDFS-7101.v1.patch, HDFS-7101_001.patch
>
>
> {code}
> String lastLine = null;
> int errCode = -1;
> try {
>   while ((line = input.readLine()) != null) {
> ...
> if (lastLine.endsWith(NamenodeFsck.HEALTHY_STATUS)) {
>   errCode = 0;
> {code}
> If the input stream is empty, lastLine is kept null, leading to NPE.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13434) RBF: Fix dead links in RBF document

2018-04-12 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13434:
-
Summary: RBF: Fix dead links in RBF document  (was: RBF: Fix dead links 
link RBF document)

> RBF: Fix dead links in RBF document
> ---
>
> Key: HDFS-13434
> URL: https://issues.apache.org/jira/browse/HDFS-13434
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
>  Labels: newbie
>
> There are many dead links in 
> [http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs-rbf/HDFSRouterFederation.html.]
>  Let's fix them.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13434) RBF: Fix dead links link RBF document

2018-04-12 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13434:
-
Labels: newbie  (was: )

> RBF: Fix dead links link RBF document
> -
>
> Key: HDFS-13434
> URL: https://issues.apache.org/jira/browse/HDFS-13434
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
>  Labels: newbie
>
> There are many dead links in 
> [http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs-rbf/HDFSRouterFederation.html.]
>  Let's fix them.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13434) RBF: Fix dead links link RBF document

2018-04-12 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13434:
-
Description: There are many dead links in 
[http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs-rbf/HDFSRouterFederation.html.]
 Let's fix them.

> RBF: Fix dead links link RBF document
> -
>
> Key: HDFS-13434
> URL: https://issues.apache.org/jira/browse/HDFS-13434
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
>  Labels: newbie
>
> There are many dead links in 
> [http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs-rbf/HDFSRouterFederation.html.]
>  Let's fix them.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13434) RBF: Fix dead links link RBF document

2018-04-12 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16435039#comment-16435039
 ] 

Akira Ajisaka commented on HDFS-13434:
--

Added. Thanks [~linyiqun]!

> RBF: Fix dead links link RBF document
> -
>
> Key: HDFS-13434
> URL: https://issues.apache.org/jira/browse/HDFS-13434
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
>  Labels: newbie
>
> There are many dead links in 
> [http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs-rbf/HDFSRouterFederation.html.]
>  Let's fix them.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13436) Fix javadoc of package-info.java

2018-04-12 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13436:
-
Summary: Fix javadoc of package-info.java  (was: Fix javadoc for 
package-info.java)

> Fix javadoc of package-info.java
> 
>
> Key: HDFS-13436
> URL: https://issues.apache.org/jira/browse/HDFS-13436
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
> Attachments: HDFS-13436.01.patch
>
>
> Javadoc should exist before {{package org.apache.hadoop}}, not after.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13436) Fix javadoc for package-info.java

2018-04-12 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13436:
-
Attachment: HDFS-13436.01.patch

> Fix javadoc for package-info.java
> -
>
> Key: HDFS-13436
> URL: https://issues.apache.org/jira/browse/HDFS-13436
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
> Attachments: HDFS-13436.01.patch
>
>
> Javadoc should exist before {{package org.apache.hadoop}}, not after.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Assigned] (HDFS-13436) Fix javadoc for package-info.java

2018-04-12 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka reassigned HDFS-13436:


Assignee: Akira Ajisaka

> Fix javadoc for package-info.java
> -
>
> Key: HDFS-13436
> URL: https://issues.apache.org/jira/browse/HDFS-13436
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
> Attachments: HDFS-13436.01.patch
>
>
> Javadoc should exist before {{package org.apache.hadoop}}, not after.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13436) Fix javadoc of package-info.java

2018-04-12 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13436:
-
Status: Patch Available  (was: Open)

> Fix javadoc of package-info.java
> 
>
> Key: HDFS-13436
> URL: https://issues.apache.org/jira/browse/HDFS-13436
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
> Attachments: HDFS-13436.01.patch
>
>
> Javadoc should exist before {{package org.apache.hadoop}}, not after.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Created] (HDFS-13436) Fix javadoc for package-info.java

2018-04-12 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-13436:


 Summary: Fix javadoc for package-info.java
 Key: HDFS-13436
 URL: https://issues.apache.org/jira/browse/HDFS-13436
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: documentation
Reporter: Akira Ajisaka


Javadoc should exist before {{package org.apache.hadoop}}, not after.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13436) Fix javadoc for package-info.java

2018-04-12 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16435028#comment-16435028
 ] 

Akira Ajisaka commented on HDFS-13436:
--

For example,
{code}
package org.apache.hadoop.hdfs.server.diskbalancer;
/**
 * Disk Balancer connects to a {@link org.apache.hadoop.hdfs.server.datanode
 * .DataNode} and attempts to spread data across all volumes evenly.
 *
 * This is achieved by :
 *
 * 1) Calculating the average data that should be on a set of volumes grouped
 * by the type. For example, how much data should be on each volume of SSDs on a
 * machine.
 *
 * 2) Once we know the average data that is expected to be on a volume we
 * move data from volumes with higher than average load to volumes with
 * less than average load.
 *
 * 3) Disk Balancer operates against data nodes which are live and operational.
 *
 */
{code}
should be
{code}
/**
 * Disk Balancer connects to a {@link org.apache.hadoop.hdfs.server.datanode
 * .DataNode} and attempts to spread data across all volumes evenly.
 *
 * This is achieved by :
 *
 * 1) Calculating the average data that should be on a set of volumes grouped
 * by the type. For example, how much data should be on each volume of SSDs on a
 * machine.
 *
 * 2) Once we know the average data that is expected to be on a volume we
 * move data from volumes with higher than average load to volumes with
 * less than average load.
 *
 * 3) Disk Balancer operates against data nodes which are live and operational.
 *
 */
package org.apache.hadoop.hdfs.server.diskbalancer;
{code}

> Fix javadoc for package-info.java
> -
>
> Key: HDFS-13436
> URL: https://issues.apache.org/jira/browse/HDFS-13436
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
>
> Javadoc should exist before {{package org.apache.hadoop}}, not after.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Created] (HDFS-13434) RBF: Fix dead links link RBF document

2018-04-11 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-13434:


 Summary: RBF: Fix dead links link RBF document
 Key: HDFS-13434
 URL: https://issues.apache.org/jira/browse/HDFS-13434
 Project: Hadoop HDFS
  Issue Type: Sub-task
  Components: documentation
Reporter: Akira Ajisaka






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13427) Fix the section titles of transparent encryption document

2018-04-11 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13427:
-
Fix Version/s: (was: 2.9.2)
   2.9.1

Committed to branch-2.9.1 as well.

> Fix the section titles of transparent encryption document
> -
>
> Key: HDFS-13427
> URL: https://issues.apache.org/jira/browse/HDFS-13427
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Fix For: 2.10.0, 2.9.1, 2.8.4, 3.2.0, 3.1.1, 3.0.3
>
> Attachments: HDFS-13427.01.patch
>
>
> {noformat}
> The `crypto` command before Hadoop 2.8.0 does not provision the `.Trash` 
> directory automatically. If an encryption zone is created before Hadoop 
> 2.8.0, and then the cluster is upgraded to Hadoop 2.8.0 or above, the trash 
> directory can be provisioned using `-provisionTrash` option (e.g., `hdfs 
> crypto -provisionTrash -path /zone`).
> Attack vectors
> --
> {noformat}
> The long sentence starts with 'The crypto' wrongly become the title. We need 
> to add a blank line between the sentence and 'Attack vectors' to fix this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13427) Fix the section titles of transparent encryption document

2018-04-11 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13427:
-
   Resolution: Fixed
Fix Version/s: 3.0.3
   2.9.2
   3.1.1
   3.2.0
   2.8.4
   2.10.0
   Status: Resolved  (was: Patch Available)

Committed this to trunk, branch-3.1, branch-3.0, branch-2, branch-2.9, and 
branch-2.8. Thanks [~arpitagarwal]!

> Fix the section titles of transparent encryption document
> -
>
> Key: HDFS-13427
> URL: https://issues.apache.org/jira/browse/HDFS-13427
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Fix For: 2.10.0, 2.8.4, 3.2.0, 3.1.1, 2.9.2, 3.0.3
>
> Attachments: HDFS-13427.01.patch
>
>
> {noformat}
> The `crypto` command before Hadoop 2.8.0 does not provision the `.Trash` 
> directory automatically. If an encryption zone is created before Hadoop 
> 2.8.0, and then the cluster is upgraded to Hadoop 2.8.0 or above, the trash 
> directory can be provisioned using `-provisionTrash` option (e.g., `hdfs 
> crypto -provisionTrash -path /zone`).
> Attack vectors
> --
> {noformat}
> The long sentence starts with 'The crypto' wrongly become the title. We need 
> to add a blank line between the sentence and 'Attack vectors' to fix this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13427) Fix the section titles of transparent encryption document

2018-04-11 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13427:
-
Summary: Fix the section titles of transparent encryption document  (was: 
Fix transparent encryption document)

> Fix the section titles of transparent encryption document
> -
>
> Key: HDFS-13427
> URL: https://issues.apache.org/jira/browse/HDFS-13427
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Attachments: HDFS-13427.01.patch
>
>
> {noformat}
> The `crypto` command before Hadoop 2.8.0 does not provision the `.Trash` 
> directory automatically. If an encryption zone is created before Hadoop 
> 2.8.0, and then the cluster is upgraded to Hadoop 2.8.0 or above, the trash 
> directory can be provisioned using `-provisionTrash` option (e.g., `hdfs 
> crypto -provisionTrash -path /zone`).
> Attack vectors
> --
> {noformat}
> The long sentence starts with 'The crypto' wrongly become the title. We need 
> to add a blank line between the sentence and 'Attack vectors' to fix this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13427) Fix transparent encryption document

2018-04-11 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13427:
-
Assignee: Akira Ajisaka
  Status: Patch Available  (was: Open)

01 patch
* Add a blank line between the two lines
* Remove labels since they are added automatically.

> Fix transparent encryption document
> ---
>
> Key: HDFS-13427
> URL: https://issues.apache.org/jira/browse/HDFS-13427
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Attachments: HDFS-13427.01.patch
>
>
> {noformat}
> The `crypto` command before Hadoop 2.8.0 does not provision the `.Trash` 
> directory automatically. If an encryption zone is created before Hadoop 
> 2.8.0, and then the cluster is upgraded to Hadoop 2.8.0 or above, the trash 
> directory can be provisioned using `-provisionTrash` option (e.g., `hdfs 
> crypto -provisionTrash -path /zone`).
> Attack vectors
> --
> {noformat}
> The long sentence starts with 'The crypto' wrongly become the title. We need 
> to add a blank line between the sentence and 'Attack vectors' to fix this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13427) Fix transparent encryption document

2018-04-11 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13427:
-
Attachment: HDFS-13427.01.patch

> Fix transparent encryption document
> ---
>
> Key: HDFS-13427
> URL: https://issues.apache.org/jira/browse/HDFS-13427
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Minor
> Attachments: HDFS-13427.01.patch
>
>
> {noformat}
> The `crypto` command before Hadoop 2.8.0 does not provision the `.Trash` 
> directory automatically. If an encryption zone is created before Hadoop 
> 2.8.0, and then the cluster is upgraded to Hadoop 2.8.0 or above, the trash 
> directory can be provisioned using `-provisionTrash` option (e.g., `hdfs 
> crypto -provisionTrash -path /zone`).
> Attack vectors
> --
> {noformat}
> The long sentence starts with 'The crypto' wrongly become the title. We need 
> to add a blank line between the sentence and 'Attack vectors' to fix this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13427) Fix transparent encryption document

2018-04-11 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13427:
-
Component/s: documentation

> Fix transparent encryption document
> ---
>
> Key: HDFS-13427
> URL: https://issues.apache.org/jira/browse/HDFS-13427
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Minor
>
> {noformat}
> The `crypto` command before Hadoop 2.8.0 does not provision the `.Trash` 
> directory automatically. If an encryption zone is created before Hadoop 
> 2.8.0, and then the cluster is upgraded to Hadoop 2.8.0 or above, the trash 
> directory can be provisioned using `-provisionTrash` option (e.g., `hdfs 
> crypto -provisionTrash -path /zone`).
> Attack vectors
> --
> {noformat}
> The long sentence starts with 'The crypto' wrongly become the title. We need 
> to add a blank line between the sentence and 'Attack vectors' to fix this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Created] (HDFS-13427) Fix transparent encryption document

2018-04-11 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-13427:


 Summary: Fix transparent encryption document
 Key: HDFS-13427
 URL: https://issues.apache.org/jira/browse/HDFS-13427
 Project: Hadoop HDFS
  Issue Type: Bug
Reporter: Akira Ajisaka


{noformat}
The `crypto` command before Hadoop 2.8.0 does not provision the `.Trash` 
directory automatically. If an encryption zone is created before Hadoop 2.8.0, 
and then the cluster is upgraded to Hadoop 2.8.0 or above, the trash directory 
can be provisioned using `-provisionTrash` option (e.g., `hdfs crypto 
-provisionTrash -path /zone`).
Attack vectors
--
{noformat}
The long sentence starts with 'The crypto' wrongly become the title. We need to 
add a blank line between the sentence and 'Attack vectors' to fix this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-7101) Potential null dereference in DFSck#doWork()

2018-04-10 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-7101:

Description: 
{code}
String lastLine = null;
int errCode = -1;
try {
  while ((line = input.readLine()) != null) {
...
if (lastLine.endsWith(NamenodeFsck.HEALTHY_STATUS)) {
  errCode = 0;
{code}
If the input stream is empty, lastLine is kept null, leading to NPE.

  was:
{code}
String lastLine = null;
int errCode = -1;
try {
  while ((line = input.readLine()) != null) {
...
if (lastLine.endsWith(NamenodeFsck.HEALTHY_STATUS)) {
  errCode = 0;
{code}
If readLine() throws exception, lastLine may be null, leading to NPE.


> Potential null dereference in DFSck#doWork()
> 
>
> Key: HDFS-7101
> URL: https://issues.apache.org/jira/browse/HDFS-7101
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 2.5.1
>Reporter: Ted Yu
>Assignee: skrho
>Priority: Minor
>  Labels: BB2015-05-TBR
> Attachments: HDFS-7101.v1.patch, HDFS-7101_001.patch
>
>
> {code}
> String lastLine = null;
> int errCode = -1;
> try {
>   while ((line = input.readLine()) != null) {
> ...
> if (lastLine.endsWith(NamenodeFsck.HEALTHY_STATUS)) {
>   errCode = 0;
> {code}
> If the input stream is empty, lastLine is kept null, leading to NPE.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-7101) Potential null dereference in DFSck#doWork()

2018-04-10 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432438#comment-16432438
 ] 

Akira Ajisaka commented on HDFS-7101:
-

LGTM, +1

> Potential null dereference in DFSck#doWork()
> 
>
> Key: HDFS-7101
> URL: https://issues.apache.org/jira/browse/HDFS-7101
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 2.5.1
>Reporter: Ted Yu
>Assignee: skrho
>Priority: Minor
>  Labels: BB2015-05-TBR
> Attachments: HDFS-7101.v1.patch, HDFS-7101_001.patch
>
>
> {code}
> String lastLine = null;
> int errCode = -1;
> try {
>   while ((line = input.readLine()) != null) {
> ...
> if (lastLine.endsWith(NamenodeFsck.HEALTHY_STATUS)) {
>   errCode = 0;
> {code}
> If readLine() throws exception, lastLine may be null, leading to NPE.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13420) License header is displayed in ArchivalStorage/MemoryStorage html pages

2018-04-10 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13420:
-
Fix Version/s: (was: 3.0.2)
   3.0.3

> License header is displayed in ArchivalStorage/MemoryStorage html pages
> ---
>
> Key: HDFS-13420
> URL: https://issues.apache.org/jira/browse/HDFS-13420
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.1.0, 3.0.1
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Fix For: 3.2.0, 3.1.1, 3.0.3
>
> Attachments: HDFS-13420.01.patch, HDFS-13420.02.patch
>
>
> Apache License header is wrongly displayed in 
> http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13420) License header is displayed in ArchivalStorage/MemoryStorage html pages

2018-04-10 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432346#comment-16432346
 ] 

Akira Ajisaka commented on HDFS-13420:
--

Thanks!

> License header is displayed in ArchivalStorage/MemoryStorage html pages
> ---
>
> Key: HDFS-13420
> URL: https://issues.apache.org/jira/browse/HDFS-13420
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.1.0, 3.0.1
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Fix For: 3.2.0, 3.1.1, 3.0.3
>
> Attachments: HDFS-13420.01.patch, HDFS-13420.02.patch
>
>
> Apache License header is wrongly displayed in 
> http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13420) License header is displayed in ArchivalStorage.html

2018-04-10 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432190#comment-16432190
 ] 

Akira Ajisaka commented on HDFS-13420:
--

bq. And do we know which one causes this?
I don't know. The markdown files in Hadoop 2.x still have BOM but the issue 
does not occur. Probably maven site plugin or something has a regression of 
processing markdown files with BOM.

> License header is displayed in ArchivalStorage.html
> ---
>
> Key: HDFS-13420
> URL: https://issues.apache.org/jira/browse/HDFS-13420
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.1.0, 3.0.1
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Attachments: HDFS-13420.01.patch, HDFS-13420.02.patch
>
>
> Apache License header is wrongly displayed in 
> http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13420) License header is displayed in ArchivalStorage.html

2018-04-10 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432186#comment-16432186
 ] 

Akira Ajisaka commented on HDFS-13420:
--

Thanks [~cheersyang] for the review. Updated the patch to fix MemoryStorage.md 
as well.

> License header is displayed in ArchivalStorage.html
> ---
>
> Key: HDFS-13420
> URL: https://issues.apache.org/jira/browse/HDFS-13420
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.1.0, 3.0.1
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Attachments: HDFS-13420.01.patch, HDFS-13420.02.patch
>
>
> Apache License header is wrongly displayed in 
> http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13420) License header is displayed in ArchivalStorage.html

2018-04-10 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13420:
-
Target Version/s: 3.2.0, 3.1.1, 3.0.3

> License header is displayed in ArchivalStorage.html
> ---
>
> Key: HDFS-13420
> URL: https://issues.apache.org/jira/browse/HDFS-13420
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.1.0, 3.0.1
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Attachments: HDFS-13420.01.patch, HDFS-13420.02.patch
>
>
> Apache License header is wrongly displayed in 
> http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13420) License header is displayed in ArchivalStorage.html

2018-04-10 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13420:
-
Attachment: HDFS-13420.02.patch

> License header is displayed in ArchivalStorage.html
> ---
>
> Key: HDFS-13420
> URL: https://issues.apache.org/jira/browse/HDFS-13420
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.1.0, 3.0.1
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Attachments: HDFS-13420.01.patch, HDFS-13420.02.patch
>
>
> Apache License header is wrongly displayed in 
> http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13420) License header is displayed in ArchivalStorage.html

2018-04-10 Thread Akira Ajisaka (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432050#comment-16432050
 ] 

Akira Ajisaka commented on HDFS-13420:
--

Attached a patch to remove BOM. After removing BOM, the license header is not 
displayed on my local build.

> License header is displayed in ArchivalStorage.html
> ---
>
> Key: HDFS-13420
> URL: https://issues.apache.org/jira/browse/HDFS-13420
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.1.0, 3.0.1
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Attachments: HDFS-13420.01.patch
>
>
> Apache License header is wrongly displayed in 
> http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13420) License header is displayed in ArchivalStorage.html

2018-04-10 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13420:
-
Attachment: HDFS-13420.01.patch

> License header is displayed in ArchivalStorage.html
> ---
>
> Key: HDFS-13420
> URL: https://issues.apache.org/jira/browse/HDFS-13420
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.1.0, 3.0.1
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Attachments: HDFS-13420.01.patch
>
>
> Apache License header is wrongly displayed in 
> http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13420) License header is displayed in ArchivalStorage.html

2018-04-10 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13420:
-
Assignee: Akira Ajisaka
  Status: Patch Available  (was: Open)

> License header is displayed in ArchivalStorage.html
> ---
>
> Key: HDFS-13420
> URL: https://issues.apache.org/jira/browse/HDFS-13420
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.0.1, 3.1.0
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Minor
> Attachments: HDFS-13420.01.patch
>
>
> Apache License header is wrongly displayed in 
> http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-13420) License header is displayed in ArchivalStorage.html

2018-04-10 Thread Akira Ajisaka (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HDFS-13420:
-
Affects Version/s: 3.1.0
   3.0.1

> License header is displayed in ArchivalStorage.html
> ---
>
> Key: HDFS-13420
> URL: https://issues.apache.org/jira/browse/HDFS-13420
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 3.1.0, 3.0.1
>Reporter: Akira Ajisaka
>Priority: Minor
>
> Apache License header is wrongly displayed in 
> http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



<    5   6   7   8   9   10   11   12   13   14   >