[jira] [Updated] (HDFS-10466) DistributedFileSystem.listLocatedStatus() should return HdfsBlockLocation instead of BlockLocation

2016-05-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-10466: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) Thanks [~andrew.wang] for discussion. I

[jira] [Updated] (HDFS-10466) DistributedFileSystem.listLocatedStatus() should return HdfsBlockLocation instead of BlockLocation

2016-05-25 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-10466: --- Attachment: HDFS-10466.001.patch > DistributedFileSystem.listLocatedStatus() should return HdfsBlockLocation

[jira] [Updated] (HDFS-10466) DistributedFileSystem.listLocatedStatus() should return HdfsBlockLocation instead of BlockLocation

2016-05-25 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-10466: --- Status: Patch Available (was: Open) Ran all related unit tests and they passed. Also verified my application

[jira] [Updated] (HDFS-10466) DistributedFileSystem.listLocatedStatus() should return HdfsBlockLocation instead of BlockLocation

2016-05-25 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-10466: --- Attachment: HDFS-10466.patch > DistributedFileSystem.listLocatedStatus() should return HdfsBlockLocation > in

[jira] [Created] (HDFS-10466) DistributedFileSystem.listLocatedStatus() should return HdfsBlockLocation instead of BlockLocation

2016-05-25 Thread Juan Yu (JIRA)
Juan Yu created HDFS-10466: -- Summary: DistributedFileSystem.listLocatedStatus() should return HdfsBlockLocation instead of BlockLocation Key: HDFS-10466 URL: https://issues.apache.org/jira/browse/HDFS-10466

[jira] [Commented] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2015-05-29 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565649#comment-14565649 ] Juan Yu commented on HDFS-8409: --- If it happens at retry, not the initial call. For example, t

[jira] [Updated] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2015-05-26 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-8409: -- Attachment: HDFS-8409.003.patch Fix whitespace. The failed test is not related to my change and it passes locall

[jira] [Updated] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2015-05-23 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-8409: -- Attachment: HDFS-8409.002.patch Resubmit the patch to re-run tests. > HDFS client RPC call throws "java.lang.Ill

[jira] [Commented] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2015-05-23 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557409#comment-14557409 ] Juan Yu commented on HDFS-8409: --- The test failure is because {code}java.lang.NoClassDefFoundE

[jira] [Commented] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2015-05-21 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1441#comment-1441 ] Juan Yu commented on HDFS-8409: --- Client.callId is only reset to null when a new RPC call obje

[jira] [Updated] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2015-05-21 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-8409: -- Status: Patch Available (was: Open) > HDFS client RPC call throws "java.lang.IllegalStateException" > --

[jira] [Updated] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2015-05-21 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-8409: -- Attachment: HDFS-8409.001.patch > HDFS client RPC call throws "java.lang.IllegalStateException" > ---

[jira] [Commented] (HDFS-8407) libhdfs hdfsListDirectory() API has different behavior than documentation

2015-05-20 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553640#comment-14553640 ] Juan Yu commented on HDFS-8407: --- I think move "errno = ret;" before the if check will cover b

[jira] [Commented] (HDFS-8407) libhdfs hdfsListDirectory() API has different behavior than documentation

2015-05-19 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14551262#comment-14551262 ] Juan Yu commented on HDFS-8407: --- Thanks [~cmccabe] for pointing this out. That's exactly what

[jira] [Assigned] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2015-05-15 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu reassigned HDFS-8409: - Assignee: Juan Yu > HDFS client RPC call throws "java.lang.IllegalStateException" > --

[jira] [Commented] (HDFS-8407) libhdfs hdfsListDirectory() API has different behavior than documentation

2015-05-15 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14545754#comment-14545754 ] Juan Yu commented on HDFS-8407: --- If an error happens when calling hdfsListDirectory, you coul

[jira] [Created] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2015-05-15 Thread Juan Yu (JIRA)
Juan Yu created HDFS-8409: - Summary: HDFS client RPC call throws "java.lang.IllegalStateException" Key: HDFS-8409 URL: https://issues.apache.org/jira/browse/HDFS-8409 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-8407) libhdfs hdfsListDirectory() API has different behavior than documentation

2015-05-14 Thread Juan Yu (JIRA)
Juan Yu created HDFS-8407: - Summary: libhdfs hdfsListDirectory() API has different behavior than documentation Key: HDFS-8407 URL: https://issues.apache.org/jira/browse/HDFS-8407 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7570) DataXceiver could leak FileDescriptor

2014-12-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14262522#comment-14262522 ] Juan Yu commented on HDFS-7570: --- Thanks Colin. This is red herring. sorry about the noise. >

[jira] [Resolved] (HDFS-7570) DataXceiver could leak FileDescriptor

2014-12-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu resolved HDFS-7570. --- Resolution: Not a Problem > DataXceiver could leak FileDescriptor > - > >

[jira] [Created] (HDFS-7570) DataXceiver could leak FileDescriptor

2014-12-24 Thread Juan Yu (JIRA)
Juan Yu created HDFS-7570: - Summary: DataXceiver could leak FileDescriptor Key: HDFS-7570 URL: https://issues.apache.org/jira/browse/HDFS-7570 Project: Hadoop HDFS Issue Type: Bug Reporte

[jira] [Commented] (HDFS-7166) SbNN Web UI shows #Under replicated blocks and #pending deletion blocks

2014-09-29 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152578#comment-14152578 ] Juan Yu commented on HDFS-7166: --- they are in {{hadoop-hdfs-project/hadoop-hdfs/src/main/weba

[jira] [Assigned] (HDFS-5189) Rename the "CorruptBlocks" metric to "CorruptReplicas"

2014-09-26 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu reassigned HDFS-5189: - Assignee: (was: Juan Yu) > Rename the "CorruptBlocks" metric to "CorruptReplicas" > --

[jira] [Assigned] (HDFS-4324) Track and report out-of-date blocks separately from corrupt blocks

2014-09-26 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu reassigned HDFS-4324: - Assignee: (was: Juan Yu) > Track and report out-of-date blocks separately from corrupt blocks > --

[jira] [Updated] (HDFS-7149) hadoop-aws only need test-scoped dependency on hadoop-common's tests jar

2014-09-25 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-7149: -- Status: Patch Available (was: Open) > hadoop-aws only need test-scoped dependency on hadoop-common's tests jar >

[jira] [Updated] (HDFS-7149) hadoop-aws only need test-scoped dependency on hadoop-common's tests jar

2014-09-25 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-7149: -- Attachment: HDFS-7149.patch > hadoop-aws only need test-scoped dependency on hadoop-common's tests jar >

[jira] [Assigned] (HDFS-7149) hadoop-aws only need test-scoped dependency on hadoop-common's tests jar

2014-09-25 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu reassigned HDFS-7149: - Assignee: Juan Yu > hadoop-aws only need test-scoped dependency on hadoop-common's tests jar > ---

[jira] [Created] (HDFS-7149) hadoop-aws only need test-scoped dependency on hadoop-common's tests jar

2014-09-25 Thread Juan Yu (JIRA)
Juan Yu created HDFS-7149: - Summary: hadoop-aws only need test-scoped dependency on hadoop-common's tests jar Key: HDFS-7149 URL: https://issues.apache.org/jira/browse/HDFS-7149 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7049) TestByteRangeInputStream.testPropagatedClose fails and throw NPE on branch-2

2014-09-24 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14146758#comment-14146758 ] Juan Yu commented on HDFS-7049: --- Thanks all for reviewing. > TestByteRangeInputStream.testPr

[jira] [Commented] (HDFS-7049) TestByteRangeInputStream.testPropagatedClose fails and throw NPE on branch-2

2014-09-18 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139941#comment-14139941 ] Juan Yu commented on HDFS-7049: --- Looks like Hadoop QA tried to apply the patch to trunk, but

[jira] [Updated] (HDFS-7049) TestByteRangeInputStream.testPropagatedClose fails and throw NPE on branch-2

2014-09-18 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-7049: -- Attachment: HDFS-7049-branch-2.002.patch Thanks Eric for reviewing. here is a new patch generated with {{git diff

[jira] [Updated] (HDFS-7049) TestByteRangeInputStream.testPropagatedClose fails and throw NPE on branch-2

2014-09-15 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-7049: -- Assignee: Juan Yu Status: Patch Available (was: Open) > TestByteRangeInputStream.testPropagatedClose fails

[jira] [Updated] (HDFS-7049) TestByteRangeInputStream.testPropagatedClose fails and throw NPE on branch-2

2014-09-15 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-7049: -- Attachment: HDFS-7049-branch-2.patch New TestByteRangeInputStream for branch-2 to fix test failure. It's the same

[jira] [Created] (HDFS-7049) TestByteRangeInputStream.testPropagatedClose fails and throw NPE on branch-2

2014-09-11 Thread Juan Yu (JIRA)
Juan Yu created HDFS-7049: - Summary: TestByteRangeInputStream.testPropagatedClose fails and throw NPE on branch-2 Key: HDFS-7049 URL: https://issues.apache.org/jira/browse/HDFS-7049 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6194) Create new tests for ByteRangeInputStream

2014-09-11 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14130416#comment-14130416 ] Juan Yu commented on HDFS-6194: --- it's not just reintroduce, the tests are also re-written. th

[jira] [Commented] (HDFS-6194) Create new tests for ByteRangeInputStream

2014-09-11 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14130309#comment-14130309 ] Juan Yu commented on HDFS-6194: --- why not branch-2? btw, the old test that use HftpFileSystem

[jira] [Commented] (HDFS-6194) Create new tests for ByteRangeInputStream

2014-09-11 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14130230#comment-14130230 ] Juan Yu commented on HDFS-6194: --- Hi [~wheat9], did you merge the new test to branch-2? the co

[jira] [Commented] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2014-08-26 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110927#comment-14110927 ] Juan Yu commented on HDFS-6908: --- [~jingzhao]] Thanks for reviewing patch and the discussion.

[jira] [Commented] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2014-08-24 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14108735#comment-14108735 ] Juan Yu commented on HDFS-6908: --- I don't think the failed tests are related to this patch. >

[jira] [Updated] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2014-08-24 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6908: -- Attachment: HDFS-6908.003.patch Thanks [~jingzhao] for reviewing. revised the patch. > incorrect snapshot dire

[jira] [Updated] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2014-08-21 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6908: -- Attachment: HDFS-6908.002.patch > incorrect snapshot directory diff generated by snapshot deletion > ---

[jira] [Updated] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2014-08-21 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6908: -- Status: Patch Available (was: Open) > incorrect snapshot directory diff generated by snapshot deletion > --

[jira] [Commented] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2014-08-21 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106507#comment-14106507 ] Juan Yu commented on HDFS-6908: --- [~jingzhao]] Thanks for the new unit test and explain the di

[jira] [Commented] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2014-08-21 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106231#comment-14106231 ] Juan Yu commented on HDFS-6908: --- Thanks [~jingzhao]. because the directory is deleted, it mea

[jira] [Updated] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2014-08-21 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6908: -- Attachment: HDFS-6908.001.patch The problem is when deleting snapshot, hdfs will clean Inode that not in any sn

[jira] [Created] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2014-08-21 Thread Juan Yu (JIRA)
Juan Yu created HDFS-6908: - Summary: incorrect snapshot directory diff generated by snapshot deletion Key: HDFS-6908 URL: https://issues.apache.org/jira/browse/HDFS-6908 Project: Hadoop HDFS Issue T

[jira] [Commented] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-08-11 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14092983#comment-14092983 ] Juan Yu commented on HDFS-6793: --- Thanks Andrew and Yongjun! > Missing changes in HftpFileSys

[jira] [Updated] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6793: -- Attachment: HDFS-6793.branch2.patch Thanks for the review. I verified related unit test against branch 2.5. rena

[jira] [Updated] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6793: -- Attachment: HDFS-6793.patch Previous one is not generated properly. > Missing changes in HftpFileSystem when Re

[jira] [Updated] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6793: -- Attachment: HDFS-6793.patch this patch is for 2.5. > Missing changes in HftpFileSystem when Reintroduce dfs.ht

[jira] [Updated] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6793: -- Status: Patch Available (was: In Progress) > Missing changes in HftpFileSystem when Reintroduce dfs.http.port /

[jira] [Work started] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6793 started by Juan Yu. > Missing changes in HftpFileSystem when Reintroduce dfs.http.port / > dfs.https.port in branch-2 >

[jira] [Updated] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6793: -- Target Version/s: 2.5.0 Affects Version/s: 2.5.0 > Missing changes in HftpFileSystem when Reintroduce dfs.h

[jira] [Created] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-30 Thread Juan Yu (JIRA)
Juan Yu created HDFS-6793: - Summary: Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2 Key: HDFS-6793 URL: https://issues.apache.org/jira/browse/HDFS-6793 Project:

[jira] [Assigned] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu reassigned HDFS-6793: - Assignee: Juan Yu > Missing changes in HftpFileSystem when Reintroduce dfs.http.port / > dfs.https.port i

[jira] [Commented] (HDFS-3815) CorruptBlocks documentation is misleading

2014-07-29 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078160#comment-14078160 ] Juan Yu commented on HDFS-3815: --- I think this is an invalid one. The "CorruptBlocks" is count

[jira] [Commented] (HDFS-5189) Rename the "CorruptBlocks" metric to "CorruptReplicas"

2014-07-29 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078070#comment-14078070 ] Juan Yu commented on HDFS-5189: --- [~qwertymaniac], "CorruptReplicas" could be misleading as we

[jira] [Resolved] (HDFS-6756) Default ipc.maximum.data.length should be increased to 128MB from 64MB

2014-07-25 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu resolved HDFS-6756. --- Resolution: Invalid > Default ipc.maximum.data.length should be increased to 128MB from 64MB > ---

[jira] [Commented] (HDFS-6756) Default ipc.maximum.data.length should be increased to 128MB from 64MB

2014-07-25 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075037#comment-14075037 ] Juan Yu commented on HDFS-6756: --- Thx a lot. One more question, The split is per storage dir

[jira] [Commented] (HDFS-6756) Default ipc.maximum.data.length should be increased to 128MB from 64MB

2014-07-25 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075019#comment-14075019 ] Juan Yu commented on HDFS-6756: --- [~arpitagarwal] You're right, this is in block report, this

[jira] [Commented] (HDFS-6756) Default ipc.maximum.data.length should be increased to 128MB from 64MB

2014-07-25 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074937#comment-14074937 ] Juan Yu commented on HDFS-6756: --- Got lots of messages like "Requested data length 72293417 is

[jira] [Commented] (HDFS-964) hdfs-default.xml shouldn't use hadoop.tmp.dir for dfs.data.dir (0.20 and lower) / dfs.datanode.dir (0.21 and up)

2014-07-25 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074787#comment-14074787 ] Juan Yu commented on HDFS-964: -- Hi [~aw], this seems a good idea, why is it marked as "Won't Fi

[jira] [Created] (HDFS-6756) Default ipc.maximum.data.length should be increased to 128MB from 64MB

2014-07-25 Thread Juan Yu (JIRA)
Juan Yu created HDFS-6756: - Summary: Default ipc.maximum.data.length should be increased to 128MB from 64MB Key: HDFS-6756 URL: https://issues.apache.org/jira/browse/HDFS-6756 Project: Hadoop HDFS I

[jira] [Assigned] (HDFS-4324) Track and report out-of-date blocks separately from corrupt blocks

2014-07-10 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu reassigned HDFS-4324: - Assignee: Juan Yu > Track and report out-of-date blocks separately from corrupt blocks > -

[jira] [Commented] (HDFS-6652) RecoverLease cannot success and file cannot be closed under high load

2014-07-09 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056936#comment-14056936 ] Juan Yu commented on HDFS-6652: --- The lease recovery failure is related to HDFS-4504 > Recove

[jira] [Updated] (HDFS-6652) RecoverLease cannot success and file cannot be closed under high load

2014-07-09 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6652: -- Attachment: testLeaseRecoveryWithMultiWriters.patch Here is an unit test to reproduce this issue. > RecoverLeas

[jira] [Created] (HDFS-6652) RecoverLease cannot success and file cannot be closed under high load

2014-07-09 Thread Juan Yu (JIRA)
Juan Yu created HDFS-6652: - Summary: RecoverLease cannot success and file cannot be closed under high load Key: HDFS-6652 URL: https://issues.apache.org/jira/browse/HDFS-6652 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-6493) Change dfs.namenode.startup.delay.block.deletion to second instead of millisecond

2014-07-03 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14051877#comment-14051877 ] Juan Yu commented on HDFS-6493: --- Thanks a lot for reviewing and committing, Andrew. --

[jira] [Commented] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-07-02 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14050552#comment-14050552 ] Juan Yu commented on HDFS-6612: --- Thanks Andrew for code review and committing. -- BR -

[jira] [Work started] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6612 started by Juan Yu. > MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID > ---

[jira] [Updated] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6612: -- Attachment: HDFS-6612.001.patch > MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

[jira] [Updated] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6612: -- Status: Patch Available (was: In Progress) > MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nam

[jira] [Reopened] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu reopened HDFS-6612: --- There are a couple of unit tests who specify nameservice in config still use {{simpleFederatedTopology(int numNam

[jira] [Resolved] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu resolved HDFS-6612. --- Resolution: Duplicate > MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID > --

[jira] [Created] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Juan Yu (JIRA)
Juan Yu created HDFS-6612: - Summary: MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID Key: HDFS-6612 URL: https://issues.apache.org/jira/browse/HDFS-6612 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-5189) Rename the "CorruptBlocks" metric to "CorruptReplicas"

2014-06-19 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu reassigned HDFS-5189: - Assignee: Juan Yu > Rename the "CorruptBlocks" metric to "CorruptReplicas" > -

[jira] [Commented] (HDFS-6549) Add support for accessing the NFS gateway from the AIX NFS client

2014-06-19 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14037599#comment-14037599 ] Juan Yu commented on HDFS-6549: --- is this a typo? true> > Add support for accessing the NFS g

[jira] [Resolved] (HDFS-6548) AuthenticationToken will be ignored if the cookie value contains '@'

2014-06-16 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu resolved HDFS-6548. --- Resolution: Invalid > AuthenticationToken will be ignored if the cookie value contains '@' > -

[jira] [Created] (HDFS-6548) AuthenticationToken will be ignored if the cookie value contains '@'

2014-06-16 Thread Juan Yu (JIRA)
Juan Yu created HDFS-6548: - Summary: AuthenticationToken will be ignored if the cookie value contains '@' Key: HDFS-6548 URL: https://issues.apache.org/jira/browse/HDFS-6548 Project: Hadoop HDFS Iss

[jira] [Updated] (HDFS-6511) BlockManager#computeInvalidateWork() could do nothing

2014-06-12 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6511: -- Status: Patch Available (was: In Progress) > BlockManager#computeInvalidateWork() could do nothing > --

[jira] [Updated] (HDFS-6511) BlockManager#computeInvalidateWork() could do nothing

2014-06-12 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6511: -- Attachment: HDFS-6511.001.patch > BlockManager#computeInvalidateWork() could do nothing > --

[jira] [Work started] (HDFS-6511) BlockManager#computeInvalidateWork() could do nothing

2014-06-12 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6511 started by Juan Yu. > BlockManager#computeInvalidateWork() could do nothing > - > > K

[jira] [Updated] (HDFS-3493) Replication is not happened for the block (which is recovered and in finalized) to the Datanode which has got the same block with old generation timestamp in RBW

2014-06-11 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-3493: -- Attachment: HDFS-3493.004.patch New patch to address Andrew's review comments. Thanks Andrew for the review. >

[jira] [Created] (HDFS-6511) BlockManager#computeInvalidateWork() could do nothing

2014-06-10 Thread Juan Yu (JIRA)
Juan Yu created HDFS-6511: - Summary: BlockManager#computeInvalidateWork() could do nothing Key: HDFS-6511 URL: https://issues.apache.org/jira/browse/HDFS-6511 Project: Hadoop HDFS Issue Type: Improve

[jira] [Updated] (HDFS-6493) Propose to change "dfs.namenode.startup.delay.block.deletion" to second instead of millisecond

2014-06-10 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6493: -- Status: Patch Available (was: In Progress) > Propose to change "dfs.namenode.startup.delay.block.deletion" to s

[jira] [Updated] (HDFS-6493) Propose to change "dfs.namenode.startup.delay.block.deletion" to second instead of millisecond

2014-06-10 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6493: -- Attachment: HDFS-6493.001.patch > Propose to change "dfs.namenode.startup.delay.block.deletion" to second > ins

[jira] [Commented] (HDFS-6493) Propose to change "dfs.namenode.startup.delay.block.deletion" to second instead of millisecond

2014-06-10 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026522#comment-14026522 ] Juan Yu commented on HDFS-6493: --- Thanks for the suggestion. > Propose to change "dfs.namenod

[jira] [Updated] (HDFS-6493) Propose to change "dfs.namenode.startup.delay.block.deletion" to second instead of millisecond

2014-06-09 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6493: -- Attachment: (was: HDFS-6493.001.patch) > Propose to change "dfs.namenode.startup.delay.block.deletion" to se

[jira] [Updated] (HDFS-6493) Propose to change "dfs.namenode.startup.delay.block.deletion" to second instead of millisecond

2014-06-09 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6493: -- Attachment: HDFS-6493.001.patch > Propose to change "dfs.namenode.startup.delay.block.deletion" to second > ins

[jira] [Work started] (HDFS-6493) Propose to change "dfs.namenode.startup.delay.block.deletion" to second instead of millisecond

2014-06-09 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6493 started by Juan Yu. > Propose to change "dfs.namenode.startup.delay.block.deletion" to second > instead of millisecond > ---

[jira] [Updated] (HDFS-3493) Replication is not happened for the block (which is recovered and in finalized) to the Datanode which has got the same block with old generation timestamp in RBW

2014-06-06 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-3493: -- Attachment: HDFS-3493.003.patch Fix broken tests > Replication is not happened for the block (which is recovere

[jira] [Commented] (HDFS-6476) Print out the KeyProvider after finding KP successfully on startup

2014-06-05 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14019572#comment-14019572 ] Juan Yu commented on HDFS-6476: --- Thanks Andrew. > Print out the KeyProvider after finding KP

[jira] [Created] (HDFS-6493) Propose to change "dfs.namenode.startup.delay.block.deletion" to second instead of millisecond

2014-06-05 Thread Juan Yu (JIRA)
Juan Yu created HDFS-6493: - Summary: Propose to change "dfs.namenode.startup.delay.block.deletion" to second instead of millisecond Key: HDFS-6493 URL: https://issues.apache.org/jira/browse/HDFS-6493 Project:

[jira] [Updated] (HDFS-6476) Print out the KeyProvider after finding KP successfully on startup

2014-06-05 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6476: -- Status: Patch Available (was: In Progress) > Print out the KeyProvider after finding KP successfully on startup

[jira] [Updated] (HDFS-6476) Print out the KeyProvider after finding KP successfully on startup

2014-06-05 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6476: -- Attachment: HDFS-6476.001.patch > Print out the KeyProvider after finding KP successfully on startup > -

[jira] [Work started] (HDFS-6476) Print out the KeyProvider after finding KP successfully on startup

2014-06-05 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6476 started by Juan Yu. > Print out the KeyProvider after finding KP successfully on startup > --

[jira] [Updated] (HDFS-3493) Replication is not happened for the block (which is recovered and in finalized) to the Datanode which has got the same block with old generation timestamp in RBW

2014-06-05 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-3493: -- Attachment: HDFS-3493.002.patch If all replicas are corrupted, I think we don't want to delete them. So modified

[jira] [Assigned] (HDFS-3493) Replication is not happened for the block (which is recovered and in finalized) to the Datanode which has got the same block with old generation timestamp in RBW

2014-06-05 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu reassigned HDFS-3493: - Assignee: Juan Yu (was: Vinayakumar B) > Replication is not happened for the block (which is recovered an

[jira] [Created] (HDFS-6476) Print out the KeyProvider after finding KP successfully on startup

2014-06-02 Thread Juan Yu (JIRA)
Juan Yu created HDFS-6476: - Summary: Print out the KeyProvider after finding KP successfully on startup Key: HDFS-6476 URL: https://issues.apache.org/jira/browse/HDFS-6476 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-6472) fix typo in webapps/hdfs/explorer.js

2014-05-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14014205#comment-14014205 ] Juan Yu commented on HDFS-6472: --- Thanks Andrew. -- - Juan > fix typo in webapps/hdfs

  1   2   >