[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-07-25 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16100601#comment-16100601 ] Yongjun Zhang commented on HDFS-12191: -- Thanks much [~manojg] for the comment. Pleas

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-07-25 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16101040#comment-16101040 ] Yongjun Zhang commented on HDFS-12191: -- Thanks [~manojg]. - We don't want to break b

[jira] [Comment Edited] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-07-25 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16101040#comment-16101040 ] Yongjun Zhang edited comment on HDFS-12191 at 7/26/17 5:22 AM: -

[jira] [Created] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-07-26 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12202: Summary: Provide new set of FileSystem API to bypass external attribute provider Key: HDFS-12202 URL: https://issues.apache.org/jira/browse/HDFS-12202 Project: Hadoop

[jira] [Assigned] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-12202: Assignee: Yongjun Zhang > Provide new set of FileSystem API to bypass external attribute pr

[jira] [Commented] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102188#comment-16102188 ] Yongjun Zhang commented on HDFS-12202: -- Hi [~arun.sur...@gmail.com], [~daryn], [~jing

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.002.patch > Enable 'hdfs dfs -stat' to display access time > --

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102531#comment-16102531 ] Yongjun Zhang commented on HDFS-12190: -- Thanks a lot [~jojochuang], very good point!

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.002.patch > Enable 'hdfs dfs -stat' to display access time > --

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: (was: HDFS-12190.002.patch) > Enable 'hdfs dfs -stat' to display access time > ---

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.003.patch 003 to fix a place missed earlier. > Enable 'hdfs dfs -stat' to

[jira] [Issue Comment Deleted] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Comment: was deleted (was: 003 to fix a place missed earlier. ) > Enable 'hdfs dfs -stat' to disp

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: (was: HDFS-12190.003.patch) > Enable 'hdfs dfs -stat' to display access time > ---

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.003.patch rev3 to take care of a missed place in last rev. > Enable 'hdfs

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16103496#comment-16103496 ] Yongjun Zhang commented on HDFS-12190: -- Thanks much [~jojochuang], very good suggesti

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.004.patch > Enable 'hdfs dfs -stat' to display access time > --

[jira] [Commented] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-07-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16103567#comment-16103567 ] Yongjun Zhang commented on HDFS-12202: -- Besides that the change is going to be very w

[jira] [Commented] (HDFS-12201) INode#getSnapshotINode() should get INodeAttributes from INodeAttributesProvider for the current INode

2017-07-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16103649#comment-16103649 ] Yongjun Zhang commented on HDFS-12201: -- Thanks [~manojg] for working on this issue, a

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.005.patch Thanks [~jojochuang], good suggestion again. updated patch. > E

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16104103#comment-16104103 ] Yongjun Zhang commented on HDFS-12190: -- Thanks [~jojochuang] for the review, the fail

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1

[jira] [Commented] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16105830#comment-16105830 ] Yongjun Zhang commented on HDFS-12217: -- Hi [~manojg], Thanks for reporting the issue

[jira] [Commented] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16105906#comment-16105906 ] Yongjun Zhang commented on HDFS-12217: -- Thanks for the new rev [~manojg]. Some comme

[jira] [Commented] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106027#comment-16106027 ] Yongjun Zhang commented on HDFS-12217: -- Thanks for the new rev [~manojg]. When a use

[jira] [Commented] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106143#comment-16106143 ] Yongjun Zhang commented on HDFS-12217: -- Hi [~manojg], {quote} LeaseManager#getINodeW

[jira] [Comment Edited] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106143#comment-16106143 ] Yongjun Zhang edited comment on HDFS-12217 at 7/29/17 3:22 PM: -

[jira] [Commented] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-11-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15625972#comment-15625972 ] Yongjun Zhang commented on HDFS-11056: -- That's very nice findings [~jojochuang]! Cong

[jira] [Commented] (HDFS-9868) add reading source cluster with HA access mode feature for DistCp

2016-11-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637395#comment-15637395 ] Yongjun Zhang commented on HDFS-9868: - Thanks for working on this guys, sounds the issu

[jira] [Commented] (HDFS-11114) Support for running async disk checks in DataNode

2016-11-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15648933#comment-15648933 ] Yongjun Zhang commented on HDFS-4: -- HI [~arpiagariu], Thanks for working on this

[jira] [Commented] (HDFS-11114) Support for running async disk checks in DataNode

2016-11-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649105#comment-15649105 ] Yongjun Zhang commented on HDFS-4: -- Thanks [~arpitagarwal]. This seems a workflow

[jira] [Updated] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

2016-11-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7578: Status: Open (was: Patch Available) > NFS WRITE and COMMIT responses should always use the channel p

[jira] [Updated] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

2016-11-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7578: Status: Patch Available (was: Open) > NFS WRITE and COMMIT responses should always use the channel p

[jira] [Updated] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

2016-11-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7578: Attachment: HDFS-7578.004.patch > NFS WRITE and COMMIT responses should always use the channel pipeli

[jira] [Commented] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

2016-11-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15685572#comment-15685572 ] Yongjun Zhang commented on HDFS-7578: - Hi [~brandonli], thanks for your earlier work he

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-11-22 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15687444#comment-15687444 ] Yongjun Zhang commented on HDFS-10918: -- Hi [~maniraj...@gmail.com] and [~xiaochen],

[jira] [Commented] (HDFS-11100) Recursively deleting file protected by sticky bit should fail

2016-11-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707672#comment-15707672 ] Yongjun Zhang commented on HDFS-11100: -- Hi [~jzhuge], Thanks for reporting the issue

[jira] [Commented] (HDFS-11100) Recursively deleting file protected by sticky bit should fail

2016-11-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707724#comment-15707724 ] Yongjun Zhang commented on HDFS-11100: -- Sure [~jzhuge], I did not mean that we need t

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-11-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11160: - Attachment: HDFS-11160.003.patch Hi [~jojochuang], Thanks for your work here. I did a review of y

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-11-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710657#comment-15710657 ] Yongjun Zhang commented on HDFS-11160: -- About your optimization: {quote} The basic id

[jira] [Commented] (HDFS-11188) Change min supported DN and NN versions back to 2.x

2016-12-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15716956#comment-15716956 ] Yongjun Zhang commented on HDFS-11188: -- Hi [~andrew.wang], Thanks for working on. T

[jira] [Commented] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2016-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736111#comment-15736111 ] Yongjun Zhang commented on HDFS-11225: -- Thanks [~jojochuang] and [~linyiqun]. I have

[jira] [Commented] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736273#comment-15736273 ] Yongjun Zhang commented on HDFS-11229: -- HI Wei-Chiu, Thanks for the patch, I thought

[jira] [Commented] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736288#comment-15736288 ] Yongjun Zhang commented on HDFS-11229: -- Ha, I got you, in java 7, "Any variable decl

[jira] [Commented] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2016-12-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15748993#comment-15748993 ] Yongjun Zhang commented on HDFS-11225: -- HI [~manojg], Would you please take a look a

[jira] [Created] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-11292: Summary: log lastWrittenTxId in logSyncAll Key: HDFS-11292 URL: https://issues.apache.org/jira/browse/HDFS-11292 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Assigned] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-11292: Assignee: Yongjun Zhang > log lastWrittenTxId in logSyncAll > -

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15799075#comment-15799075 ] Yongjun Zhang commented on HDFS-10943: -- The issue remains even after HDFS-7964 is inc

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: HDFS-11292.001.patch > log lastWrittenTxId in logSyncAll > ---

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Status: Patch Available (was: Open) > log lastWrittenTxId in logSyncAll > ---

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: (was: HDFS-11292.001.patch) > log lastWrittenTxId in logSyncAll >

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: HDFS-11292.001.patch > log lastWrittenTxId in logSyncAll > ---

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: HDFS-11292.002.patch > log lastWrittenTxId in logSyncAll > ---

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: (was: HDFS-11292.002.patch) > log lastWrittenTxId in logSyncAll >

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: HDFS-11292.002.patch > log lastWrittenTxId in logSyncAll > ---

[jira] [Updated] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Summary: log lastWrittenTxId etc info in logSyncAll (was: log lastWrittenTxId in logSyncAll) > l

[jira] [Commented] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15810369#comment-15810369 ] Yongjun Zhang commented on HDFS-11292: -- Thanks [~jojochuang], good comments! I just u

[jira] [Updated] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: HDFS-11292.003.patch > log lastWrittenTxId etc info in logSyncAll > --

[jira] [Commented] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813354#comment-15813354 ] Yongjun Zhang commented on HDFS-11292: -- Thanks [~jojochuang] much for the review! I c

[jira] [Updated] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11306) Print remaining edit logs from buffer if edit log can't be rolled.

2017-01-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813865#comment-15813865 ] Yongjun Zhang commented on HDFS-11306: -- Hi [~jojochuang], Thanks much for working on

[jira] [Commented] (HDFS-11306) Print remaining edit logs from buffer if edit log can't be rolled.

2017-01-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15822016#comment-15822016 ] Yongjun Zhang commented on HDFS-11306: -- Thanks for the updated patch [~jojochuang]. W

[jira] [Updated] (HDFS-11306) Print remaining edit logs from buffer if edit log can't be rolled.

2017-01-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11306: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11306) Print remaining edit logs from buffer if edit log can't be rolled.

2017-01-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826829#comment-15826829 ] Yongjun Zhang commented on HDFS-11306: -- I saw [~jojochuang] has committed to trunk an

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2017-01-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826910#comment-15826910 ] Yongjun Zhang commented on HDFS-10943: -- Hi [~zhz], I originally saw it with CDH 5.5.x

[jira] [Commented] (HDFS-11363) Need more diagnosis info when seeing Slow waitForAckedSeqno

2017-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15849039#comment-15849039 ] Yongjun Zhang commented on HDFS-11363: -- Thanks [~xiaochen] for the patch. The patch

[jira] [Commented] (HDFS-11363) Need more diagnosis info when seeing Slow waitForAckedSeqno

2017-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15849184#comment-15849184 ] Yongjun Zhang commented on HDFS-11363: -- Thanks [~xiaochen] for the new rev, except fo

[jira] [Created] (HDFS-11385) DistCp CopyCommitter should issue warning instead of throw exception when failed to delete file.

2017-02-01 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-11385: Summary: DistCp CopyCommitter should issue warning instead of throw exception when failed to delete file. Key: HDFS-11385 URL: https://issues.apache.org/jira/browse/HDFS-11385

[jira] [Commented] (HDFS-11391) Numeric usernames do no work with WebHDFS FS (write access)

2017-02-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853287#comment-15853287 ] Yongjun Zhang commented on HDFS-11391: -- Hi [~pvillard], Thanks for reporting the iss

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-02-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861566#comment-15861566 ] Yongjun Zhang commented on HDFS-11402: -- Hi [~manojg], Thanks for working on this iss

[jira] [Commented] (HDFS-11391) Numeric usernames do no work with WebHDFS FS (write access)

2017-02-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15864485#comment-15864485 ] Yongjun Zhang commented on HDFS-11391: -- Thanks [~pvillard]. I'm +1 on the patch, will

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-05-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272850#comment-15272850 ] Yongjun Zhang commented on HDFS-9732: - Hi [~ste...@apache.org], So far all comments ar

[jira] [Created] (HDFS-10376) setOwner call is not run as the specified user in TestPermission

2016-05-06 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10376: Summary: setOwner call is not run as the specified user in TestPermission Key: HDFS-10376 URL: https://issues.apache.org/jira/browse/HDFS-10376 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-10376) setOwner call is not run as the specified user in TestPermission

2016-05-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-10376: Assignee: John Zhuge Thanks John for offering to look into. > setOwner call is not run as

[jira] [Commented] (HDFS-10376) setOwner call is not run as the specified user in TestPermission

2016-05-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274901#comment-15274901 ] Yongjun Zhang commented on HDFS-10376: -- Hi [~jzhuge], Thanks a lot for your investig

[jira] [Comment Edited] (HDFS-10376) setOwner call is not run as the specified user in TestPermission

2016-05-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274901#comment-15274901 ] Yongjun Zhang edited comment on HDFS-10376 at 5/6/16 11:24 PM: -

[jira] [Commented] (HDFS-10378) setOwner throws AccessControlException with wrong message

2016-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276994#comment-15276994 ] Yongjun Zhang commented on HDFS-10378: -- HI [~jzhuge], Thanks for reporting the issue

[jira] [Comment Edited] (HDFS-10378) setOwner throws AccessControlException with wrong message

2016-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276994#comment-15276994 ] Yongjun Zhang edited comment on HDFS-10378 at 5/9/16 10:41 PM: -

[jira] [Created] (HDFS-10386) DataTransferProtocol#writeBlock missing some javadocs

2016-05-10 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10386: Summary: DataTransferProtocol#writeBlock missing some javadocs Key: HDFS-10386 URL: https://issues.apache.org/jira/browse/HDFS-10386 Project: Hadoop HDFS Iss

[jira] [Created] (HDFS-10387) DataTransferProtocol#writeBlock missing some javadocs

2016-05-10 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10387: Summary: DataTransferProtocol#writeBlock missing some javadocs Key: HDFS-10387 URL: https://issues.apache.org/jira/browse/HDFS-10387 Project: Hadoop HDFS Iss

[jira] [Assigned] (HDFS-10387) DataTransferProtocol#writeBlock missing some javadocs

2016-05-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-10387: Assignee: John Zhuge (was: Yongjun Zhang) Thanks John for being willing to help on this on

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-05-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281978#comment-15281978 ] Yongjun Zhang commented on HDFS-9732: - Many thanks [~ste...@apache.org] and [~aw]! >

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build diff copy list in distcp

2016-05-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282121#comment-15282121 ] Yongjun Zhang commented on HDFS-8828: - Thanks [~liuml07] and [~jingzhao], +1 on the pro

[jira] [Created] (HDFS-10396) Using -diff option with DistCp may get "Comparison method violates its general contract" exception

2016-05-12 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10396: Summary: Using -diff option with DistCp may get "Comparison method violates its general contract" exception Key: HDFS-10396 URL: https://issues.apache.org/jira/browse/HDFS-10396

[jira] [Commented] (HDFS-10396) Using -diff option with DistCp may get "Comparison method violates its general contract" exception

2016-05-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282126#comment-15282126 ] Yongjun Zhang commented on HDFS-10396: -- I have a fix but need to write a unit test fo

[jira] [Commented] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283184#comment-15283184 ] Yongjun Zhang commented on HDFS-10397: -- Hi [~liuml07], Thanks for the patch. I did a

[jira] [Commented] (HDFS-10220) A large number of expired leases can make namenode unresponsive and cause failover

2016-05-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283237#comment-15283237 ] Yongjun Zhang commented on HDFS-10220: -- I happen to see this jira now. Hi [~daryn],

[jira] [Commented] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283787#comment-15283787 ] Yongjun Zhang commented on HDFS-10397: -- Hi [~liuml07], I think it's a very good idea

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-05-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284168#comment-15284168 ] Yongjun Zhang commented on HDFS-9732: - HI [~steve_l], now we have Allen's agreement. Wo

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-05-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284924#comment-15284924 ] Yongjun Zhang commented on HDFS-9732: - Thank you all [~steve_l], [~cnauroth] and [~aw].

[jira] [Updated] (HDFS-9732) Improve DelegationTokenIdentifier.toString() —for better logging

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9732: Summary: Improve DelegationTokenIdentifier.toString() —for better logging (was: Remove DelegationTok

[jira] [Updated] (HDFS-9732) Improve DelegationTokenIdentifier.toString() —for better logging

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9732: Target Version/s: (was: ) Labels: supportability (was: ) > Improve DelegationTokenId

[jira] [Updated] (HDFS-9732) Improve DelegationTokenIdentifier.toString() for better logging

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9732: Summary: Improve DelegationTokenIdentifier.toString() for better logging (was: Improve DelegationTok

[jira] [Commented] (HDFS-9732) Improve DelegationTokenIdentifier.toString() for better logging

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15287588#comment-15287588 ] Yongjun Zhang commented on HDFS-9732: - Thanks [~steve_l], [~cnauroth] and [~aw] again!

[jira] [Updated] (HDFS-9732) Improve DelegationTokenIdentifier.toString() for better logging

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9732: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1 Status: Re

[jira] [Commented] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15287730#comment-15287730 ] Yongjun Zhang commented on HDFS-10381: -- Hi [~jzhuge], Thanks for reporting and worki

[jira] [Commented] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15287744#comment-15287744 ] Yongjun Zhang commented on HDFS-10397: -- Sorry for the delayed response [~liuml07], +1

[jira] [Updated] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10381: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolv

[jira] [Commented] (HDFS-7597) DNs should not open new NN connections when webhdfs clients seek

2016-05-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15297236#comment-15297236 ] Yongjun Zhang commented on HDFS-7597: - HI [~daryn], [~cnauroth] and [~xiaobingo], Than

[jira] [Assigned] (HDFS-6937) Another issue in handling checksum errors in write pipeline

2016-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-6937: --- Assignee: Yongjun Zhang (was: Colin Patrick McCabe) > Another issue in handling checksum erro

[jira] [Commented] (HDFS-6937) Another issue in handling checksum errors in write pipeline

2016-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15301723#comment-15301723 ] Yongjun Zhang commented on HDFS-6937: - I'm proposing a simplified solution here: Inste

<    5   6   7   8   9   10   11   12   13   14   >