[jira] [Resolved] (HDFS-4925) TestQuorumJournalManager.testPurgeLogs intermittently Fails assertNoThreadsMatching

2016-02-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA resolved HDFS-4925. - Resolution: Duplicate Fix Version/s: (was: 2.6.5) (was: 2.7.3)

[jira] [Commented] (HDFS-4925) TestQuorumJournalManager.testPurgeLogs intermittently Fails assertNoThreadsMatching

2016-02-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140461#comment-15140461 ] Akira AJISAKA commented on HDFS-4925: - Thanks [~jojochuang] for fixing the test. I'll r

[jira] [Reopened] (HDFS-4925) TestQuorumJournalManager.testPurgeLogs intermittently Fails assertNoThreadsMatching

2016-02-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA reopened HDFS-4925: - > TestQuorumJournalManager.testPurgeLogs intermittently Fails > assertNoThreadsMatching >

[jira] [Resolved] (HDFS-4925) TestQuorumJournalManager.testPurgeLogs intermittently Fails assertNoThreadsMatching

2016-02-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-4925. --- Resolution: Fixed Fix Version/s: 2.6.5 2.7.3 2.8.0

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140396#comment-15140396 ] Guocui Mi commented on HDFS-9787: - Agree with you on this, should create one new workitem f

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140384#comment-15140384 ] Jesse Yates commented on HDFS-9787: --- The original solution was an attempting to catch the

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140372#comment-15140372 ] Guocui Mi commented on HDFS-9787: - lastCheckpointTime is also used to check if it is necess

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140367#comment-15140367 ] Guocui Mi commented on HDFS-9787: - >>> this would imply that the non-primary SNN never send

[jira] [Updated] (HDFS-9637) Add test for HADOOP-12702 and HADOOP-12759

2016-02-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9637: --- Attachment: HDFS-9637.006.patch Here's one more little update. I noticed some formatting that

[jira] [Commented] (HDFS-9780) RollingFileSystemSink doesn't work on secure clusters

2016-02-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140277#comment-15140277 ] Karthik Kambatla commented on HDFS-9780: Quickly skimmed through the patch. Do we

[jira] [Updated] (HDFS-9780) RollingFileSystemSink doesn't work on secure clusters

2016-02-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HDFS-9780: --- Status: Open (was: Patch Available) Canceling patch until HDFS-9637 gets committed. > Rollin

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140258#comment-15140258 ] Hadoop QA commented on HDFS-9787: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9637) Add test for HADOOP-12702 and HADOOP-12759

2016-02-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140252#comment-15140252 ] Karthik Kambatla commented on HDFS-9637: Looks good. +1. Will check this in tomorro

[jira] [Commented] (HDFS-9637) Add test for HADOOP-12702 and HADOOP-12759

2016-02-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140247#comment-15140247 ] Hadoop QA commented on HDFS-9637: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9703) DiskBalancer : getBandwidth implementation

2016-02-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9703: --- Attachment: HDFS-9703-HDFS-1312.001.patch > DiskBalancer : getBandwidth implementation > --

[jira] [Updated] (HDFS-9703) DiskBalancer : getBandwidth implementation

2016-02-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9703: --- Attachment: (was: HDFS-9703-HDFS-1312.001.patch) > DiskBalancer : getBandwidth implementation > ---

[jira] [Commented] (HDFS-9779) TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value

2016-02-09 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140221#comment-15140221 ] Kuhu Shukla commented on HDFS-9779: --- Thank you Uma! > TestReplicationPolicyWithNodeGroup

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140220#comment-15140220 ] Inigo Goiri commented on HDFS-9787: --- My bad, this is right. We will test resetting the {{

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140218#comment-15140218 ] Inigo Goiri commented on HDFS-9787: --- Now that I see this, can it be the problem that we d

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-02-09 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140195#comment-15140195 ] Larry McCay commented on HDFS-9711: --- Hi [~cnauroth] - Looks great! The effort to add a f

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140176#comment-15140176 ] Jesse Yates commented on HDFS-9787: --- I don't think you need a new variable - lastCheckpoi

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140175#comment-15140175 ] Jesse Yates commented on HDFS-9787: --- Taking a quick look, this would imply that the non-p

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9787: -- Status: Patch Available (was: Open) > SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer chan

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140162#comment-15140162 ] Inigo Goiri commented on HDFS-9787: --- Thanks! > SNNs stop uploading FSImage to ANN once i

[jira] [Updated] (HDFS-9637) Add test for HADOOP-12702 and HADOOP-12759

2016-02-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9637: --- Attachment: HDFS-9637.005.patch Huh. Good point, [~kasha]. At one time there was a reason for

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9787: Attachment: HDFS-9786-v000.patch check last upload time instead of last check point time. > SNNs stop upload

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9787: Description: SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer become false. Here is the logic t

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140148#comment-15140148 ] Jesse Yates commented on HDFS-9787: --- I think I'll have some time tomorrow - adding it to

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140146#comment-15140146 ] Inigo Goiri commented on HDFS-9787: --- [~jesse_yates], do you mind taking a look at this?

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9787: Status: Open (was: Patch Available) > SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9787: Assignee: Guocui Mi Status: Patch Available (was: Open) check time since last upload instead of time s

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9787: -- Affects Version/s: (was: 2.6.2) 3.0.0 > SNNs stop uploading FSImage to ANN onc

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-02-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140135#comment-15140135 ] Chris Nauroth commented on HDFS-9711: - The last round of JDK 8 test failures are unrela

[jira] [Commented] (HDFS-9637) Add test for HADOOP-12702 and HADOOP-12759

2016-02-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140132#comment-15140132 ] Karthik Kambatla commented on HDFS-9637: Reviewing the tests here, following up fro

[jira] [Created] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-09 Thread Guocui Mi (JIRA)
Guocui Mi created HDFS-9787: --- Summary: SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false. Key: HDFS-9787 URL: https://issues.apache.org/jira/browse/HDFS-9787 Project: Hadoop HDF

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-02-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140056#comment-15140056 ] Hadoop QA commented on HDFS-9711: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9779) TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value

2016-02-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140030#comment-15140030 ] Hudson commented on HDFS-9779: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9271 (See [https:

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-02-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139998#comment-15139998 ] Uma Maheswara Rao G commented on HDFS-7955: --- Thanks [~rakeshr] for the work. I th

[jira] [Updated] (HDFS-9779) TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value

2016-02-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-9779: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Statu

[jira] [Commented] (HDFS-9775) Erasure Coding : Rename BlockRecoveryWork to BlockReconstructionWork

2016-02-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139971#comment-15139971 ] Hudson commented on HDFS-9775: -- FAILURE: Integrated in Hadoop-trunk-Commit #9270 (See [https:

[jira] [Updated] (HDFS-9702) DiskBalancer : getVolumeMap implementation

2016-02-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9702: --- Attachment: HDFS-9702-HDFS-1312.001.patch > DiskBalancer : getVolumeMap implementation > --

[jira] [Created] (HDFS-9786) HttpFS doesn't write the proxyuser information in logfile

2016-02-09 Thread HeeSoo Kim (JIRA)
HeeSoo Kim created HDFS-9786: Summary: HttpFS doesn't write the proxyuser information in logfile Key: HDFS-9786 URL: https://issues.apache.org/jira/browse/HDFS-9786 Project: Hadoop HDFS Issue Typ

[jira] [Updated] (HDFS-9702) DiskBalancer : getVolumeMap implementation

2016-02-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9702: --- Attachment: (was: HDFS-9702-HDFS-1312.001.patch) > DiskBalancer : getVolumeMap implementation > ---

[jira] [Updated] (HDFS-9775) Erasure Coding : Rename BlockRecoveryWork to BlockReconstructionWork

2016-02-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9775: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was: P

[jira] [Commented] (HDFS-9775) Erasure Coding : Rename BlockRecoveryWork to BlockReconstructionWork

2016-02-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139925#comment-15139925 ] Zhe Zhang commented on HDFS-9775: - +1 on the patch. I just committed it to trunk. Thanks Ra

[jira] [Commented] (HDFS-9760) WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler

2016-02-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139896#comment-15139896 ] Hudson commented on HDFS-9760: -- FAILURE: Integrated in Hadoop-trunk-Commit #9269 (See [https:

[jira] [Updated] (HDFS-9760) WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler

2016-02-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-9760: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available

[jira] [Updated] (HDFS-9311) Support optional offload of NameNode HA service health checks to a separate RPC server.

2016-02-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9311: Release Note: There is now support for offloading HA health check RPC activity to a separate RPC serv

[jira] [Updated] (HDFS-9683) DiskBalancer : Add cancelPlan implementation

2016-02-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9683: --- Attachment: HDFS-9683-HDFS-1312.001.patch > DiskBalancer : Add cancelPlan implementation >

[jira] [Updated] (HDFS-9683) DiskBalancer : Add cancelPlan implementation

2016-02-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9683: --- Attachment: (was: HDFS-9683-HDFS-1312.001.patch) > DiskBalancer : Add cancelPlan implementation > -

[jira] [Updated] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-02-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9711: Attachment: HDFS-9711.003.patch Here is patch v003. I updated this in response HADOOP-12758, where [

[jira] [Commented] (HDFS-9785) Remove unused TrashPolicy#getInstance and initiate code

2016-02-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139667#comment-15139667 ] Zhe Zhang commented on HDFS-9785: - Actually {{TrashPolicy}} could be directly used by appli

[jira] [Updated] (HDFS-9785) Remove unused TrashPolicy#getInstance and initiate code

2016-02-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9785: Labels: incompatibleChange (was: ) > Remove unused TrashPolicy#getInstance and initiate code > -

[jira] [Updated] (HDFS-9785) Remove unused TrashPolicy#getInstance and initiate code

2016-02-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9785: Target Version/s: 3.0.0 (was: 2.8.0) > Remove unused TrashPolicy#getInstance and initiate code > ---

[jira] [Updated] (HDFS-9785) Remove unused TrashPolicy#getInstance and initiate code

2016-02-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9785: Description: A follow-on from HDFS-8831: now the {{getInstance}} and {{initiate}} APIs with Path is not used

[jira] [Updated] (HDFS-9785) Remove unused TrashPolicy#getInstance and initiate code

2016-02-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9785: Summary: Remove unused TrashPolicy#getInstance and initiate code (was: Remove unused TrashPolicy#getInstance

[jira] [Created] (HDFS-9785) Remove unused TrashPolicy#getInstance code

2016-02-09 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-9785: --- Summary: Remove unused TrashPolicy#getInstance code Key: HDFS-9785 URL: https://issues.apache.org/jira/browse/HDFS-9785 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-9784) Example usage is not correct in Transparent Encryption document

2016-02-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139402#comment-15139402 ] Hudson commented on HDFS-9784: -- FAILURE: Integrated in Hadoop-trunk-Commit #9268 (See [https:

[jira] [Updated] (HDFS-9752) Permanent write failures may happen to slow writers during datanode rolling upgrades

2016-02-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9752: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.6.5 2.7.3

[jira] [Commented] (HDFS-9752) Permanent write failures may happen to slow writers during datanode rolling upgrades

2016-02-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139393#comment-15139393 ] Akira AJISAKA commented on HDFS-9752: - +1 for the branch-2.7 patch. I'll commit it shor

[jira] [Comment Edited] (HDFS-9784) Example usage is not correct in Transparent Encryption document

2016-02-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139378#comment-15139378 ] Akira AJISAKA edited comment on HDFS-9784 at 2/9/16 6:43 PM: - F

[jira] [Commented] (HDFS-9784) Example usage is not correct in Transparent Encryption document

2016-02-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139378#comment-15139378 ] Akira AJISAKA commented on HDFS-9784: - Filed HADOOP-12876 for documenting "hadoop key"

[jira] [Updated] (HDFS-9784) Example usage is not correct in Transparent Encryption document

2016-02-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9784: Assignee: Takashi Ohnishi > Example usage is not correct in Transparent Encryption document > ---

[jira] [Updated] (HDFS-9784) Example usage is not correct in Transparent Encryption document

2016-02-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9784: Resolution: Fixed Fix Version/s: 2.7.3 2.8.0 Status: Resolved (w

[jira] [Updated] (HDFS-9784) Example usage is not correct in Transparent Encryption document

2016-02-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9784: Hadoop Flags: Reviewed Summary: Example usage is not correct in Transparent Encryption docum

[jira] [Moved] (HDFS-9784) Example usage is not correct in "Transparent Encryption in HDFS" document.

2016-02-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA moved HADOOP-12779 to HDFS-9784: -- Affects Version/s: (was: 2.7.2) (was: 3.0.

[jira] [Commented] (HDFS-8959) Provide an iterator-based API for listing all the snapshottable directories

2016-02-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139311#comment-15139311 ] Rakesh R commented on HDFS-8959: I've rebased the patch in the latest trunk code. I'm plann

[jira] [Commented] (HDFS-9752) Permanent write failures may happen to slow writers during datanode rolling upgrades

2016-02-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139280#comment-15139280 ] Arpit Agarwal commented on HDFS-9752: - +1 for the branch-2.6 patch. I committed it to b

[jira] [Resolved] (HDFS-8701) WebHDFS write commands fail when running multiple DataNodes on one machine

2016-02-09 Thread Anthony Hsu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Hsu resolved HDFS-8701. --- Resolution: Cannot Reproduce > WebHDFS write commands fail when running multiple DataNodes on one machi

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-02-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9781: -- Description: FsDatasetImpl#getBlockReports occasionally throws NPE. The NPE caused TestFsDataset

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-02-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139140#comment-15139140 ] Wei-Chiu Chuang commented on HDFS-9781: --- This is related to HDFS-9701, which created

[jira] [Resolved] (HDFS-9783) DataNode deadlocks after running hdfs mover

2016-02-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HDFS-9783. - Resolution: Duplicate Resolving as duplicate. Feel free to re-open if fix in HDFS-9661 doesnt work

[jira] [Commented] (HDFS-9783) DataNode deadlocks after running hdfs mover

2016-02-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139135#comment-15139135 ] Vinayakumar B commented on HDFS-9783: - This issue has been already fixed in HDFS-9661 w

[jira] [Commented] (HDFS-9637) Add test for HADOOP-12702 and HADOOP-12759

2016-02-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139120#comment-15139120 ] Daniel Templeton commented on HDFS-9637: Test failures are unrelated. > Add test f

[jira] [Updated] (HDFS-9783) DataNode deadlocks after running hdfs mover

2016-02-09 Thread David Watzke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Watzke updated HDFS-9783: --- Description: We're running CDH 5.4.4 (with Hadoop 2.6.0). Recently we've added 800T of ARCHIVE storage

[jira] [Updated] (HDFS-9783) DataNode deadlocks after running hdfs mover

2016-02-09 Thread David Watzke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Watzke updated HDFS-9783: --- Description: We're running CDH 5.4.4 (with Hadoop 2.6.0). Recently we've added 800T of ARCHIVE storage

[jira] [Updated] (HDFS-9783) DataNode deadlocks after running hdfs mover

2016-02-09 Thread David Watzke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Watzke updated HDFS-9783: --- Attachment: datanode.stack.txt deadlock revealed by jstack > DataNode deadlocks after running hdfs mov

[jira] [Created] (HDFS-9783) DataNode deadlocks after running hdfs mover

2016-02-09 Thread David Watzke (JIRA)
David Watzke created HDFS-9783: -- Summary: DataNode deadlocks after running hdfs mover Key: HDFS-9783 URL: https://issues.apache.org/jira/browse/HDFS-9783 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-09 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139027#comment-15139027 ] Kuhu Shukla commented on HDFS-9395: --- Thank you Vinayakumar. While making this change I al

[jira] [Commented] (HDFS-9637) Add test for HADOOP-12702 and HADOOP-12759

2016-02-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138924#comment-15138924 ] Hadoop QA commented on HDFS-9637: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8959) Provide an iterator-based API for listing all the snapshottable directories

2016-02-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138869#comment-15138869 ] Hadoop QA commented on HDFS-8959: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-02-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138779#comment-15138779 ] Hadoop QA commented on HDFS-9579: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9637) Add test for HADOOP-12702 and HADOOP-12759

2016-02-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9637: --- Attachment: HDFS-9637.004.patch Reposting patch 4 as it wasn't the current code. > Add test fo

[jira] [Updated] (HDFS-9637) Add test for HADOOP-12702 and HADOOP-12759

2016-02-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9637: --- Attachment: (was: HDFS-9637.004.patch) > Add test for HADOOP-12702 and HADOOP-12759 > -

[jira] [Commented] (HDFS-9780) RollingFileSystemSink doesn't work on secure clusters

2016-02-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138646#comment-15138646 ] Daniel Templeton commented on HDFS-9780: HDFS-9782 has been created to make the int

[jira] [Updated] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-02-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9782: --- Attachment: HDFS-9782.001.patch Here's an initial sketch of the plan. > RollingFileSystemSink

[jira] [Updated] (HDFS-8959) Provide an iterator-based API for listing all the snapshottable directories

2016-02-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8959: --- Attachment: HDFS-8959-02.patch > Provide an iterator-based API for listing all the snapshottable directories >

[jira] [Commented] (HDFS-9637) Add test for HADOOP-12702 and HADOOP-12759

2016-02-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138523#comment-15138523 ] Hadoop QA commented on HDFS-9637: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||