[jira] [Updated] (HDFS-6708) StorageType should be encoded in the block token

2017-04-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6708: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) I c

[jira] [Commented] (HDFS-11697) Javadoc of erasure coding policy in file status

2017-04-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984293#comment-15984293 ] Hadoop QA commented on HDFS-11697: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11697) Javadoc of erasure coding policy in file status

2017-04-26 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984330#comment-15984330 ] Akira Ajisaka commented on HDFS-11697: -- LGTM, +1. > Javadoc of erasure coding policy

[jira] [Commented] (HDFS-6708) StorageType should be encoded in the block token

2017-04-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984334#comment-15984334 ] Hudson commented on HDFS-6708: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1163

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-04-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984356#comment-15984356 ] Yiqun Lin commented on HDFS-11580: -- Thanks [~vagarychen], [~msingh] for the quick review!

[jira] [Updated] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-04-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11580: - Attachment: HDFS-11580-HDFS-7240.005.patch > Ozone: Support asynchronus client API for SCM and containers

[jira] [Commented] (HDFS-11417) Add datanode admin command to get the storage info.

2017-04-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984361#comment-15984361 ] Surendra Singh Lilhore commented on HDFS-11417: --- Thanks [~ajisakaa] for revi

[jira] [Comment Edited] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-04-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984356#comment-15984356 ] Yiqun Lin edited comment on HDFS-11580 at 4/26/17 8:31 AM: --- Than

[jira] [Commented] (HDFS-11373) Backport HDFS-11258 and HDFS-11272 to branch-2.7

2017-04-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984437#comment-15984437 ] Hadoop QA commented on HDFS-11373: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11417) Add datanode admin command to get the storage info.

2017-04-26 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11417: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11417) Add datanode admin command to get the storage info.

2017-04-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984468#comment-15984468 ] Hudson commented on HDFS-11417: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-11697) Javadoc of erasure coding policy in file status

2017-04-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984473#comment-15984473 ] Hadoop QA commented on HDFS-11697: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-04-26 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984602#comment-15984602 ] Takanobu Asanuma commented on HDFS-10999: - *LowRedundancyBlocks.java:* Looks like

[jira] [Comment Edited] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-04-26 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984602#comment-15984602 ] Takanobu Asanuma edited comment on HDFS-10999 at 4/26/17 11:20 AM: -

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-04-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984615#comment-15984615 ] Hadoop QA commented on HDFS-11580: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11373) Backport HDFS-11258 and HDFS-11272 to branch-2.7

2017-04-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984621#comment-15984621 ] Hadoop QA commented on HDFS-11373: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11703) [READ] Tests for ProvidedStorageMap

2017-04-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984625#comment-15984625 ] Hadoop QA commented on HDFS-11703: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11605) Allow user to customize and add new erasure code codecs and policies

2017-04-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984644#comment-15984644 ] Hadoop QA commented on HDFS-11605: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-11705) BUG: Inconsistent storagespace for directory

2017-04-26 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11705: -- Summary: BUG: Inconsistent storagespace for directory Key: HDFS-11705 URL: https://issues.apache.org/jira/browse/HDFS-11705 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-11705) BUG: Inconsistent storagespace for directory

2017-04-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11705: --- Description: I was running a a test TestRenameWithSnapshots.testDu, and found several errors

[jira] [Commented] (HDFS-11705) BUG: Inconsistent storagespace for directory

2017-04-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984705#comment-15984705 ] Wei-Chiu Chuang commented on HDFS-11705: I think it is related to HDFS-10797. > B

[jira] [Updated] (HDFS-11705) BUG: Inconsistent storagespace for directory

2017-04-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11705: --- Affects Version/s: (was: 2.8.0) > BUG: Inconsistent storagespace for directory > -

[jira] [Updated] (HDFS-11705) BUG: Inconsistent storagespace for directory

2017-04-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11705: --- Affects Version/s: 2.8.0 > BUG: Inconsistent storagespace for directory >

[jira] [Commented] (HDFS-11705) BUG: Inconsistent storagespace for directory

2017-04-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984737#comment-15984737 ] Wei-Chiu Chuang commented on HDFS-11705: This issue still persists even after reve

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-04-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984824#comment-15984824 ] Kihwal Lee commented on HDFS-5042: -- bq. Can we recover this kind of block from namenode af

[jira] [Commented] (HDFS-11705) BUG: Inconsistent storagespace for directory

2017-04-26 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984868#comment-15984868 ] Daryn Sharp commented on HDFS-11705: Since the revert of HDFS-10797, I started working

[jira] [Commented] (HDFS-11373) Backport HDFS-11258 and HDFS-11272 to branch-2.7

2017-04-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984912#comment-15984912 ] Brahma Reddy Battula commented on HDFS-11373: - {{TestFailures}},{{whitespaces}

[jira] [Created] (HDFS-11706) Enable fallback to regular distcp when distcp failed with snapshot diff

2017-04-26 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-11706: Summary: Enable fallback to regular distcp when distcp failed with snapshot diff Key: HDFS-11706 URL: https://issues.apache.org/jira/browse/HDFS-11706 Project: Hadoop

[jira] [Created] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

2017-04-26 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-11707: -- Summary: TestDirectoryScanner#testThrottling fails on OSX Key: HDFS-11707 URL: https://issues.apache.org/jira/browse/HDFS-11707 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8873) Allow the directoryScanner to be rate-limited

2017-04-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-8873: -- Attachment: HDFS-8873-branch-2.7.009.patch I've noticed the new {{TestDirectoryScanner#testThrottling}} f

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985152#comment-15985152 ] Zhe Zhang commented on HDFS-11384: -- {{TestBalancerWithSaslDataTransfer}} fails on my loca

[jira] [Comment Edited] (HDFS-8873) Allow the directoryScanner to be rate-limited

2017-04-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985134#comment-15985134 ] Erik Krogen edited comment on HDFS-8873 at 4/26/17 5:05 PM: I'v

[jira] [Commented] (HDFS-11627) Block Storage: Cblock cache should register with flusher to upload blocks to containers

2017-04-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985233#comment-15985233 ] Chen Liang commented on HDFS-11627: --- The failed tests are unrelated, committed to featur

[jira] [Reopened] (HDFS-8872) Reporting of missing blocks is different in fsck and namenode ui/metasave

2017-04-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-8872: - > Reporting of missing blocks is different in fsck and namenode ui/metasave > -

[jira] [Resolved] (HDFS-8872) Reporting of missing blocks is different in fsck and namenode ui/metasave

2017-04-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8872. - Resolution: Duplicate > Reporting of missing blocks is different in fsck and namenode ui/metasave > ---

[jira] [Commented] (HDFS-8872) Reporting of missing blocks is different in fsck and namenode ui/metasave

2017-04-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985295#comment-15985295 ] Zhe Zhang commented on HDFS-8872: - Linked HDFS-10495. > Reporting of missing blocks is dif

[jira] [Commented] (HDFS-7933) fsck should also report decommissioning replicas.

2017-04-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985310#comment-15985310 ] Zhe Zhang commented on HDFS-7933: - [~brahmareddy] Sorry missed your question. You are right

[jira] [Assigned] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-04-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-11661: -- Assignee: Wei-Chiu Chuang > GetContentSummary uses excessive amounts of memory > --

[jira] [Updated] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-04-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11661: --- Attachment: HDFS-11661.001.patch Here's my proof of concept fix to eliminate includedNodes whi

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-04-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985431#comment-15985431 ] Surendra Singh Lilhore commented on HDFS-5042: -- Thanks [~kihwal]. In my case b

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Attachment: HDFS-11384.010.patch * New version. It fixes {{TestBalancerWithSaslDataTra

[jira] [Commented] (HDFS-11417) Add datanode admin command to get the storage info.

2017-04-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985442#comment-15985442 ] Surendra Singh Lilhore commented on HDFS-11417: --- Thanks [~ajisakaa] for revi

[jira] [Commented] (HDFS-10495) Block should be marked as missing if the all the replicas are on Decommissioned nodes.

2017-04-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985457#comment-15985457 ] Kihwal Lee commented on HDFS-10495: --- I've analyzed this and discussed potential solution

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-04-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985460#comment-15985460 ] Kihwal Lee commented on HDFS-5042: -- We've seen that too. Unless there is other bug in Hado

[jira] [Commented] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

2017-04-26 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985482#comment-15985482 ] Kuhu Shukla commented on HDFS-10788: [~jojochuang], Thank you for the the update on th

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985527#comment-15985527 ] Zhe Zhang commented on HDFS-11384: -- Thanks [~shv]. Latest patch LGTM. +1 pending Jenkins.

[jira] [Commented] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

2017-04-26 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985605#comment-15985605 ] Andras Bokor commented on HDFS-11707: - I cannot reproduce with the same OS version. Do

[jira] [Commented] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

2017-04-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985610#comment-15985610 ] Erik Krogen commented on HDFS-11707: Thanks for looking, [~boky01]. Yes, consistently

[jira] [Commented] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

2017-04-26 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985626#comment-15985626 ] Andras Bokor commented on HDFS-11707: - 2.5 GHz Intel Core i7 OS X 10.11.3 {code}mvn c

[jira] [Commented] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

2017-04-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985669#comment-15985669 ] Wei-Chiu Chuang commented on HDFS-10788: Sorry for the confusion. CDH5.4 and above

[jira] [Comment Edited] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

2017-04-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985669#comment-15985669 ] Wei-Chiu Chuang edited comment on HDFS-10788 at 4/26/17 10:38 PM: --

[jira] [Updated] (HDFS-10455) Logging the username when deny the setOwner operation

2017-04-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10455: - Target Version/s: 3.0.0-alpha2, 2.8.0 (was: 2.8.0, 3.0.0-alpha2) Fix Version/s: 2.7.4 This looks l

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985763#comment-15985763 ] Hadoop QA commented on HDFS-11384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-04-26 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982436#comment-15982436 ] Uma Maheswara Rao G edited comment on HDFS-11695 at 4/27/17 12:27 AM: --

[jira] [Commented] (HDFS-11284) [SPS]: fix issue of moving blocks with satisfier while changing replication factor

2017-04-26 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985805#comment-15985805 ] Uma Maheswara Rao G commented on HDFS-11284: [~yuanbo] we may need to edit the

[jira] [Updated] (HDFS-11605) Allow user to customize and add new erasure code codecs and policies

2017-04-26 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-11605: Attachment: HDFS-11605.005.patch > Allow user to customize and add new erasure code codecs and polic

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Target Version/s: 2.7.4 Status: Open (was: Patch Available) > Add optio

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Attachment: HDFS-11384.011.patch Latest patch added Javadoc to TestBalancerRPCDelay, a

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Attachment: HDFS-11384-branch-2.8.011.patch > Add option for balancer to disperse getB

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Status: Patch Available (was: Open) > Add option for balancer to disperse getBlocks c

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Attachment: HDFS-11384-branch-2.7.011.patch > Add option for balancer to disperse getB

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985885#comment-15985885 ] Hadoop QA commented on HDFS-11384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985898#comment-15985898 ] Hudson commented on HDFS-11384: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-6708) StorageType should be encoded in the block token

2017-04-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985906#comment-15985906 ] Chris Douglas commented on HDFS-6708: - Forgot to mention that I ran Yetus and the HDFS

[jira] [Updated] (HDFS-11627) Block Storage: Cblock cache should register with flusher to upload blocks to containers

2017-04-26 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11627: - Resolution: Fixed Status: Resolved (was: Patch Available) > Block Storage: Cblock

[jira] [Commented] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-04-26 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985973#comment-15985973 ] Yuanbo Liu commented on HDFS-11695: --- Thanks for pinging me, sure, I will take a look. >

[jira] [Created] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-04-26 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-11708: Summary: positional read will fail if replicas moved to different DNs after stream is opened Key: HDFS-11708 URL: https://issues.apache.org/jira/browse/HDFS-11708 Pro

[jira] [Created] (HDFS-11709) StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully

2017-04-26 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-11709: Summary: StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully Key: HDFS-11709 URL: https://issues.apache.org/jira/browse/HDFS-11709 Project: Hadoop

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15986048#comment-15986048 ] Hadoop QA commented on HDFS-11384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11605) Allow user to customize and add new erasure code codecs and policies

2017-04-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15986069#comment-15986069 ] Hadoop QA commented on HDFS-11605: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-04-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11708: - Attachment: HDFS-11708-01.patch Patch for trunk > positional read will fail if replicas moved to

[jira] [Updated] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-04-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11708: - Status: Patch Available (was: Open) > positional read will fail if replicas moved to different DN

[jira] [Updated] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-04-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11708: - Description: Scenario: 1. File was written to DN1, DN2 with RF=2 2. File stream opened to read and