[jira] [Updated] (HDFS-12422) Replace DataNode in Pipeline for Last Packet

2017-09-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12422: -- Labels: hdfs (was: ) Status: Patch Available (was: In Progress) > Replace DataNode in Pipe

[jira] [Commented] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162018#comment-16162018 ] Anu Engineer commented on HDFS-11772: - [~msingh]/ [~linyiqun] Can any of you please co

[jira] [Work started] (HDFS-12422) Replace DataNode in Pipeline for Last Packet

2017-09-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12422 started by Lukas Majercak. - > Replace DataNode in Pipeline for Last Packet > --

[jira] [Updated] (HDFS-12422) Replace DataNode in Pipeline for Last Packet

2017-09-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12422: -- Attachment: HDFS-12422.001.patch > Replace DataNode in Pipeline for Last Packet > --

[jira] [Assigned] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-12420: Assignee: (was: Ajay Kumar) Hadoop Flags: Incompatible change > Disable Namenod

[jira] [Assigned] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar reassigned HDFS-12420: - Assignee: Ajay Kumar > Disable Namenode format when data already exist >

[jira] [Updated] (HDFS-11921) Ozone: KSM: Unable to put keys with zero length

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11921: Labels: OzonePostMerge (was: ozoneMerge) > Ozone: KSM: Unable to put keys with zero length > --

[jira] [Updated] (HDFS-11948) Ozone: change TestRatisManager to check cluster with data

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11948: Labels: OzonePostMerge (was: ozoneMerge) > Ozone: change TestRatisManager to check cluster with dat

[jira] [Created] (HDFS-12422) Replace DataNode in Pipeline for Last Packet

2017-09-11 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-12422: - Summary: Replace DataNode in Pipeline for Last Packet Key: HDFS-12422 URL: https://issues.apache.org/jira/browse/HDFS-12422 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-12003) Ozone: Misc : Cleanup error messages

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12003: Labels: OzonePostMerge (was: ozoneMerge) > Ozone: Misc : Cleanup error messages > -

[jira] [Resolved] (HDFS-11982) Add markdown documentation about Ozone

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-11982. - Resolution: Later > Add markdown documentation about Ozone > -

[jira] [Updated] (HDFS-11991) Ozone: Ozone shell: the root is assumed to hdfs

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11991: Labels: OzonePostMerge (was: ozoneMerge) > Ozone: Ozone shell: the root is assumed to hdfs > --

[jira] [Updated] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12420: -- Summary: Disable Namenode format when data already exist (was: Improve error message on Namenode format

[jira] [Assigned] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar reassigned HDFS-12420: - Assignee: (was: Ajay Kumar) > Disable Namenode format when data already exist > -

[jira] [Updated] (HDFS-12303) Change default EC cell size to 1MB for better performance

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12303: --- Release Note: The cell size of the provided HDFS erasure coding policies has been changed from 64k to

[jira] [Updated] (HDFS-12020) Ozone: Misc: Explore if the default memory settings are correct

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12020: Labels: OzonePostMerge (was: ozoneMerge) > Ozone: Misc: Explore if the default memory settings are

[jira] [Commented] (HDFS-12060) Ozone: OzoneClient: Add list calls

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161999#comment-16161999 ] Anu Engineer commented on HDFS-12060: - [~nandakumar131] Can you please update this JIR

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161994#comment-16161994 ] Anu Engineer commented on HDFS-12098: - @weiwei yang, I was talking to [~vagarychen] of

[jira] [Updated] (HDFS-12100) Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12100: Labels: OzonePostMerge (was: ozoneMerge) > Ozone: KSM: Allocate key should honour volume quota if q

[jira] [Commented] (HDFS-12205) Ozone: List Key on an empty ozone bucket fails with command failed error

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161991#comment-16161991 ] Anu Engineer commented on HDFS-12205: - [~ljain] Can you please confirm that this is st

[jira] [Updated] (HDFS-12256) Ozone : handle inactive containers on DataNode

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12256: Labels: ozoneMerge tocheck (was: ozoneMerge) > Ozone : handle inactive containers on DataNode > ---

[jira] [Resolved] (HDFS-12252) Ozone: SCM: Container State Machine -1- Track container creation state in SCM

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-12252. - Resolution: Duplicate > Ozone: SCM: Container State Machine -1- Track container creation state in

[jira] [Updated] (HDFS-12265) Ozone : better handling of operation fail due to chill mode

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12265: Labels: OzonePostMerge (was: ozoneMerge) > Ozone : better handling of operation fail due to chill m

[jira] [Resolved] (HDFS-12239) Ozone: OzoneClient : Remove createContainer handling from client

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-12239. - Resolution: Duplicate > Ozone: OzoneClient : Remove createContainer handling from client > ---

[jira] [Updated] (HDFS-12213) Ozone: Corona: Support for online mode

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12213: Labels: OzonePostMerge tool (was: ozoneMerge tool) > Ozone: Corona: Support for online mode > -

[jira] [Updated] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12328: Priority: Critical (was: Major) > Ozone: Purge metadata of deleted blocks after max retry times > -

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12321: Labels: OzonePostMerge (was: ozoneMerge) > Ozone : debug cli: add support to load user-provided SQL

[jira] [Updated] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12328: Labels: OzonePostMerge (was: ozoneMerge) > Ozone: Purge metadata of deleted blocks after max retry

[jira] [Updated] (HDFS-12329) Ozone: Ratis: Readonly calls in XceiverClientRatis should use sendReadOnly

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12329: Labels: OzonePostMerge (was: ozoneMerge) > Ozone: Ratis: Readonly calls in XceiverClientRatis shoul

[jira] [Updated] (HDFS-12331) Ozone: Mini cluster can't start up on Windows after HDFS-12159

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12331: Labels: OzonePostMerge tocheck (was: ozoneMerge) > Ozone: Mini cluster can't start up on Windows af

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161971#comment-16161971 ] Andrew Wang commented on HDFS-11096: Hi Sean, thanks for going through all these. I ag

[jira] [Updated] (HDFS-12338) Ozone: SCM: clean up containers that timeout during creation

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12338: Labels: OzonePostMerge (was: ozoneMerge) > Ozone: SCM: clean up containers that timeout during crea

[jira] [Updated] (HDFS-12338) Ozone: SCM: clean up containers that timeout during creation

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12338: Priority: Critical (was: Major) > Ozone: SCM: clean up containers that timeout during creation > --

[jira] [Updated] (HDFS-12421) Balancer to emit standard metrics

2017-09-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-12421: - Component/s: metrics > Balancer to emit standard metrics > - > >

[jira] [Comment Edited] (HDFS-12410) Ignore unknown StorageTypes

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161939#comment-16161939 ] Anu Engineer edited comment on HDFS-12410 at 9/11/17 8:33 PM: --

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161940#comment-16161940 ] Chris Douglas commented on HDFS-11600: -- bq. The proliferation of test classes still s

[jira] [Commented] (HDFS-12410) Ignore unknown StorageTypes

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161939#comment-16161939 ] Anu Engineer commented on HDFS-12410: - [~chris.douglas] and [~elgoiri] Ignoring and lo

[jira] [Issue Comment Deleted] (HDFS-12410) Ignore unknown StorageTypes

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12410: Comment: was deleted (was: [~chris.douglas] and [~goiri]) > Ignore unknown StorageTypes > -

[jira] [Commented] (HDFS-12410) Ignore unknown StorageTypes

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161932#comment-16161932 ] Anu Engineer commented on HDFS-12410: - [~chris.douglas] and [~goiri] > Ignore unknown

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161888#comment-16161888 ] Andrew Wang commented on HDFS-11600: One possible issue with combining these into the

[jira] [Created] (HDFS-12421) Balancer to emit standard metrics

2017-09-11 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-12421: -- Summary: Balancer to emit standard metrics Key: HDFS-12421 URL: https://issues.apache.org/jira/browse/HDFS-12421 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161856#comment-16161856 ] Hadoop QA commented on HDFS-12417: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161842#comment-16161842 ] Chris Douglas commented on HDFS-11600: -- Attached a naive rebase of the original patch

[jira] [Updated] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12417: - Attachment: HDFS-12417.001.patch Parameterizing tests by subclassing is not the correct pattern. R

[jira] [Updated] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-11600: - Attachment: HDFS-11600.002.patch > Refactor TestDFSStripedOutputStreamWithFailure test classes > -

[jira] [Commented] (HDFS-12410) Ignore unknown StorageTypes

2017-09-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161810#comment-16161810 ] Íñigo Goiri commented on HDFS-12410: [~ajayydv] resorting to default might be another

[jira] [Commented] (HDFS-12410) Ignore unknown StorageTypes

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161798#comment-16161798 ] Ajay Kumar commented on HDFS-12410: --- [~chris.douglas] Instead of ignoring such storage t

[jira] [Commented] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161796#comment-16161796 ] Hadoop QA commented on HDFS-12417: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Assigned] (HDFS-12420) Improve error message on Namenode format

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar reassigned HDFS-12420: - Assignee: Ajay Kumar > Improve error message on Namenode format > ---

[jira] [Created] (HDFS-12420) Improve error message on Namenode format

2017-09-11 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDFS-12420: - Summary: Improve error message on Namenode format Key: HDFS-12420 URL: https://issues.apache.org/jira/browse/HDFS-12420 Project: Hadoop HDFS Issue Type: Improvemen

[jira] [Created] (HDFS-12419) Fix TestDistCpViewFs failures on branch-2

2017-09-11 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12419: - Summary: Fix TestDistCpViewFs failures on branch-2 Key: HDFS-12419 URL: https://issues.apache.org/jira/browse/HDFS-12419 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-12412) Remove ErasureCodingWorker.stripedReadPool

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161724#comment-16161724 ] Andrew Wang commented on HDFS-12412: Agree, nice idea here Eddy. We can always add mor

[jira] [Updated] (HDFS-12412) Remove ErasureCodingWorker.stripedReadPool

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12412: --- Labels: hdfs-ec-3.0-nice-to-have (was: ) > Remove ErasureCodingWorker.stripedReadPool > -

[jira] [Commented] (HDFS-12409) Add metrics of execution time of different stages in EC recovery task

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161715#comment-16161715 ] Andrew Wang commented on HDFS-12409: We should also fix the checkstyles and check the

[jira] [Commented] (HDFS-12409) Add metrics of execution time of different stages in EC recovery task

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161713#comment-16161713 ] Andrew Wang commented on HDFS-12409: +1 LGTM thanks Eddy! > Add metrics of execution

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161705#comment-16161705 ] Xiaoyu Yao commented on HDFS-12235: --- Thanks all for working on this. Patch v12 looks goo

[jira] [Commented] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161658#comment-16161658 ] Arpit Agarwal commented on HDFS-12417: -- +1 > Disable flaky TestDFSStripedOutputStrea

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161657#comment-16161657 ] Hadoop QA commented on HDFS-4114: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161654#comment-16161654 ] Arpit Agarwal commented on HDFS-4114: - I've filed HDFS-12418 to restore BackupNode unit

[jira] [Updated] (HDFS-12418) Fix BackupNode UT broken by HDFS-10391

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12418: - Target Version/s: 3.0.0-beta1 > Fix BackupNode UT broken by HDFS-10391 > -

[jira] [Created] (HDFS-12418) Fix BackupNode UT broken by HDFS-10391

2017-09-11 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-12418: Summary: Fix BackupNode UT broken by HDFS-10391 Key: HDFS-12418 URL: https://issues.apache.org/jira/browse/HDFS-12418 Project: Hadoop HDFS Issue Type: Bug

[jira] [Comment Edited] (HDFS-10391) Always enable NameNode service RPC port

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16160015#comment-16160015 ] Arpit Agarwal edited comment on HDFS-10391 at 9/11/17 5:36 PM: -

[jira] [Assigned] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar reassigned HDFS-12417: - Assignee: (was: Ajay Kumar) > Disable flaky TestDFSStripedOutputStreamWithFailure > -

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161628#comment-16161628 ] Hudson commented on HDFS-12349: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-12401) Ozone: TestBlockDeletingService#testBlockDeletionTimeout sometimes timeout

2017-09-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161622#comment-16161622 ] Xiaoyu Yao commented on HDFS-12401: --- No, it is my local repro when submit another ticket

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161581#comment-16161581 ] Lei (Eddy) Xu commented on HDFS-12349: -- Sure, [~chris.douglas]. I will revert it an

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161576#comment-16161576 ] Hadoop QA commented on HDFS-11600: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161574#comment-16161574 ] Chris Douglas commented on HDFS-12349: -- There's too much noise in the HDFS tests righ

[jira] [Updated] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12417: - Status: Patch Available (was: Open) > Disable flaky TestDFSStripedOutputStreamWithFailure > -

[jira] [Updated] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12417: - Attachment: HDFS-12417.000.patch > Disable flaky TestDFSStripedOutputStreamWithFailure > -

[jira] [Assigned] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar reassigned HDFS-12417: - Assignee: Ajay Kumar > Disable flaky TestDFSStripedOutputStreamWithFailure >

[jira] [Created] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Chris Douglas (JIRA)
Chris Douglas created HDFS-12417: Summary: Disable flaky TestDFSStripedOutputStreamWithFailure Key: HDFS-12417 URL: https://issues.apache.org/jira/browse/HDFS-12417 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161547#comment-16161547 ] Chris Douglas commented on HDFS-12349: -- bq. Verified that all failed tests are not re

[jira] [Reopened] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reopened HDFS-12349: -- > Improve log message when it could not alloc enough blocks for EC > --

[jira] [Commented] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-09-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161415#comment-16161415 ] Rushabh S Shah commented on HDFS-11754: --- Thanks [~erofeev] for working on this. Over

[jira] [Commented] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161409#comment-16161409 ] Anu Engineer commented on HDFS-11922: - [~cheersyang] & [~yuanbo] Thanks for designing

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161170#comment-16161170 ] Weiwei Yang commented on HDFS-12370: Hi [~linyiqun] Thanks for sharing your idea. The

[jira] [Comment Edited] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161170#comment-16161170 ] Weiwei Yang edited comment on HDFS-12370 at 9/11/17 12:50 PM: --

[jira] [Work stopped] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12415 stopped by Weiwei Yang. -- > Ozone: TestXceiverClientManager occasionally fails > --

[jira] [Updated] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12415: --- Status: In Progress (was: Patch Available) > Ozone: TestXceiverClientManager occasionally fails > ---

[jira] [Commented] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161168#comment-16161168 ] Weiwei Yang commented on HDFS-12415: Hi [~msingh] Thanks for pointing this out, you a

[jira] [Commented] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161140#comment-16161140 ] Hadoop QA commented on HDFS-12414: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161137#comment-16161137 ] Mukul Kumar Singh commented on HDFS-12415: -- Thanks for the patch [~cheersyang], T

[jira] [Commented] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161095#comment-16161095 ] Rakesh R commented on HDFS-12395: - Thanks [~Sammi] for the continuous efforts. bq. I'm n

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161098#comment-16161098 ] Yiqun Lin commented on HDFS-12370: -- Thanks for the review and commit, [~cheersyang].I not

[jira] [Commented] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161089#comment-16161089 ] Brahma Reddy Battula commented on HDFS-12416: - Dupe of HDFS-12177 and HDFS-118

[jira] [Commented] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161083#comment-16161083 ] Hadoop QA commented on HDFS-12416: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Suhan Mao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhan Mao updated HDFS-12416: - Status: Patch Available (was: Open) Patch submitted. The patch will check whether the stringbuilder is nu

[jira] [Commented] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161063#comment-16161063 ] Hadoop QA commented on HDFS-12415: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Suhan Mao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhan Mao updated HDFS-12416: - Description: In BlockPlacementPolicyDefault.chooseRandom method. The code are in below structure: {code:ja

[jira] [Updated] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Suhan Mao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhan Mao updated HDFS-12416: - Attachment: HDFS-12416.001.patch > BlockPlacementPolicyDefault will cause NN shutdown if log level is chan

[jira] [Updated] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Suhan Mao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhan Mao updated HDFS-12416: - Attachment: HDFS-12416.patch > BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

[jira] [Created] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Suhan Mao (JIRA)
Suhan Mao created HDFS-12416: Summary: BlockPlacementPolicyDefault will cause NN shutdown if log level is changed Key: HDFS-12416 URL: https://issues.apache.org/jira/browse/HDFS-12416 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12370: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolv

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161004#comment-16161004 ] Weiwei Yang commented on HDFS-12370: I have tested this patch in a cluster, here is th

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Status: Patch Available (was: Open) > Ensure to use CLI command to enable/disable erasure coding policy >

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: HDFS-12414.001.patch Initial patch > Ensure to use CLI command to enable/disable erasure codi

[jira] [Updated] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12415: --- Attachment: HDFS-12415-HDFS-7240.001.patch > Ozone: TestXceiverClientManager occasionally fails >

[jira] [Updated] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12415: --- Status: Patch Available (was: Open) > Ozone: TestXceiverClientManager occasionally fails > --

[jira] [Commented] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16160899#comment-16160899 ] Weiwei Yang commented on HDFS-12415: It looks like test cases are calling {{allocateCo

<    1   2   3   >