[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and improve concurrent operations.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and improve concurrent operations. (was: Ozone:

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and improve concurrent operations.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an i

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and improve concurrent framework.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and improve concurrent framework. (was: Ozone:

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter. (was:

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an i

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an i

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an i

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an i

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an i

[jira] [Created] (HDFS-14489) fix naming issue for ScmBlockLocationTestingClient

2019-05-14 Thread star (JIRA)
star created HDFS-14489: --- Summary: fix naming issue for ScmBlockLocationTestingClient Key: HDFS-14489 URL: https://issues.apache.org/jira/browse/HDFS-14489 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-14489) fix naming issue for ScmBlockLocationTestingClient

2019-05-14 Thread star (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] star updated HDFS-14489: Attachment: HDFS-14489.patch > fix naming issue for ScmBlockLocationTestingClient > ---

[jira] [Work logged] (HDDS-1522) Provide intellij runConfiguration for Ozone components

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1522?focusedWorklogId=241601&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241601 ] ASF GitHub Bot logged work on HDDS-1522: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1518) Use /etc/ozone for configuration inside docker-compose

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1518?focusedWorklogId=241605&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241605 ] ASF GitHub Bot logged work on HDDS-1518: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14486) The exception classes in some throw statements do not accurately describe why they are thrown

2019-05-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839220#comment-16839220 ] Steve Loughran commented on HDFS-14486: --- FWIW, if you are interested in where many

[jira] [Work logged] (HDDS-1503) Reduce garbage generated by non-netty threads in datanode ratis server

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1503?focusedWorklogId=241628&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241628 ] ASF GitHub Bot logged work on HDDS-1503: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1503) Reduce garbage generated by non-netty threads in datanode ratis server

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1503?focusedWorklogId=241636&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241636 ] ASF GitHub Bot logged work on HDDS-1503: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1503) Reduce garbage generated by non-netty threads in datanode ratis server

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1503?focusedWorklogId=241637&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241637 ] ASF GitHub Bot logged work on HDDS-1503: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-1503) Reduce garbage generated by non-netty threads in datanode ratis server

2019-05-14 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDDS-1503: -- Resolution: Fixed Fix Version/s: 0.5.0 Status: Resolved (was: Patch Available) > Redu

[jira] [Commented] (HDDS-1521) Use more natural directory structure for ozone

2019-05-14 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839254#comment-16839254 ] Elek, Marton commented on HDDS-1521: We have no native libraries or man pages but we h

[jira] [Commented] (HDDS-1503) Reduce garbage generated by non-netty threads in datanode ratis server

2019-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839257#comment-16839257 ] Hudson commented on HDDS-1503: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #165

[jira] [Updated] (HDFS-14489) fix naming issue for ScmBlockLocationTestingClient

2019-05-14 Thread star (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] star updated HDFS-14489: Component/s: (was: fs/ozone) ozone > fix naming issue for ScmBlockLocationTestingClient >

[jira] [Work logged] (HDDS-1496) Support partial chunk reads and checksum verification

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1496?focusedWorklogId=241649&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241649 ] ASF GitHub Bot logged work on HDDS-1496: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-1458) Create a maven profile to run fault injection tests

2019-05-14 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839321#comment-16839321 ] Elek, Marton commented on HDDS-1458: bq. The disk tests are only setting up structure

[jira] [Created] (HDDS-1526) Publish ozone 0.4.0 to the dockerhub

2019-05-14 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1526: -- Summary: Publish ozone 0.4.0 to the dockerhub Key: HDDS-1526 URL: https://issues.apache.org/jira/browse/HDDS-1526 Project: Hadoop Distributed Data Store Issue Ty

[jira] [Commented] (HDDS-1525) Mapreduce failure when using Hadoop 2.7.5

2019-05-14 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839340#comment-16839340 ] Elek, Marton commented on HDDS-1525: Thank you very much to report the problem [~Sammi

[jira] [Commented] (HDDS-1525) Mapreduce failure when using Hadoop 2.7.5

2019-05-14 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839343#comment-16839343 ] Elek, Marton commented on HDDS-1525: UPDATE: AFAIK 0.4.0 branch SHOULD work with this

[jira] [Work logged] (HDDS-1526) Publish ozone 0.4.0 to the dockerhub

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1526?focusedWorklogId=241684&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241684 ] ASF GitHub Bot logged work on HDDS-1526: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-1526) Publish ozone 0.4.0 to the dockerhub

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-1526: - Labels: pull-request-available (was: ) > Publish ozone 0.4.0 to the dockerhub > -

[jira] [Work logged] (HDDS-1512) Implement DoubleBuffer in OzoneManager

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1512?focusedWorklogId=241688&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241688 ] ASF GitHub Bot logged work on HDDS-1512: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14353) Erasure Coding: metrics xmitsInProgress become to negative.

2019-05-14 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDFS-14353: -- Attachment: HDFS-14353.007.patch > Erasure Coding: metrics xmitsInProgress become to negative. > --

[jira] [Commented] (HDFS-14353) Erasure Coding: metrics xmitsInProgress become to negative.

2019-05-14 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839371#comment-16839371 ] maobaolong commented on HDFS-14353: --- [~elgoiri] Thank you for your advice, it's really

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-05-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839531#comment-16839531 ] Erik Krogen commented on HDFS-12979: Thanks [~vagarychen]! The new {{isPrimary}} logi

[jira] [Commented] (HDFS-14353) Erasure Coding: metrics xmitsInProgress become to negative.

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839556#comment-16839556 ] Hadoop QA commented on HDFS-14353: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDDS-1458) Create a maven profile to run fault injection tests

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839564#comment-16839564 ] Eric Yang commented on HDDS-1458: - {quote}Can we support both the approaches?{quote} Sure

[jira] [Created] (HDFS-14490) RBF: Remove unnecessary quota checks

2019-05-14 Thread Ayush Saxena (JIRA)
Ayush Saxena created HDFS-14490: --- Summary: RBF: Remove unnecessary quota checks Key: HDFS-14490 URL: https://issues.apache.org/jira/browse/HDFS-14490 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-14490) RBF: Remove unnecessary quota checks

2019-05-14 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14490: Attachment: HDFS-14490-HDFS-13891-01.patch > RBF: Remove unnecessary quota checks > ---

[jira] [Updated] (HDFS-14490) RBF: Remove unnecessary quota checks

2019-05-14 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14490: Status: Patch Available (was: Open) > RBF: Remove unnecessary quota checks > -

[jira] [Commented] (HDFS-14440) RBF: Optimize the file write process in case of multiple destinations.

2019-05-14 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839583#comment-16839583 ] Ayush Saxena commented on HDFS-14440: - [~elgoiri] any further thoughts?? > RBF: Opt

[jira] [Commented] (HDDS-1449) JVM Exit in datanode while committing a key

2019-05-14 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839588#comment-16839588 ] Mukul Kumar Singh commented on HDDS-1449: - The issue is because of the db pointer

[jira] [Commented] (HDDS-1521) Use more natural directory structure for ozone

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839604#comment-16839604 ] Eric Yang commented on HDDS-1521: - {quote}It's also a possible approach to keep the tar st

[jira] [Commented] (HDFS-14490) RBF: Remove unnecessary quota checks

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839632#comment-16839632 ] Hadoop QA commented on HDFS-14490: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-14353) Erasure Coding: metrics xmitsInProgress become to negative.

2019-05-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839642#comment-16839642 ] Íñigo Goiri commented on HDFS-14353: As this is trunk, we can use lambdas: {code} Gen

[jira] [Commented] (HDFS-14440) RBF: Optimize the file write process in case of multiple destinations.

2019-05-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839654#comment-16839654 ] Íñigo Goiri commented on HDFS-14440: Sorry, I was out last week. As you can see, I st

[jira] [Updated] (HDFS-14482) Crash when using libhdfs with bad classpath

2019-05-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-14482: --- Affects Version/s: 3.3.0 Fix Version/s: 3.3.0 > Crash when using libhdfs with bad classpath >

[jira] [Resolved] (HDFS-14482) Crash when using libhdfs with bad classpath

2019-05-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-14482. Resolution: Fixed > Crash when using libhdfs with bad classpath > -

[jira] [Commented] (HDFS-14482) Crash when using libhdfs with bad classpath

2019-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839691#comment-16839691 ] Hudson commented on HDFS-14482: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Comment Edited] (HDDS-1458) Create a maven profile to run fault injection tests

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839564#comment-16839564 ] Eric Yang edited comment on HDDS-1458 at 5/14/19 6:48 PM: -- {quote

[jira] [Commented] (HDFS-14447) RBF: Router should support RefreshUserMappingsProtocol

2019-05-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839720#comment-16839720 ] Lukas Majercak commented on HDFS-14447: --- There are a couple of syntax inconsistenci

[jira] [Created] (HDFS-14491) More Clarity on Namenode UI Around Blocks and Replicas

2019-05-14 Thread Alan Jackoway (JIRA)
Alan Jackoway created HDFS-14491: Summary: More Clarity on Namenode UI Around Blocks and Replicas Key: HDFS-14491 URL: https://issues.apache.org/jira/browse/HDFS-14491 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-14447) RBF: Router should support RefreshUserMappingsProtocol

2019-05-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839732#comment-16839732 ] Íñigo Goiri commented on HDFS-14447: Thanks [~lukmajercak], I agree on fixing the spa

[jira] [Commented] (HDFS-14490) RBF: Remove unnecessary quota checks

2019-05-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839735#comment-16839735 ] Íñigo Goiri commented on HDFS-14490: This makes me wonder if the default case should

[jira] [Created] (HDDS-1527) HDDS Datanode start fails due to datanode.id file parse error.

2019-05-14 Thread Aravindan Vijayan (JIRA)
Aravindan Vijayan created HDDS-1527: --- Summary: HDDS Datanode start fails due to datanode.id file parse error. Key: HDDS-1527 URL: https://issues.apache.org/jira/browse/HDDS-1527 Project: Hadoop Dis

[jira] [Updated] (HDDS-1527) HDDS Datanode start fails due to datanode.id file parse error.

2019-05-14 Thread Aravindan Vijayan (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-1527: Description: * Ozone datanode start fails when there is an existing Datanode > HDDS Datanode

[jira] [Updated] (HDDS-1527) HDDS Datanode start fails due to datanode.id file read errors.

2019-05-14 Thread Aravindan Vijayan (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-1527: Summary: HDDS Datanode start fails due to datanode.id file read errors. (was: HDDS Datanod

[jira] [Updated] (HDDS-1527) HDDS Datanode start fails due to datanode.id file read errors.

2019-05-14 Thread Aravindan Vijayan (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-1527: Description: * Ozone datanode start fails when there is an existing Datanode.id file which

[jira] [Commented] (HDDS-1495) Create hadoop/ozone docker images with inline build process

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839804#comment-16839804 ] Eric Yang commented on HDDS-1495: - {quote} a) As I wrote earler the statement is not true,

[jira] [Comment Edited] (HDDS-1527) HDDS Datanode start fails due to datanode.id file read errors.

2019-05-14 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839809#comment-16839809 ] Siddharth Wagle edited comment on HDDS-1527 at 5/14/19 9:30 PM:

[jira] [Commented] (HDDS-1527) HDDS Datanode start fails due to datanode.id file read errors.

2019-05-14 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839809#comment-16839809 ] Siddharth Wagle commented on HDDS-1527: --- [~avijayan] Would you kindly add the except

[jira] [Assigned] (HDDS-1527) HDDS Datanode start fails due to datanode.id file read errors.

2019-05-14 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-1527: - Assignee: Siddharth Wagle > HDDS Datanode start fails due to datanode.id file read errors

[jira] [Reopened] (HDDS-1520) Classpath assembly doesn't work if ozone is symlinked

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reopened HDDS-1520: - > Classpath assembly doesn't work if ozone is symlinked >

[jira] [Commented] (HDDS-1520) Classpath assembly doesn't work if ozone is symlinked

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839816#comment-16839816 ] Eric Yang commented on HDDS-1520: - This issue may have caused by how long a single argumen

[jira] [Created] (HDDS-1528) Buffer Pool in BlockInputStream

2019-05-14 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-1528: Summary: Buffer Pool in BlockInputStream Key: HDDS-1528 URL: https://issues.apache.org/jira/browse/HDDS-1528 Project: Hadoop Distributed Data Store Issue Typ

[jira] [Created] (HDDS-1529) BlockInputStream: Avoid buffer copy if the whole chunk is being read

2019-05-14 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-1529: Summary: BlockInputStream: Avoid buffer copy if the whole chunk is being read Key: HDDS-1529 URL: https://issues.apache.org/jira/browse/HDDS-1529 Project: Hadoop Dist

[jira] [Work logged] (HDDS-1441) Remove usage of getRetryFailureException

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1441?focusedWorklogId=242076&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242076 ] ASF GitHub Bot logged work on HDDS-1441: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1422) Exception during DataNode shutdown

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1422?focusedWorklogId=242079&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242079 ] ASF GitHub Bot logged work on HDDS-1422: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1501) Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received.

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1501?focusedWorklogId=242121&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242121 ] ASF GitHub Bot logged work on HDDS-1501: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-1501) Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received.

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-1501: - Labels: pull-request-available (was: ) > Create a Recon task interface that is used to update the

[jira] [Work logged] (HDDS-1501) Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received.

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1501?focusedWorklogId=242128&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242128 ] ASF GitHub Bot logged work on HDDS-1501: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-1520) Classpath assembly doesn't work if ozone is symlinked

2019-05-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839864#comment-16839864 ] Anu Engineer commented on HDDS-1520: [~eyang] Would you care to update the Jira – to r

[jira] [Work logged] (HDDS-1496) Support partial chunk reads and checksum verification

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1496?focusedWorklogId=242129&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242129 ] ASF GitHub Bot logged work on HDDS-1496: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242130&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242130 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242135&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242135 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242131&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242131 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242134&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242134 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242136&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242136 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242133&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242133 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242132&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242132 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-1495) Create hadoop/ozone docker images with inline build process

2019-05-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839865#comment-16839865 ] Anu Engineer commented on HDDS-1495: {quote}The goal is to fold [hadoop-docker-ozone

[jira] [Commented] (HDDS-1527) HDDS Datanode start fails due to datanode.id file read errors.

2019-05-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839869#comment-16839869 ] Anu Engineer commented on HDDS-1527: [~hanishakoneru] FYI .. Thx. > HDDS Datanode sta

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242144&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242144 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-05-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839872#comment-16839872 ] Chen Liang commented on HDFS-12979: --- Thanks for the review [~xkrogen]. For the canceli

[jira] [Work logged] (HDDS-1518) Use /etc/ozone for configuration inside docker-compose

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1518?focusedWorklogId=242147&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242147 ] ASF GitHub Bot logged work on HDDS-1518: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-1495) Create hadoop/ozone docker images with inline build process

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839874#comment-16839874 ] Eric Yang commented on HDDS-1495: - [~anu], the current implementation in YARN has reached

[jira] [Commented] (HDDS-1495) Create hadoop/ozone docker images with inline build process

2019-05-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839877#comment-16839877 ] Anu Engineer commented on HDDS-1495: The current approach allows us to build the docke

[jira] [Commented] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839879#comment-16839879 ] Anu Engineer commented on HDFS-14484: - {quote}3. Remove the process of appending an u

[jira] [Commented] (HDFS-14135) TestWebHdfsTimeouts Fails intermittently in trunk

2019-05-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839883#comment-16839883 ] Masatake Iwasaki commented on HDFS-14135: - [~elgoiri] using reserved address did

[jira] [Commented] (HDFS-14234) Limit WebHDFS to specifc user, host, directory triples

2019-05-14 Thread Clay B. (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839889#comment-16839889 ] Clay B. commented on HDFS-14234: Oops, I kept missing that I was failing the test \{{org

[jira] [Updated] (HDFS-14234) Limit WebHDFS to specifc user, host, directory triples

2019-05-14 Thread Clay B. (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Clay B. updated HDFS-14234: --- Attachment: 0007-HDFS-14234.-Limit-WebHDFS-to-specifc-user-host-direc.patch > Limit WebHDFS to specifc user,

[jira] [Work logged] (HDDS-1501) Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received.

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1501?focusedWorklogId=242158&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242158 ] ASF GitHub Bot logged work on HDDS-1501: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1501) Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received.

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1501?focusedWorklogId=242173&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242173 ] ASF GitHub Bot logged work on HDDS-1501: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1451) SCMBlockManager findPipeline and createPipeline are not lock protected

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1451?focusedWorklogId=242186&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242186 ] ASF GitHub Bot logged work on HDDS-1451: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1511) Space tracking for Open Containers in HDDS Volumes

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1511?focusedWorklogId=242188&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242188 ] ASF GitHub Bot logged work on HDDS-1511: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1511) Space tracking for Open Containers in HDDS Volumes

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1511?focusedWorklogId=242193&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242193 ] ASF GitHub Bot logged work on HDDS-1511: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1511) Space tracking for Open Containers in HDDS Volumes

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1511?focusedWorklogId=242196&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242196 ] ASF GitHub Bot logged work on HDDS-1511: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14447) RBF: Router should support RefreshUserMappingsProtocol

2019-05-14 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839933#comment-16839933 ] Shen Yinjie commented on HDFS-14447: Thanks very much for your review! [~elgoiri] [~l

[jira] [Work logged] (HDDS-1511) Space tracking for Open Containers in HDDS Volumes

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1511?focusedWorklogId=242191&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242191 ] ASF GitHub Bot logged work on HDDS-1511: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and introduce "--bufferSize" and "--validateWrit

[jira] [Commented] (HDFS-14356) Implement HDFS cache on SCM with native PMDK libs

2019-05-14 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839937#comment-16839937 ] Sammi Chen commented on HDFS-14356: --- [~PhiloHe], I will review the new patch this week.

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an i

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" op

  1   2   >