[jira] [Created] (HDFS-14934) [SBN Read] Standby NN throws many InterruptedExceptions when dfs.ha.tail-edits.period is 0

2019-10-25 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-14934: --- Summary: [SBN Read] Standby NN throws many InterruptedExceptions when dfs.ha.tail-edits.period is 0 Key: HDFS-14934 URL: https://issues.apache.org/jira/browse/HDFS-14934

[jira] [Created] (HDFS-14935) Unified constant in DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14935: -- Summary: Unified constant in DFSNetworkTopology#isNodeInScope Key: HDFS-14935 URL: https://issues.apache.org/jira/browse/HDFS-14935 Project: Hadoop HDFS Issue Ty

[GitHub] [hadoop-ozone] bshashikant commented on a change in pull request #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s…

2019-10-25 Thread GitBox
bshashikant commented on a change in pull request #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s… URL: https://github.com/apache/hadoop-ozone/pull/40#discussion_r338982546 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/XceiverC

[GitHub] [hadoop-ozone] bshashikant commented on issue #81: HDDS-2347 XCeiverClientGrpc's parallel use leads to NPE

2019-10-25 Thread GitBox
bshashikant commented on issue #81: HDDS-2347 XCeiverClientGrpc's parallel use leads to NPE URL: https://github.com/apache/hadoop-ozone/pull/81#issuecomment-546295056 The changes look good to me. I am +1 on this. This is an

[GitHub] [hadoop-ozone] cxorm opened a new pull request #85: HDDS-2219. Move all the ozone dist scripts/configs to one location

2019-10-25 Thread GitBox
cxorm opened a new pull request #85: HDDS-2219. Move all the ozone dist scripts/configs to one location URL: https://github.com/apache/hadoop-ozone/pull/85 ## What changes were proposed in this pull request? Relocate the separated scripts and confuguration file to the same directory,

[GitHub] [hadoop-ozone] sodonnel opened a new pull request #86: HDDS-2329 Destroy pipelines on any decommission or maintenance nodes

2019-10-25 Thread GitBox
sodonnel opened a new pull request #86: HDDS-2329 Destroy pipelines on any decommission or maintenance nodes URL: https://github.com/apache/hadoop-ozone/pull/86 ## What changes were proposed in this pull request? When a node is marked for decommission or maintenance, the first step i

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

2019-10-25 Thread Jim Brennan
+1 (non-binding) on RC1 I built from source on Mac and RHEL7, ran hdfs, nodemanager, and resourcemanager unit tests, and set up a one-node cluster and ran some test jobs (pi and sleep). - Jim On Tue, Oct 22, 2019 at 4:55 PM Jonathan Hung wrote: > Hi folks, > > This is the second release candida

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

2019-10-25 Thread Erik Krogen
Thanks for putting this together, Jonathan! I noticed that the RELEASENOTES.md makes no mention of any of the major features you mentioned in your email about the RC. Is this expected? I guess it is caused by the lack of a release note on the JIRAs for those features. I also noticed that buildi

[jira] [Reopened] (HDDS-2206) Separate handling for OMException and IOException in the Ozone Manager

2019-10-25 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDDS-2206: - Reverted this based on offline conversation with [~aengineer]. Anu has requested we add a config key

[GitHub] [hadoop-ozone] arp7 merged pull request #72: HDDS-2341. Validate tar entry path during extraction

2019-10-25 Thread GitBox
arp7 merged pull request #72: HDDS-2341. Validate tar entry path during extraction URL: https://github.com/apache/hadoop-ozone/pull/72 This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [hadoop-ozone] hanishakoneru commented on a change in pull request #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s…

2019-10-25 Thread GitBox
hanishakoneru commented on a change in pull request #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s… URL: https://github.com/apache/hadoop-ozone/pull/40#discussion_r339160033 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/Xceive

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s…

2019-10-25 Thread GitBox
hanishakoneru commented on issue #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s… URL: https://github.com/apache/hadoop-ozone/pull/40#issuecomment-546441415 /retest This is an automated message from

[GitHub] [hadoop-ozone] adoroszlai commented on issue #72: HDDS-2341. Validate tar entry path during extraction

2019-10-25 Thread GitBox
adoroszlai commented on issue #72: HDDS-2341. Validate tar entry path during extraction URL: https://github.com/apache/hadoop-ozone/pull/72#issuecomment-546444851 Thanks everyone again for reviews and @arp7 for merging it. Th

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #87: HDDS-2273. Avoid buffer copying in GrpcReplicationService

2019-10-25 Thread GitBox
adoroszlai opened a new pull request #87: HDDS-2273. Avoid buffer copying in GrpcReplicationService URL: https://github.com/apache/hadoop-ozone/pull/87 ## What changes were proposed in this pull request? Use `ByteString.Output` stream instead of `ByteArrayOutputStream`. Its initial

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #88: HDDS-2272. Avoid buffer copying in GrpcReplicationClient

2019-10-25 Thread GitBox
adoroszlai opened a new pull request #88: HDDS-2272. Avoid buffer copying in GrpcReplicationClient URL: https://github.com/apache/hadoop-ozone/pull/88 ## What changes were proposed in this pull request? Eliminate `BufferedOutputStream`, write `ByteString` directly to `FileStream` to

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

2019-10-25 Thread Jonathan Hung
Thanks for looking Erik. For the release notes, yeah I think it's because there's no release notes for the corresponding JIRAs. I've added details for these features to the index.md.vm file which should show up on the homepage for 2.10.0 (e.g. https://hadoop.apache.org/docs/r2.9.0/index.html). We

[jira] [Resolved] (HDFS-14308) DFSStripedInputStream curStripeBuf is not freed by unbuffer()

2019-10-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14308. Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution: Fi

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #51: HDDS-2311. Fix logic of RetryPolicy in OzoneClientSideTranslatorPB.

2019-10-25 Thread GitBox
hanishakoneru commented on issue #51: HDDS-2311. Fix logic of RetryPolicy in OzoneClientSideTranslatorPB. URL: https://github.com/apache/hadoop-ozone/pull/51#issuecomment-546501577 /retest This is an automated message from th

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #81: HDDS-2347 XCeiverClientGrpc's parallel use leads to NPE

2019-10-25 Thread GitBox
hanishakoneru commented on issue #81: HDDS-2347 XCeiverClientGrpc's parallel use leads to NPE URL: https://github.com/apache/hadoop-ozone/pull/81#issuecomment-546508203 Thank you for working on this @fapifta. Integration test failures do no look related to this PR. LGTM. +1. --

[jira] [Created] (HDDS-2366) Remove ozone.enabled flag

2019-10-25 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-2366: Summary: Remove ozone.enabled flag Key: HDDS-2366 URL: https://issues.apache.org/jira/browse/HDDS-2366 Project: Hadoop Distributed Data Store Issue T

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #89: HDDS-2322. DoubleBuffer flush termination and OM shutdown's after that. Make entry returned from cache a new copy.

2019-10-25 Thread GitBox
bharatviswa504 opened a new pull request #89: HDDS-2322. DoubleBuffer flush termination and OM shutdown's after that. Make entry returned from cache a new copy. URL: https://github.com/apache/hadoop-ozone/pull/89 ## What changes were proposed in this pull request? Whenever value is

[GitHub] [hadoop-ozone] swagle opened a new pull request #90: HDDS-2366. Remoce ozone.enabled as a flag and config item.

2019-10-25 Thread GitBox
swagle opened a new pull request #90: HDDS-2366. Remoce ozone.enabled as a flag and config item. URL: https://github.com/apache/hadoop-ozone/pull/90 ## What changes were proposed in this pull request? Removed all checks for ozone.enabled and configuration items. ## What is the

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

2019-10-25 Thread Jonathan Hung
Some more thoughts: for the javadoc issue, I think we can just support building on java 7. For the release notes issue, I can work with the authors of the major features to come up with release notes and update them before pushing it to site. The release notes in the published artifacts won't be u

[jira] [Resolved] (HDDS-2056) Datanode unable to start command handler thread with security enabled

2019-10-25 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh resolved HDDS-2056. - Resolution: Duplicate > Datanode unable to start command handler thread with security enab

[GitHub] [hadoop-ozone] cxorm opened a new pull request #91: HDDS-2361. Ozone Manager init & start command prints out unnecessary line in the beginning.

2019-10-25 Thread GitBox
cxorm opened a new pull request #91: HDDS-2361. Ozone Manager init & start command prints out unnecessary line in the beginning. URL: https://github.com/apache/hadoop-ozone/pull/91 If OZONE_MANAGER_CLASSPATH is null, we will not show the string. ## What changes were proposed in this