[jira] [Created] (HDFS-9358) TestNodeCount#testNodeCount timed out

Wei-Chiu Chuang created HDFS-9358: - Summary: TestNodeCount#testNodeCount timed out Key: HDFS-9358 URL: https://issues.apache.org/jira/browse/HDFS-9358 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-9359) Enable libhdfs++ to use existing libhdfs CLI tests

James Clampffer created HDFS-9359: - Summary: Enable libhdfs++ to use existing libhdfs CLI tests Key: HDFS-9359 URL: https://issues.apache.org/jira/browse/HDFS-9359 Project: Hadoop HDFS Issue

continuing releases on Apache Hadoop 2.6.x

As you may have seen, 2.6.2 is out . I have also retargeted all open issues that were targeted for 2.6.2 to 2.6.3. Continuing the discussion in the email thread here , I'd like us to maintain the cadence of

Re: continuing releases on Apache Hadoop 2.6.x

Just to stress on the following, it is very important that any critical bug-fixes that we push into 2.8.0 or even trunk, we should consider them for 2.6.3 and 2.7.3 if it makes sense. This is the only way we can avoid extremely long release cycles like that of 2.6.1. Also, to clarify a little,

Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

Forking the thread. Started looking at the 2.8 list, various features’ status and arrived here. While I understand the pervasive nature of EC and a need for a significant bake-in, moving this to a 3.x release is not a good idea. We will surely get a 2.8 out this year and, as needed, I can even

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

Thanks for forking the thread Vinod, SGTM, though I really do recommend waiting for 2.9 given the current size of 2.8. I'm not a fan of an "off by default" half-measure, since it doesn't change our compatibility requirements, and there's some major NN surgery that can't really be disabled. If we

Jenkins build is back to normal : Hadoop-Hdfs-trunk-Java8 #563

See

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #565

See Changes: [zhz] HDFS-9339. Extend full test of KMS ACLs. Contributed by Daniel [lei] HDFS-9312. Fix TestReplication to be FsDataset-agnostic. (lei) [yliu] HDFS-9275. Wait previous ErasureCodingWork to finish before schedule

Hadoop-Hdfs-trunk-Java8 - Build # 565 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/565/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6681 lines...] main: [mkdir] Created dir:

Re: 2.7.2 release plan

HI Naga and Vinod/Tsuyoshi/Karthik, Looked at this list, IIRC, some of them are 70k+ patch, I'm afraid the changes number is too many and risky for a minor release. Issues besides YARN-3136 are more or less change web UI / REST API, and they look more like enhancements instead of bug fixes. I

[jira] [Created] (HDFS-9360) Storage type usage isn't updated properly after file deletion

Ming Ma created HDFS-9360: - Summary: Storage type usage isn't updated properly after file deletion Key: HDFS-9360 URL: https://issues.apache.org/jira/browse/HDFS-9360 Project: Hadoop HDFS Issue

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

Thanks for the discussion, Vinod and Andrew. Backporting EC to 2.9 sounds good to me. On Mon, Nov 2, 2015 at 12:06 PM, Andrew Wang wrote: > Thanks for forking the thread Vinod, > > SGTM, though I really do recommend waiting for 2.9 given the current size > of 2.8. I'm

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

+1 for EC to go into 2.9. Yes, 3.x would be long way to go when we plan to have 2.8 and 2.9 releases. Regards, Uma On 11/2/15, 11:49 AM, "Vinod Vavilapalli" wrote: >Forking the thread. Started looking at the 2.8 list, various features¹ >status and arrived here. >

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

Thanks Vinod for the proposal and Andrew/Jing for the comments. 2.9 sounds a good plan. As Andrew pointed out, 2.8 is already quite big. And even when disabled, EC logic has been baked in NN pretty deeply. Do we have a tentative date or estimate for 2.9? --- Zhe Zhang On Mon, Nov 2, 2015 at

Re: Planning Apache Hadoop 2.7.2

We are down to 4 now (https://issues.apache.org/jira/issues/?filter=12332867), appreciate help moving forward with them. Thanks +Vinod On Oct 26, 2015, at 11:34 AM, Vinod Kumar Vavilapalli > wrote: Got swamped again. We already have

[jira] [Created] (HDFS-9362) TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows.

Chris Nauroth created HDFS-9362: --- Summary: TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows. Key: HDFS-9362 URL: https://issues.apache.org/jira/browse/HDFS-9362

RE: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

Sounds good to me. When it's determined to include EC in 2.9 release, it may be good to have a rough release date as Zhe asked, so accordingly the scope of EC can be discussed out. We still have quite a few of things as Phase I follow-on tasks to do before EC can be deployed in a production

Hadoop-Hdfs-trunk - Build # 2500 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2500/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9357 lines...] [INFO] Deleting

RE: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

+1 for the idea. On Nov 3, 2015 07:22, "Zheng, Kai" wrote: > Sounds good to me. When it's determined to include EC in 2.9 release, it > may be good to have a rough release date as Zhe asked, so accordingly the > scope of EC can be discussed out. We still have quite a few of

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

+1 for the plan about Phase I & II. BTW, maybe out of the scope of this thread, just want to mention we should either move the jira under HDFS-8031 or update the jira component as "erasure-coding" when making further improvement or fixing bugs in EC. In this way it will be easier for later

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

+1 on putting EC on 2.9. Is it a good time to start the discussion on the issues of releasing 2.8? ~Haohui On Mon, Nov 2, 2015 at 1:40 PM, Gangumalla, Uma wrote: > +1 for EC to go into 2.9. Yes, 3.x would be long way to go when we plan to > have 2.8 and 2.9 releases.

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

Yes, I’ve already started looking at 2.8.0, that is exactly how I ended up with this discussion on the state of EC. +Vinod On Nov 2, 2015, at 3:02 PM, Haohui Mai > wrote: Is it a good time to start the discussion on the issues of releasing 2.8?

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

If we use an umbrella JIRA to categorize all the ongoing EC work, that will let us more easily change the target version later. For instance, if we decide to bump Phase II out of 2.9, then we just need to change the target version of the Phase II umbrella rather than all the subtasks. On Mon, Nov

[jira] [Created] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils()

Tony Wu created HDFS-9363: - Summary: Add fetchReplica() to FsDatasetTestUtils() Key: HDFS-9363 URL: https://issues.apache.org/jira/browse/HDFS-9363 Project: Hadoop HDFS Issue Type: Improvement

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #564

See Changes: [zhz] HDFS-8777. Erasure Coding: add tests for taking snapshots on EC files. [aajisaka] MAPREDUCE-6525. Fix test failure of TestMiniMRClientCluster.testRestart. [zhz] HDFS-9329.

Hadoop-Hdfs-trunk-Java8 - Build # 564 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/564/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7033 lines...] [INFO] Executed tasks [INFO] [INFO]

RE: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

Yeah, so for the issues we recently resolved on trunk and are addressing as follow-on tasks in Phase I, we would label them with "erasure coding" and maybe also set the target version as "2.9" for the convenience? -Original Message- From: Jing Zhao [mailto:ji...@apache.org] Sent:

[jira] [Created] (HDFS-9364) Unnecessary DNS resolution attempts when NameNodeProxies

Xiao Chen created HDFS-9364: --- Summary: Unnecessary DNS resolution attempts when NameNodeProxies Key: HDFS-9364 URL: https://issues.apache.org/jira/browse/HDFS-9364 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-9365) Balaner should call getNNServiceRpcAddressesForCluster after HDFS-6376

Tsz Wo Nicholas Sze created HDFS-9365: - Summary: Balaner should call getNNServiceRpcAddressesForCluster after HDFS-6376 Key: HDFS-9365 URL: https://issues.apache.org/jira/browse/HDFS-9365

Hadoop-Hdfs-trunk - Build # 2501 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2501/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9563 lines...] [INFO] Executed tasks [INFO] [INFO] ---

Build failed in Jenkins: Hadoop-Hdfs-trunk #2501

See Changes: [aajisaka] MAPREDUCE-6525. Fix test failure of TestMiniMRClientCluster.testRestart. [zhz] HDFS-9329. TestBootstrapStandby#testRateThrottling is flaky because [cnauroth] HADOOP-12533. Introduce FileNotFoundException in