Re: [DISCUSS] Branches and versions for Hadoop 3

2017-08-28 Thread Rohith Sharma K S
On 29 August 2017 at 06:24, Andrew Wang wrote: > So far I've seen no -1's to the branching proposal, so I plan to execute > this tomorrow unless there's further feedback. > For on going branch merge threads i.e TSv2, voting will be closing tomorrow. Does it end up in merging into trunk(3.1.0-SNAP

Re: [DISCUSS] Merge HDFS-10467 to (Router-based federation) trunk

2017-08-28 Thread Iñigo Goiri
Brahma, thank you for the comments. i) I can send a patch with the diff between branches. ii) Working with Giovanni for the review. iii) We had some numbers in our cluster. iv) We could have a Router just for giving a view of all the namespaces without giving RPC accesses. Another case might be onl

Re: [DISCUSS] Branches and versions for Hadoop 3

2017-08-28 Thread Andrew Wang
So far I've seen no -1's to the branching proposal, so I plan to execute this tomorrow unless there's further feedback. Regarding the above discussion, I think Jason and I have essentially the same opinion. I hope that keeping trunk a release branch means a higher bar for merges and code review i

[jira] [Created] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-12369: Summary: Edit log corruption due to hard lease recovery of not-closed file Key: HDFS-12369 URL: https://issues.apache.org/jira/browse/HDFS-12369 Project: Hadoop HDFS

Re: [DISCUSS] Branches and versions for Hadoop 3

2017-08-28 Thread Colin McCabe
On Mon, Aug 28, 2017, at 14:22, Allen Wittenauer wrote: > > > On Aug 28, 2017, at 12:41 PM, Jason Lowe wrote: > > > > I think this gets back to the "if it's worth committing" part. > > This brings us back to my original question: > > "Doesn't this place an undue burden on the contr

Re: [DISCUSS] Branches and versions for Hadoop 3

2017-08-28 Thread Allen Wittenauer
> On Aug 28, 2017, at 12:41 PM, Jason Lowe wrote: > > I think this gets back to the "if it's worth committing" part. This brings us back to my original question: "Doesn't this place an undue burden on the contributor with the first incompatible patch to prove worthiness? What

Re: [DISCUSS] Branches and versions for Hadoop 3

2017-08-28 Thread Vinod Kumar Vavilapalli
+1 to Andrew’s proposal for 3.x releases. We had fairly elaborate threads on this branching & compatibility topic before. One of them’s here: [1] +1 to what Jason said. (a) Incompatible changes are not to be treated lightly. We need to stop breaking stuff and ‘just dump it on trunk'. (b) Maj

Re: [DISCUSS] Branches and versions for Hadoop 3

2017-08-28 Thread Jason Lowe
Allen Wittenauer wrote: > > On Aug 25, 2017, at 1:23 PM, Jason Lowe wrote: > > > > Allen Wittenauer wrote: > > > > > Doesn't this place an undue burden on the contributor with the first > incompatible patch to prove worthiness? What happens if it is decided that > it's not good enough? > > > >

[jira] [Created] (HDFS-12368) [branch-2] Enable DFSNetworkTopology as default

2017-08-28 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12368: - Summary: [branch-2] Enable DFSNetworkTopology as default Key: HDFS-12368 URL: https://issues.apache.org/jira/browse/HDFS-12368 Project: Hadoop HDFS Issue Type: Imp

Re: [DISCUSS] Branches and versions for Hadoop 3

2017-08-28 Thread Allen Wittenauer
> On Aug 25, 2017, at 1:23 PM, Jason Lowe wrote: > > Allen Wittenauer wrote: > > > Doesn't this place an undue burden on the contributor with the first > > incompatible patch to prove worthiness? What happens if it is decided that > > it's not good enough? > > It is a burden for that first

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-08-28 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/506/ [Aug 27, 2017 10:19:55 PM] (liuml07) MAPREDUCE-6945. TestMapFileOutputFormat missing @after annotation. -1 overall The following subsystems voted -1: findbugs unit The following subsystems voted

RE: [DISCUSS] Merge HDFS-10467 to (Router-based federation) trunk

2017-08-28 Thread Brahma Reddy Battula
Nice Feature, Great work Guys. Looking forward getting in this, as already YARN federation is in. At first glance I have few questions i) Could have a consolidated patch for better review..? ii) Hoping "Federation Metrics" and "Federation UI" will be included. iii) do we've RPC benchmarks ?

Re: [VOTE] Merge feature branch YARN-5355 (Timeline Service v2) to trunk

2017-08-28 Thread Rohith Sharma K S
+1 (binding) Thank you very much for the great team work! Built from source and deployed in secured cluster. The below are the test result. Deployment : Standard hadoop security deployment authentication and authorization as well. Branch-2 Hadoop and Hbase security cluster. Branch-3

[jira] [Created] (HDFS-12367) Ozone: Too many open files error while running corona

2017-08-28 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12367: -- Summary: Ozone: Too many open files error while running corona Key: HDFS-12367 URL: https://issues.apache.org/jira/browse/HDFS-12367 Project: Hadoop HDFS Issue T

[jira] [Created] (HDFS-12366) Ozone: Refactor KSM metadata class names to avoid confusion

2017-08-28 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12366: -- Summary: Ozone: Refactor KSM metadata class names to avoid confusion Key: HDFS-12366 URL: https://issues.apache.org/jira/browse/HDFS-12366 Project: Hadoop HDFS

[jira] [Created] (HDFS-12365) Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient

2017-08-28 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12365: -- Summary: Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient Key: HDFS-12365 URL: https://issues.apache.org/jira/browse/HDFS-12365

[jira] [Created] (HDFS-12364) Compile Error:TestClientProtocolForPipelineRecovery#testUpdatePipeLineAfterDNReg

2017-08-28 Thread Jiandan Yang (JIRA)
Jiandan Yang created HDFS-12364: Summary: Compile Error:TestClientProtocolForPipelineRecovery#testUpdatePipeLineAfterDNReg Key: HDFS-12364 URL: https://issues.apache.org/jira/browse/HDFS-12364 Projec