Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

Thanks for starting this thread, Wangda! +1 for establishing a faster cadence now itself. One word of caution though. The same I expressed while we were trying to do both 2.8 and 3.0 releases at the same time. Please try avoiding concurrent releases and splitting community bandwidth - it's not

Re: [DISCUSS] Looking to a 2.9.0 release

As I mentioned in the [VOTE] thread at [1], for Timeline Service v2, we are thinking about merging to branch2 some time in the next couple of weeks. So far, we have been maintaining a branch2 based YARN-5355_branch2 along with our trunk based feature branch YARN-5355. Varun Saxena has been

Re: [VOTE] Merge feature branch YARN-5355 (Timeline Service v2) to trunk

Thanks everyone. It has been over a week (~9 days) since TSv2 has been merged to trunk with no problems thus far. We are now thinking about merging timeline service v2 to branch2 some time in the next few weeks. So far, we have been maintaining a branch2 based YARN-5355_branch2 along with our

2017-09-07 Hadoop 3 release status update

https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3+release+status+updates 2017-09-07 Slightly early update since I'll be out tomorrow. We're one week out, and focus is on blocker burndown. Highlights: - 3.1.0 release planning is underway, led by Wangda. Target release date is in

[jira] [Created] (HADOOP-14848) Switch from JDiff to japicmp

Andrew Wang created HADOOP-14848: Summary: Switch from JDiff to japicmp Key: HADOOP-14848 URL: https://issues.apache.org/jira/browse/HADOOP-14848 Project: Hadoop Common Issue Type:

Re: [VOTE] Merge yarn-native-services branch into trunk

Hi folks, This vote closes today. I see a -1 from Allen on inclusion in beta1. I see there's active fixing going on, but given that we're one week out from RC0, I think we should drop this from beta1. Allen, Jian, others, is this reasonable? What release should we retarget this for? I don't have

Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

Thanks for all your valuable feedbacks. Regarding to security issues for alpha features: I completely agree with Larry: ideally, all alpha features should be disabled by default. Steve/Arun/Haibo: could you please comment about feature's rough merge plan and status (like alpha/beta). I will

Re: [DISCUSS] Looking to a 2.9.0 release

Hi Subru, We are also discussing the merge of HDFS-10467 (Router-based federation) and we would like to target 2.9 to do a full release together with YARN federation. Chris Douglas already arranged the integration into trunk for 3.0.0 GA. Regarding the points to cover: 1. API compatibility: we

[jira] [Created] (HADOOP-14847) Remove Guava Supplier and change to java Supplier in AMRMClient and AMRMClientAysnc

Bharat Viswanadham created HADOOP-14847: --- Summary: Remove Guava Supplier and change to java Supplier in AMRMClient and AMRMClientAysnc Key: HADOOP-14847 URL:

Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

Thanks Wangda for initiating 3.1.0 release efforts. One YARN feature I'd like to add to 3.1.0 is YARN Oversubscription (YARN-1011) Best, Haibo On Wed, Sep 6, 2017 at 11:13 AM, Wangda Tan wrote: > Hi all, > > As we discussed on [1], there were proposals from Steve / Vinod

Re: DISCUSS: Hadoop Compatability Guidelines

There's also the DataNode data directory layout. FS edit logs should also be included if we're including the fsimage. Historically we've bumped these in minor and major releases, though I'm not sure whether precedent supports the practice. It means you can't downgrade, and features that need

Re: DISCUSS: Hadoop Compatability Guidelines

On 7 Sep 2017, at 19:13, Daniel Templeton > wrote: Good point. I think it would be valuable to enumerate the policies around the versioned state stores. We have the three you listed. We should probably include the HDFS fsimage in that list.

Re: DISCUSS: Hadoop Compatability Guidelines

Good point.  I think it would be valuable to enumerate the policies around the versioned state stores.  We have the three you listed. We should probably include the HDFS fsimage in that list.  Any others? I also want to add a section that clarifies when it's OK to change the visibility or

Re: Moving Java Forward Faster

I read Mark Reinhold's blog [1] and overall like this change to release cadence. It introduces 3-year LTS releases along with the 6-month feature release cadence. We'd probably stick with the LTS releases. The blog says they only plan to support each LTS for 3 years though. I'd like this to

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/516/ [Sep 6, 2017 6:51:51 AM] (cdouglas) HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. [Sep 6, 2017 8:19:34 PM] (junping_du) YARN-7148. TestLogsCLI fails in trunk and branch-2 and javadoc

Re: Moving Java Forward Faster

ugh. this will be rough for cross-jdk compatibility, unless they update the target jre options of javac to support more than the last 2 major versions. > Question: Does GPL licensing of the JDK/JVM affect us negatively? Nope. all the openjdk bits we rely on were already going to be under the

Re: Moving Java Forward Faster

Interesting. Thanks for sharing this, Allen. Question: Does GPL licensing of the JDK/JVM affect us negatively? On Thu, Sep 7, 2017 at 10:14 AM, Allen Wittenauer wrote: > > > > Begin forwarded message: > > > > From: "Rory O'Donnell" > >

Fwd: Moving Java Forward Faster

> Begin forwarded message: > > From: "Rory O'Donnell" > Subject: Moving Java Forward Faster > Date: September 7, 2017 at 2:12:45 AM PDT > To: "strub...@yahoo.de >> Mark Struberg" > Cc: rory.odonn...@oracle.com, abdul.kolarku...@oracle.com, >

[jira] [Created] (HADOOP-14846) Wrong shell exit code if the shell process cannot be even started

Yuqi Wang created HADOOP-14846: -- Summary: Wrong shell exit code if the shell process cannot be even started Key: HADOOP-14846 URL: https://issues.apache.org/jira/browse/HADOOP-14846 Project: Hadoop

[jira] [Created] (HADOOP-14845) getFileStatus not making any auth checks

Sivaguru Sankaridurg created HADOOP-14845: - Summary: getFileStatus not making any auth checks Key: HADOOP-14845 URL: https://issues.apache.org/jira/browse/HADOOP-14845 Project: Hadoop Common