Re: DISCUSS: Hadoop Compatability Guidelines

There's also the DataNode data directory layout. FS edit logs should also be included if we're including the fsimage. Historically we've bumped these in minor and major releases, though I'm not sure whether precedent supports the practice. It means you can't downgrade, and features that need

Re: DISCUSS: Hadoop Compatability Guidelines

On 7 Sep 2017, at 19:13, Daniel Templeton > wrote: Good point. I think it would be valuable to enumerate the policies around the versioned state stores. We have the three you listed. We should probably include the HDFS fsimage in that list.

Re: DISCUSS: Hadoop Compatability Guidelines

Good point.  I think it would be valuable to enumerate the policies around the versioned state stores.  We have the three you listed. We should probably include the HDFS fsimage in that list.  Any others? I also want to add a section that clarifies when it's OK to change the visibility or

Re: DISCUSS: Hadoop Compatability Guidelines

Thanks for starting this Daniel. I think we should also add a section for store compatibility (all state stores including RM, NM, Federation etc.). Essentially an explicit policy detailing when is it ok to change the major and minor versions and how it should relate to the hadoop release version.

Re: DISCUSS: Hadoop Compatability Guidelines

Good idea.  I should have thought of that. :)  Done. Daniel On 9/5/17 10:33 AM, Anu Engineer wrote: Could you please attach the PDFs to the JIRA. I think the mailer is stripping them off from the mail. Thanks Anu On 9/5/17, 9:44 AM, "Daniel Templeton" wrote:

Re: DISCUSS: Hadoop Compatability Guidelines

Could you please attach the PDFs to the JIRA. I think the mailer is stripping them off from the mail. Thanks Anu On 9/5/17, 9:44 AM, "Daniel Templeton" wrote: >Resending with a broader audience, and reattaching the PDFs. > >Daniel > >On 9/4/17 9:01 AM, Daniel

Re: DISCUSS: Hadoop Compatability Guidelines

Resending with a broader audience, and reattaching the PDFs. Daniel On 9/4/17 9:01 AM, Daniel Templeton wrote: All, in prep for Hadoop 3 beta 1 I've been working on updating the compatibility guidelines on HADOOP-13714.  I think the initial doc is more or less complete, so I'd like to open

DISCUSS: Hadoop Compatability Guidelines

All, in prep for Hadoop 3 beta 1 I've been working on updating the compatibility guidelines on HADOOP-13714.  I think the initial doc is more or less complete, so I'd like to open the discussion up to the broader Hadoop community. In the new guidelines, I have drawn some lines in the sand