Re: 1.2.1-rc3 - Avro input format for Hadoop 2 broken/fix?

2015-02-04 Thread Patrick Wendell
Hi Markus, That won't be included in 1.2.1 most likely because the release votes have already started, and at that point we don't hold the release except for major regression issues from 1.2.0. However, if this goes through we can backport it into the 1.2 branch and it will end up in a future

Re: 1.2.1-rc3 - Avro input format for Hadoop 2 broken/fix?

2015-02-04 Thread M. Dale
On 02/04/2015 02:04 PM, Josh Rosen wrote: It looks like you replied just to me; mind CC’ing the mailing list, too? On February 4, 2015 at 11:02:34 AM, M. Dale (medal...@yahoo.com mailto:medal...@yahoo.com) wrote: Josh, That was a bug that was present earlier. It was marked as fixed in

1.2.1-rc3 - Avro input format for Hadoop 2 broken/fix?

2015-02-04 Thread M. Dale
SPARK-3039 Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API was reopened and prevents v.1.2.1-rc3 from using Avro Input format for Hadoop 2 API/instances (it includes the hadoop1 avro-mapred library files). What are the chances of getting the fix outlined here