SPARK-3039 "Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API" was reopened and prevents v.1.2.1-rc3 from using Avro Input format for Hadoop 2 API/instances (it includes the hadoop1 avro-mapred library files).

What are the chances of getting the fix outlined here (https://github.com/medale/spark/compare/apache:v1.2.1-rc3...avro-hadoop2-v1.2.1-rc2) included in 1.2.1? My apologies, I do not know how to generate a pull request against a tag version.

I did add pull request https://github.com/apache/spark/pull/4315 for the current 1.3.0-SNAPSHOT master on this issue. Even though 1.3.0 build already does not include avro-mapred in the spark assembly jar this minor change improves dependence convergence.

Thanks,
Markus

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

Reply via email to