>From https://issues.apache.org/jira/browse/SPARK-25588, I'm reading that:
- this is a Parquet-Avro version conflict thing - a downstream app wants different versions of Parquet and Avro than Spark uses, which triggers it - it doesn't work in 2.4.0 It's not a regression from 2.4.0, which is the immediate question. There isn't even a Parquet fix available. But I'm not even seeing why this is excuse-making? On Sun, Mar 10, 2019 at 8:44 PM Mark Hamstra <m...@clearstorydata.com> wrote: > > Now wait... we created a regression in 2.4.0. Arguably, we should have > blocked that release until we had a fix; but the issue came up late in the > release process and it looks to me like there wasn't an adequate fix > immediately available, so we did something bad and released 2.4.0 with a > known regression. Saying that there is now no regression from 2.4 is > tautological and no excuse for not taking in a fix -- and it looks like that > fix has been waiting for months. --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
