Hi Stefan
Have you got any response from Spark team regarding LZ4 library
compatibility? To avoid this kind of problems, lz4 should be shaded in
Spark distribution, IMHO.
Currently I'm not able to update Spark in my application due to this issue.
It is not possible to consume compressed topics
Hi all,
we'd like to upgrade one of our Spark jobs from 1.4.1 to 1.5.2 (we run
Spark on Amazon EMR).
The job consumes and pushes lz4 compressed data from/to Kafka.
When upgrading to 1.5.2 everything works fine, except we get the following
exception:
java.lang.NoSuchMethodError:
