Update! Netty has reverted the affecting change in v4.1.96. See netty
commit here[1] and arrow PR to upgrade here[2].
The upcoming release of arrow-memory-netty v13 should work with netty
versions <4.1.94 and >=4.1.96.
[1]
I just want to add that there is a Spark Jira issue[1] for upgrading Netty
once Arrow v13.0.0 is released this month.
[1] https://issues.apache.org/jira/projects/SPARK/issues/SPARK-44212
On Thu, Jul 6, 2023 at 2:25 PM Dane Pitkin wrote:
> Hi all,
>
> The next release of Apache Arrow v13.0.0
Hi all,
The next release of Apache Arrow v13.0.0 coming this month[1] has upgraded
Netty to v4.1.94.Final[2] due to a moderate severity CVE[3]. We are seeing
that Spark using Netty v4.1.93.Final is not compatible with Arrow
v13.0.0, throwing an exception at runtime[4]. There has been some talk in