Re: Apache Arrow integration issue with Spark involving Netty

2023-07-28 Thread Dane Pitkin
commit/dc16c5818a5cd0711f17e0a966783cdc84c9db01 [2] https://github.com/apache/arrow/pull/36926 On Thu, Jul 13, 2023 at 11:47 AM Dane Pitkin wrote: > I just want to add that there is a Spark Jira issue[1] for upgrading Netty > once Arrow v13.0.0 is released this month. > > [1] https://issues.apache.org/jira/projects/

Re: Apache Arrow integration issue with Spark involving Netty

2023-07-13 Thread Dane Pitkin
I just want to add that there is a Spark Jira issue[1] for upgrading Netty once Arrow v13.0.0 is released this month. [1] https://issues.apache.org/jira/projects/SPARK/issues/SPARK-44212 On Thu, Jul 6, 2023 at 2:25 PM Dane Pitkin wrote: > Hi all, > > The next release of Apache Arro

Apache Arrow integration issue with Spark involving Netty

2023-07-06 Thread Dane Pitkin
Hi all, The next release of Apache Arrow v13.0.0 coming this month[1] has upgraded Netty to v4.1.94.Final[2] due to a moderate severity CVE[3]. We are seeing that Spark using Netty v4.1.93.Final is not compatible with Arrow v13.0.0, throwing an exception at runtime[4]. There has been some talk in