Holden, I agree with you a lot in a sense that this is a chicken and egg
situation.
Spark v4.0 release is a really big one, isn't it?
(1) First, do you think the proposed items are 'BLOCKER'-level Apache Spark 4.0
JIRA items? May I ask why you think in that way? If I understand more, I can
Yup I think buidling consensus on what goes in 4.X is something we’ll need
to do.
On Mon, Jun 12, 2023 at 11:56 AM Dongjoon Hyun
wrote:
> Thank you for sharing those. I'm also interested in taking advantage of
> it. Also, I hope `spark-upgrade` can help us in line with Spark 4.0.
>
> However,
Thank you for sharing those. I'm also interested in taking advantage of it.
Also, I hope `spark-upgrade` can help us in line with Spark 4.0.
However, we don't need to discuss any of this if we don't build a consensus
on both Spark 4.0 or next Scala version.
We don't have a vehicle at all to
My self and a few folks have been working on a spark-upgrade project
(focused on getting folks onto current versions of Spark). Since it looks
like were starting the discussion around Spark 4 I was thinking now could
be a good time for us to consider if we want to try and integrate
auto-upgrade
