Re: [VOTE] Release Spark 4.0.1 (RC1)

2025-09-04 Thread Szehon Ho
+1 (non binding) Checked signature, checksum, and ran basic test on spark-4.0.1-bin-hadoop3. Thanks Dongjoon Szehon On Tue, Sep 2, 2025 at 11:50 PM Jungtaek Lim wrote: > +1 (non-binding) > > Thanks, > Jungtaek Lim (HeartSaVioR) > > On Wed, Sep 3, 2025 at 9:16 AM kazuyuki tanimura > wrote: > >

[DISCUSS] Enhance JSON Parsing to Support Standard Compliance

2025-09-04 Thread Philo
Hi all, I am writing to initiate a discussion on enhancing Spark JSON parsing to support standard compliance. ## Motivation In the current version of Spark, the JSON parser is designed to be compatible with Hive, which means that some behaviors may not adhere strictly to standard JSON compliance.

Re: [DISCUSS] Enhance JSON Parsing to Support Standard Compliance

2025-09-04 Thread Wenchen Fan
Do we have a list of behaviors we want to change after enabling the new config? On Thu, Sep 4, 2025 at 5:38 PM Philo wrote: > Hi all, > > I am writing to initiate a discussion on enhancing Spark JSON parsing to > support standard compliance. > > ## Motivation > In the current version of Spark, t