Re: SPARK-51166 Prepare Apache Spark 4.1.0 for November 2025

I have the same concerns as Holden regarding the release timeline. Would it make sense to shift our RC to January? Just to clarify, this isn’t an issue with the release manager. The challenge is more about the level of community involvement during the RC stage, and we’ll need stronger engagement f

[DISCUSS] SPIP: Add llms.txt files to Spark Documentation

Hi all, I’d like to propose adding llms.txt files to the Spark documentation. As more users rely on AI-assisted tools and LLMs to learn, write Spark code, and troubleshoot issues, it’s increasingly important that these tools point back to the up-to-date official documentation. This will help impr

Re: SPARK-51166 Prepare Apache Spark 4.1.0 for November 2025

Thank you, Holden. Yes, it's true and I agree with all your comments. At this time, we are in a much better situation because we have Apache Spark 4.1.0-preview1 already. In addition, I expect Apache Spark 4.1.0-preview2 in October. So, the 4.1.0 release will be smoother than ever. I will volunt

SPARK-51166 Prepare Apache Spark 4.1.0 for November 2025

Hi, All. As of now, the Apache Spark Versioning Policy page is a little outdated because it still shows only the delivered Spark 4.0.0 release window. https://spark.apache.org/versioning-policy.html Since Apache Spark 4.0.0 was announced on May 23rd, I believe we can release 4.1.0 after 6 months

Re: [External] [ANNOUNCE] Announcing Apache Spark 4.1.0-preview1

hi, couldn't find the release notes, not in the announcement and not here Index of /releases It is harder to test and experiment when not knowing what changed and what's new... Would be great if release notes could be added next round Just my two cents, Ofi

Re: [DISCUSS][SPIP] JDBC Driver for Spark Connect

I'm supportive of the general idea! On Mon, Sep 8, 2025 at 5:47 AM Cheng Pan wrote: > Update: > > I got some questions/responses on the SPIP docs and GitHub PR, > looking forward to more feedback! > > I have discussed offline with Kent Yao, and he will shepherd this SPIP. > > Thanks, > Cheng Pan