ASF board report draft for Nov 2023

2023-11-05 Thread Matei Zaharia
It’s time to send our project’s quarterly report to the ASF board on Wednesday November 8th. Here’s what I wrote as a draft; let me know any suggested changes. = Issues for the board: - None Project status: - We released Apache Spark 3.5 on September 15, a feature

Re: [DISCUSS] SPIP: ShuffleManager short name registration via SparkPlugin

2023-11-05 Thread Alessandro Bellina
Thanks for the comments Reynold. This is an ease of use change, and it is not absolutely required (as other ease of use changes are not required either). That said, do we not want to invest in making Spark easier to configure for the average user, or even the user that is trying out Spark? Here