Re: ASF board report draft for August 2023

2023-08-09 Thread Matei Zaharia
Sounds good, I’ll add that. > On Aug 8, 2023, at 9:34 AM, Holden Karau wrote: > > Maybe add a link to the 4.0 JIRA where we are tracking the current plans for > 4.0? > > On Tue, Aug 8, 2023 at 9:33 AM Dongjoon Hyun > wrote: >> Thank you, Matei. >> >> It looks

Re: ASF board report draft for August 2023

2023-08-08 Thread Holden Karau
Maybe add a link to the 4.0 JIRA where we are tracking the current plans for 4.0? On Tue, Aug 8, 2023 at 9:33 AM Dongjoon Hyun wrote: > Thank you, Matei. > > It looks good to me. > > Dongjoon > > On Mon, Aug 7, 2023 at 22:54 Matei Zaharia > wrote: > >> It’s time to send our quarterly report to

Re: ASF board report draft for August 2023

2023-08-08 Thread Dongjoon Hyun
Thank you, Matei. It looks good to me. Dongjoon On Mon, Aug 7, 2023 at 22:54 Matei Zaharia wrote: > It’s time to send our quarterly report to the ASF board on August 9th. > Here’s what I wrote as a draft — feel free to suggest changes. > > = > > Issues for the

ASF board report draft for August 2023

2023-08-07 Thread Matei Zaharia
It’s time to send our quarterly report to the ASF board on August 9th. Here’s what I wrote as a draft — feel free to suggest changes. = Issues for the board: - None Project status: - We cut the branch Spark 3.5.0 on July 17th 2023. The community is working on bug

Re: ASF board report draft for August

2022-08-10 Thread Matei Zaharia
Actually I forgot to add one more item. I want to mention that the community started a large effort to improve Structured Streaming performance, usability, APIs, and connectors (https://issues.apache.org/jira/browse/SPARK-40025 ), and we’d love

ASF board report draft for August

2022-08-10 Thread Matei Zaharia
It’s time to submit our quarterly report to the ASF board on Friday. Here is a draft, lmk if you have suggestions: === Description: Apache Spark is a fast and general purpose engine for large-scale data processing. It offers high-level APIs in Java, Scala, Python, R and SQL

Re: ASF board report draft for August

2021-08-10 Thread Matei Zaharia
Good point, I’ll make sure to include that. > On Aug 9, 2021, at 9:20 PM, Mridul Muralidharan wrote: > > Hi Matei, > > 3.2 will also include support for pushed based shuffle (spip SPARK-30602). > > Regards, > Mridul > > On Mon, Aug 9, 2021 at 9:26 PM Hyukjin Kwon

Re: ASF board report draft for August

2021-08-09 Thread Mridul Muralidharan
Hi Matei, 3.2 will also include support for pushed based shuffle (spip SPARK-30602). Regards, Mridul On Mon, Aug 9, 2021 at 9:26 PM Hyukjin Kwon wrote: > > Are you referring to what version of Koala project? 1.8.1? > > Yes, the latest version 1.8.1. > > 2021년 8월 10일 (화) 오전 11:07, Igor Costa

Re: ASF board report draft for August

2021-08-09 Thread Hyukjin Kwon
> Are you referring to what version of Koala project? 1.8.1? Yes, the latest version 1.8.1. 2021년 8월 10일 (화) 오전 11:07, Igor Costa 님이 작성: > Hi Matei, nice update > > > Just one question, when you mention “ We are working on Spark 3.2.0 as > our next release, with a release candidate likely to

Re: ASF board report draft for August

2021-08-09 Thread Hyukjin Kwon
There is an SPIP passed and ready for Spark 3.2: pandas API on Spark: - JIRA: SPIP: Support pandas API layer on PySpark ( https://issues.apache.org/jira/browse/SPARK-34849) - Vote: [VOTE] SPIP: Support pandas API layer on PySpark ( https://www.mail-archive.com/dev@spark.apache.org/msg27605.html)

Re: ASF board report draft for August

2021-08-09 Thread Igor Costa
Hi Matei, nice update Just one question, when you mention “ We are working on Spark 3.2.0 as our next release, with a release candidate likely to come soon. Spark 3.2 includes a new Pandas API for Apache Spark based on the Koalas project” Are you referring to what version of Koala project?

ASF board report draft for August

2021-08-09 Thread Matei Zaharia
It’s time for our quarterly report to the ASF board, which we need to send out this Wednesday. I wrote the draft below based on community activity — let me know if you’d like to add or change anything: == Description: Apache Spark is a fast and general

ASF board report draft for August

2020-08-10 Thread Matei Zaharia
Hi all, Our quarterly project board report needs to be submitted on August 12th, and I wanted to include anything notable going on that we want to appear in the board archive. Here is my draft below; let me know if you have suggested changes. ===

ASF board report draft for August

2019-08-12 Thread Matei Zaharia
Hi all, It’s time to submit our quarterly report to the ASF board again this Wednesday. Here is my draft about what’s new — feel free to suggest changes. Apache Spark is a fast and general engine for large-scale data processing. It offers high-level APIs in Java, Scala, Python and