Re: ASF board report draft for Feb 2023

2023-02-06 Thread Dongjoon Hyun
Thank you, Matei. Could you include the following addtionally? 1. Liang-Chi is preparing v3.3.2 (This month). https://lists.apache.org/thread/nwzr3o2cxyyf6sbb37b8yylgcvmbtp16 2. Since Spark 3.4.0, we attached SBOM to Apache Spark Maven artifacts [SPARK-41893] in line with other ASF projects.

ASF board report draft for Feb 2023

2023-02-06 Thread Matei Zaharia
Hi all, It’s time to send our quarterly report to the ASF board this Wednesday (Feb 8th). Here is a draft; let me know if you have suggestions: === Issues for the board: - None Project status: - We cut the branch Spark 3.4.0 on Jan 24th 2023. The community is working on

Re: Pandas UDF cogroup.applyInPandas with multiple dataframes

2023-02-06 Thread Santosh Pingale
Created a PR: https://github.com/apache/spark/pull/39902 > On 24 Jan 2023, at 15:04, Santosh Pingale wrote: > > Hey all > > I have an interesting problem in hand. We have cases where we want to pass > multiple(20 to 30) data frames to