Re: [VOTE] Release Apache Spark 3.4.0 (RC5)

Sorry for the last-minute change, but we found two wrong behaviors and want to fix them before the release: https://github.com/apache/spark/pull/40641 We missed a corner case when the input index for `array_insert` is 0. It should fail as 0 is an invalid index.

Re: [VOTE] Release Apache Spark 3.4.0 (RC5)

+1 On Tue, Apr 4, 2023 at 3:46 AM L. C. Hsieh wrote: > +1 > > Thanks Xinrong. > > On Mon, Apr 3, 2023 at 12:35 PM Dongjoon Hyun > wrote: > > > > +1 > > > > I also verified that RC5 has SBOM artifacts. > > > > >

Re: Slack for PySpark users

Thank you, Denny. May I interpret your comment as a request to support multiple channels in ASF too? > because it would allow us to create multiple channels for different topics Any other reasons? Dongjoon. On Mon, Apr 3, 2023 at 5:31 PM Denny Lee wrote: > I do think creating a new Slack

Re: Slack for PySpark users

I do think creating a new Slack channel would be helpful because it would allow us to create multiple channels for different topics - streaming, graph, ML, etc. We would need a volunteer core to maintain it so we can keep the spirit and letter of ASF / code of conduct. I’d be glad to volunteer

Re: Slack for PySpark users

Shall we summarize the discussion so far? To sum up, "ASF Slack" vs "3rd-party Slack" was the real background to initiate this thread instead of "Slack" vs "Mailing list"? If ASF Slack provides what you need, is it better than creating a new Slack channel? Or, is there another reason for us to

Re: Slack for PySpark users

I agree, whatever individual sentiments are. Mich Talebzadeh, Lead Solutions Architect/Engineering Lead Palantir Technologies Limited view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at

Re: Slack for PySpark users

Just to be clear, if there is no strong volunteer to make the new community channel stay active, I'd probably be OK to not fork the channel. You can see a strong counter example from #spark channel in ASF. It is the place where there are only questions and promos but zero answers. I see volunteers

Re: Slack for PySpark users

The number of subscribers doesn't give any meaningful value. Please look into the number of mails being sent to the list. https://lists.apache.org/list.html?u...@spark.apache.org The latest month there were more than 200 emails being sent was Feb 2022, more than a year ago. It was more than 1k in

Re: Slack for PySpark users

Do you think there is a way to put it back to the official ASF-provided Slack channel? Dongjoon. On Mon, Apr 3, 2023 at 2:18 PM Mich Talebzadeh wrote: > > I for myself prefer to use the newly formed slack. > > sparkcommunitytalk.slack.com > > In summary, it may be a good idea to take a tour of

Re: Slack for PySpark users

I for myself prefer to use the newly formed slack. sparkcommunitytalk.slack.com In summary, it may be a good idea to take a tour of it and see for yourself. Topics are sectioned as per user requests. I trust this answers your question. Mich Talebzadeh, Lead Solutions Architect/Engineering Lead

Re: Slack for PySpark users

As Mich Talebzadeh pointed out, Apache Spark has an official Slack channel. > It's unavoidable if "users" prefer to use an alternative communication mechanism rather than the user mailing list. The following is the number of people in the official channels. - u...@spark.apache.org has 4519

Re: [VOTE] Release Apache Spark 3.4.0 (RC5)

+1 Thanks Xinrong. On Mon, Apr 3, 2023 at 12:35 PM Dongjoon Hyun wrote: > > +1 > > I also verified that RC5 has SBOM artifacts. > > https://repository.apache.org/content/repositories/orgapachespark-1439/org/apache/spark/spark-core_2.12/3.4.0/spark-core_2.12-3.4.0-cyclonedx.json >

Re: [VOTE] Release Apache Spark 3.4.0 (RC5)

+1 Compiled on Java 17 with Scala 2.13 on macos and ran some basic code. Pozdrawiam, Jacek Laskowski "The Internals Of" Online Books Follow me on https://twitter.com/jaceklaskowski On Thu, Mar 30, 2023 at 10:21 AM Xinrong

Re: [VOTE] Release Apache Spark 3.4.0 (RC5)

+1 I also verified that RC5 has SBOM artifacts. https://repository.apache.org/content/repositories/orgapachespark-1439/org/apache/spark/spark-core_2.12/3.4.0/spark-core_2.12-3.4.0-cyclonedx.json

Re: [VOTE] Release Apache Spark 3.4.0 (RC5)

+1, checked Java 17 + Scala 2.13 + Python 3.10.10. 发件人: Herman van Hovell 日期: 2023年3月31日 星期五 12:12 收件人: Sean Owen 抄送: Xinrong Meng , dev 主题: Re: [VOTE] Release Apache Spark 3.4.0 (RC5) +1 On Thu, Mar 30, 2023 at 11:05 PM Sean Owen mailto:sro...@apache.org>> wrote: +1 same result from me as