Re: Slack for PySpark users

2023-04-03 Thread Dongjoon Hyun
Thank you, Denny. May I interpret your comment as a request to support multiple channels in ASF too? > because it would allow us to create multiple channels for different topics Any other reasons? Dongjoon. On Mon, Apr 3, 2023 at 5:31 PM Denny Lee wrote: > I do think creating a new Slack

Re: Slack for PySpark users

2023-04-03 Thread Denny Lee
I do think creating a new Slack channel would be helpful because it would allow us to create multiple channels for different topics - streaming, graph, ML, etc. We would need a volunteer core to maintain it so we can keep the spirit and letter of ASF / code of conduct. I’d be glad to volunteer

Re: Slack for PySpark users

2023-04-03 Thread Dongjoon Hyun
Shall we summarize the discussion so far? To sum up, "ASF Slack" vs "3rd-party Slack" was the real background to initiate this thread instead of "Slack" vs "Mailing list"? If ASF Slack provides what you need, is it better than creating a new Slack channel? Or, is there another reason for us to

Re: Slack for PySpark users

2023-04-03 Thread Mich Talebzadeh
I agree, whatever individual sentiments are. Mich Talebzadeh, Lead Solutions Architect/Engineering Lead Palantir Technologies Limited view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at

Re: Slack for PySpark users

2023-04-03 Thread Jungtaek Lim
Just to be clear, if there is no strong volunteer to make the new community channel stay active, I'd probably be OK to not fork the channel. You can see a strong counter example from #spark channel in ASF. It is the place where there are only questions and promos but zero answers. I see volunteers

Re: Slack for PySpark users

2023-04-03 Thread Jungtaek Lim
The number of subscribers doesn't give any meaningful value. Please look into the number of mails being sent to the list. https://lists.apache.org/list.html?user@spark.apache.org The latest month there were more than 200 emails being sent was Feb 2022, more than a year ago. It was more than 1k in

Re: Looping through a series of telephone numbers

2023-04-03 Thread Gera Shegalov
+1 to using a UDF. E.g., TransmogrifAI uses libphonenumber https://github.com/google/libphonenumber that normalizes

Re: Slack for PySpark users

2023-04-03 Thread Dongjoon Hyun
Do you think there is a way to put it back to the official ASF-provided Slack channel? Dongjoon. On Mon, Apr 3, 2023 at 2:18 PM Mich Talebzadeh wrote: > > I for myself prefer to use the newly formed slack. > > sparkcommunitytalk.slack.com > > In summary, it may be a good idea to take a tour of

Re: Slack for PySpark users

2023-04-03 Thread Mich Talebzadeh
I for myself prefer to use the newly formed slack. sparkcommunitytalk.slack.com In summary, it may be a good idea to take a tour of it and see for yourself. Topics are sectioned as per user requests. I trust this answers your question. Mich Talebzadeh, Lead Solutions Architect/Engineering Lead

Re: Slack for PySpark users

2023-04-03 Thread Dongjoon Hyun
As Mich Talebzadeh pointed out, Apache Spark has an official Slack channel. > It's unavoidable if "users" prefer to use an alternative communication mechanism rather than the user mailing list. The following is the number of people in the official channels. - user@spark.apache.org has 4519