[VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-07 Thread Xinrong Meng
Please vote on releasing the following candidate(RC7) as Apache Spark version 3.4.0. The vote is open until 11:59pm Pacific time *April 12th* and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 3.4.0 [ ] -1 Do not release this

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

2023-04-07 Thread Dongjoon Hyun
Thank you! Dongjoon On Fri, Apr 7, 2023 at 2:16 PM Xinrong Meng wrote: > I am able to proceed with the release now. I'll send an announcement when > the RC cut is completed. > > Xinrong > > On Fri, Apr 7, 2023 at 9:54 AM Dongjoon Hyun > wrote: > >> Got it. Thank you for sharing the current

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

2023-04-07 Thread Xinrong Meng
I am able to proceed with the release now. I'll send an announcement when the RC cut is completed. Xinrong On Fri, Apr 7, 2023 at 9:54 AM Dongjoon Hyun wrote: > Got it. Thank you for sharing the current status. > > Dongjoon. > > On Fri, Apr 7, 2023 at 9:21 AM Xinrong Meng > wrote: > >> Hi

Re: Slack for Spark Community: Merging various threads

2023-04-07 Thread Bjørn Jørgensen
Yes, I have done some search for slack alternatives I feel that we should do some search, to find if there can be a better solution than slack. For what I have found, there are two that can be an alternative for slack. Rocket.Chat

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

2023-04-07 Thread Dongjoon Hyun
Got it. Thank you for sharing the current status. Dongjoon. On Fri, Apr 7, 2023 at 9:21 AM Xinrong Meng wrote: > Hi Dongjoon, > > Yes, it is. To be more specific, we failed to build documentation for RC7 > because of the sbt build outage. > > Xinrong > > On Fri, Apr 7, 2023 at 9:12 AM Dongjoon

Re: Slack for Spark Community: Merging various threads

2023-04-07 Thread Holden Karau
I think there was some concern around how to make any sync channel show up in logs / index / search results? On Fri, Apr 7, 2023 at 9:41 AM Dongjoon Hyun wrote: > Thank you, All. > > I'm very satisfied with the focused and right questions for the real > issues by removing irrelevant claims. :)

Re: Slack for Spark Community: Merging various threads

2023-04-07 Thread Dongjoon Hyun
Thank you, All. I'm very satisfied with the focused and right questions for the real issues by removing irrelevant claims. :) Let me collect your relevant comments simply. # Category 1: Invitation Hurdle > The key question here is that do PMC members have the bandwidth of inviting everyone in

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

2023-04-07 Thread Xinrong Meng
Hi Dongjoon, Yes, it is. To be more specific, we failed to build documentation for RC7 because of the sbt build outage. Xinrong On Fri, Apr 7, 2023 at 9:12 AM Dongjoon Hyun wrote: > Hi, Xinrong. > > I saw the RC7 tag. Maybe, RC7 vote is blocked due to the on-going build > outage? > >

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

2023-04-07 Thread Dongjoon Hyun
Hi, Xinrong. I saw the RC7 tag. Maybe, RC7 vote is blocked due to the on-going build outage? Dongjoon. On Thu, Apr 6, 2023 at 6:17 PM Xinrong Meng wrote: > Thank you! Let me recut the RC then. > > On Thu, Apr 6, 2023 at 6:14 PM Hyukjin Kwon wrote: > >> Merged the fix. >> >> On Fri, 7 Apr

Re: sbt build is broken because repo is not available

2023-04-07 Thread Dongjoon Hyun
Thank you for the pointer, Yuming. Dongjoon. On Fri, Apr 7, 2023 at 12:18 AM Yuming Wang wrote: > Hi all, > > sbt build is broken because repo is not available. Please see: > https://github.com/sbt/sbt/issues/7202. > >

[SparkSQL, SparkUI, RESTAPI] How to extract the WholeStageCodeGen ids from SparkUI

2023-04-07 Thread Chenghao Lyu
Hi, The detailed stage page shows the involved WholeStageCodegen Ids in its DAG visualization from the Spark UI when running a SparkSQL. (e.g., under the link node:18088/history/application_1663600377480_62091/stages/stage/?id=1=0). However, I have trouble extracting the WholeStageCodegen ids

sbt build is broken because repo is not available

2023-04-07 Thread Yuming Wang
Hi all, sbt build is broken because repo is not available. Please see: https://github.com/sbt/sbt/issues/7202.