Re: [VOTE] Release Apache Spark 3.5.0 (RC2)

2023-08-24 Thread Yuanjian Li
-1, do not release this package because the correctness issue https://issues.apache.org/jira/browse/SPARK-44871 / https://github.com/apache/spark/pull/42559 was not addressed in RC2. The vote has failed. I plan to cut RC3 in two days. Best, Yuanjian yangjie01 于2023年8月20日周日 20:24写道: > -1, due

Re: Some questions about Spark github action

2023-08-24 Thread Jia Fan
Thanks Xinrong and Jack. I will take a look, also I find https://github.com/apache/spark/pull/32092 is what I want. Thanks a lot. Xinrong Meng 于2023年8月25日周五 04:30写道: > Hi Jia, > > Consider reviewing GitHub Action variables like > $GITHUB_REPOSITORY. Detailed information can be found >

Fwd:  Wednesday: Join 6 Members at "Ofir Press | Complementing Scale: Novel Guidance Methods for Improving LMs"

2023-08-24 Thread Mich Talebzadeh
They recently combined Apache Spark and AI meeting in London. An online session worth attending for some? HTH Mich view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk.

Re: Some questions about Spark github action

2023-08-24 Thread Xinrong Meng
Hi Jia, Consider reviewing GitHub Action variables like $GITHUB_REPOSITORY. Detailed information can be found https://docs.github.com/en/actions/learn-github-actions/variables. Additionally, you might find the code segment

Re: Some questions about Spark github action

2023-08-24 Thread Jack Wells
Hi Jia, Github Action workflows are stored in the .github/workflows directory off the base of the git repo. Here’s a link: https://github.com/apache/spark/tree/master/.github/workflows. Does this help? Jack On Aug 24, 2023 at 04:54:31, Jia Fan wrote: > Hi, folks > I'm a PMC member of

Re: What else could be removed in Spark 4?

2023-08-24 Thread Steve Loughran
I would recommend cutting them. + historically they've fixed the version of aws-sdk jar used in spark releases, meaning s3a connector through spark rarely used the same sdk release as that qualified through the hadoop sdk update process, so if there were incompatibilities, it'd be up to the spark

Some questions about Spark github action

2023-08-24 Thread Jia Fan
Hi, folks I'm a PMC member of Apache SeaTunnel. Recently, I’m optimizing the github action process on SeaTunnel. The main purpose is to be like Spark, when a developer submits a PR, it can automatically run github action on the fork repository instead of the main repository. In this way, all