Re: Apache Spark 3.3 Release

Thanks Maxim for volunteering to drive the release! I support the plan (March 15th) to perform a release branch cut. Btw, would we be open for modification of critical/blocker issues after the release branch cut? I have a blocker JIRA ticket and the PR is open for reviewing, but need some time to

Re: Apache Spark 3.3 Release

Thank you, Max, for volunteering for Apache Spark 3.3 release manager. Ya, I'm also +1 for the original plan. Dongjoon On Thu, Mar 3, 2022 at 10:52 AM Mridul Muralidharan wrote: > > Agree with Sean, code freeze by mid March sounds good. > > Regards, > Mridul > > On Thu, Mar 3, 2022 at 12:47

Re: Apache Spark 3.3 Release

Agree with Sean, code freeze by mid March sounds good. Regards, Mridul On Thu, Mar 3, 2022 at 12:47 PM Sean Owen wrote: > I think it's fine to pursue the existing plan - code freeze in two weeks > and try to close off key remaining issues. Final release pending on how > those go, and testing,

Re: Apache Spark 3.3 Release

I think it's fine to pursue the existing plan - code freeze in two weeks and try to close off key remaining issues. Final release pending on how those go, and testing, but fine to get the ball rolling. On Thu, Mar 3, 2022 at 12:45 PM Maxim Gekk wrote: > Hello All, > > I would like to bring on

Apache Spark 3.3 Release

Hello All, I would like to bring on the table the theme about the new Spark release 3.3. According to the public schedule at https://spark.apache.org/versioning-policy.html, we planned to start the code freeze and release branch cut on March 15th, 2022. Since this date is coming soon, I would

Re: Spark Streaming | Dynamic Action Support

In short, I don't think there is such a possibility. However, there is the option of shutting down spark gracefully with checkpoint directory enabled. In such a way you can re-submit the modified code which will pick up BatchID from where it was left off, assuming the topic is the same. See the

Re: Spark Streaming | Dynamic Action Support

What is the definition of action here? view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any

Spark Streaming | Dynamic Action Support

Hi, Is there any way I can add/delete actions/jobs dynamically in a running spark streaming job. I will call an API and execute only the configured actions in the system. Eg . In the first batch suppose there are 5 actions in the spark application. Now suppose some configuration is changed and

Re: `running-on-kubernetes` page render bad in v3.2.1(latest) website

It already has been fixed by: https://github.com/apache/spark/pull/35572 Sorry for bothering here. Just ignore my previous email.