+1
Yes, it's a perfect timing to deliver Spark 3.5.7.
Thank you for volunteering for it, Peter.
Dongjoon.
On 2025/09/09 15:49:36 Peter Toth wrote:
> Hi dev list,
>
> Apache Spark 3.5.6 was released on May 29, 2025, so it's been more than 3
> months.
> As far
)
Apache Spark 4.1.0-preview3 (2025-11-02)
Apache Spark 4.1.0 Feature Freeze (2025-11-02)
Apache Spark 4.1.0 RC1 (2025-11-23)
I'm sure that we have a sufficient plan to handle Spark 4.1.0 for November. So,
please don't worry.
Dongjoon.
On 2025/09/09 05:23:21 Xiao Li wrote:
> I have the sam
will volunteer as the release manager of Apache Spark 4.1.0 to finish it
on time.
Dongjoon.
On Mon, Sep 8, 2025 at 11:25 AM Holden Karau wrote:
> I like that, I think it’s a little tight but if we scope down it should be
> fine. Our history of trying to do releases in December is not great s
11-23 Release candidates (RC)
For Apache Spark 4.1.0 progress, you can refer to the umbrella JIRA issue
and its subtasks. In addition, you can add your on-going JIRA issues there
too.
https://issues.apache.org/jira/browse/SPARK-51166
(SPARK-51166 Prepare Apache Spark 4.1.0)
WDYT?
Thanks,
Dongjoon.
The vote passes with 21 +1s (9 binding +1s).
Thanks to all who helped with the release!
(* = binding)
+1:
- Max Gekk *
- Yang Jie *
- Peter Toth
- Kent Yao *
- John Zhuge
- Wenchen Fan *
- Cheng Pan
- Kousuke Saruta *
- Liang-Chi Hsieh *
- Dongjoon Hyun *
- Huaxin Gao *
- Prashant Singh
- Jafeer
have been possible without you.
Dongjoon Hyun
Thank you all. This vote passed.
I'll conclude this vote.
Dongjoon.
On 2025/09/04 18:02:47 Szehon Ho wrote:
> +1 (non binding)
>
> Checked signature, checksum, and ran basic test on spark-4.0.1-bin-hadoop3.
>
> Thanks Dongjoon
> Szehon
>
> On Tue, Sep 2,
Great!
Thank you, Hyukjin.
Dongjoon.
On 2025/09/03 00:31:53 Hyukjin Kwon wrote:
> Hi, all.
>
> To enable wide-scale community testing of the upcoming Spark 4.1.0 release,
> the Apache Spark community has posted a Spark 4.1.0-preview1 release
> <https://dist.apache.org/repos/
antic Versioning` world.
We can discuss more on SPARK-53420 independently.
Thanks,
Dongjoon.
On Tue, Sep 2, 2025 at 8:03 PM Yuming Wang wrote:
> Could we upgrade parquet to 1.16.0(
> https://github.com/apache/parquet-java/releases/tag/apache-parquet-1.16.0)
> to this data issue(https://git
+1
Dongjoon
On 2025/09/02 15:23:55 "L. C. Hsieh" wrote:
> +1
>
> On Tue, Sep 2, 2025 at 6:08 AM Wenchen Fan wrote:
> >
> > +1
> >
> > On Tue, Sep 2, 2025 at 1:48 PM wrote:
> >>
> >> Please vote on releasing the following candida
Please vote on releasing the following candidate as Apache Spark version 4.0.1.
The vote is open until Fri, 05 Sep 2025 22:47:52 PDT and passes if a majority
+1 PMC votes are cast, with
a minimum of 3 +1 votes.
[ ] +1 Release this package as Apache Spark 4.0.1
[ ] -1 Do not release this package
Thank you, Angel, Vlad, Jules, Jungtaek.
Dongjoon.
On 2025/08/28 05:34:20 Jungtaek Lim wrote:
> +1 I was thinking of doing this since we had several major fixes on the new
> API transformWithState, but forgot about it. Thanks for raising this!
>
> On Thu, Aug 28, 2025 at 6:36 AM
Thank you, Bjorn, Cheng, Kent, Jie, Peter, Wenchen, Anish.
I'm starting the preparation including rechecking the current PyPi issue status.
Thanks,
Dongjoon.
On 2025/08/26 16:07:35 Anish Shrigondekar wrote:
> +1 - Thanks Dongjoon !
>
> Thanks,
> Anish
>
> On Tue,
2025-09-02.
Best regards,
Dongjoon Hyun.
PS. I don't think any PyPi issues need to block the ASF release processes.
So, the official ASF distribution channels and Maven Central are the main
target for this release.
+1
Dongjoon
On Tue, Jul 8, 2025 at 05:41 Hyukjin Kwon wrote:
> Alright. +1 from myself :-).
>
> On Tue, Jul 8, 2025 at 9:39 PM wrote:
>
>> Please vote on releasing the following candidate as Apache Spark version
>> 4.1.0-preview1.
>>
>> The vote is open unt
://github.com/apache/spark-kubernetes-operator/releases/tag/0.4.0
* https://s.apache.org/spark-kubernetes-operator-0.4.0
- Published Docker Image
* apache/spark-kubernetes-operator:0.4.0
Cheers,
Dongjoon.
The vote passes with 9 +1s (5 binding +1s).
Thanks to all who helped with the release!
(* = binding)
+1:
- Peter Toth
- Zhou Jiang
- Huaxin Gao *
- Liang-Chi Hsieh *
- Wenchen Fan *
- Yang Jie *
- Attila Mészáros
- Liu Cao
- Dongjoon Hyun *
+0: None
-1: None
Thank you all. This vote passed. I'll conclude the vote.
Dongjoon.
On 2025/07/03 15:50:13 Dongjoon Hyun wrote:
> +1
>
> Dongjoon
>
> On 2025/07/01 20:37:07 Liu Cao wrote:
> > +1 (non-binding)
> >
> > On Mon, Jun 30, 2025 at 11:17 PM Attila Mészáros w
+1
Dongjoon
On 2025/07/01 20:37:07 Liu Cao wrote:
> +1 (non-binding)
>
> On Mon, Jun 30, 2025 at 11:17 PM Attila Mészáros wrote:
>
> > +1
> >
> > On Tue, Jul 1, 2025 at 8:11 AM Yang Jie wrote:
> > >
> > > +1
> > >
> > > On 20
+1
On 2025/07/03 06:44:32 "L. C. Hsieh" wrote:
> +1
>
> On Wed, Jul 2, 2025 at 9:38 PM Hyukjin Kwon wrote:
> >
> > Hi all,
> >
> > I would like to start a vote on the monthly preview releases.
> >
> > Discussion thread:
> > https://lists.apache.org/thread/1hmsb3g7lm5k2f9xnp6x2hmss8yrd5h8
> > SP
Spark Connect for Swift" and
"Spark K8s Operator". :-)
Thank you again.
Dongjoon.
On 2025/07/02 00:31:10 Hyukjin Kwon wrote:
> Hi Dongjoon,
>
> Thanks a lot for your detailed feedback and great questions!
> Let me clarify my current proposal and thoughts:
>
> 1.
ke `4.0.1`, ..., `4.0.2`.
In short, "Automated Monthly Maintenance Release" might be the prerequisite for
"Monthly Preview Release". What do you think about that? Can we extend your
SPIP in this direction?
Thanks,
Dongjoon.
On 2025/06/30 23:34:54 Hyukjin Kwon wrote:
2016.11 (1.6.3)
Spark 2: 2016.07 (2.0.0) ~ 2021.05 (2.4.8)
Spark 3: 2020.06 (3.0.0) ~ 2026.04 (3.5.x)
Spark 4: 2025.02 (4.0.0) ~ 2031?
Maybe, we want to revisit this topic when we start to discuss Apache Spark 5
someday.
Best,
Dongjoon.
On 2025/06/25 17:08:58 Yaniv Kunda wrote:
> Hi all,
>
/projects/SPARK/versions/12355993
Thanks,
Dongjoon.
+1 for the proposal, Hyukjin. Thank you for the whole and seamless
migration toward this direction.
Please make it sure that we explicitly show the human release manager name
and email address (instead of bot sender) in the generated email. That's
the only concern I have.
Thanks,
Dongjoon.
Image
* apache/spark-kubernetes-operator:0.3.0
Cheers,
Dongjoon.
The vote passes with 12 +1s (7 binding +1s).
Thanks to all who helped with the release!
(* = binding)
+1:
- Zhou Jiang
- Huaxin Gao *
- Liang-Chi Hsieh *
- Peter Toth
- Yang Jie *
- DB Tsai *
- Wenchen Fan *
- Liu Cao
- Vlad Rozov
- Dongjoon Hyun *
- Jungtaek Lim
- Xinrong Meng *
+0: None
-1
Thank you all.
This vote passed. I'll conclude this one.
Dongjoon.
On 2025/06/03 00:45:13 Xinrong Meng wrote:
> +1
>
> Thanks Dongjoon!
>
> On Mon, Jun 2, 2025 at 4:29 PM Jungtaek Lim
> wrote:
>
> > +1 (non-binding)
> >
> > On Mon, Jun 2, 2025 a
The vote passes with 15 +1s (9 binding +1s).
Thanks to all who helped with the release.
(* = binding)
+1:
- Zhou Jiang
- Huaxin Gao *
- Liang-Chi Hsieh *
- Peter Toth
- Yang Jie *
- DB Tsai *
- Yuanjian Li *
- Wenchen Fan *
- Vlad Rozov
- Dongjoon Hyun *
- Sandy Ryza
- Denny Lee
- Jungtaek Lim
/tag/0.3.0
- https://s.apache.org/spark-connect-swift-0.3.0
Swift Package Index
- https://swiftpackageindex.com/apache/spark-connect-swift
Cheers,
Dongjoon.
Thank you all.
This vote passed. I'll conclude this.
Dongjoon.
On 2025/06/03 00:45:20 Reynold Xin wrote:
> +1
>
> On Mon, Jun 2, 2025 at 5:45 PM Xinrong Meng wrote:
>
> > +1
> >
> > Thank you Dongjoon!
> >
> > On Mon, Jun 2, 2025 at 4:29 PM Ju
+1
Dongjoon
On 2025/06/02 13:13:45 "Rozov, Vlad" wrote:
> +1 (non-binding)
>
> Thank you,
>
> Vlad
>
> On Jun 1, 2025, at 7:21 PM, Wenchen Fan wrote:
>
> +1
>
> On Mon, Jun 2, 2025 at 9:55 AM Yuanjian Li
> mailto:xyliyuanj...@gmail.com>&
+1
Dongjoon
On 2025/06/02 13:12:46 "Rozov, Vlad" wrote:
> +1 (non-binding)
>
> Thank you,
>
> Vlad
>
> On Jun 1, 2025, at 7:44 PM, Liu Cao wrote:
>
> +1 (non-binding)
>
> On Sun, Jun 1, 2025 at 7:22 PM Wenchen Fan
> mailto:cloud0...@gmail.c
+1
Dongjoon
On Sun, Jun 1, 2025 at 12:02 L. C. Hsieh wrote:
> Hi all,
>
> I would like to start a vote on the new real-time mode in Apache Spark
> Structured Streaming.
>
> Discussion thread:
> https://lists.apache.org/thread/ovmfbzfkc3t9odvv5gs75fhpvdckn90f
> SPIP:
&
://dist.apache.org/repos/dist/dev/spark/spark-kubernetes-operator-0.3.0-rc.1/
LIST OF ISSUES:
https://issues.apache.org/jira/projects/SPARK/versions/12355949
Thanks,
Dongjoon.
/spark-connect-swift-0.3.0-rc.1/
LIST OF ISSUES:
https://issues.apache.org/jira/projects/SPARK/versions/12355948
Thanks,
Dongjoon.
Thank you, Hyujjin!
It's really great.
Dongjoon.
On Thu, May 29, 2025 at 00:41 Hyukjin Kwon wrote:
> Yup I'll write it down 👍
>
> On Thu, May 29, 2025 at 4:39 PM Jungtaek Lim
> wrote:
>
>> Awesome work! I also can't see the screenshots. Maybe we'd
properly and safely. Then, Apache Spark 3.5.x can
upgrade to Apache Parquet 1.13.2 from 1.13.1.
WDYT, Vlad?
Dongjoon.
On 2025/05/28 04:09:39 Hyukjin Kwon wrote:
> It's written in https://spark.apache.org/versioning-policy.html.
> Spark follows semver. Improvements go to the feature versi
+1 from my side.
Thank you, Hyukjin.
Dongjoon
On 2025/05/26 22:19:22 Hyukjin Kwon wrote:
> Thanks guys. BTW for clarification, this is the preparation of more
> frequent releases so we don't have to wait so long for each release. Let's
> prepare this first, and roll it fas
ll/50755
Dongjoon.
On 2025/05/26 03:08:32 "Rozov, Vlad" wrote:
> There is an existing PR that was reverted due to a deadlock. As deadlock is
> now fixed, the revert can now be undone.
>
> https://github.com/apache/spark/pull/50528
> https://github.com/apache/spark/commit/eb6cc4c
heck signature: No public key
Dongjoon.
On 2025/05/23 17:56:25 Allison Wang wrote:
> +1
>
> On Fri, May 23, 2025 at 10:15 AM Hyukjin Kwon wrote:
>
> > Oh it's actually a test and also to release. Let me know if you have any
> > concern!
> >
> > On Fri, Ma
://github.com/apache/spark-kubernetes-operator/releases/tag/0.2.0
* https://s.apache.org/spark-kubernetes-operator-0.2.0
- Published Docker Image
* apache/spark-kubernetes-operator:0.2.0
Cheers,
Dongjoon.
The vote passes with 11 +1s (7 binding +1s).
Thanks to all who helped with the release!
(* = binding)
+1:
- Dongjoon Hyun *
- Zhou Jiang
- Liang-Chi Hsieh *
- Huaxin Gao *
- Hyukjin Kwon *
- Peter Toth
- Vlad Rozov
- Liu Cao
- Wenchen Fan *
- Ruifeng Zheng *
- Yang Jie *
+0: None
-1: None
Thank you all. This vote passed.
I'm going to conclude this vote.
Dongjoon.
On 2025/05/19 04:55:53 Yang Jie wrote:
> +1
>
> On 2025/05/19 04:53:52 Ruifeng Zheng wrote:
> > +1
> >
> > On Mon, May 19, 2025 at 12:34 PM Wenchen Fan wrote:
> >
> > >
Package Index
- https://swiftpackageindex.com/apache/spark-connect-swift
Cheers,
Dongjoon.
The vote passes with 11 +1s (7 binding +1s).
Thanks to all who helped with the release.
(* = binding)
+1:
- Dongjoon Hyun *
- Peter Toth
- Huaxin Gao *
- Liang-Chi Hsieh *
- Hyukjin Kwon *
- Zhou Jiang
- Vlad Rozov
- Jules Damji
- Wenchen Fan *
- Ruifeng Zheng *
- Yang Jie *
+0: None
-1: None
Thank you all.
This vote passed. I'll conclude this vote.
Dongjoon.
On 2025/05/19 04:59:29 Yang Jie wrote:
> +1
>
> On 2025/05/19 04:53:38 Ruifeng Zheng wrote:
> > +1
> >
> > On Mon, May 19, 2025 at 12:34 PM Wenchen Fan wrote:
> >
> > > +1
&g
+1
It's great. Thank you, Hyukjin.
Dongjoon.
On Tue, May 20, 2025 at 3:18 AM Hyukjin Kwon wrote:
> Thanks guys.
>
> Just to avoid surprises, there would be a bit of commits, reverts, tag
> removal and creations in branch-3.5 (
> https://github.com/apache/spark/commits/br
+1
Thank you, Wenchen.
Dongjoon.
On Mon, May 19, 2025 at 5:27 PM Gengliang Wang wrote:
> +1
>
> On Mon, May 19, 2025 at 5:21 PM Jungtaek Lim
> wrote:
>
>> +1 (non-binding)
>>
>> On Tue, May 20, 2025 at 8:47 AM Ruifeng Zheng
>> wrote:
>>
>>&
+1
I checked the shasum and signature and tested with K8s v1.32.
Thanks,
Dongjoon
On 2025/05/17 15:19:58 Dongjoon Hyun wrote:
> Please vote on releasing the following candidate as Apache Spark K8s
> Operator 0.2.0. This vote is open for the next 72 hours and passes if a
> majority +1
/projects/SPARK/versions/12355908
Thanks,
Dongjoon.
+1.
I checked the checksum and signature and tested with Spark 4.0.0 RC6.
Thanks,
Dongjoon.
On 2025/05/17 12:39:39 Dongjoon Hyun wrote:
> Please vote on releasing the following candidate as Apache Spark Connect
> Swift Client 0.2.0. This vote is open for the next 72 hours and passe
/projects/SPARK/versions/12355907
Thanks,
Dongjoon.
Thank you, Mridul. The typo is fixed like the following.
- Support Apache Spark 3.5 and 4.0
+ Support Apache Spark 3.5 and 4.0 (RC4)
Dongjoon.
On 2025/05/08 15:01:48 Mridul Muralidharan wrote:
> I had not checked the release.
>
> The release notes mention that Apache Spark 4.0 is
-connect-swift
Cheers,
Dongjoon.
The vote passes with 13 +1s (7 binding +1s) and one -1.
Thanks to all who helped with the release and gave us invaluable feedback!
(* = binding)
+1:
- Dongjoon Hyun *
- Liang-Chi Hsieh *
- Huaxin Gao *
- Kazuyuki Tanimura
- Gabor Sommogyi
- DB Tsai *
- Yang Jie *
- Peter Toth
- Jungtaek Lim
Thank you all. This vote passed. Let me conclude this vote.
Dongjoon.
On 2025/05/07 11:22:36 Max Gekk wrote:
> +1
>
> On Tue, May 6, 2025 at 8:52 PM Rozov, Vlad
> wrote:
>
> > +1 (non-binding)
> >
> >
> > On May 6, 2025, at 6:33 AM, Sakthi wrote:
>
-operator:0.1.0
Cheers,
Dongjoon.
The vote passes with 14 +1s (9 binding +1s).
Thanks to all who helped with the release!
(* = binding)
+1:
- Zhou Jiang
- Dongjoon Hyun *
- Vlad Rozov
- Liang-Chi Hsieh *
- Huaxin Gao *
- Kazuyuki Tanimura
- Gabor Sommogyi
- DB Tsai *
- Wenchen Fan *
- Ruifeng Zheng *
- Hyukjin Kwon *
- Kent Yao
Thank you all. This vote passed. I'll conclude this.
Dongjoon.
On 2025/05/06 15:59:34 Dongjoon Hyun wrote:
> To Rozov, we use "Apache SkyWalking Eyes" in our GitHub Action.
>
> - https://github.com/apache/skywalking-eyes
>
> -
> https://github.com/apac
Could you file a JIRA issue with the description of your steps, Martin?
Dongjoon.
On 2025/05/05 10:32:13 Martin Grund wrote:
> Not sure this counts as -1, but by cursory checking the code, I found that
> the way the TLS connection is set up is not always working:
>
> https://githu
ad RAT jar manually and run it.
Dongjoon.
On 2025/05/05 02:36:01 "Rozov, Vlad" wrote:
> +1 (not binding)
>
> Checked checksum and signatures, build, and confirmed that binary files are
> not included into the release.
>
> Is Apache RAT part of the gradle build? If not, h
+1
Dongjoon
On 2025/05/06 14:05:13 "Rozov, Vlad" wrote:
> +1 (non-binding)
>
>
> On May 6, 2025, at 6:34 AM, Sakthi wrote:
>
> +1 (non-binding)
>
> On Tue, May 6, 2025 at 1:30 AM Max Gekk
> mailto:max.g...@gmail.com>> wrote:
> +
+1
I checked the checksum and signatures, and tested with K8s v1.32.
Dongjoon.
On 2025/05/04 23:58:54 Zhou Jiang wrote:
> +1 , thanks for driving this release!
>
> *Zhou JIANG*
>
>
>
> On Sun, May 4, 2025 at 16:58 Dongjoon Hyun wrote:
>
> > Please vote on rel
+1
I checked the checksum and signatures, and tested with Apache Spark 4.0.0 RC4
on Swift 6.1.
This is the initial release (v0.1) with 105 patches to provide a tangible
release to the users.
v0.2 is under planning in SPARK-51999.
Dongjoon.
On 2025/05/04 22:14:54 Dongjoon Hyun wrote
/projects/SPARK/versions/12354567
Thanks,
Dongjoon.
/projects/SPARK/versions/12355780
Thanks,
Dongjoon.
too which uses `spark.sql.optimizer.pruneFiltersCanPruneStreamingSubplan`
already.
https://github.com/apache/spark/pull/50291
- buildConf("spark.sql.optimizer.pruneFiltersCanPruneStreamingSubplan")
+
buildConf("spark.databricks.sql.optimizer.pruneFiltersCanPruneStreamingSubplan")
Dongjoon.
On 2025/03/17 02:36:4
+1 for supporting NanoSecond Timestamps.
Thank you, Qi.
Dongjoon.
-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
at kind of difficulty blocks the Apache Spark
committer.
Thanks,
Dongjoon.
On 2025/03/16 21:08:08 Martin Grund wrote:
> So I was just playing with the Swift client to build a Mac app and
> everything worked nicely! However, similar to the Go repository, my
> suggestion would be to handle issues
tabricks.*` situations, we
should stop now and protect `branch-4.0`. The side-effect and implication is
huge.
Apache Spark 4.0.0 is the only version we can stop this spreading. So,
documentation only is the only feasible way to choose.
So, -1 (= The technical justification for the veto is vali
lease with the AS-IS code with the improved Spark 4.0 migration
guide because I provided a technical justification for my vote via the
concrete alternative based on the existing Spark 3.5.5, AS-IS code base,
and the suggested better migration guide way in order to eliminate the
affected streaming queries.
believe I've been providing all my best to the Apache Spark community by
actions and with valid technical clarification (without no modification
during the process).
Sincerely,
Dongjoon
On Thu, Mar 13, 2025 at 11:41 PM Mridul Muralidharan
wrote:
>
> FWIW, I am +1 on the proposal (t
rs to upgrade to
the next maintenance release before moving to a new feature or major
release?
Thanks,
Dongjoon.
On Thu, Mar 13, 2025 at 12:58 AM Jungtaek Lim
wrote:
> Thanks to everyone who participated and voted!
>
> Now I can technically conclude the VOTE, but I'm willin
`spark-kubernetes-operator` repository.
Thank you again.
Dongjoon.
-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
Thank you, Martin and Yang and Hyukjin.
Dongjoon
On 2025/03/10 14:17:06 Hyukjin Kwon wrote:
> +1
> On Mon, Mar 10, 2025 at 6:48 AM Yang Jie wrote:
>
> > Great! Really happy to see that spark-connect supports more programming
> > languages.
> >
> >
> > On
s at 4.0.0 and 4.1.0.
Given that, I don't think
- This is an inevitable or
- This is 0 cost
Dongjoon.
On 2025/03/10 12:46:16 Jungtaek Lim wrote:
> Starting from my +1 (non-binding).
>
> In addition, I propose to retain migration logic till Spark 4.1.x and
> remove it in Spark
Thank you, Liang-Chi, Wenchen, Max, Kent, Peter, Denny, Huaxin!
Dongjoon.
On 2025/03/10 17:14:27 huaxin gao wrote:
> +1
>
> On Mon, Mar 10, 2025 at 10:04 AM Denny Lee wrote:
>
> > +1 (non-binding)
> >
> > On Mon, Mar 10, 2025 at 9:47 AM Peter Toth wrote:
> &
Swift language in Spark Connect
- https://github.com/dongjoon-hyun/spark-connect-swift
This new repository creation follows our previous community decision for
`Go` language.
- https://lists.apache.org/thread/qhnvtzmq64wbc0glrg2j89lslqb70q67
New Clients for Go and Rust
- https://github.com/apache/
Thank you for leading the discussion, Jungtaek.
+1 for voting because we couldn't build a unanimous consensus on this specific
topic.
Thanks,
Dongjoon.
On 2025/03/07 09:15:39 Jungtaek Lim wrote:
> I'll need to start VOTE to move
uideline because all other Spark versions (except
3.5.4) are not contaminated by `spark.databricks.*` conf.
"For Spark 3.5.4 streaming jobs, if you want to migrate the existing
running jobs, we need to upgrade them to Spark 3.5.5+ before upgrading
Spark 4.0"
Dongjoon.
On Tue, Mar 4,
S `master` and `branch-4.0`
and recommend to upgrade to the latest version of Apache Spark 3.5.x first
before upgrading to Spark 4.
Sincerely,
Dongjoon.
On Tue, Mar 4, 2025 at 8:37 PM Jungtaek Lim
wrote:
> Bumping on this. Again, this is a blocker for Spark 4.0.0. I will consider
> this as &quo
consensus (like an official
voting) for this specific feature.
I guess this discussion thread was initiated as a preparation for that. :)
Thanks,
Dongjoon.
On Tue, Mar 4, 2025 at 7:08 PM Jungtaek Lim
wrote:
> Thank you for understanding. Actually I'm dealing with a blocker for Spark
&
have been possible without you.
Dongjoon Hyun
The vote passes with 8 +1s (4 binding +1s) and 2 -0s (1 binding -0s).
Thanks to all who helped with the release!
(* = binding)
+1:
- Dongjoon Hyun *
- Mich Talebzadeh
- Yang Jie *
- Max Gekk *
- Kent Yao *
- Kakthi
- Chris Nauroth
- Cheng Pan
+0: None
-0:
- Wenchen Fan *
- Vlad Rozov
Thank you all.
Let me conclude this vote.
Dongjoon
On 2025/02/27 06:07:57 Cheng Pan wrote:
> +1 (non-binding)
>
> Pass integration tests with Apache Kyuubi.
>
> Thanks,
> Cheng Pan
>
>
>
> > On Feb 27, 2025, at 14:04, Chris Nauroth wrote:
> >
>
)
Dongjoon.
On 2025/02/26 16:41:51 "Rozov, Vlad" wrote:
> -0 (non-binding).
>
> IMO, it will be good to address
> https://issues.apache.org/jira/browse/SPARK-51318 to avoid legal issues and
> meet ASF source release policy.
>
> Thank you,
>
> Vlad
>
> O
lthough I agree that those test coverages are important, I don't think that's
worthy for Apache Spark community to take a risk to be shutdown. That's the
lesson which I've learned last year.
Sincerely,
Dongjoon.
On 2025/02/26 13:31:56 Sean Owen wrote:
> The gist of the initi
he votes.
https://issues.apache.org/jira/browse/SPARK-51318
(Remove `jar` files from Apache Spark repository and disable affected tests)
WDYT?
BTW, please note that I didn't define SPARK-51318 as a blocker for any
on-going releases yet.
Best regards,
Dongjoon.
Let me spin-off this as a new thread because this is related to all Apache
Spark releases.
Thanks,
Dongjoon
-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
Source Code)
-
https://github.com/apache/hive/blob/rel/release-1.2.2/itests/test-serde/src/main/java/org/apache/hadoop/hive/serde2/TestSerDe.java
Dongjoon.
On 2025/02/26 04:59:56 "Rozov, Vlad" wrote:
> AFAIK, there are 3 ways to satisfy ASF source release policy:
>
> 1. Use source
SPARK-44297 in the same way?
https://issues.apache.org/jira/browse/SPARK-44297
https://github.com/apache/spark/pull/41852
Dongjoon.
On 2025/02/25 19:53:45 "Rozov, Vlad" wrote:
> I am not sure if this was already discussed and noted, so want to confirm
> with PMC members:
>
&g
Jul 19 2016
spark-2.0.0/sql/hive/src/test/resources/TestUDTF.jar
-rw-r--r-- 0 jenkins jenkins1328 Jul 19 2016
spark-2.0.0/sql/hive-thriftserver/src/test/resources/TestUDTF.jar
-rw-r--r-- 0 jenkins jenkins1328 Jul 19 2016
spark-2.0.0/core/src/test/resources/TestUDTF.jar
Dongjoon.
On
- it's not a regression at 3.5.5 (as Wenchen mentioned) and
- it didn't have a proper target version and priority field.
I don't think we should stop this vote.
SPARK-51281 can be a part of Apache Spark 3.5.6 release.
I'll keep this vote open.
Thanks,
Dongjoon.
On Sun, Feb
I'll start with my +1.
I have thoroughly verified all test results, signatures, checksums, and the
recently deprecated configuration.
Dongjoon.
On 2025/02/24 00:37:57 Dongjoon Hyun wrote:
> Please vote on releasing the following candidate as Apache Spark version
> 3.5.5.
>
>
Please vote on releasing the following candidate as Apache Spark version
3.5.5.
The vote is open until February 27th 1AM (PST) and passes if a majority +1
PMC votes are cast, with a minimum of 3 +1 votes.
[ ] +1 Release this package as Apache Spark 3.5.5
[ ] -1 Do not release this package because
+1
Thank you, Max.
Dongjoon.
On 2025/02/23 15:49:58 Max Gekk wrote:
> Hi Spark devs,
>
> Following the discussion [1], I'd like to start the vote for the SPIP [2].
> The SPIP aims to add a new data type TIME to Spark SQL types. New type
> should conform to TIME(n) WITHOUT
7 binding +1s).
Thanks to all who helped with the vote!
(* = binding)
+1:
- Dongjoon Hyun *
- Mark Hamstra *
- Yang Jie *
- Sakthi
- Wenchen Fan *
- Angel
- Mich Talebzadeh
- Jungtaek Lim
- Liang-Chi Hsieh *
- Max Gekk *
- Peter Toth
- Zhou Jiang
- Reynold Xin *
- Denny Lee
- Jules Damji
- Husse
The vote passes with 17 +1s (6 binding +1s).
Thanks to all who helped with the vote!
(* = binding)
+1:
- Dongjoon Hyun *
- Mark Hamstra *
- Yang Jie *
- Sakthi
- Wenchen Fan *
- Angel
- Mich Talebzadeh
- Jungtaek Lim
- Liang-Chi Hsieh *
- Max Gekk
- Peter Toth
- Zhou Jiang
- Reynold Xin *
- Denny
Thank you all. This vote passed.
I'll conclude the vote by sending a vote result email.
Dongjoon.
On 2025/02/21 00:37:07 John Zhuge wrote:
> +1 (non-binding)
>
> John Zhuge
>
>
> On Thu, Feb 20, 2025 at 1:52 PM Hussein Awala wrote:
>
> > +1 (non-binding)
&g
1 - 100 of 988 matches
Mail list logo
