Please vote on releasing the following candidate as Apache Spark version
4.0.0-preview1.
The vote is open until May 16 PST and passes if a majority +1 PMC votes are
cast, with
a minimum of 3 +1 votes.
[ ] +1 Release this package as Apache Spark 4.0.0-preview1
[ ] -1 Do not release this package
Author: wenchen
Date: Sat May 11 04:28:26 2024
New Revision: 69098
Log:
Apache Spark v4.0.0-preview1-rc1
Added:
dev/spark/v4.0.0-preview1-rc1-bin/
dev/spark/v4.0.0-preview1-rc1-bin/SparkR_4.0.0-preview1.tar.gz (with
props)
dev/spark/v4.0.0-preview1-rc1-bin/SparkR_4.0.0-preview1
Author: wenchen
Date: Sat May 11 03:59:33 2024
New Revision: 69097
Log:
prepare for re-uploading
Removed:
dev/spark/v4.0.0-preview1-rc1-bin/
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional
Author: wenchen
Date: Fri May 10 16:44:08 2024
New Revision: 69092
Log:
Apache Spark v4.0.0-preview1-rc1 docs
[This commit notification would consist of 4810 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new a6632ffa16f6 [SPARK-48143][SQL] Use lightweight
[
https://issues.apache.org/jira/browse/SPARK-48146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-48146:
---
Assignee: Kelvin Jiang
> Fix error with aggregate function in With ch
[
https://issues.apache.org/jira/browse/SPARK-48146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-48146.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46443
[https
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 7ef0440ef221 [SPARK-48146][SQL] Fix aggregate
[
https://issues.apache.org/jira/browse/SPARK-48158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-48158.
-
Fix Version/s: 4.0.0
Assignee: Uroš Bojanić
Resolution: Fixed
> XML expressi
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 33cac4436e59 [SPARK-47847][CORE] Deprecate
`spark.network.remoteReadNioBufferConversion`
add 2df494fd4e4e
Thanks for leading this project! Let's move forward.
On Fri, May 10, 2024 at 10:31 AM L. C. Hsieh wrote:
> Thanks Anton. Thank you, Wenchen, Dongjoon, Ryan, Serge, Allison and
> others if I miss those who are participating in the discussion.
>
> I suppose we have reached a consen
[
https://issues.apache.org/jira/browse/SPARK-48222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-48222:
---
Assignee: Nicholas Chammas
> Sync Ruby Bundler to 2.4.22 and refresh Gem lock f
[
https://issues.apache.org/jira/browse/SPARK-48222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-48222.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46512
[https
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 9a2818820f11 [SPARK-48222][INFRA][DOCS] Sync
/44628#discussion_r1595718574
I'll continue after the issue is fixed.
On Fri, May 10, 2024 at 12:29 AM Dongjoon Hyun
wrote:
> Please re-try to upload, Wenchen. ASF Infra team bumped up our upload
> limit based on our request.
>
> > Your upload limit has been increased to 650
Author: wenchen
Date: Thu May 9 16:31:11 2024
New Revision: 69065
Log:
Apache Spark v4.0.0-preview1-rc1
Added:
dev/spark/v4.0.0-preview1-rc1-bin/
dev/spark/v4.0.0-preview1-rc1-bin/pyspark-4.0.0.dev1.tar.gz (with props)
dev/spark/v4.0.0-preview1-rc1-bin/pyspark-4.0.0.dev1
;> Could you file an INFRA JIRA issue with the error message and context
>> first, Wenchen?
>>
>> As you know, if we see something, we had better file a JIRA issue because
>> it could be not only an Apache Spark project issue but also all ASF project
>> issues.
>>
[
https://issues.apache.org/jira/browse/SPARK-47409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47409:
---
Assignee: David Milicevic
> StringTrim & StringTrimLeft/Right/Both (binary &
[
https://issues.apache.org/jira/browse/SPARK-47409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47409.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46206
[https
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 21333f8c1fc0 [SPARK-47409][SQL] Add support
Thanks for starting the discussion! To add a bit more color, we should at
least add a test job to make sure the release script can produce the
packages correctly. Today it's kind of being manually tested by the
release manager each time, which slows down the release process. It's
better if we can
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 3fd38d4c07f6 [SPARK-47803][FOLLOWUP] Check
[
https://issues.apache.org/jira/browse/SPARK-47421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47421.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46460
[https
[
https://issues.apache.org/jira/browse/SPARK-47421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47421:
---
Assignee: Uroš Bojanić
> URL expressions (all collati
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 045ec6a166c8 [SPARK-48208][SS] Skip providing memory usage metrics
from RocksDB if bounded memory usage is enabled
[
https://issues.apache.org/jira/browse/SPARK-47354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47354.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46424
[https
[
https://issues.apache.org/jira/browse/SPARK-47354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47354:
---
Assignee: Uroš Bojanić
> Variant expressions (all collati
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from a4ab82b8f340 [SPARK-48186][SQL] Add support for AbstractMapType
add 91da4ac25148 [SPARK-47354][SQL] Add
[
https://issues.apache.org/jira/browse/SPARK-48186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-48186.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46458
[https
[
https://issues.apache.org/jira/browse/SPARK-48186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-48186:
---
Assignee: Uroš Bojanić
> Add support for AbstractMapT
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 6cc3dc2ef4d2 [SPARK-48169][SPARK-48143][SQL] Revert BadRecordException
optimizations
add a4ab82b8f340 [SPARK
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 6cc3dc2ef4d2 [SPARK-48169][SPARK-48143][SQL
>>>>>
>>>>> בתאריך יום ד׳, 8 במאי 2024, 00:54, מאת Holden Karau <
>>>>> holden.ka...@gmail.com>:
>>>>>
>>>>>> Indeed. We could conceivably build the release in CI/CD but the final
>>>>>&
[
https://issues.apache.org/jira/browse/SPARK-48197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-48197.
-
Fix Version/s: 3.5.2
4.0.0
Resolution: Fixed
Issue resolved by pull
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new 541e1c4da131 [SPARK-48197][SQL] Avoid
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 337f980f0073 [SPARK-48204][INFRA] Fix release script for Spark 4.0+
add 7e79e91dc8c5 [SPARK-48197][SQL] Avoid
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to tag v4.0.0-preview1-rc1
in repository https://gitbox.apache.org/repos/asf/spark.git
at 7dcf77c739c3 (commit)
This tag includes the following new commits:
new 7dcf77c739c3 Preparing Spark
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to tag v4.0.0-preview1-rc1
in repository https://gitbox.apache.org/repos/asf/spark.git
commit 7dcf77c739c3854260464d732dbfb9a0f54706e7
Author: Wenchen Fan
AuthorDate: Thu May 9 02:32:06 2024 +
Wenchen Fan created SPARK-48204:
---
Summary: fix release script for Spark 4.0+
Key: SPARK-48204
URL: https://issues.apache.org/jira/browse/SPARK-48204
Project: Spark
Issue Type: Bug
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to tag v4.0.0-preview-rc1
in repository https://gitbox.apache.org/repos/asf/spark.git
at 9fec87d16a04 (commit)
This tag includes the following new commits:
new 9fec87d16a04 Preparing Spark
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to tag v4.0.0-preview-rc1
in repository https://gitbox.apache.org/repos/asf/spark.git
commit 9fec87d16a0418759d835541557ad22f20940e9e
Author: Wenchen Fan
AuthorDate: Wed May 8 14:16:23 2024 +
[
https://issues.apache.org/jira/browse/SPARK-48161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-48161.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46462
[https
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 8950add773e6 [SPARK-48188][SQL] Consistently use normalized plan for
cache
add 8d7081639ab4 [SPARK-48161][SQL
Wenchen Fan created SPARK-48188:
---
Summary: Consistently use normalized plan for cache
Key: SPARK-48188
URL: https://issues.apache.org/jira/browse/SPARK-48188
Project: Spark
Issue Type: Bug
UPDATE:
Unfortunately, it took me quite some time to set up my laptop and get it
ready for the release process (docker desktop doesn't work anymore, my pgp
key is lost, etc.). I'll start the RC process at my tomorrow. Thanks for
your patience!
Wenchen
On Fri, May 3, 2024 at 7:47 AM yangjie01
Author: wenchen
Date: Tue May 7 17:07:43 2024
New Revision: 69013
Log:
Update KEYS
Modified:
dev/spark/KEYS
Modified: dev/spark/KEYS
==
--- dev/spark/KEYS (original)
+++ dev/spark/KEYS Tue May 7 17:07:43 2024
[
https://issues.apache.org/jira/browse/SPARK-47297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47297:
---
Assignee: Uroš Bojanić
> Format expressions (all collati
[
https://issues.apache.org/jira/browse/SPARK-47297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47297.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46423
[https
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 148f5335427c [SPARK-47297][SQL] Add collation
Wenchen Fan created SPARK-48173:
---
Summary: CheckAnalsis should see the entire query plan
Key: SPARK-48173
URL: https://issues.apache.org/jira/browse/SPARK-48173
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-48143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-48143:
---
Assignee: Vladimir Golubev
> UnivocityParser is slow when parsing partially-malformed
[
https://issues.apache.org/jira/browse/SPARK-48143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-48143.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46400
[https
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 326dbb447873 [SPARK-48143][SQL] Use lightweight
[
https://issues.apache.org/jira/browse/SPARK-47267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47267:
---
Assignee: Uroš Bojanić
> Hash functions should respect collat
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 08c6bb9bf32f [SPARK-47267][SQL] Add collation
[
https://issues.apache.org/jira/browse/SPARK-47267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47267.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46422
[https
[
https://issues.apache.org/jira/browse/SPARK-48166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-48166.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46428
[https
[
https://issues.apache.org/jira/browse/SPARK-48166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-48166:
---
Assignee: Vladimir Golubev
> Unwanted use of internal BadRecordExcept
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 7f8ef96cea27 [SPARK-48166][SQL] Avoid using
[
https://issues.apache.org/jira/browse/SPARK-48027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-48027:
Affects Version/s: (was: 3.5.1)
(was: 3.4.3)
> InjectRuntimeFil
[
https://issues.apache.org/jira/browse/SPARK-48027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-48027.
-
Fix Version/s: 4.0.0
Assignee: angerszhu
Resolution: Fixed
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new b5e39bedab14 [SPARK-48027][SQL
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new d67752a8f3d7 [SPARK-47681][SQL][FOLLOWUP] Fix
+1 for Holden's comment. Yes, it would be great to mention `it` as "soon".
> (If Wenchen release it on Monday, we can simply mention the release)
>
> In addition, Apache Spark PMC received an official notice from ASF Infra
> team.
>
> https://lists.apache.org/thread/rgy1cg17tkd3y
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new 45befc07d2a0 [SPARK-48019][SQL
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new bf2e25459fe4 [SPARK-48019][SQL][FOLLOWUP] Use
ch changes in new Spark versions, or avoid using private APIs.
Exceptions can happen if certain private APIs are used too widely and we
should avoid breaking them.
Thanks,
Wenchen
On Wed, May 1, 2024 at 11:51 PM Erik Krogen wrote:
> Thanks for raising this important discussion Wenchen! Two p
be sufficient to put
behavior changes in this area in the release notes.
On Wed, May 1, 2024 at 11:18 PM Santosh Pingale
wrote:
> Thanks Wenchen for starting this!
>
> How do we define "the user" for spark?
> 1. End users: There are some users that use spark as a service
a Preview release,
> the faster we can start getting feedback for fixing things for a great
> Spark 4.0 final release.
>
> So I urge the community to produce a Spark 4.0 Preview soon even if
> certain features targeting the Delta 4.0 release are still incomplete.
>
> Thanks!
>
>
a conclusion, I'll document it in
https://spark.apache.org/versioning-policy.html .
Thanks,
Wenchen
Yes, Spark has a shim layer to support all Hive versions. It shouldn't be
an issue as many users create native Spark data source tables already
today, by explicitly putting the `USING` clause in the CREATE TABLE
statement.
On Wed, May 1, 2024 at 12:56 AM Mich Talebzadeh
wrote:
> @Wenchen
[
https://issues.apache.org/jira/browse/SPARK-47359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47359.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45820
[https
[
https://issues.apache.org/jira/browse/SPARK-47359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47359:
---
Assignee: Milan Dankovic
> StringTranslate (all collati
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 0329479acb67 [SPARK-47359][SQL] Support
[
https://issues.apache.org/jira/browse/SPARK-48003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-48003.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46241
[https
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 3aea6c258bf3 [SPARK-48003][SQL] Add collation
[
https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47566.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45725
[https
[
https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47566:
---
Assignee: Milan Dankovic
> SubstringIndex
> --
>
>
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 12a507464f10 [SPARK-47566][SQL] Support
ave a more reasonable default behavior: creating Parquet tables (or
whatever is specified by `spark.sql.sources.default`).
On Tue, Apr 30, 2024 at 10:45 AM Wenchen Fan wrote:
> @Mich Talebzadeh there seems to be a
> misunderstanding here. The Spark native data source table is still stor
024 at 2:08 AM Mich Talebzadeh
> wrote:
>
>>
>> Hi @Wenchen Fan
>>
>> Thanks for your response. I believe we have not had enough time to
>> "DISCUSS" this matter.
>>
>> Currently in order to make Spark take advantage of Hive, I create a soft
>
[
https://issues.apache.org/jira/browse/SPARK-48033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-48033.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46269
[https
[
https://issues.apache.org/jira/browse/SPARK-48033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-48033:
---
Assignee: Richard Chen
> Support Generated Column expressions that are `RuntimeReplacea
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new da92293f9ce0 [SPARK-48033][SQL] Fix
[
https://issues.apache.org/jira/browse/SPARK-47741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47741:
---
Assignee: Milan Stefanovic
> Handle stack overflow when parsing qu
[
https://issues.apache.org/jira/browse/SPARK-47741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47741.
-
Resolution: Fixed
Issue resolved by pull request 45896
[https://github.com/apache/spark/pull
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 3fbcb26d8e99 [SPARK-48016][SQL] Fix a bug in try_divide function when
with decimals
add fe05eb8fa3b2 [SPARK
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 3f15ad40640c [SPARK-47994][SQL] Fix bug with CASE WHEN column filter
push down in SQLServer
add d913d1b2662c
[
https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47148.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45234
[https
[
https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47567.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45791
[https
[
https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47567:
---
Assignee: Milan Dankovic
> StringLocate
>
>
>
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 7b1147a05a6c [SPARK-47567][SQL] Support LOCATE
[
https://issues.apache.org/jira/browse/SPARK-47939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47939.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46209
[https
[
https://issues.apache.org/jira/browse/SPARK-47939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47939:
---
Assignee: Vladimir Golubev
> Parameterized queries fail for DESCRIBE & EX
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 0e52b59b540f [SPARK-47939][SQL] Implement a new
@Mich Talebzadeh thanks for sharing your
concern!
Note: creating Spark native data source tables is usually Hive compatible
as well, unless we use features that Hive does not support (TIMESTAMP NTZ,
ANSI INTERVAL, etc.). I think it's a better default to create Spark native
table in this case,
[
https://issues.apache.org/jira/browse/SPARK-47927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47927:
---
Assignee: Emil Ejbyfeldt
> Nullability after join not respected in
[
https://issues.apache.org/jira/browse/SPARK-47927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47927.
-
Fix Version/s: 3.4.4
3.5.2
4.0.0
Resolution: Fixed
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.4 by this push:
new f4dc254ee0bd [SPARK-47927][SQL] Fix
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new 33768f66d953 [SPARK-47927][SQL] Fix
1 - 100 of 17259 matches
Mail list logo
