Re: [外部邮件] [VOTE] Release Spark 3.5.2 (RC2)

2024-07-25 Thread Wenchen Fan
I'm changing my vote to -1 as we found a regression that breaks Delta Lake's generated column feature. The fix was merged just now: https://github.com/apache/spark/pull/47483 Can we cut a new RC? On Thu, Jul 25, 2024 at 3:13 PM Mridul Muralidharan wrote: > > +1 > > Signatures, digests, etc

[jira] [Resolved] (SPARK-48761) Add clusterBy DataFrameWriter API for Scala

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48761. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47301 [https

[jira] [Assigned] (SPARK-48761) Add clusterBy DataFrameWriter API for Scala

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48761: --- Assignee: Jiaheng Tang > Add clusterBy DataFrameWriter API for Sc

[jira] [Assigned] (SPARK-48990) Unified variable related SQL syntax keywords

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48990: --- Assignee: BingKun Pan > Unified variable related SQL syntax keywo

[jira] [Resolved] (SPARK-48990) Unified variable related SQL syntax keywords

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48990. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47469 [https

[jira] [Resolved] (SPARK-48833) Support variant in `InMemoryTableScan`

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48833. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47252 [https

[jira] [Assigned] (SPARK-48833) Support variant in `InMemoryTableScan`

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48833: --- Assignee: Richard Chen > Support variant in `InMemoryTableS

[jira] [Resolved] (SPARK-48338) Sql Scripting support for Spark SQL

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48338. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47404 [https

[jira] [Assigned] (SPARK-48338) Sql Scripting support for Spark SQL

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48338: --- Assignee: Aleksandar Tomic > Sql Scripting support for Spark

[jira] [Resolved] (SPARK-48935) Make `checkEvaluation` directly check the `Collation` expression itself in UT

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48935. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47401 [https

Re: [外部邮件] [VOTE] Release Spark 3.5.2 (RC2)

2024-07-23 Thread Wenchen Fan
+1 On Wed, Jul 24, 2024 at 10:51 AM Kent Yao wrote: > +1(non-binding), I have checked: > > - Download links are OK > - Signatures, Checksums, and the KEYS file are OK > - LICENSE and NOTICE are present > - No unexpected binary files in source releases > - Successfully built from source > >

[jira] [Resolved] (SPARK-48914) Add OFFSET operator as an option in the subquery generator

2024-07-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48914. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47375 [https

Re: [VOTE] Differentiate Spark without Spark Connect from Spark Connect

2024-07-22 Thread Wenchen Fan
+1 On Tue, Jul 23, 2024 at 8:40 AM Xinrong Meng wrote: > +1 > > Thank you @Hyukjin Kwon ! > > On Mon, Jul 22, 2024 at 5:20 PM Gengliang Wang wrote: > >> +1 >> >> On Mon, Jul 22, 2024 at 5:19 PM Hyukjin Kwon >> wrote: >> >>> Starting with my own +1. >>> >>> On Tue, 23 Jul 2024 at 09:12,

[jira] [Resolved] (SPARK-48959) Make NoSuchNamespaceException extend NoSuchDatabaseException

2024-07-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48959. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47433 [https

[jira] [Assigned] (SPARK-48959) Make NoSuchNamespaceException extend NoSuchDatabaseException

2024-07-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48959: --- Assignee: Ruifeng Zheng > Make NoSuchNamespaceException extend NoSuchDatabaseExcept

Re: [DISCUSS] Differentiate Spark without Spark Connect from Spark Connect

2024-07-22 Thread Wenchen Fan
Classic SGTM. On Mon, Jul 22, 2024 at 1:12 PM Jungtaek Lim wrote: > I'd propose not to change the name of "Spark Connect" - the name > represents the characteristic of the mode (separation of layer for client > and server). Trying to remove the part of "Connect" would just make > confusion. > >

[jira] [Resolved] (SPARK-48388) [M0] Fix SET behavior for scripts

2024-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48388. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47272 [https

[jira] [Assigned] (SPARK-48388) [M0] Fix SET behavior for scripts

2024-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48388: --- Assignee: David Milicevic > [M0] Fix SET behavior for scri

Re: [VOTE] Release Spark 3.5.2 (RC1)

2024-07-18 Thread Wenchen Fan
> The vote is open until Jul 18 Is it a typo? It's July 18 today. On Thu, Jul 18, 2024 at 6:30 PM Kent Yao wrote: > Hi dev, > > Please vote on releasing the following candidate as Apache Spark version > 3.5.2. > > The vote is open until Jul 18, 11 AM UTC, and passes if a majority +1 > PMC

[jira] [Resolved] (SPARK-48900) Add `reason` string to all job / stage / job group cancellation calls

2024-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48900. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47361 [https

[jira] [Assigned] (SPARK-48900) Add `reason` string to all job / stage / job group cancellation calls

2024-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48900: --- Assignee: Mingkang Li > Add `reason` string to all job / stage / job group cancellat

[jira] [Assigned] (SPARK-48915) Add inequality (!=, <, <=, >, >=) predicates for correlation in GeneratedSubquerySuite

2024-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48915: --- Assignee: Wei Guo > Add inequality (!=, <, <=, >, >=) predicates

[jira] [Resolved] (SPARK-48915) Add inequality (!=, <, <=, >, >=) predicates for correlation in GeneratedSubquerySuite

2024-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48915. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47386 [https

[jira] [Assigned] (SPARK-48923) Fix the incorrect logic of `CollationFactorySuite`

2024-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48923: --- Assignee: BingKun Pan > Fix the incorrect logic of `CollationFactorySu

[jira] [Resolved] (SPARK-48923) Fix the incorrect logic of `CollationFactorySuite`

2024-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48923. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47382 [https

[jira] [Assigned] (SPARK-48350) [M0] Support for exceptions thrown from parser/interpreter

2024-07-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48350: --- Assignee: Milan Dankovic > [M0] Support for exceptions thrown from parser/interpre

[jira] [Resolved] (SPARK-48350) [M0] Support for exceptions thrown from parser/interpreter

2024-07-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48350. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47147 [https

[jira] [Resolved] (SPARK-48441) Alter string search logic for: trim (UTF8_BINARY_LCASE)

2024-07-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48441. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46762 [https

[jira] [Assigned] (SPARK-48441) Alter string search logic for: trim (UTF8_BINARY_LCASE)

2024-07-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48441: --- Assignee: Uroš Bojanić > Alter string search logic for: trim (UTF8_BINARY_LC

[jira] [Assigned] (SPARK-48440) Alter string search logic for: translate (UTF8_BINARY_LCASE)

2024-07-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48440: --- Assignee: Uroš Bojanić > Alter string search logic for: translate (UTF8_BINARY_LC

[jira] [Resolved] (SPARK-48440) Alter string search logic for: translate (UTF8_BINARY_LCASE)

2024-07-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48440. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46761 [https

[jira] [Assigned] (SPARK-48871) Fix INVALID_NON_DETERMINISTIC_EXPRESSIONS validation in CheckAnalysis

2024-07-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48871: --- Assignee: Carmen Kwan > Fix INVALID_NON_DETERMINISTIC_EXPRESSIONS validat

[jira] [Resolved] (SPARK-48871) Fix INVALID_NON_DETERMINISTIC_EXPRESSIONS validation in CheckAnalysis

2024-07-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48871. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-48841) Include `collationName` to `sql()` of `Collate`

2024-07-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48841. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47265 [https

[jira] [Resolved] (SPARK-48793) Unify v1 and v2 `ALTER TABLE .. `DROP|RENAME` COLUMN[S] ...` tests

2024-07-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48793. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47199 [https

[jira] [Resolved] (SPARK-48773) Document config "spark.default.parallelism"

2024-07-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48773. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47171 [https

[jira] [Resolved] (SPARK-48851) Attach full name for `SCHEMA_NOT_FOUND`

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48851. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47276 [https

[jira] [Assigned] (SPARK-48851) Attach full name for `SCHEMA_NOT_FOUND`

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48851: --- Assignee: BingKun Pan > Attach full name for `SCHEMA_NOT_FO

[jira] [Resolved] (SPARK-48529) [M0] Support for labels

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48529. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47146 [https

[jira] [Assigned] (SPARK-48529) [M0] Support for labels

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48529: --- Assignee: David Milicevic > [M0] Support for lab

[jira] [Resolved] (SPARK-48791) Perf regression due to accumulator registration overhead using CopyOnWriteArrayList

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48791. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47197 [https

[jira] [Assigned] (SPARK-48791) Perf regression due to accumulator registration overhead using CopyOnWriteArrayList

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48791: --- Assignee: wuyi > Perf regression due to accumulator registration overhead us

[jira] [Assigned] (SPARK-48843) Infinite loop with GlobalLimit/BindParameters

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48843: --- Assignee: Nemanja Boric > Infinite loop with GlobalLimit/BindParamet

[jira] [Resolved] (SPARK-48843) Infinite loop with GlobalLimit/BindParameters

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48843. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-36680) Supports Dynamic Table Options for Spark SQL

2024-07-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36680: --- Assignee: wang-zhun > Supports Dynamic Table Options for Spark

[jira] [Resolved] (SPARK-36680) Supports Dynamic Table Options for Spark SQL

2024-07-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36680. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46707 [https

[jira] [Assigned] (SPARK-46625) IDENTIFIER clause does not work with CTE reference

2024-07-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46625: --- Assignee: Nebojsa Savic > IDENTIFIER clause does not work with CTE refere

[jira] [Resolved] (SPARK-46625) IDENTIFIER clause does not work with CTE reference

2024-07-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46625. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47180 [https

[jira] [Resolved] (SPARK-48771) Speed up LogicalPlanIntegrity.validateExprIdUniqueness for large query plans

2024-07-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48771. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47170 [https

[jira] [Assigned] (SPARK-48771) Speed up LogicalPlanIntegrity.validateExprIdUniqueness for large query plans

2024-07-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48771: --- Assignee: Kelvin Jiang > Speed up LogicalPlanIntegrity.validateExprIdUniqueness for la

Re: [VOTE] Allow GitHub Actions runs for contributors' PRs without approvals in apache/spark-connect-go

2024-07-08 Thread Wenchen Fan
+1 On Tue, Jul 9, 2024 at 10:47 AM Reynold Xin wrote: > +1 > > On Mon, Jul 8, 2024 at 7:44 PM haydn wrote: > >> +1 >> >> On Mon, Jul 8, 2024 at 7:41 PM haydn wrote: >> >>> +1 >>> >>> On Mon, Jul 8, 2024 at 19:41 Takuya UESHIN >>> wrote: >>> +1 On Mon, Jul 8, 2024 at 6:05 PM

[jira] [Assigned] (SPARK-48776) XML, JSON and CSV default timestamp formatting fails for seconds offset

2024-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48776: --- Assignee: Milan Stefanovic > XML, JSON and CSV default timestamp formatting fa

[jira] [Resolved] (SPARK-48776) XML, JSON and CSV default timestamp formatting fails for seconds offset

2024-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48776. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47177 [https

[jira] [Resolved] (SPARK-48343) [M0] Interpreter support

2024-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48343. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47026 [https

[jira] [Assigned] (SPARK-48343) [M0] Interpreter support

2024-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48343: --- Assignee: David Milicevic > [M0] Interpreter supp

[jira] [Assigned] (SPARK-48719) Wrong Result in regr_slope_intercept Aggregate with Tuples has NULL

2024-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48719: --- Assignee: Jonathon Lee > Wrong Result in regr_slope_intercept Aggregate with Tuples

[jira] [Resolved] (SPARK-48719) Wrong Result in regr_slope_intercept Aggregate with Tuples has NULL

2024-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48719. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-48810) [CONNECT] session.stop() should be best effort

2024-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48810. - Fix Version/s: 4.0.0 Assignee: Niranjan Jayakar Resolution: Fixed > [CONN

[jira] [Resolved] (SPARK-48767) Fix Variant error prompt

2024-07-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48767. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47162 [https

[jira] [Assigned] (SPARK-48783) Update the table-valued function documentation

2024-07-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48783: --- Assignee: Allison Wang > Update the table-valued function documentat

[jira] [Resolved] (SPARK-48783) Update the table-valued function documentation

2024-07-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48783. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47184 [https

[jira] [Assigned] (SPARK-48280) Improve collation testing surface area using expression walking

2024-07-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48280: --- Assignee: Mihailo Milosevic > Improve collation testing surface area using express

[jira] [Resolved] (SPARK-48280) Improve collation testing surface area using expression walking

2024-07-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48280. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46801 [https

[jira] [Resolved] (SPARK-48715) UTF8String to String conversions should use Unicode replacement logic

2024-07-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48715. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47131 [https

[jira] [Assigned] (SPARK-48715) UTF8String to String conversions should use Unicode replacement logic

2024-07-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48715: --- Assignee: Uroš Bojanić > UTF8String to String conversions should use Unicode replacem

Re: [VOTE] Move Spark Connect server to builtin package (Client API layer stays external)

2024-07-03 Thread Wenchen Fan
+1 On Thu, Jul 4, 2024 at 10:41 AM Gengliang Wang wrote: > +1 > > On Wed, Jul 3, 2024 at 4:48 PM Reynold Xin > wrote: > >> +1 >> >> On Wed, Jul 3, 2024 at 4:45 PM L. C. Hsieh wrote: >> >>> +1 >>> >>> On Wed, Jul 3, 2024 at 3:54 PM Dongjoon Hyun >>> wrote: >>> > >>> > +1 >>> > >>> > Dongjoon

[jira] [Resolved] (SPARK-48790) Use checkDatasetUnorderly in DeprecatedDatasetAggregatorSuite

2024-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48790. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47196 [https

[jira] [Deleted] (SPARK-48349) [M1] Support for debugging

2024-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan deleted SPARK-48349: > [M1] Support for debugging > -- > > Key:

[jira] [Deleted] (SPARK-48579) [M1] Merge DatabricksSqlParser with SparkSqlParser

2024-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan deleted SPARK-48579: > [M1] Merge DatabricksSqlParser with SparkSqlPar

[jira] [Deleted] (SPARK-48527) [M0] Thrift investigation

2024-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan deleted SPARK-48527: > [M0] Thrift investigation > - > > Key:

[jira] [Resolved] (SPARK-48760) Introduce ALTER TABLE ... CLUSTER BY to change clustering columns

2024-07-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48760. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47156 [https

[jira] [Resolved] (SPARK-48759) Add migration doc for CREATE TABLE AS SELECT behavior change behavior change since Spark 3.4

2024-07-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48759. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47152 [https

[jira] [Resolved] (SPARK-48697) Add collation aware string filters

2024-07-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48697. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47059 [https

[jira] [Resolved] (SPARK-48737) Reduce number of exception creations for default expression analysis

2024-07-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48737. - Resolution: Fixed Issue resolved by pull request 47124 [https://github.com/apache/spark/pull

[jira] [Assigned] (SPARK-48737) Reduce number of exception creations for default expression analysis

2024-07-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48737: --- Assignee: Uros Stankovic > Reduce number of exception creations for default express

[jira] [Assigned] (SPARK-48747) Add code point iterator to UTF8String

2024-07-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48747: --- Assignee: Uroš Bojanić > Add code point iterator to UTF8Str

[jira] [Resolved] (SPARK-48747) Add code point iterator to UTF8String

2024-07-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48747. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47123 [https

[jira] [Resolved] (SPARK-48668) Support ALTER NAMESPACE ... UNSET PROPERTIES in v2

2024-06-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48668. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47038 [https

[jira] [Assigned] (SPARK-48668) Support ALTER NAMESPACE ... UNSET PROPERTIES in v2

2024-06-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48668: --- Assignee: BingKun Pan > Support ALTER NAMESPACE ... UNSET PROPERTIES in

[jira] [Resolved] (SPARK-48282) Alter string search logic for: replace, find_in_set (UTF8_BINARY_LCASE)

2024-06-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48282. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46682 [https

[jira] [Resolved] (SPARK-48682) Use ICU in InitCap expression (UTF8_BINARY collation)

2024-06-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48682. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47100 [https

[jira] [Resolved] (SPARK-48428) IllegalStateException due to nested column aliasing

2024-06-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48428. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-48428) IllegalStateException due to nested column aliasing

2024-06-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48428: --- Assignee: Emil Ejbyfeldt > IllegalStateException due to nested column alias

[jira] [Resolved] (SPARK-48729) Add a UserDefinedFunction interface to represent a SQL function

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48729. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47108 [https

[jira] [Assigned] (SPARK-48729) Add a UserDefinedFunction interface to represent a SQL function

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48729: --- Assignee: Allison Wang > Add a UserDefinedFunction interface to represent a SQL funct

[jira] [Assigned] (SPARK-47353) Mode expression for strings (all collations)

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47353: --- Assignee: Gideon P > Mode expression for strings (all collati

[jira] [Resolved] (SPARK-47353) Mode expression for strings (all collations)

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47353. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46597 [https

[jira] [Assigned] (SPARK-48670) Providing suggestion as part of error message when invalid collation name is given

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48670: --- Assignee: Aleksandar Tomic > Providing suggestion as part of error message when inva

[jira] [Resolved] (SPARK-48670) Providing suggestion as part of error message when invalid collation name is given

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48670. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47040 [https

[jira] [Resolved] (SPARK-48699) Refine collation API

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48699. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47014 [https

[jira] [Resolved] (SPARK-48718) Got incastable error when deserializer in cogroup is resolved during application of DeduplicateRelation rule

2024-06-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48718. - Fix Version/s: 4.0.0 Assignee: Xinyi Yu Resolution: Fixed > Got incasta

[jira] [Updated] (SPARK-43781) IllegalStateException when cogrouping two datasets derived from the same source

2024-06-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-43781: Fix Version/s: 4.0.0 (was: 3.5.0) > IllegalStateException when cogroup

[jira] [Resolved] (SPARK-48578) Add new expressions for UTF8 string validation

2024-06-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48578. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46845 [https

[jira] [Assigned] (SPARK-48578) Add new expressions for UTF8 string validation

2024-06-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48578: --- Assignee: Uroš Bojanić > Add new expressions for UTF8 string validat

[jira] [Resolved] (SPARK-48681) Use ICU in Lower/Upper expressions (UTF8_BINARY collation)

2024-06-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48681. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47043 [https

[jira] [Assigned] (SPARK-48675) Cache table doesn't work with collated column

2024-06-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48675: --- Assignee: Nikola Mandic > Cache table doesn't work with collated col

[jira] [Resolved] (SPARK-48675) Cache table doesn't work with collated column

2024-06-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48675. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47045 [https

[jira] [Resolved] (SPARK-48659) Unify v1 and v2 ALTER TABLE .. SET TBLPROPERTIES tests

2024-06-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48659. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47018 [https

[jira] [Assigned] (SPARK-48659) Unify v1 and v2 ALTER TABLE .. SET TBLPROPERTIES tests

2024-06-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48659: --- Assignee: BingKun Pan > Unify v1 and v2 ALTER TABLE .. SET TBLPROPERTIES te

[jira] [Resolved] (SPARK-48479) Support creating SQL functions in parser

2024-06-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48479. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46816 [https

  1   2   3   4   5   6   7   8   9   10   >