[jira] [Assigned] (SPARK-38978) Support push down limit and offset to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-38978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38978: Assignee: (was: Apache Spark) > Support push down limit and offset to JDBC data sourc

[jira] [Assigned] (SPARK-38978) Support push down limit and offset to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-38978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38978: Assignee: Apache Spark > Support push down limit and offset to JDBC data source V2 >

[jira] [Commented] (SPARK-38978) Support push down limit and offset to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-38978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525433#comment-17525433 ] Apache Spark commented on SPARK-38978: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38955: Assignee: Apache Spark > from_csv can corrupt surrounding lines if a lineSep is in the da

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525421#comment-17525421 ] Apache Spark commented on SPARK-38955: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38955: Assignee: (was: Apache Spark) > from_csv can corrupt surrounding lines if a lineSep i

[jira] [Created] (SPARK-38978) Support push down limit and offset to JDBC data source V2

jiaan.geng created SPARK-38978: -- Summary: Support push down limit and offset to JDBC data source V2 Key: SPARK-38978 URL: https://issues.apache.org/jira/browse/SPARK-38978 Project: Spark Issue T

[jira] [Created] (SPARK-38977) Fix schema pruning with correlated subqueries

Anton Okolnychyi created SPARK-38977: Summary: Fix schema pruning with correlated subqueries Key: SPARK-38977 URL: https://issues.apache.org/jira/browse/SPARK-38977 Project: Spark Issue T

[jira] [Comment Edited] (SPARK-38931) RocksDB File manager would not create initial dfs directory with unknown number of keys on 1st empty checkpoint

[ https://issues.apache.org/jira/browse/SPARK-38931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525403#comment-17525403 ] Jungtaek Lim edited comment on SPARK-38931 at 4/21/22 3:56 AM: ---

[jira] [Commented] (SPARK-38931) RocksDB File manager would not create initial dfs directory with unknown number of keys on 1st empty checkpoint

[ https://issues.apache.org/jira/browse/SPARK-38931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525403#comment-17525403 ] Jungtaek Lim commented on SPARK-38931: -- (Leaving the history; SPARK-37724 will be i

[jira] [Commented] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525402#comment-17525402 ] Apache Spark commented on SPARK-38973: -- User 'otterc' has created a pull request fo

[jira] [Assigned] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38973: Assignee: (was: Apache Spark) > When push-based shuffle is enabled, a stage may not c

[jira] [Assigned] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38973: Assignee: Apache Spark > When push-based shuffle is enabled, a stage may not complete whe

[jira] [Updated] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-38973: -- Description: With push-based shuffle enabled and adaptive merge finalization, there are scena

[jira] [Updated] (SPARK-38931) RocksDB File manager would not create initial dfs directory with unknown number of keys on 1st empty checkpoint

[ https://issues.apache.org/jira/browse/SPARK-38931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38931: - Affects Version/s: 3.3.0 (was: 3.2.1) > RocksDB File manager would no

[jira] [Updated] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-38973: -- Description: With push-based shuffle enabled and adaptive merge finalization, there are scena

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525399#comment-17525399 ] Hyukjin Kwon commented on SPARK-38955: -- Yeah, I think {{lineSep}} shouldn't respect

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525395#comment-17525395 ] Hyukjin Kwon commented on SPARK-38955: -- Oh okay, I got what you mean. {code} 1,\n2

[jira] [Resolved] (SPARK-37953) Improve the implement of UnevaluableAggregate

[ https://issues.apache.org/jira/browse/SPARK-37953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-37953. Resolution: Won't Fix > Improve the implement of UnevaluableAggregate > --

[jira] [Resolved] (SPARK-37914) Make RuntimeReplaceable works for AggregateFunction

[ https://issues.apache.org/jira/browse/SPARK-37914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-37914. Resolution: Won't Fix > Make RuntimeReplaceable works for AggregateFunction >

[jira] [Commented] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

[ https://issues.apache.org/jira/browse/SPARK-37702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525393#comment-17525393 ] Apache Spark commented on SPARK-37702: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

[ https://issues.apache.org/jira/browse/SPARK-37702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37702: Assignee: Apache Spark > Support ANSI Aggregate Function: regr_syy >

[jira] [Assigned] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

[ https://issues.apache.org/jira/browse/SPARK-37702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37702: Assignee: (was: Apache Spark) > Support ANSI Aggregate Function: regr_syy > -

[jira] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

[ https://issues.apache.org/jira/browse/SPARK-37702 ] jiaan.geng deleted comment on SPARK-37702: was (Author: beliefer): I'm working on. > Support ANSI Aggregate Function: regr_syy > - > >

[jira] [Updated] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

[ https://issues.apache.org/jira/browse/SPARK-37702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37702: --- Affects Version/s: 3.4.0 (was: 3.3.0) > Support ANSI Aggregate Function:

[jira] [Updated] (SPARK-38976) spark-sql. overwrite. hive table-duplicate records

[ https://issues.apache.org/jira/browse/SPARK-38976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wesharn updated SPARK-38976: Description: It occured duplicate records  when spark-sql overwrite hive table . when spark job has failur

[jira] [Updated] (SPARK-38976) spark-sql. overwrite. hive table-duplicate records

[ https://issues.apache.org/jira/browse/SPARK-38976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wesharn updated SPARK-38976: Description: spark-sql. overwrite. hive table-duplicate records  when job has failure stages why? > spar

[jira] [Resolved] (SPARK-38936) Script transform feed thread should have name

[ https://issues.apache.org/jira/browse/SPARK-38936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38936. -- Fix Version/s: 3.3.0 3.2.2 3.1.3 Resolution: Fixed

[jira] [Assigned] (SPARK-38936) Script transform feed thread should have name

[ https://issues.apache.org/jira/browse/SPARK-38936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38936: Assignee: dzcxzl > Script transform feed thread should have name > --

[jira] [Created] (SPARK-38976) spark-sql. overwrite. hive table-duplicate records

wesharn created SPARK-38976: --- Summary: spark-sql. overwrite. hive table-duplicate records Key: SPARK-38976 URL: https://issues.apache.org/jira/browse/SPARK-38976 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-38975) support jdbc about greenplum more

[ https://issues.apache.org/jira/browse/SPARK-38975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wesharn updated SPARK-38975: Description: the code as: Dataset invoke = spark.read().format("jdbc").option("url", url) .option("dbtabl

[jira] [Assigned] (SPARK-38581) List of supported pandas APIs for pandas API on Spark docs.

[ https://issues.apache.org/jira/browse/SPARK-38581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38581: Assignee: Haejoon Lee > List of supported pandas APIs for pandas API on Spark docs. > ---

[jira] [Resolved] (SPARK-38581) List of supported pandas APIs for pandas API on Spark docs.

[ https://issues.apache.org/jira/browse/SPARK-38581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38581. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36083 [https://gi

[jira] [Created] (SPARK-38975) support jdbc about greenplum more

wesharn created SPARK-38975: --- Summary: support jdbc about greenplum more Key: SPARK-38975 URL: https://issues.apache.org/jira/browse/SPARK-38975 Project: Spark Issue Type: Improvement Com

[jira] [Resolved] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

[ https://issues.apache.org/jira/browse/SPARK-38971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38971. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36269 [https://gi

[jira] [Assigned] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

[ https://issues.apache.org/jira/browse/SPARK-38971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38971: Assignee: Xinrong Meng > Test anchor frame for in-place `Series.rename_axis` > --

[jira] [Assigned] (SPARK-38974) List functions should only list registered functions in the specified database

[ https://issues.apache.org/jira/browse/SPARK-38974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38974: Assignee: (was: Apache Spark) > List functions should only list registered functions

[jira] [Commented] (SPARK-38974) List functions should only list registered functions in the specified database

[ https://issues.apache.org/jira/browse/SPARK-38974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525350#comment-17525350 ] Apache Spark commented on SPARK-38974: -- User 'allisonwang-db' has created a pull re

[jira] [Assigned] (SPARK-38974) List functions should only list registered functions in the specified database

[ https://issues.apache.org/jira/browse/SPARK-38974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38974: Assignee: Apache Spark > List functions should only list registered functions in the spec

[jira] [Created] (SPARK-38974) List functions should only list registered functions in the specified database

Allison Wang created SPARK-38974: Summary: List functions should only list registered functions in the specified database Key: SPARK-38974 URL: https://issues.apache.org/jira/browse/SPARK-38974 Projec

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525310#comment-17525310 ] Robert Joseph Evans commented on SPARK-38955: - Conceptually I am fine if we

[jira] [Created] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

Chandni Singh created SPARK-38973: - Summary: When push-based shuffle is enabled, a stage may not complete when retried Key: SPARK-38973 URL: https://issues.apache.org/jira/browse/SPARK-38973 Project:

[jira] [Commented] (SPARK-38972) [SQL] Support style for error message parameters

[ https://issues.apache.org/jira/browse/SPARK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525295#comment-17525295 ] Apache Spark commented on SPARK-38972: -- User 'srielau' has created a pull request f

[jira] [Commented] (SPARK-38972) [SQL] Support style for error message parameters

[ https://issues.apache.org/jira/browse/SPARK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525297#comment-17525297 ] Apache Spark commented on SPARK-38972: -- User 'srielau' has created a pull request f

[jira] [Commented] (SPARK-38432) Refactor framework so as JDBC dialect could compile filter by self way

[ https://issues.apache.org/jira/browse/SPARK-38432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525296#comment-17525296 ] Apache Spark commented on SPARK-38432: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-38432) Refactor framework so as JDBC dialect could compile filter by self way

[ https://issues.apache.org/jira/browse/SPARK-38432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525298#comment-17525298 ] Apache Spark commented on SPARK-38432: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-38972) [SQL] Support style for error message parameters

[ https://issues.apache.org/jira/browse/SPARK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38972: Assignee: (was: Apache Spark) > [SQL] Support style for error message parameters > -

[jira] [Assigned] (SPARK-38972) [SQL] Support style for error message parameters

[ https://issues.apache.org/jira/browse/SPARK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38972: Assignee: Apache Spark > [SQL] Support style for error message parameters >

[jira] [Commented] (SPARK-38913) Output identifiers in error messages in SQL style

[ https://issues.apache.org/jira/browse/SPARK-38913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525283#comment-17525283 ] Apache Spark commented on SPARK-38913: -- User 'MaxGekk' has created a pull request f

[jira] [Updated] (SPARK-38972) [SQL] Support style for error message parameters

[ https://issues.apache.org/jira/browse/SPARK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Rielau updated SPARK-38972: - Description: In preparation of scraping error messages and turn them into docs we want to name

[jira] [Updated] (SPARK-38972) [SQL] Support style for error message parameters

[ https://issues.apache.org/jira/browse/SPARK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Rielau updated SPARK-38972: - Summary: [SQL] Support style for error message parameters (was: Support style for error messa

[jira] [Created] (SPARK-38972) Support style for error message parameters

Serge Rielau created SPARK-38972: Summary: Support style for error message parameters Key: SPARK-38972 URL: https://issues.apache.org/jira/browse/SPARK-38972 Project: Spark Issue Type: Impro

[jira] [Updated] (SPARK-38949) Wrap SQL statements by double quotes in error messages

[ https://issues.apache.org/jira/browse/SPARK-38949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38949: - Affects Version/s: 3.3.0 > Wrap SQL statements by double quotes in error messages >

[jira] [Updated] (SPARK-38949) Wrap SQL statements by double quotes in error messages

[ https://issues.apache.org/jira/browse/SPARK-38949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38949: - Fix Version/s: 3.3.0 > Wrap SQL statements by double quotes in error messages >

[jira] [Commented] (SPARK-38693) Spark does not use SessionManager

[ https://issues.apache.org/jira/browse/SPARK-38693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525178#comment-17525178 ] Connor Penhale commented on SPARK-38693: Hey Team, Can confirm PAC4J has the sa

[jira] [Commented] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

[ https://issues.apache.org/jira/browse/SPARK-38971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525147#comment-17525147 ] Apache Spark commented on SPARK-38971: -- User 'xinrong-databricks' has created a pul

[jira] [Assigned] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

[ https://issues.apache.org/jira/browse/SPARK-38971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38971: Assignee: (was: Apache Spark) > Test anchor frame for in-place `Series.rename_axis` >

[jira] [Assigned] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

[ https://issues.apache.org/jira/browse/SPARK-38971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38971: Assignee: Apache Spark > Test anchor frame for in-place `Series.rename_axis` > --

[jira] [Commented] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

[ https://issues.apache.org/jira/browse/SPARK-38971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525144#comment-17525144 ] Apache Spark commented on SPARK-38971: -- User 'xinrong-databricks' has created a pul

[jira] [Created] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

Xinrong Meng created SPARK-38971: Summary: Test anchor frame for in-place `Series.rename_axis` Key: SPARK-38971 URL: https://issues.apache.org/jira/browse/SPARK-38971 Project: Spark Issue Typ

[jira] [Commented] (SPARK-38970) Check for changes only if changes are being built / tested (not on forks)

[ https://issues.apache.org/jira/browse/SPARK-38970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525141#comment-17525141 ] Apache Spark commented on SPARK-38970: -- User 'EnricoMi' has created a pull request

[jira] [Assigned] (SPARK-38970) Check for changes only if changes are being built / tested (not on forks)

[ https://issues.apache.org/jira/browse/SPARK-38970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38970: Assignee: (was: Apache Spark) > Check for changes only if changes are being built / t

[jira] [Assigned] (SPARK-38970) Check for changes only if changes are being built / tested (not on forks)

[ https://issues.apache.org/jira/browse/SPARK-38970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38970: Assignee: Apache Spark > Check for changes only if changes are being built / tested (not

[jira] [Created] (SPARK-38970) Check for changes only if changes are being built / tested (not on forks)

Enrico Minack created SPARK-38970: - Summary: Check for changes only if changes are being built / tested (not on forks) Key: SPARK-38970 URL: https://issues.apache.org/jira/browse/SPARK-38970 Project:

[jira] [Resolved] (SPARK-38404) Spark does not find CTE inside nested CTE

[ https://issues.apache.org/jira/browse/SPARK-38404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38404. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36146 [https://gith

[jira] [Assigned] (SPARK-38404) Spark does not find CTE inside nested CTE

[ https://issues.apache.org/jira/browse/SPARK-38404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38404: --- Assignee: Peter Toth > Spark does not find CTE inside nested CTE >

[jira] [Comment Edited] (SPARK-38946) test_eval failed due to pandas reference changed

[ https://issues.apache.org/jira/browse/SPARK-38946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17524282#comment-17524282 ] Yikun Jiang edited comment on SPARK-38946 at 4/20/22 3:45 PM:

[jira] [Commented] (SPARK-38946) test_eval failed due to pandas reference changed

[ https://issues.apache.org/jira/browse/SPARK-38946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525080#comment-17525080 ] Yikun Jiang commented on SPARK-38946: - Also here is original related changes: [http

[jira] [Updated] (SPARK-38946) test_eval failed due to pandas reference changed

[ https://issues.apache.org/jira/browse/SPARK-38946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38946: Description: {code:java} DataFrameTest.test_eval DataFrameTest.test_update DataFrameTest.test_inpl

[jira] [Updated] (SPARK-38821) test_nsmallest test failed tue to pandas 1.4.0-1.4.2 bug

[ https://issues.apache.org/jira/browse/SPARK-38821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38821: Description: [https://github.com/apache/spark/blob/becda3339381b3975ed567c156260eda036d7a1b/python

[jira] [Updated] (SPARK-38946) test_eval failed due to pandas reference changed

[ https://issues.apache.org/jira/browse/SPARK-38946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38946: Description: {code:java} DataFrameTest.test_eval DataFrameTest.test_update DataFrameTest.test_inpl

[jira] [Updated] (SPARK-38947) Support Groupby positional indexing

[ https://issues.apache.org/jira/browse/SPARK-38947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38947: Description: {code:java} GroupByTest.test_tail GroupByTest.test_head {code} [1]  [https://pandas.p

[jira] [Created] (SPARK-38969) Graceful decomissionning on Kubernetes fails / decom script error

Yeachan Park created SPARK-38969: Summary: Graceful decomissionning on Kubernetes fails / decom script error Key: SPARK-38969 URL: https://issues.apache.org/jira/browse/SPARK-38969 Project: Spark

[jira] [Updated] (SPARK-38947) Support Groupby positional indexing

[ https://issues.apache.org/jira/browse/SPARK-38947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38947: Description: {code:java} GroupByTest.test_tail GroupByTest.test_head {code} [1]  https://pandas.py

[jira] [Updated] (SPARK-38947) Support Groupby positional indexing

[ https://issues.apache.org/jira/browse/SPARK-38947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38947: Summary: Support Groupby positional indexing (was: test_eval failed due to pandas reference chang

[jira] [Updated] (SPARK-38819) Support Groupby positional indexing

[ https://issues.apache.org/jira/browse/SPARK-38819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38819: Summary: Support Groupby positional indexing (was: Run Pandas on Spark with Pandas 1.4.x ) > Sup

[jira] [Updated] (SPARK-38819) Run Pandas on Spark with Pandas 1.4.x

[ https://issues.apache.org/jira/browse/SPARK-38819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38819: Summary: Run Pandas on Spark with Pandas 1.4.x (was: Support Groupby positional indexing) > Run

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525046#comment-17525046 ] André F. commented on SPARK-38330: -- Strangely, even using the `openssl` option I still

[jira] [Resolved] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37681. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 34964 [https://gith

[jira] [Assigned] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37681: --- Assignee: jiaan.geng > Support ANSI Aggregate Function: regr_sxy >

[jira] [Resolved] (SPARK-38967) Turn spark.sql.ansi.strictIndexOperator into internal config

[ https://issues.apache.org/jira/browse/SPARK-38967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38967. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36282 [https://gith

[jira] [Commented] (SPARK-38949) Wrap SQL statements by double quotes in error messages

[ https://issues.apache.org/jira/browse/SPARK-38949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525001#comment-17525001 ] Apache Spark commented on SPARK-38949: -- User 'MaxGekk' has created a pull request f

[jira] [Updated] (SPARK-34079) Merge non-correlated scalar subqueries

[ https://issues.apache.org/jira/browse/SPARK-34079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-34079: Summary: Merge non-correlated scalar subqueries (was: Improvement CTE table scan) > Merge non-co

[jira] [Resolved] (SPARK-34079) Improvement CTE table scan

[ https://issues.apache.org/jira/browse/SPARK-34079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34079. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 32298 [https://gith

[jira] [Assigned] (SPARK-34079) Improvement CTE table scan

[ https://issues.apache.org/jira/browse/SPARK-34079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34079: --- Assignee: Peter Toth > Improvement CTE table scan > -- > >

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17524994#comment-17524994 ] Hyukjin Kwon commented on SPARK-38955: -- For extra clarification, from_csv is an exp

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17524990#comment-17524990 ] Hyukjin Kwon commented on SPARK-38955: -- The main problem is that from_csv assumes e

[jira] [Resolved] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc

[ https://issues.apache.org/jira/browse/SPARK-37691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37691. - Fix Version/s: 3.3.0 Assignee: jiaan.geng Resolution: Fixed > Support ANSI Aggre

[jira] [Updated] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

[ https://issues.apache.org/jira/browse/SPARK-38219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-38219: Fix Version/s: 3.3.0 (was: 3.4.0) > Support ANSI aggregation function perce

[jira] [Assigned] (SPARK-28330) ANSI SQL: Top-level in

[ https://issues.apache.org/jira/browse/SPARK-28330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28330: --- Assignee: jiaan.geng > ANSI SQL: Top-level in > -

[jira] [Resolved] (SPARK-28330) ANSI SQL: Top-level in

[ https://issues.apache.org/jira/browse/SPARK-28330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28330. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35975 [https://gith

[jira] [Updated] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-38955: -- Labels: (was: corr) > from_csv can corrupt surrounding lines if a lineSep is in the data > -

[jira] [Updated] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-38955: -- Priority: Blocker (was: Major) > from_csv can corrupt surrounding lines if a lineSep is in th

[jira] [Updated] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-38955: -- Labels: corr (was: ) > from_csv can corrupt surrounding lines if a lineSep is in the data > -

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17524985#comment-17524985 ] Thomas Graves commented on SPARK-38955: --- the from_csv docs point to the data sourc

[jira] [Resolved] (SPARK-38949) Wrap SQL statements by double quotes in error messages

[ https://issues.apache.org/jira/browse/SPARK-38949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38949. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36259 [https://github.com

[jira] [Assigned] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38968: Assignee: (was: Apache Spark) > remove hadoopConf from KerberosConfDriverFeatureStep

[jira] [Commented] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17524915#comment-17524915 ] Apache Spark commented on SPARK-38968: -- User 'dcoliversun' has created a pull reque

[jira] [Assigned] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38968: Assignee: Apache Spark > remove hadoopConf from KerberosConfDriverFeatureStep > -

[jira] [Commented] (SPARK-38750) Test the error class: SECOND_FUNCTION_ARGUMENT_NOT_INTEGER

[ https://issues.apache.org/jira/browse/SPARK-38750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17524914#comment-17524914 ] Apache Spark commented on SPARK-38750: -- User 'panbingkun' has created a pull reques

  1   2   >