[jira] [Assigned] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38955: Assignee: Apache Spark > from_csv can corrupt surrounding lines if a lineSep is in the

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525421#comment-17525421 ] Apache Spark commented on SPARK-38955: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38955: Assignee: (was: Apache Spark) > from_csv can corrupt surrounding lines if a lineSep

[jira] [Created] (SPARK-38978) Support push down limit and offset to JDBC data source V2

jiaan.geng created SPARK-38978: -- Summary: Support push down limit and offset to JDBC data source V2 Key: SPARK-38978 URL: https://issues.apache.org/jira/browse/SPARK-38978 Project: Spark Issue

[jira] [Created] (SPARK-38977) Fix schema pruning with correlated subqueries

Anton Okolnychyi created SPARK-38977: Summary: Fix schema pruning with correlated subqueries Key: SPARK-38977 URL: https://issues.apache.org/jira/browse/SPARK-38977 Project: Spark Issue

[jira] [Comment Edited] (SPARK-38931) RocksDB File manager would not create initial dfs directory with unknown number of keys on 1st empty checkpoint

[ https://issues.apache.org/jira/browse/SPARK-38931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525403#comment-17525403 ] Jungtaek Lim edited comment on SPARK-38931 at 4/21/22 3:56 AM: --- (Leaving

[jira] [Commented] (SPARK-38931) RocksDB File manager would not create initial dfs directory with unknown number of keys on 1st empty checkpoint

[ https://issues.apache.org/jira/browse/SPARK-38931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525403#comment-17525403 ] Jungtaek Lim commented on SPARK-38931: -- (Leaving the history; SPARK-37724 will be introduced in

[jira] [Commented] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525402#comment-17525402 ] Apache Spark commented on SPARK-38973: -- User 'otterc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38973: Assignee: (was: Apache Spark) > When push-based shuffle is enabled, a stage may not

[jira] [Assigned] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38973: Assignee: Apache Spark > When push-based shuffle is enabled, a stage may not complete

[jira] [Updated] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-38973: -- Description: With push-based shuffle enabled and adaptive merge finalization, there are

[jira] [Updated] (SPARK-38931) RocksDB File manager would not create initial dfs directory with unknown number of keys on 1st empty checkpoint

[ https://issues.apache.org/jira/browse/SPARK-38931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38931: - Affects Version/s: 3.3.0 (was: 3.2.1) > RocksDB File manager would

[jira] [Updated] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-38973: -- Description: With push-based shuffle enabled and adaptive merge finalization, there are

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525399#comment-17525399 ] Hyukjin Kwon commented on SPARK-38955: -- Yeah, I think {{lineSep}} shouldn't respected here. Let me

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525395#comment-17525395 ] Hyukjin Kwon commented on SPARK-38955: -- Oh okay, I got what you mean. {code} 1,\n2,3,4,5| {1,

[jira] [Resolved] (SPARK-37953) Improve the implement of UnevaluableAggregate

[ https://issues.apache.org/jira/browse/SPARK-37953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-37953. Resolution: Won't Fix > Improve the implement of UnevaluableAggregate >

[jira] [Resolved] (SPARK-37914) Make RuntimeReplaceable works for AggregateFunction

[ https://issues.apache.org/jira/browse/SPARK-37914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-37914. Resolution: Won't Fix > Make RuntimeReplaceable works for AggregateFunction >

[jira] [Commented] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

[ https://issues.apache.org/jira/browse/SPARK-37702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525393#comment-17525393 ] Apache Spark commented on SPARK-37702: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

[ https://issues.apache.org/jira/browse/SPARK-37702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37702: Assignee: Apache Spark > Support ANSI Aggregate Function: regr_syy >

[jira] [Assigned] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

[ https://issues.apache.org/jira/browse/SPARK-37702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37702: Assignee: (was: Apache Spark) > Support ANSI Aggregate Function: regr_syy >

[jira] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

[ https://issues.apache.org/jira/browse/SPARK-37702 ] jiaan.geng deleted comment on SPARK-37702: was (Author: beliefer): I'm working on. > Support ANSI Aggregate Function: regr_syy > - > >

[jira] [Updated] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

[ https://issues.apache.org/jira/browse/SPARK-37702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37702: --- Affects Version/s: 3.4.0 (was: 3.3.0) > Support ANSI Aggregate Function:

[jira] [Updated] (SPARK-38976) spark-sql. overwrite. hive table-duplicate records

[ https://issues.apache.org/jira/browse/SPARK-38976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wesharn updated SPARK-38976: Description: It occured duplicate records  when spark-sql overwrite hive table . when spark job has

[jira] [Updated] (SPARK-38976) spark-sql. overwrite. hive table-duplicate records

[ https://issues.apache.org/jira/browse/SPARK-38976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wesharn updated SPARK-38976: Description: spark-sql. overwrite. hive table-duplicate records  when job has failure stages why? >

[jira] [Resolved] (SPARK-38936) Script transform feed thread should have name

[ https://issues.apache.org/jira/browse/SPARK-38936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38936. -- Fix Version/s: 3.3.0 3.2.2 3.1.3 Resolution:

[jira] [Assigned] (SPARK-38936) Script transform feed thread should have name

[ https://issues.apache.org/jira/browse/SPARK-38936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38936: Assignee: dzcxzl > Script transform feed thread should have name >

[jira] [Created] (SPARK-38976) spark-sql. overwrite. hive table-duplicate records

wesharn created SPARK-38976: --- Summary: spark-sql. overwrite. hive table-duplicate records Key: SPARK-38976 URL: https://issues.apache.org/jira/browse/SPARK-38976 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38975) support jdbc about greenplum more

[ https://issues.apache.org/jira/browse/SPARK-38975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wesharn updated SPARK-38975: Description: the code as: Dataset invoke = spark.read().format("jdbc").option("url", url)

[jira] [Assigned] (SPARK-38581) List of supported pandas APIs for pandas API on Spark docs.

[ https://issues.apache.org/jira/browse/SPARK-38581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38581: Assignee: Haejoon Lee > List of supported pandas APIs for pandas API on Spark docs. >

[jira] [Resolved] (SPARK-38581) List of supported pandas APIs for pandas API on Spark docs.

[ https://issues.apache.org/jira/browse/SPARK-38581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38581. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36083

[jira] [Created] (SPARK-38975) support jdbc about greenplum more

wesharn created SPARK-38975: --- Summary: support jdbc about greenplum more Key: SPARK-38975 URL: https://issues.apache.org/jira/browse/SPARK-38975 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

[ https://issues.apache.org/jira/browse/SPARK-38971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38971. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36269

[jira] [Assigned] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

[ https://issues.apache.org/jira/browse/SPARK-38971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38971: Assignee: Xinrong Meng > Test anchor frame for in-place `Series.rename_axis` >

[jira] [Assigned] (SPARK-38974) List functions should only list registered functions in the specified database

[ https://issues.apache.org/jira/browse/SPARK-38974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38974: Assignee: (was: Apache Spark) > List functions should only list registered functions

[jira] [Commented] (SPARK-38974) List functions should only list registered functions in the specified database

[ https://issues.apache.org/jira/browse/SPARK-38974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525350#comment-17525350 ] Apache Spark commented on SPARK-38974: -- User 'allisonwang-db' has created a pull request for this

[jira] [Assigned] (SPARK-38974) List functions should only list registered functions in the specified database

[ https://issues.apache.org/jira/browse/SPARK-38974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38974: Assignee: Apache Spark > List functions should only list registered functions in the

[jira] [Created] (SPARK-38974) List functions should only list registered functions in the specified database

Allison Wang created SPARK-38974: Summary: List functions should only list registered functions in the specified database Key: SPARK-38974 URL: https://issues.apache.org/jira/browse/SPARK-38974

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525310#comment-17525310 ] Robert Joseph Evans commented on SPARK-38955: - Conceptually I am fine if we want to remove

[jira] [Created] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

Chandni Singh created SPARK-38973: - Summary: When push-based shuffle is enabled, a stage may not complete when retried Key: SPARK-38973 URL: https://issues.apache.org/jira/browse/SPARK-38973 Project:

[jira] [Commented] (SPARK-38972) [SQL] Support style for error message parameters

[ https://issues.apache.org/jira/browse/SPARK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525295#comment-17525295 ] Apache Spark commented on SPARK-38972: -- User 'srielau' has created a pull request for this issue:

[jira] [Commented] (SPARK-38972) [SQL] Support style for error message parameters

[ https://issues.apache.org/jira/browse/SPARK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525297#comment-17525297 ] Apache Spark commented on SPARK-38972: -- User 'srielau' has created a pull request for this issue:

[jira] [Commented] (SPARK-38432) Refactor framework so as JDBC dialect could compile filter by self way

[ https://issues.apache.org/jira/browse/SPARK-38432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525296#comment-17525296 ] Apache Spark commented on SPARK-38432: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-38432) Refactor framework so as JDBC dialect could compile filter by self way

[ https://issues.apache.org/jira/browse/SPARK-38432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525298#comment-17525298 ] Apache Spark commented on SPARK-38432: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38972) [SQL] Support style for error message parameters

[ https://issues.apache.org/jira/browse/SPARK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38972: Assignee: (was: Apache Spark) > [SQL] Support style for error message parameters >

[jira] [Assigned] (SPARK-38972) [SQL] Support style for error message parameters

[ https://issues.apache.org/jira/browse/SPARK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38972: Assignee: Apache Spark > [SQL] Support style for error message parameters >

[jira] [Commented] (SPARK-38913) Output identifiers in error messages in SQL style

[ https://issues.apache.org/jira/browse/SPARK-38913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525283#comment-17525283 ] Apache Spark commented on SPARK-38913: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-38972) [SQL] Support style for error message parameters

[ https://issues.apache.org/jira/browse/SPARK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Rielau updated SPARK-38972: - Description: In preparation of scraping error messages and turn them into docs we want to name

[jira] [Updated] (SPARK-38972) [SQL] Support style for error message parameters

[ https://issues.apache.org/jira/browse/SPARK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Rielau updated SPARK-38972: - Summary: [SQL] Support style for error message parameters (was: Support style for error

[jira] [Created] (SPARK-38972) Support style for error message parameters

Serge Rielau created SPARK-38972: Summary: Support style for error message parameters Key: SPARK-38972 URL: https://issues.apache.org/jira/browse/SPARK-38972 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38949) Wrap SQL statements by double quotes in error messages

[ https://issues.apache.org/jira/browse/SPARK-38949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38949: - Affects Version/s: 3.3.0 > Wrap SQL statements by double quotes in error messages >

[jira] [Updated] (SPARK-38949) Wrap SQL statements by double quotes in error messages

[ https://issues.apache.org/jira/browse/SPARK-38949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38949: - Fix Version/s: 3.3.0 > Wrap SQL statements by double quotes in error messages >

[jira] [Commented] (SPARK-38693) Spark does not use SessionManager

[ https://issues.apache.org/jira/browse/SPARK-38693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525178#comment-17525178 ] Connor Penhale commented on SPARK-38693: Hey Team, Can confirm PAC4J has the same issues with

[jira] [Commented] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

[ https://issues.apache.org/jira/browse/SPARK-38971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525147#comment-17525147 ] Apache Spark commented on SPARK-38971: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

[ https://issues.apache.org/jira/browse/SPARK-38971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38971: Assignee: (was: Apache Spark) > Test anchor frame for in-place `Series.rename_axis`

[jira] [Assigned] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

[ https://issues.apache.org/jira/browse/SPARK-38971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38971: Assignee: Apache Spark > Test anchor frame for in-place `Series.rename_axis` >

[jira] [Commented] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

[ https://issues.apache.org/jira/browse/SPARK-38971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525144#comment-17525144 ] Apache Spark commented on SPARK-38971: -- User 'xinrong-databricks' has created a pull request for

[jira] [Created] (SPARK-38971) Test anchor frame for in-place `Series.rename_axis`

Xinrong Meng created SPARK-38971: Summary: Test anchor frame for in-place `Series.rename_axis` Key: SPARK-38971 URL: https://issues.apache.org/jira/browse/SPARK-38971 Project: Spark Issue

[jira] [Commented] (SPARK-38970) Check for changes only if changes are being built / tested (not on forks)

[ https://issues.apache.org/jira/browse/SPARK-38970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525141#comment-17525141 ] Apache Spark commented on SPARK-38970: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38970) Check for changes only if changes are being built / tested (not on forks)

[ https://issues.apache.org/jira/browse/SPARK-38970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38970: Assignee: (was: Apache Spark) > Check for changes only if changes are being built /

[jira] [Assigned] (SPARK-38970) Check for changes only if changes are being built / tested (not on forks)

[ https://issues.apache.org/jira/browse/SPARK-38970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38970: Assignee: Apache Spark > Check for changes only if changes are being built / tested (not

[jira] [Created] (SPARK-38970) Check for changes only if changes are being built / tested (not on forks)

Enrico Minack created SPARK-38970: - Summary: Check for changes only if changes are being built / tested (not on forks) Key: SPARK-38970 URL: https://issues.apache.org/jira/browse/SPARK-38970 Project:

[jira] [Resolved] (SPARK-38404) Spark does not find CTE inside nested CTE

[ https://issues.apache.org/jira/browse/SPARK-38404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38404. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36146

[jira] [Assigned] (SPARK-38404) Spark does not find CTE inside nested CTE

[ https://issues.apache.org/jira/browse/SPARK-38404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38404: --- Assignee: Peter Toth > Spark does not find CTE inside nested CTE >

[jira] [Comment Edited] (SPARK-38946) test_eval failed due to pandas reference changed

[ https://issues.apache.org/jira/browse/SPARK-38946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524282#comment-17524282 ] Yikun Jiang edited comment on SPARK-38946 at 4/20/22 3:45 PM: --

[jira] [Commented] (SPARK-38946) test_eval failed due to pandas reference changed

[ https://issues.apache.org/jira/browse/SPARK-38946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525080#comment-17525080 ] Yikun Jiang commented on SPARK-38946: - Also here is original related changes:

[jira] [Updated] (SPARK-38946) test_eval failed due to pandas reference changed

[ https://issues.apache.org/jira/browse/SPARK-38946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38946: Description: {code:java} DataFrameTest.test_eval DataFrameTest.test_update

[jira] [Updated] (SPARK-38821) test_nsmallest test failed tue to pandas 1.4.0-1.4.2 bug

[ https://issues.apache.org/jira/browse/SPARK-38821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38821: Description:

[jira] [Updated] (SPARK-38946) test_eval failed due to pandas reference changed

[ https://issues.apache.org/jira/browse/SPARK-38946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38946: Description: {code:java} DataFrameTest.test_eval DataFrameTest.test_update

[jira] [Updated] (SPARK-38947) Support Groupby positional indexing

[ https://issues.apache.org/jira/browse/SPARK-38947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38947: Description: {code:java} GroupByTest.test_tail GroupByTest.test_head {code} [1] 

[jira] [Created] (SPARK-38969) Graceful decomissionning on Kubernetes fails / decom script error

Yeachan Park created SPARK-38969: Summary: Graceful decomissionning on Kubernetes fails / decom script error Key: SPARK-38969 URL: https://issues.apache.org/jira/browse/SPARK-38969 Project: Spark

[jira] [Updated] (SPARK-38947) Support Groupby positional indexing

[ https://issues.apache.org/jira/browse/SPARK-38947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38947: Description: {code:java} GroupByTest.test_tail GroupByTest.test_head {code} [1] 

[jira] [Updated] (SPARK-38947) Support Groupby positional indexing

[ https://issues.apache.org/jira/browse/SPARK-38947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38947: Summary: Support Groupby positional indexing (was: test_eval failed due to pandas reference

[jira] [Updated] (SPARK-38819) Support Groupby positional indexing

[ https://issues.apache.org/jira/browse/SPARK-38819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38819: Summary: Support Groupby positional indexing (was: Run Pandas on Spark with Pandas 1.4.x ) >

[jira] [Updated] (SPARK-38819) Run Pandas on Spark with Pandas 1.4.x

[ https://issues.apache.org/jira/browse/SPARK-38819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38819: Summary: Run Pandas on Spark with Pandas 1.4.x (was: Support Groupby positional indexing) > Run

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525046#comment-17525046 ] André F. commented on SPARK-38330: -- Strangely, even using the `openssl` option I still see some calls

[jira] [Resolved] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37681. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 34964

[jira] [Assigned] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37681: --- Assignee: jiaan.geng > Support ANSI Aggregate Function: regr_sxy >

[jira] [Resolved] (SPARK-38967) Turn spark.sql.ansi.strictIndexOperator into internal config

[ https://issues.apache.org/jira/browse/SPARK-38967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38967. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36282

[jira] [Commented] (SPARK-38949) Wrap SQL statements by double quotes in error messages

[ https://issues.apache.org/jira/browse/SPARK-38949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525001#comment-17525001 ] Apache Spark commented on SPARK-38949: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-34079) Merge non-correlated scalar subqueries

[ https://issues.apache.org/jira/browse/SPARK-34079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-34079: Summary: Merge non-correlated scalar subqueries (was: Improvement CTE table scan) > Merge

[jira] [Resolved] (SPARK-34079) Improvement CTE table scan

[ https://issues.apache.org/jira/browse/SPARK-34079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34079. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 32298

[jira] [Assigned] (SPARK-34079) Improvement CTE table scan

[ https://issues.apache.org/jira/browse/SPARK-34079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34079: --- Assignee: Peter Toth > Improvement CTE table scan > -- > >

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524994#comment-17524994 ] Hyukjin Kwon commented on SPARK-38955: -- For extra clarification, from_csv is an expression whereas

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524990#comment-17524990 ] Hyukjin Kwon commented on SPARK-38955: -- The main problem is that from_csv assumes each record is

[jira] [Resolved] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc

[ https://issues.apache.org/jira/browse/SPARK-37691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37691. - Fix Version/s: 3.3.0 Assignee: jiaan.geng Resolution: Fixed > Support ANSI

[jira] [Updated] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

[ https://issues.apache.org/jira/browse/SPARK-38219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-38219: Fix Version/s: 3.3.0 (was: 3.4.0) > Support ANSI aggregation function

[jira] [Assigned] (SPARK-28330) ANSI SQL: Top-level in

[ https://issues.apache.org/jira/browse/SPARK-28330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28330: --- Assignee: jiaan.geng > ANSI SQL: Top-level in >

[jira] [Resolved] (SPARK-28330) ANSI SQL: Top-level in

[ https://issues.apache.org/jira/browse/SPARK-28330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28330. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35975

[jira] [Updated] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-38955: -- Labels: (was: corr) > from_csv can corrupt surrounding lines if a lineSep is in the data >

[jira] [Updated] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-38955: -- Priority: Blocker (was: Major) > from_csv can corrupt surrounding lines if a lineSep is in

[jira] [Updated] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-38955: -- Labels: corr (was: ) > from_csv can corrupt surrounding lines if a lineSep is in the data >

[jira] [Commented] (SPARK-38955) from_csv can corrupt surrounding lines if a lineSep is in the data

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524985#comment-17524985 ] Thomas Graves commented on SPARK-38955: --- the from_csv docs point to the data source options which

[jira] [Resolved] (SPARK-38949) Wrap SQL statements by double quotes in error messages

[ https://issues.apache.org/jira/browse/SPARK-38949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38949. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36259

[jira] [Assigned] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38968: Assignee: (was: Apache Spark) > remove hadoopConf from KerberosConfDriverFeatureStep

[jira] [Commented] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524915#comment-17524915 ] Apache Spark commented on SPARK-38968: -- User 'dcoliversun' has created a pull request for this

[jira] [Assigned] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38968: Assignee: Apache Spark > remove hadoopConf from KerberosConfDriverFeatureStep >

[jira] [Commented] (SPARK-38750) Test the error class: SECOND_FUNCTION_ARGUMENT_NOT_INTEGER

[ https://issues.apache.org/jira/browse/SPARK-38750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524914#comment-17524914 ] Apache Spark commented on SPARK-38750: -- User 'panbingkun' has created a pull request for this

[jira] [Created] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

qian created SPARK-38968: Summary: remove hadoopConf from KerberosConfDriverFeatureStep Key: SPARK-38968 URL: https://issues.apache.org/jira/browse/SPARK-38968 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-38750) Test the error class: SECOND_FUNCTION_ARGUMENT_NOT_INTEGER

[ https://issues.apache.org/jira/browse/SPARK-38750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38750: Assignee: (was: Apache Spark) > Test the error class:

[jira] [Assigned] (SPARK-38750) Test the error class: SECOND_FUNCTION_ARGUMENT_NOT_INTEGER

[ https://issues.apache.org/jira/browse/SPARK-38750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38750: Assignee: Apache Spark > Test the error class: SECOND_FUNCTION_ARGUMENT_NOT_INTEGER >

  1   2   >