[jira] [Assigned] (SPARK-36849) Migrate UseStatement to v2 command framework

2021-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36849: --- Assignee: dohongdayi > Migrate UseStatement to v2 command framework >

[jira] [Resolved] (SPARK-36849) Migrate UseStatement to v2 command framework

2021-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36849. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34127

[jira] [Assigned] (SPARK-36645) Aggregate (Min/Max/Count) push down for Parquet

2021-10-10 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36645: --- Assignee: Huaxin Gao > Aggregate (Min/Max/Count) push down for Parquet >

[jira] [Resolved] (SPARK-36645) Aggregate (Min/Max/Count) push down for Parquet

2021-10-10 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36645. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33639

[jira] [Assigned] (SPARK-36970) Manual disabled format `B` for `date_format` function to compatibility with Java 8 behavior.

2021-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36970: Assignee: (was: Apache Spark) > Manual disabled format `B` for `date_format`

[jira] [Assigned] (SPARK-36970) Manual disabled format `B` for `date_format` function to compatibility with Java 8 behavior.

2021-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36970: Assignee: Apache Spark > Manual disabled format `B` for `date_format` function to

[jira] [Commented] (SPARK-36970) Manual disabled format `B` for `date_format` function to compatibility with Java 8 behavior.

2021-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426954#comment-17426954 ] Apache Spark commented on SPARK-36970: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-36943) Improve error message for missing column

2021-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36943: --- Assignee: Karen Feng > Improve error message for missing column >

[jira] [Resolved] (SPARK-36943) Improve error message for missing column

2021-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36943. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34202

[jira] [Updated] (SPARK-36970) Manual disabled format `B` for `date_format` function to compatibility with Java 8 behavior.

2021-10-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-36970: - Summary: Manual disabled format `B` for `date_format` function to compatibility with Java 8 behavior.

[jira] [Created] (SPARK-36970) Manual disabled foramt `B` for `date_format` function to compatibility with Java 8 behavior.

2021-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-36970: Summary: Manual disabled foramt `B` for `date_format` function to compatibility with Java 8 behavior. Key: SPARK-36970 URL: https://issues.apache.org/jira/browse/SPARK-36970

[jira] [Assigned] (SPARK-36727) Support sql overwrite a path that is also being read from when partitionOverwriteMode is dynamic

2021-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36727: Assignee: (was: Apache Spark) > Support sql overwrite a path that is also being read

[jira] [Assigned] (SPARK-36727) Support sql overwrite a path that is also being read from when partitionOverwriteMode is dynamic

2021-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36727: Assignee: Apache Spark > Support sql overwrite a path that is also being read from when

[jira] [Commented] (SPARK-36969) Inline type hints for python/pyspark/context.py

2021-10-10 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426924#comment-17426924 ] dch nguyen commented on SPARK-36969: working on this > Inline type hints for

[jira] [Created] (SPARK-36969) Inline type hints for python/pyspark/context.py

2021-10-10 Thread dch nguyen (Jira)
dch nguyen created SPARK-36969: -- Summary: Inline type hints for python/pyspark/context.py Key: SPARK-36969 URL: https://issues.apache.org/jira/browse/SPARK-36969 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36963) Add max_by/min_by to sql.functions

2021-10-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36963. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34229

[jira] [Assigned] (SPARK-36963) Add max_by/min_by to sql.functions

2021-10-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36963: Assignee: zhengruifeng > Add max_by/min_by to sql.functions >

[jira] [Assigned] (SPARK-36900) "SPARK-36464: size returns correct positive number even with over 2GB data" will oom with JDK17

2021-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-36900: Assignee: Sean R. Owen > "SPARK-36464: size returns correct positive number even with

[jira] [Resolved] (SPARK-36900) "SPARK-36464: size returns correct positive number even with over 2GB data" will oom with JDK17

2021-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36900. -- Fix Version/s: 3.2.1 3.3.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-36914) Implement dropIndex and listIndexes in JDBC (MySQL dialect)

2021-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36914: Assignee: Apache Spark > Implement dropIndex and listIndexes in JDBC (MySQL dialect) >

[jira] [Assigned] (SPARK-36914) Implement dropIndex and listIndexes in JDBC (MySQL dialect)

2021-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36914: Assignee: (was: Apache Spark) > Implement dropIndex and listIndexes in JDBC (MySQL

[jira] [Commented] (SPARK-36914) Implement dropIndex and listIndexes in JDBC (MySQL dialect)

2021-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426890#comment-17426890 ] Apache Spark commented on SPARK-36914: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-36914) Implement dropIndex and listIndexes in JDBC (MySQL dialect)

2021-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426889#comment-17426889 ] Apache Spark commented on SPARK-36914: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36968) ps.Series.dot raise "matrices are not aligned" if index is not same

2021-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36968: Assignee: (was: Apache Spark) > ps.Series.dot raise "matrices are not aligned" if

[jira] [Assigned] (SPARK-36968) ps.Series.dot raise "matrices are not aligned" if index is not same

2021-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36968: Assignee: Apache Spark > ps.Series.dot raise "matrices are not aligned" if index is not

[jira] [Commented] (SPARK-36968) ps.Series.dot raise "matrices are not aligned" if index is not same

2021-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426794#comment-17426794 ] Apache Spark commented on SPARK-36968: -- User 'dchvn' has created a pull request for this issue:

[jira] [Updated] (SPARK-36968) ps.Series.dot raise "matrices are not aligned" if index is not same

2021-10-10 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36968: --- Summary: ps.Series.dot raise "matrices are not aligned" if index is not same (was: ps.Series.dot

[jira] [Updated] (SPARK-36968) ps.Series.dot raise ValueError "matrices are not aligned" if index is not same

2021-10-10 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36968: --- Summary: ps.Series.dot raise ValueError "matrices are not aligned" if index is not same (was:

[jira] [Created] (SPARK-36968) ps.Series.dot raise ValueError matrices are not aligned if index is not same

2021-10-10 Thread dch nguyen (Jira)
dch nguyen created SPARK-36968: -- Summary: ps.Series.dot raise ValueError matrices are not aligned if index is not same Key: SPARK-36968 URL: https://issues.apache.org/jira/browse/SPARK-36968 Project: