[jira] [Commented] (SPARK-36149) dayofweek documentation for python and R

[ https://issues.apache.org/jira/browse/SPARK-36149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381101#comment-17381101 ] Dominik Gehl commented on SPARK-36149: -- Same is true for weekofyear > dayofweek do

[jira] [Updated] (SPARK-36045) TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ

[ https://issues.apache.org/jira/browse/SPARK-36045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36045: --- Summary: TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ (was: TO_UTC_TI

[jira] [Updated] (SPARK-36045) TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ

[ https://issues.apache.org/jira/browse/SPARK-36045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36045: --- Description: Currently, the SQL function (was: For the function `TO_UTC_TIMESTAMP`, it sho

[jira] [Commented] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381109#comment-17381109 ] Apache Spark commented on SPARK-36146: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36146: Assignee: Apache Spark > Upgrade Python version from 3.6 to higher version in GitHub lint

[jira] [Updated] (SPARK-36045) TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ

[ https://issues.apache.org/jira/browse/SPARK-36045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36045: --- Description: Currently, the SQL function to_utc_timestamp is confusing: it just takes the t

[jira] [Assigned] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36146: Assignee: (was: Apache Spark) > Upgrade Python version from 3.6 to higher version in

[jira] [Commented] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381110#comment-17381110 ] Apache Spark commented on SPARK-36146: -- User 'HyukjinKwon' has created a pull reque

[jira] [Updated] (SPARK-36045) TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ

[ https://issues.apache.org/jira/browse/SPARK-36045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36045: --- Description: Currently, the SQL function to_utc_timestamp is confusing: it just takes the t

[jira] [Resolved] (SPARK-36150) Disable MiMa for Scala 2.13 artifacts

[ https://issues.apache.org/jira/browse/SPARK-36150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36150. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33355 [https://

[jira] [Assigned] (SPARK-36150) Disable MiMa for Scala 2.13 artifacts

[ https://issues.apache.org/jira/browse/SPARK-36150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36150: - Assignee: Dongjoon Hyun > Disable MiMa for Scala 2.13 artifacts > -

[jira] [Assigned] (SPARK-36148) Missing validation of regexp_replace inputs

[ https://issues.apache.org/jira/browse/SPARK-36148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36148: Assignee: (was: Apache Spark) > Missing validation of regexp_replace inputs > ---

[jira] [Assigned] (SPARK-36148) Missing validation of regexp_replace inputs

[ https://issues.apache.org/jira/browse/SPARK-36148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36148: Assignee: Apache Spark > Missing validation of regexp_replace inputs > --

[jira] [Commented] (SPARK-36148) Missing validation of regexp_replace inputs

[ https://issues.apache.org/jira/browse/SPARK-36148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381130#comment-17381130 ] Apache Spark commented on SPARK-36148: -- User 'linhongliu-db' has created a pull req

[jira] [Created] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

Dongjoon Hyun created SPARK-36152: - Summary: Add Scala 2.13 daily build and test GitHub Action job Key: SPARK-36152 URL: https://issues.apache.org/jira/browse/SPARK-36152 Project: Spark Issue

[jira] [Commented] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-36152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381137#comment-17381137 ] Apache Spark commented on SPARK-36152: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-36152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36152: Assignee: Apache Spark > Add Scala 2.13 daily build and test GitHub Action job >

[jira] [Assigned] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-36152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36152: Assignee: (was: Apache Spark) > Add Scala 2.13 daily build and test GitHub Action job

[jira] [Created] (SPARK-36153) Add SLQ doc about transform for current behavior

angerszhu created SPARK-36153: - Summary: Add SLQ doc about transform for current behavior Key: SPARK-36153 URL: https://issues.apache.org/jira/browse/SPARK-36153 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

Dominik Gehl created SPARK-36154: Summary: pyspark documentation doesn't mention week and quarter as valid format arguments to trunc Key: SPARK-36154 URL: https://issues.apache.org/jira/browse/SPARK-36154

[jira] [Commented] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381149#comment-17381149 ] Apache Spark commented on SPARK-36154: -- User 'dominikgehl' has created a pull reque

[jira] [Assigned] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36154: Assignee: Apache Spark > pyspark documentation doesn't mention week and quarter as valid

[jira] [Created] (SPARK-36155) Eliminate join base uniqueness

Yuming Wang created SPARK-36155: --- Summary: Eliminate join base uniqueness Key: SPARK-36155 URL: https://issues.apache.org/jira/browse/SPARK-36155 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36154: Assignee: (was: Apache Spark) > pyspark documentation doesn't mention week and quarte

[jira] [Commented] (SPARK-33922) Fix error test SparkLauncherSuite.testSparkLauncherGetError

[ https://issues.apache.org/jira/browse/SPARK-33922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381155#comment-17381155 ] Xiaochang Wu commented on SPARK-33922: -- [~dengziming] Could you pls unset SPARK_HOM

[jira] [Commented] (SPARK-36090) Support TimestampNTZType in expression Sequence

[ https://issues.apache.org/jira/browse/SPARK-36090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381169#comment-17381169 ] Apache Spark commented on SPARK-36090: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-36090) Support TimestampNTZType in expression Sequence

[ https://issues.apache.org/jira/browse/SPARK-36090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36090: Assignee: Apache Spark > Support TimestampNTZType in expression Sequence > --

[jira] [Assigned] (SPARK-36090) Support TimestampNTZType in expression Sequence

[ https://issues.apache.org/jira/browse/SPARK-36090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36090: Assignee: (was: Apache Spark) > Support TimestampNTZType in expression Sequence > ---

[jira] [Issue Comment Deleted] (SPARK-36090) Support TimestampNTZType in expression Sequence

[ https://issues.apache.org/jira/browse/SPARK-36090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36090: --- Comment: was deleted (was: I'm working on.) > Support TimestampNTZType in expression Sequence > ---

[jira] [Assigned] (SPARK-36155) Eliminate join base uniqueness

[ https://issues.apache.org/jira/browse/SPARK-36155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36155: Assignee: Apache Spark > Eliminate join base uniqueness > --

[jira] [Commented] (SPARK-36155) Eliminate join base uniqueness

[ https://issues.apache.org/jira/browse/SPARK-36155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381174#comment-17381174 ] Apache Spark commented on SPARK-36155: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-36155) Eliminate join base uniqueness

[ https://issues.apache.org/jira/browse/SPARK-36155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36155: Assignee: (was: Apache Spark) > Eliminate join base uniqueness >

[jira] [Resolved] (SPARK-36149) dayofweek documentation for python and R

[ https://issues.apache.org/jira/browse/SPARK-36149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36149. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33345 [https://github.com

[jira] [Resolved] (SPARK-36148) Missing validation of regexp_replace inputs

[ https://issues.apache.org/jira/browse/SPARK-36148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36148. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33357 [https://github.com

[jira] [Assigned] (SPARK-36148) Missing validation of regexp_replace inputs

[ https://issues.apache.org/jira/browse/SPARK-36148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36148: Assignee: Linhong Liu > Missing validation of regexp_replace inputs > ---

[jira] [Created] (SPARK-36156) Row FORMAT SERDE should handle null value as `\N`

angerszhu created SPARK-36156: - Summary: Row FORMAT SERDE should handle null value as `\N` Key: SPARK-36156 URL: https://issues.apache.org/jira/browse/SPARK-36156 Project: Spark Issue Type: Sub-t

[jira] [Assigned] (SPARK-36153) Add SLQ doc about transform for current behavior

[ https://issues.apache.org/jira/browse/SPARK-36153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36153: Assignee: Apache Spark > Add SLQ doc about transform for current behavior > -

[jira] [Commented] (SPARK-36153) Add SLQ doc about transform for current behavior

[ https://issues.apache.org/jira/browse/SPARK-36153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381207#comment-17381207 ] Apache Spark commented on SPARK-36153: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-36153) Add SLQ doc about transform for current behavior

[ https://issues.apache.org/jira/browse/SPARK-36153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36153: Assignee: (was: Apache Spark) > Add SLQ doc about transform for current behavior > --

[jira] [Assigned] (SPARK-36156) Row FORMAT SERDE should handle null value as `\N`

[ https://issues.apache.org/jira/browse/SPARK-36156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36156: Assignee: (was: Apache Spark) > Row FORMAT SERDE should handle null value as `\N` > -

[jira] [Assigned] (SPARK-36156) Row FORMAT SERDE should handle null value as `\N`

[ https://issues.apache.org/jira/browse/SPARK-36156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36156: Assignee: Apache Spark > Row FORMAT SERDE should handle null value as `\N` >

[jira] [Commented] (SPARK-36156) Row FORMAT SERDE should handle null value as `\N`

[ https://issues.apache.org/jira/browse/SPARK-36156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381241#comment-17381241 ] Apache Spark commented on SPARK-36156: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-36156) Row FORMAT SERDE should handle null value as `\N`

[ https://issues.apache.org/jira/browse/SPARK-36156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381240#comment-17381240 ] Apache Spark commented on SPARK-36156: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-32792) Improve in filter pushdown for ParquetFilters

[ https://issues.apache.org/jira/browse/SPARK-32792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381252#comment-17381252 ] Apache Spark commented on SPARK-32792: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-32792) Improve in filter pushdown for ParquetFilters

[ https://issues.apache.org/jira/browse/SPARK-32792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381251#comment-17381251 ] Apache Spark commented on SPARK-32792: -- User 'wangyum' has created a pull request f

[jira] [Created] (SPARK-36157) TimeWindow expression: apply filter before project

Jungtaek Lim created SPARK-36157: Summary: TimeWindow expression: apply filter before project Key: SPARK-36157 URL: https://issues.apache.org/jira/browse/SPARK-36157 Project: Spark Issue Type

[jira] [Created] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

Dominik Gehl created SPARK-36158: Summary: pyspark sql/functions documentation for months_between isn't as precise as scala version Key: SPARK-36158 URL: https://issues.apache.org/jira/browse/SPARK-36158

[jira] [Commented] (SPARK-36031) Keep same behavior with pandas for operations of series with nan

[ https://issues.apache.org/jira/browse/SPARK-36031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381269#comment-17381269 ] Yikun Jiang commented on SPARK-36031: - [~XinrongM] OK, Thanks for your help. > Keep

[jira] [Created] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

Hyukjin Kwon created SPARK-36159: Summary: Replace 'python' to 'python3' in dev/test-dependencies.sh Key: SPARK-36159 URL: https://issues.apache.org/jira/browse/SPARK-36159 Project: Spark Is

[jira] [Assigned] (SPARK-36157) TimeWindow expression: apply filter before project

[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36157: Assignee: (was: Apache Spark) > TimeWindow expression: apply filter before project >

[jira] [Commented] (SPARK-36157) TimeWindow expression: apply filter before project

[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381276#comment-17381276 ] Apache Spark commented on SPARK-36157: -- User 'HeartSaVioR' has created a pull reque

[jira] [Assigned] (SPARK-36157) TimeWindow expression: apply filter before project

[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36157: Assignee: Apache Spark > TimeWindow expression: apply filter before project > ---

[jira] [Commented] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

[ https://issues.apache.org/jira/browse/SPARK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381277#comment-17381277 ] Apache Spark commented on SPARK-36158: -- User 'dominikgehl' has created a pull reque

[jira] [Assigned] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

[ https://issues.apache.org/jira/browse/SPARK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36158: Assignee: (was: Apache Spark) > pyspark sql/functions documentation for months_betwee

[jira] [Commented] (SPARK-36157) TimeWindow expression: apply filter before project

[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381278#comment-17381278 ] Apache Spark commented on SPARK-36157: -- User 'HeartSaVioR' has created a pull reque

[jira] [Assigned] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

[ https://issues.apache.org/jira/browse/SPARK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36158: Assignee: Apache Spark > pyspark sql/functions documentation for months_between isn't as

[jira] [Assigned] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

[ https://issues.apache.org/jira/browse/SPARK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36159: Assignee: Apache Spark > Replace 'python' to 'python3' in dev/test-dependencies.sh > ---

[jira] [Assigned] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

[ https://issues.apache.org/jira/browse/SPARK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36159: Assignee: (was: Apache Spark) > Replace 'python' to 'python3' in dev/test-dependencie

[jira] [Commented] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

[ https://issues.apache.org/jira/browse/SPARK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381280#comment-17381280 ] Apache Spark commented on SPARK-36159: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-21784) Add ALTER TABLE ADD CONSTRANT DDL to support defining primary key and foreign keys

[ https://issues.apache.org/jira/browse/SPARK-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381290#comment-17381290 ] Hay commented on SPARK-21784: - Is there any progress on this feature? Like [~ksunitha] state

[jira] [Created] (SPARK-36160) pyspark sql/column documentation for between is complicated

Dominik Gehl created SPARK-36160: Summary: pyspark sql/column documentation for between is complicated Key: SPARK-36160 URL: https://issues.apache.org/jira/browse/SPARK-36160 Project: Spark

[jira] [Commented] (SPARK-36160) pyspark sql/column documentation for between is complicated

[ https://issues.apache.org/jira/browse/SPARK-36160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381354#comment-17381354 ] Apache Spark commented on SPARK-36160: -- User 'dominikgehl' has created a pull reque

[jira] [Assigned] (SPARK-36160) pyspark sql/column documentation for between is complicated

[ https://issues.apache.org/jira/browse/SPARK-36160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36160: Assignee: Apache Spark > pyspark sql/column documentation for between is complicated > --

[jira] [Assigned] (SPARK-36160) pyspark sql/column documentation for between is complicated

[ https://issues.apache.org/jira/browse/SPARK-36160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36160: Assignee: (was: Apache Spark) > pyspark sql/column documentation for between is compl

[jira] [Assigned] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36154: Assignee: Max Gekk > pyspark documentation doesn't mention week and quarter as valid format > ar

[jira] [Assigned] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36154: Assignee: (was: Max Gekk) > pyspark documentation doesn't mention week and quarter as valid f

[jira] [Resolved] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36154. -- Fix Version/s: 3.3.0 3.1.3 3.2.0 Resolution: Fixed > pysp

[jira] [Created] (SPARK-36161) dropDuplicates does not type check argument

Samuel Moseley created SPARK-36161: -- Summary: dropDuplicates does not type check argument Key: SPARK-36161 URL: https://issues.apache.org/jira/browse/SPARK-36161 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381372#comment-17381372 ] Apache Spark commented on SPARK-36034: -- User 'sammyjmoseley' has created a pull req

[jira] [Created] (SPARK-36162) extractJoinKeysWithColStats support EqualNullSafe

Yuming Wang created SPARK-36162: --- Summary: extractJoinKeysWithColStats support EqualNullSafe Key: SPARK-36162 URL: https://issues.apache.org/jira/browse/SPARK-36162 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-36162) extractJoinKeysWithColStats support EqualNullSafe

[ https://issues.apache.org/jira/browse/SPARK-36162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-36162: Description: sql("select * from date_dim join item on d_date_sk = i_item_sk").explain("cost") {nof

[jira] [Created] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

Ivan created SPARK-36163: Summary: Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option Key: SPARK-36163 URL: https://issues.apache.org/jira/browse/SPARK-36163 Proj

[jira] [Commented] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381385#comment-17381385 ] Ivan commented on SPARK-36163: -- I will open a PR for this shortly. > Propagate correct JDB

[jira] [Assigned] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36163: Assignee: Apache Spark > Propagate correct JDBC properties in JDBC connector provider and

[jira] [Commented] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381388#comment-17381388 ] Apache Spark commented on SPARK-36163: -- User 'sadikovi' has created a pull request

[jira] [Assigned] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36163: Assignee: (was: Apache Spark) > Propagate correct JDBC properties in JDBC connector p

[jira] [Commented] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381389#comment-17381389 ] Apache Spark commented on SPARK-36163: -- User 'sadikovi' has created a pull request

[jira] [Assigned] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

[ https://issues.apache.org/jira/browse/SPARK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36159: - Assignee: Hyukjin Kwon > Replace 'python' to 'python3' in dev/test-dependencies.sh > -

[jira] [Resolved] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

[ https://issues.apache.org/jira/browse/SPARK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36159. --- Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution: Fix

[jira] [Resolved] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36146. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33356 [https://

[jira] [Assigned] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36146: - Assignee: Hyukjin Kwon > Upgrade Python version from 3.6 to higher version in GitHub li

[jira] [Commented] (SPARK-36134) jackson-databind RCE vulnerability

[ https://issues.apache.org/jira/browse/SPARK-36134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381417#comment-17381417 ] Erik Krogen commented on SPARK-36134: - 3.1.2 doesn't exist yet, the only release in

[jira] [Resolved] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

[ https://issues.apache.org/jira/browse/SPARK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36158. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33366 [https://github.com

[jira] [Resolved] (SPARK-36157) TimeWindow expression: apply filter before project

[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36157. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33367 [https://gith

[jira] [Assigned] (SPARK-36157) TimeWindow expression: apply filter before project

[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36157: --- Assignee: Jungtaek Lim > TimeWindow expression: apply filter before project > -

[jira] [Created] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

William Hyun created SPARK-36164: Summary: Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined. Key: SPARK-36164 URL: https://issues.apache.org/jira/browse/SPARK-36164

[jira] [Resolved] (SPARK-36135) Support TimestampNTZ type in file partitioning

[ https://issues.apache.org/jira/browse/SPARK-36135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36135. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33344 [https:

[jira] [Assigned] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36164: Assignee: Apache Spark > Change run-test.py so that it does not fail when > os.environ["

[jira] [Commented] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381477#comment-17381477 ] Apache Spark commented on SPARK-36164: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36164: Assignee: (was: Apache Spark) > Change run-test.py so that it does not fail when > o

[jira] [Commented] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381476#comment-17381476 ] Apache Spark commented on SPARK-36164: -- User 'williamhyun' has created a pull reque

[jira] [Created] (SPARK-36165) Fix SQL doc generation in GitHub Action

Dongjoon Hyun created SPARK-36165: - Summary: Fix SQL doc generation in GitHub Action Key: SPARK-36165 URL: https://issues.apache.org/jira/browse/SPARK-36165 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-36165) Fix SQL doc generation in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381494#comment-17381494 ] Apache Spark commented on SPARK-36165: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-36165) Fix SQL doc generation in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36165: Assignee: (was: Apache Spark) > Fix SQL doc generation in GitHub Action > ---

[jira] [Assigned] (SPARK-36165) Fix SQL doc generation in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36165: Assignee: Apache Spark > Fix SQL doc generation in GitHub Action > --

[jira] [Updated] (SPARK-36127) Support comparison between a Categorical and a scalar

[ https://issues.apache.org/jira/browse/SPARK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36127: - Summary: Support comparison between a Categorical and a scalar (was: Adjust non-equality compar

[jira] [Assigned] (SPARK-36165) Fix SQL doc generation in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36165: - Assignee: Dongjoon Hyun > Fix SQL doc generation in GitHub Action > ---

[jira] [Resolved] (SPARK-36165) Fix SQL doc generation in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36165. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33372 [https://

[jira] [Resolved] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36164. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33371 [https://

[jira] [Assigned] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36164: - Assignee: William Hyun > Change run-test.py so that it does not fail when > os.environ

  1   2   >