[jira] [Commented] (SPARK-36149) dayofweek documentation for python and R

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381078#comment-17381078 ] Apache Spark commented on SPARK-36149: -- User 'dominikgehl' has created a pull request for this

[jira] [Assigned] (SPARK-36149) dayofweek documentation for python and R

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36149: Assignee: Apache Spark > dayofweek documentation for python and R >

[jira] [Assigned] (SPARK-36149) dayofweek documentation for python and R

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36149: Assignee: (was: Apache Spark) > dayofweek documentation for python and R >

[jira] [Updated] (SPARK-36045) TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ

2021-07-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36045: --- Description: Currently, the SQL function to_utc_timestamp is confusing: it just takes the

[jira] [Assigned] (SPARK-36148) Missing validation of regexp_replace inputs

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36148: Assignee: (was: Apache Spark) > Missing validation of regexp_replace inputs >

[jira] [Assigned] (SPARK-36148) Missing validation of regexp_replace inputs

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36148: Assignee: Apache Spark > Missing validation of regexp_replace inputs >

[jira] [Commented] (SPARK-36148) Missing validation of regexp_replace inputs

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381130#comment-17381130 ] Apache Spark commented on SPARK-36148: -- User 'linhongliu-db' has created a pull request for this

[jira] [Assigned] (SPARK-36090) Support TimestampNTZType in expression Sequence

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36090: Assignee: Apache Spark > Support TimestampNTZType in expression Sequence >

[jira] [Assigned] (SPARK-36090) Support TimestampNTZType in expression Sequence

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36090: Assignee: (was: Apache Spark) > Support TimestampNTZType in expression Sequence >

[jira] [Commented] (SPARK-36090) Support TimestampNTZType in expression Sequence

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381169#comment-17381169 ] Apache Spark commented on SPARK-36090: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36155) Eliminate join base uniqueness

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36155: Assignee: Apache Spark > Eliminate join base uniqueness > --

[jira] [Commented] (SPARK-36155) Eliminate join base uniqueness

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381174#comment-17381174 ] Apache Spark commented on SPARK-36155: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36155) Eliminate join base uniqueness

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36155: Assignee: (was: Apache Spark) > Eliminate join base uniqueness >

[jira] [Updated] (SPARK-36150) Disable MiMa for Scala 2.13 artifacts

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36150: -- Affects Version/s: 3.2.0 > Disable MiMa for Scala 2.13 artifacts >

[jira] [Commented] (SPARK-36149) dayofweek documentation for python and R

2021-07-15 Thread Dominik Gehl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381101#comment-17381101 ] Dominik Gehl commented on SPARK-36149: -- Same is true for weekofyear > dayofweek documentation for

[jira] [Commented] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381110#comment-17381110 ] Apache Spark commented on SPARK-36146: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-36150) Disable MiMa for Scala 2.13 artifacts

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36150. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33355

[jira] [Assigned] (SPARK-36150) Disable MiMa for Scala 2.13 artifacts

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36150: - Assignee: Dongjoon Hyun > Disable MiMa for Scala 2.13 artifacts >

[jira] [Created] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

2021-07-15 Thread Dominik Gehl (Jira)
Dominik Gehl created SPARK-36154: Summary: pyspark documentation doesn't mention week and quarter as valid format arguments to trunc Key: SPARK-36154 URL: https://issues.apache.org/jira/browse/SPARK-36154

[jira] [Created] (SPARK-36149) dayofweek documentation for python and R

2021-07-15 Thread Dominik Gehl (Jira)
Dominik Gehl created SPARK-36149: Summary: dayofweek documentation for python and R Key: SPARK-36149 URL: https://issues.apache.org/jira/browse/SPARK-36149 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36146: Assignee: (was: Apache Spark) > Upgrade Python version from 3.6 to higher version in

[jira] [Commented] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381109#comment-17381109 ] Apache Spark commented on SPARK-36146: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36146: Assignee: Apache Spark > Upgrade Python version from 3.6 to higher version in GitHub

[jira] [Updated] (SPARK-36045) TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ

2021-07-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36045: --- Description: Currently, the SQL function to_utc_timestamp is confusing: it just takes the

[jira] [Created] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

2021-07-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-36152: - Summary: Add Scala 2.13 daily build and test GitHub Action job Key: SPARK-36152 URL: https://issues.apache.org/jira/browse/SPARK-36152 Project: Spark

[jira] [Created] (SPARK-36153) Add SLQ doc about transform for current behavior

2021-07-15 Thread angerszhu (Jira)
angerszhu created SPARK-36153: - Summary: Add SLQ doc about transform for current behavior Key: SPARK-36153 URL: https://issues.apache.org/jira/browse/SPARK-36153 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36037) Support ANSI SQL LOCALTIMESTAMP datetime value function

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381061#comment-17381061 ] Apache Spark commented on SPARK-36037: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-36150) Disable MiMa for Scala 2.13 artifacts

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381091#comment-17381091 ] Apache Spark commented on SPARK-36150: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-36150) Disable MiMa for Scala 2.13 artifacts

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36150: Assignee: Apache Spark > Disable MiMa for Scala 2.13 artifacts >

[jira] [Assigned] (SPARK-36150) Disable MiMa for Scala 2.13 artifacts

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36150: Assignee: (was: Apache Spark) > Disable MiMa for Scala 2.13 artifacts >

[jira] [Updated] (SPARK-36045) TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ

2021-07-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36045: --- Summary: TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ (was:

[jira] [Commented] (SPARK-33922) Fix error test SparkLauncherSuite.testSparkLauncherGetError

2021-07-15 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381155#comment-17381155 ] Xiaochang Wu commented on SPARK-33922: -- [~dengziming] Could you pls unset SPARK_HOME before running

[jira] [Issue Comment Deleted] (SPARK-36090) Support TimestampNTZType in expression Sequence

2021-07-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36090: --- Comment: was deleted (was: I'm working on.) > Support TimestampNTZType in expression Sequence >

[jira] [Resolved] (SPARK-36149) dayofweek documentation for python and R

2021-07-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36149. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33345

[jira] [Updated] (SPARK-36090) Support TimestampNTZType in expression Sequence

2021-07-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36090: --- Summary: Support TimestampNTZType in expression Sequence (was: Support TimestampNTZ type in

[jira] [Created] (SPARK-36150) Disable MiMa for Scala 2.13 artifacts

2021-07-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-36150: - Summary: Disable MiMa for Scala 2.13 artifacts Key: SPARK-36150 URL: https://issues.apache.org/jira/browse/SPARK-36150 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381137#comment-17381137 ] Apache Spark commented on SPARK-36152: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36152: Assignee: Apache Spark > Add Scala 2.13 daily build and test GitHub Action job >

[jira] [Assigned] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36152: Assignee: (was: Apache Spark) > Add Scala 2.13 daily build and test GitHub Action

[jira] [Commented] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381149#comment-17381149 ] Apache Spark commented on SPARK-36154: -- User 'dominikgehl' has created a pull request for this

[jira] [Assigned] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36154: Assignee: Apache Spark > pyspark documentation doesn't mention week and quarter as valid

[jira] [Created] (SPARK-36155) Eliminate join base uniqueness

2021-07-15 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-36155: --- Summary: Eliminate join base uniqueness Key: SPARK-36155 URL: https://issues.apache.org/jira/browse/SPARK-36155 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36154: Assignee: (was: Apache Spark) > pyspark documentation doesn't mention week and

[jira] [Commented] (SPARK-36149) dayofweek documentation for python and R

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381081#comment-17381081 ] Apache Spark commented on SPARK-36149: -- User 'dominikgehl' has created a pull request for this

[jira] [Updated] (SPARK-36149) dayofweek documentation for python and R

2021-07-15 Thread Dominik Gehl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominik Gehl updated SPARK-36149: - Description: Python and R documentation for {{dayofweek}} doesn't mention which integer

[jira] [Created] (SPARK-36151) Enable MiMa for Scala 2.13 artifacts after Spark 3.2.0 release

2021-07-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-36151: - Summary: Enable MiMa for Scala 2.13 artifacts after Spark 3.2.0 release Key: SPARK-36151 URL: https://issues.apache.org/jira/browse/SPARK-36151 Project: Spark

[jira] [Updated] (SPARK-36045) TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ

2021-07-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36045: --- Description: Currently, the SQL function (was: For the function `TO_UTC_TIMESTAMP`, it

[jira] [Created] (SPARK-36160) pyspark sql/column documentation for between is complicated

2021-07-15 Thread Dominik Gehl (Jira)
Dominik Gehl created SPARK-36160: Summary: pyspark sql/column documentation for between is complicated Key: SPARK-36160 URL: https://issues.apache.org/jira/browse/SPARK-36160 Project: Spark

[jira] [Assigned] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

2021-07-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36154: Assignee: Max Gekk > pyspark documentation doesn't mention week and quarter as valid format >

[jira] [Assigned] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

2021-07-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36154: Assignee: (was: Max Gekk) > pyspark documentation doesn't mention week and quarter as valid

[jira] [Created] (SPARK-36161) dropDuplicates does not type check argument

2021-07-15 Thread Samuel Moseley (Jira)
Samuel Moseley created SPARK-36161: -- Summary: dropDuplicates does not type check argument Key: SPARK-36161 URL: https://issues.apache.org/jira/browse/SPARK-36161 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36162) extractJoinKeysWithColStats support EqualNullSafe

2021-07-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-36162: Description: sql("select * from date_dim join item on d_date_sk = i_item_sk").explain("cost")

[jira] [Assigned] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36159: - Assignee: Hyukjin Kwon > Replace 'python' to 'python3' in dev/test-dependencies.sh >

[jira] [Resolved] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36159. --- Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution:

[jira] [Commented] (SPARK-36160) pyspark sql/column documentation for between is complicated

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381354#comment-17381354 ] Apache Spark commented on SPARK-36160: -- User 'dominikgehl' has created a pull request for this

[jira] [Assigned] (SPARK-36160) pyspark sql/column documentation for between is complicated

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36160: Assignee: Apache Spark > pyspark sql/column documentation for between is complicated >

[jira] [Assigned] (SPARK-36160) pyspark sql/column documentation for between is complicated

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36160: Assignee: (was: Apache Spark) > pyspark sql/column documentation for between is

[jira] [Commented] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381372#comment-17381372 ] Apache Spark commented on SPARK-36034: -- User 'sammyjmoseley' has created a pull request for this

[jira] [Created] (SPARK-36162) extractJoinKeysWithColStats support EqualNullSafe

2021-07-15 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-36162: --- Summary: extractJoinKeysWithColStats support EqualNullSafe Key: SPARK-36162 URL: https://issues.apache.org/jira/browse/SPARK-36162 Project: Spark Issue Type:

[jira] [Created] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

2021-07-15 Thread Ivan (Jira)
Ivan created SPARK-36163: Summary: Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option Key: SPARK-36163 URL: https://issues.apache.org/jira/browse/SPARK-36163

[jira] [Commented] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

2021-07-15 Thread Ivan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381385#comment-17381385 ] Ivan commented on SPARK-36163: -- I will open a PR for this shortly. > Propagate correct JDBC properties in

[jira] [Resolved] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36146. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33356

[jira] [Assigned] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36146: - Assignee: Hyukjin Kwon > Upgrade Python version from 3.6 to higher version in GitHub

[jira] [Assigned] (SPARK-36156) Row FORMAT SERDE should handle null value as `\N`

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36156: Assignee: (was: Apache Spark) > Row FORMAT SERDE should handle null value as `\N` >

[jira] [Assigned] (SPARK-36156) Row FORMAT SERDE should handle null value as `\N`

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36156: Assignee: Apache Spark > Row FORMAT SERDE should handle null value as `\N` >

[jira] [Commented] (SPARK-36156) Row FORMAT SERDE should handle null value as `\N`

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381241#comment-17381241 ] Apache Spark commented on SPARK-36156: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-36156) Row FORMAT SERDE should handle null value as `\N`

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381240#comment-17381240 ] Apache Spark commented on SPARK-36156: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-32792) Improve in filter pushdown for ParquetFilters

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381252#comment-17381252 ] Apache Spark commented on SPARK-32792: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-32792) Improve in filter pushdown for ParquetFilters

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381251#comment-17381251 ] Apache Spark commented on SPARK-32792: -- User 'wangyum' has created a pull request for this issue:

[jira] [Created] (SPARK-36157) TimeWindow expression: apply filter before project

2021-07-15 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-36157: Summary: TimeWindow expression: apply filter before project Key: SPARK-36157 URL: https://issues.apache.org/jira/browse/SPARK-36157 Project: Spark Issue

[jira] [Commented] (SPARK-36157) TimeWindow expression: apply filter before project

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381276#comment-17381276 ] Apache Spark commented on SPARK-36157: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-36157) TimeWindow expression: apply filter before project

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36157: Assignee: Apache Spark > TimeWindow expression: apply filter before project >

[jira] [Assigned] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36158: Assignee: (was: Apache Spark) > pyspark sql/functions documentation for

[jira] [Commented] (SPARK-36157) TimeWindow expression: apply filter before project

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381278#comment-17381278 ] Apache Spark commented on SPARK-36157: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381277#comment-17381277 ] Apache Spark commented on SPARK-36158: -- User 'dominikgehl' has created a pull request for this

[jira] [Resolved] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

2021-07-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36154. -- Fix Version/s: 3.3.0 3.1.3 3.2.0 Resolution: Fixed >

[jira] [Commented] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381389#comment-17381389 ] Apache Spark commented on SPARK-36163: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36163: Assignee: Apache Spark > Propagate correct JDBC properties in JDBC connector provider

[jira] [Commented] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381388#comment-17381388 ] Apache Spark commented on SPARK-36163: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36163: Assignee: (was: Apache Spark) > Propagate correct JDBC properties in JDBC connector

[jira] [Resolved] (SPARK-36148) Missing validation of regexp_replace inputs

2021-07-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36148. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33357

[jira] [Assigned] (SPARK-36148) Missing validation of regexp_replace inputs

2021-07-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36148: Assignee: Linhong Liu > Missing validation of regexp_replace inputs >

[jira] [Assigned] (SPARK-36153) Add SLQ doc about transform for current behavior

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36153: Assignee: Apache Spark > Add SLQ doc about transform for current behavior >

[jira] [Commented] (SPARK-36153) Add SLQ doc about transform for current behavior

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381207#comment-17381207 ] Apache Spark commented on SPARK-36153: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-36153) Add SLQ doc about transform for current behavior

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36153: Assignee: (was: Apache Spark) > Add SLQ doc about transform for current behavior >

[jira] [Assigned] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36158: Assignee: Apache Spark > pyspark sql/functions documentation for months_between isn't as

[jira] [Created] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

2021-07-15 Thread Dominik Gehl (Jira)
Dominik Gehl created SPARK-36158: Summary: pyspark sql/functions documentation for months_between isn't as precise as scala version Key: SPARK-36158 URL: https://issues.apache.org/jira/browse/SPARK-36158

[jira] [Assigned] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36159: Assignee: Apache Spark > Replace 'python' to 'python3' in dev/test-dependencies.sh >

[jira] [Assigned] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36159: Assignee: (was: Apache Spark) > Replace 'python' to 'python3' in

[jira] [Commented] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381280#comment-17381280 ] Apache Spark commented on SPARK-36159: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-36156) Row FORMAT SERDE should handle null value as `\N`

2021-07-15 Thread angerszhu (Jira)
angerszhu created SPARK-36156: - Summary: Row FORMAT SERDE should handle null value as `\N` Key: SPARK-36156 URL: https://issues.apache.org/jira/browse/SPARK-36156 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36031) Keep same behavior with pandas for operations of series with nan

2021-07-15 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381269#comment-17381269 ] Yikun Jiang commented on SPARK-36031: - [~XinrongM] OK, Thanks for your help. > Keep same behavior

[jira] [Assigned] (SPARK-36157) TimeWindow expression: apply filter before project

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36157: Assignee: (was: Apache Spark) > TimeWindow expression: apply filter before project >

[jira] [Created] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

2021-07-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-36159: Summary: Replace 'python' to 'python3' in dev/test-dependencies.sh Key: SPARK-36159 URL: https://issues.apache.org/jira/browse/SPARK-36159 Project: Spark

[jira] [Commented] (SPARK-21784) Add ALTER TABLE ADD CONSTRANT DDL to support defining primary key and foreign keys

2021-07-15 Thread Hay (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381290#comment-17381290 ] Hay commented on SPARK-21784: - Is there any progress on this feature? Like [~ksunitha] stated, the

[jira] [Resolved] (SPARK-36135) Support TimestampNTZ type in file partitioning

2021-07-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36135. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33344

[jira] [Assigned] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36164: Assignee: Apache Spark > Change run-test.py so that it does not fail when >

[jira] [Commented] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381477#comment-17381477 ] Apache Spark commented on SPARK-36164: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36164: Assignee: (was: Apache Spark) > Change run-test.py so that it does not fail when >

[jira] [Commented] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381476#comment-17381476 ] Apache Spark commented on SPARK-36164: -- User 'williamhyun' has created a pull request for this

  1   2   >