[jira] [Created] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-01 Thread Aimilios Tsouvelekakis (Jira)
Aimilios Tsouvelekakis created SPARK-42647: -- Summary: Remove aliases from deprecated numpy data types Key: SPARK-42647 URL: https://issues.apache.org/jira/browse/SPARK-42647 Project: Spark

[jira] [Updated] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-01 Thread Aimilios Tsouvelekakis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aimilios Tsouvelekakis updated SPARK-42647: --- Description: Numpy has started changing the alias to some of its

[jira] [Resolved] (SPARK-42639) Add createDataFrame/createDataset to SparkSession

2023-03-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42639. --- Fix Version/s: 3.4.1 Resolution: Fixed Issue resolved by pull request 40242

[jira] [Assigned] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42647: Assignee: Apache Spark > Remove aliases from deprecated numpy data types >

[jira] [Commented] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695520#comment-17695520 ] Apache Spark commented on SPARK-42647: -- User 'aimtsou' has created a pull request for this issue:

[jira] [Created] (SPARK-42648) Upgrade versions-maven-plugin to 2.15.0

2023-03-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-42648: Summary: Upgrade versions-maven-plugin to 2.15.0 Key: SPARK-42648 URL: https://issues.apache.org/jira/browse/SPARK-42648 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42647: Assignee: (was: Apache Spark) > Remove aliases from deprecated numpy data types >

[jira] [Assigned] (SPARK-42629) Update the description of default data source in the document

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42629: Assignee: Apache Spark > Update the description of default data source in the document >

[jira] [Assigned] (SPARK-42629) Update the description of default data source in the document

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42629: Assignee: (was: Apache Spark) > Update the description of default data source in the

[jira] [Commented] (SPARK-42629) Update the description of default data source in the document

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695046#comment-17695046 ] Apache Spark commented on SPARK-42629: -- User 'huangxiaopingRD' has created a pull request for this

[jira] [Assigned] (SPARK-42630) Make `parse_data_type` use new proto message `DDLParse`

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42630: Assignee: Apache Spark > Make `parse_data_type` use new proto message `DDLParse` >

[jira] [Assigned] (SPARK-42630) Make `parse_data_type` use new proto message `DDLParse`

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42630: Assignee: (was: Apache Spark) > Make `parse_data_type` use new proto message

[jira] [Commented] (SPARK-42630) Make `parse_data_type` use new proto message `DDLParse`

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695056#comment-17695056 ] Apache Spark commented on SPARK-42630: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2023-03-01 Thread icyjhl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694993#comment-17694993 ] icyjhl commented on SPARK-40610: Hi [~yumwang], it's string. > Spark fall back to use getPartitions

[jira] [Created] (SPARK-42629) Update the description of default data source in the document

2023-03-01 Thread xiaoping.huang (Jira)
xiaoping.huang created SPARK-42629: -- Summary: Update the description of default data source in the document Key: SPARK-42629 URL: https://issues.apache.org/jira/browse/SPARK-42629 Project: Spark

[jira] [Created] (SPARK-42630) Make `parse_data_type` use new proto message `DDLParse`

2023-03-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-42630: - Summary: Make `parse_data_type` use new proto message `DDLParse` Key: SPARK-42630 URL: https://issues.apache.org/jira/browse/SPARK-42630 Project: Spark

[jira] [Updated] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2023-03-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34827: -- Target Version/s: (was: 3.3.0) > Support fetching shuffle blocks in batch with i/o

[jira] [Created] (SPARK-42631) Support custom extensions in Spark Connect Scala client

2023-03-01 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-42631: -- Summary: Support custom extensions in Spark Connect Scala client Key: SPARK-42631 URL: https://issues.apache.org/jira/browse/SPARK-42631 Project: Spark

[jira] [Updated] (SPARK-39993) Spark on Kubernetes doesn't filter data by date

2023-03-01 Thread Hanna Liashchuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanna Liashchuk updated SPARK-39993: Affects Version/s: 3.3.2 > Spark on Kubernetes doesn't filter data by date >

[jira] [Commented] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695157#comment-17695157 ] Apache Spark commented on SPARK-34827: -- User 'tomvanbussel' has created a pull request for this

[jira] [Assigned] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34827: Assignee: Apache Spark > Support fetching shuffle blocks in batch with i/o encryption >

[jira] [Assigned] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34827: Assignee: (was: Apache Spark) > Support fetching shuffle blocks in batch with i/o

[jira] [Resolved] (SPARK-42581) Add SparkSession implicits

2023-03-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42581. --- Fix Version/s: 3.4.1 Resolution: Fixed > Add SparkSession implicits >

[jira] [Updated] (SPARK-42609) Add tests for grouping() and grouping_id() functions

2023-03-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-42609: -- Summary: Add tests for grouping() and grouping_id() functions (was: Support

[jira] [Created] (SPARK-42632) Fix scala paths in tests

2023-03-01 Thread Jira
Herman van Hövell created SPARK-42632: - Summary: Fix scala paths in tests Key: SPARK-42632 URL: https://issues.apache.org/jira/browse/SPARK-42632 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-42410) Support Scala 2.12/2.13 tests in connect module

2023-03-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-42410: -- Epic Link: SPARK-42554 > Support Scala 2.12/2.13 tests in connect module >

[jira] [Updated] (SPARK-42543) Specify protocol for UDF artifact transfer in JVM/Scala client

2023-03-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-42543: -- Epic Link: SPARK-42554 > Specify protocol for UDF artifact transfer in JVM/Scala

[jira] [Commented] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2023-03-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695223#comment-17695223 ] Dongjoon Hyun commented on SPARK-34827: --- Also, I lower the priority from `Blocker` to `Major`

[jira] [Updated] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2023-03-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34827: -- Affects Version/s: 3.4.0 > Support fetching shuffle blocks in batch with i/o encryption >

[jira] [Updated] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2023-03-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34827: -- Priority: Major (was: Blocker) > Support fetching shuffle blocks in batch with i/o

[jira] [Commented] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2023-03-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695222#comment-17695222 ] Dongjoon Hyun commented on SPARK-34827: --- I removed `Target Version` field value, `3.3.0`, because

[jira] [Created] (SPARK-42633) Use the actual schema in a LocalRelation

2023-03-01 Thread Jira
Herman van Hövell created SPARK-42633: - Summary: Use the actual schema in a LocalRelation Key: SPARK-42633 URL: https://issues.apache.org/jira/browse/SPARK-42633 Project: Spark Issue

[jira] [Created] (SPARK-42634) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-42634: -- Summary: Several counter-intuitive behaviours in the TimestampAdd expression Key: SPARK-42634 URL: https://issues.apache.org/jira/browse/SPARK-42634 Project: Spark

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Commented] (SPARK-42631) Support custom extensions in Spark Connect Scala client

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695254#comment-17695254 ] Apache Spark commented on SPARK-42631: -- User 'tomvanbussel' has created a pull request for this

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Commented] (SPARK-38735) Test the error class: INTERNAL_ERROR

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695261#comment-17695261 ] Apache Spark commented on SPARK-38735: -- User 'the8thC' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38735) Test the error class: INTERNAL_ERROR

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38735: Assignee: Apache Spark > Test the error class: INTERNAL_ERROR >

[jira] [Assigned] (SPARK-38735) Test the error class: INTERNAL_ERROR

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38735: Assignee: (was: Apache Spark) > Test the error class: INTERNAL_ERROR >

[jira] [Commented] (SPARK-38735) Test the error class: INTERNAL_ERROR

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695259#comment-17695259 ] Apache Spark commented on SPARK-38735: -- User 'the8thC' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42634) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li resolved SPARK-42634. Resolution: Fixed duplicate > Several counter-intuitive behaviours in the TimestampAdd

[jira] [Created] (SPARK-42638) current_user() is blocked from VALUES, but current_timestamp() is not

2023-03-01 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-42638: Summary: current_user() is blocked from VALUES, but current_timestamp() is not Key: SPARK-42638 URL: https://issues.apache.org/jira/browse/SPARK-42638 Project: Spark

[jira] [Commented] (SPARK-40159) Aggregate should be group only after collapse project to aggregate

2023-03-01 Thread Ritika Maheshwari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695327#comment-17695327 ] Ritika Maheshwari commented on SPARK-40159: --- This issue seems to have been resolved by

[jira] [Closed] (SPARK-42634) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li closed SPARK-42634. -- This is a duplicate, created by mistake. > Several counter-intuitive behaviours in the TimestampAdd

[jira] [Created] (SPARK-42637) Add SparkSession.stop

2023-03-01 Thread Jira
Herman van Hövell created SPARK-42637: - Summary: Add SparkSession.stop Key: SPARK-42637 URL: https://issues.apache.org/jira/browse/SPARK-42637 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Component/s: (was: SQL) > Several counter-intuitive behaviours in the TimestampAdd expression >

[jira] [Assigned] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42635: Assignee: (was: Apache Spark) > Several counter-intuitive behaviours in the

[jira] [Commented] (SPARK-42633) Use the actual schema in a LocalRelation

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695280#comment-17695280 ] Apache Spark commented on SPARK-42633: -- User 'hvanhovell' has created a pull request for this

[jira] [Commented] (SPARK-42637) Add SparkSession.stop

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695279#comment-17695279 ] Apache Spark commented on SPARK-42637: -- User 'hvanhovell' has created a pull request for this

[jira] [Created] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-42635: -- Summary: Several counter-intuitive behaviours in the TimestampAdd expression Key: SPARK-42635 URL: https://issues.apache.org/jira/browse/SPARK-42635 Project: Spark

[jira] [Assigned] (SPARK-42631) Support custom extensions in Spark Connect Scala client

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42631: Assignee: (was: Apache Spark) > Support custom extensions in Spark Connect Scala

[jira] [Commented] (SPARK-42631) Support custom extensions in Spark Connect Scala client

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695252#comment-17695252 ] Apache Spark commented on SPARK-42631: -- User 'tomvanbussel' has created a pull request for this

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Assigned] (SPARK-42631) Support custom extensions in Spark Connect Scala client

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42631: Assignee: Apache Spark > Support custom extensions in Spark Connect Scala client >

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Resolved] (SPARK-41843) Implement SparkSession.udf

2023-03-01 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-41843. --- Fix Version/s: 3.4.0 Resolution: Fixed > Implement SparkSession.udf >

[jira] [Updated] (SPARK-42634) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42634: --- Description: (was: # When the time is close to daylight saving time transition, the result may

[jira] [Assigned] (SPARK-42632) Fix scala paths in tests

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42632: Assignee: Herman van Hövell (was: Apache Spark) > Fix scala paths in tests >

[jira] [Assigned] (SPARK-42632) Fix scala paths in tests

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42632: Assignee: Apache Spark (was: Herman van Hövell) > Fix scala paths in tests >

[jira] [Commented] (SPARK-42632) Fix scala paths in tests

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695232#comment-17695232 ] Apache Spark commented on SPARK-42632: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-42633) Use the actual schema in a LocalRelation

2023-03-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-42633: - Assignee: Herman van Hövell > Use the actual schema in a LocalRelation >

[jira] [Updated] (SPARK-39993) Spark on Kubernetes doesn't filter data by date

2023-03-01 Thread Hanna Liashchuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanna Liashchuk updated SPARK-39993: Affects Version/s: (was: 3.3.2) > Spark on Kubernetes doesn't filter data by date >

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Component/s: SQL (was: Spark Core) > Several counter-intuitive behaviours in

[jira] [Created] (SPARK-42636) Audit annotation usage

2023-03-01 Thread Jira
Herman van Hövell created SPARK-42636: - Summary: Audit annotation usage Key: SPARK-42636 URL: https://issues.apache.org/jira/browse/SPARK-42636 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42635: Assignee: Apache Spark > Several counter-intuitive behaviours in the TimestampAdd

[jira] [Commented] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695278#comment-17695278 ] Apache Spark commented on SPARK-42635: -- User 'chenhao-db' has created a pull request for this

[jira] [Assigned] (SPARK-42458) createDataFrame should support DDL string as schema

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42458: Assignee: Apache Spark > createDataFrame should support DDL string as schema >

[jira] [Assigned] (SPARK-42458) createDataFrame should support DDL string as schema

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42458: Assignee: (was: Apache Spark) > createDataFrame should support DDL string as schema

[jira] [Commented] (SPARK-42458) createDataFrame should support DDL string as schema

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695351#comment-17695351 ] Apache Spark commented on SPARK-42458: -- User 'ueshin' has created a pull request for this issue:

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Attachment: Screenshot 2023-03-01 at 8.10.08 PM.png > Make Python the first code example tab

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Attachment: Screenshot 2023-03-01 at 8.10.22 PM.png > Make Python the first code example tab

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Description: Python is the most approachable and most popular language so it should be the

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Description: Python is the most approachable and most popular language so it should be the

[jira] [Resolved] (SPARK-42521) Add NULL values for INSERT commands with user-specified lists of fewer columns than the target table

2023-03-01 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42521. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40229

[jira] [Assigned] (SPARK-42521) Add NULL values for INSERT commands with user-specified lists of fewer columns than the target table

2023-03-01 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42521: -- Assignee: Daniel > Add NULL values for INSERT commands with user-specified lists of

[jira] [Created] (SPARK-42644) Add `hive` dependency to `connect` module

2023-03-01 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42644: - Summary: Add `hive` dependency to `connect` module Key: SPARK-42644 URL: https://issues.apache.org/jira/browse/SPARK-42644 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-42645) Introduce feature to allow for function caching across input rows.

2023-03-01 Thread Michael Tong (Jira)
Michael Tong created SPARK-42645: Summary: Introduce feature to allow for function caching across input rows. Key: SPARK-42645 URL: https://issues.apache.org/jira/browse/SPARK-42645 Project: Spark

[jira] [Commented] (SPARK-42644) Add `hive` dependency to `connect` module

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695464#comment-17695464 ] Apache Spark commented on SPARK-42644: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42644) Add `hive` dependency to `connect` module

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42644: Assignee: Apache Spark > Add `hive` dependency to `connect` module >

[jira] [Assigned] (SPARK-42644) Add `hive` dependency to `connect` module

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42644: Assignee: (was: Apache Spark) > Add `hive` dependency to `connect` module >

[jira] [Updated] (SPARK-42642) Make Python the first code example tab in the Spark documentation

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Summary: Make Python the first code example tab in the Spark documentation (was: Make Python

[jira] [Created] (SPARK-42643) Implement `spark.udf.registerJavaFunction`

2023-03-01 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-42643: Summary: Implement `spark.udf.registerJavaFunction` Key: SPARK-42643 URL: https://issues.apache.org/jira/browse/SPARK-42643 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42643) Implement `spark.udf.registerJavaFunction`

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42643: Assignee: (was: Apache Spark) > Implement `spark.udf.registerJavaFunction` >

[jira] [Commented] (SPARK-42643) Implement `spark.udf.registerJavaFunction`

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695429#comment-17695429 ] Apache Spark commented on SPARK-42643: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42643) Implement `spark.udf.registerJavaFunction`

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42643: Assignee: Apache Spark > Implement `spark.udf.registerJavaFunction` >

[jira] [Commented] (SPARK-41823) DataFrame.join creating ambiguous column names

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695428#comment-17695428 ] Apache Spark commented on SPARK-41823: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Description: Python is the most approachable and most popular language so it should be the

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Description: Python is the most approachable and most popular language so it should be the

[jira] [Created] (SPARK-42646) Upgrad cyclonedx from 2.7.3 to 2.7.5

2023-03-01 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-42646: --- Summary: Upgrad cyclonedx from 2.7.3 to 2.7.5 Key: SPARK-42646 URL: https://issues.apache.org/jira/browse/SPARK-42646 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42646) Upgrad cyclonedx from 2.7.3 to 2.7.5

2023-03-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-42646: Description:

[jira] [Assigned] (SPARK-42646) Upgrad cyclonedx from 2.7.3 to 2.7.5

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42646: Assignee: (was: Apache Spark) > Upgrad cyclonedx from 2.7.3 to 2.7.5 >

[jira] [Assigned] (SPARK-42646) Upgrad cyclonedx from 2.7.3 to 2.7.5

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42646: Assignee: Apache Spark > Upgrad cyclonedx from 2.7.3 to 2.7.5 >

[jira] [Commented] (SPARK-42646) Upgrad cyclonedx from 2.7.3 to 2.7.5

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695465#comment-17695465 ] Apache Spark commented on SPARK-42646: -- User 'panbingkun' has created a pull request for this

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Description: Python is the most approachable and most popular language so it should be the

[jira] [Assigned] (SPARK-42553) NonReserved keyword "interval" can't be column name

2023-03-01 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42553: Assignee: jiang13021 > NonReserved keyword "interval" can't be column name >

[jira] [Resolved] (SPARK-42553) NonReserved keyword "interval" can't be column name

2023-03-01 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42553. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40195

  1   2   >