[jira] [Created] (SPARK-42648) Upgrade versions-maven-plugin to 2.15.0

2023-03-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-42648: Summary: Upgrade versions-maven-plugin to 2.15.0 Key: SPARK-42648 URL: https://issues.apache.org/jira/browse/SPARK-42648 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42647: Assignee: (was: Apache Spark) > Remove aliases from deprecated numpy data types >

[jira] [Commented] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695520#comment-17695520 ] Apache Spark commented on SPARK-42647: -- User 'aimtsou' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42647: Assignee: Apache Spark > Remove aliases from deprecated numpy data types >

[jira] [Resolved] (SPARK-42639) Add createDataFrame/createDataset to SparkSession

2023-03-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42639. --- Fix Version/s: 3.4.1 Resolution: Fixed Issue resolved by pull request 40242

[jira] [Updated] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-01 Thread Aimilios Tsouvelekakis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aimilios Tsouvelekakis updated SPARK-42647: --- Description: Numpy has started changing the alias to some of its

[jira] [Created] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-01 Thread Aimilios Tsouvelekakis (Jira)
Aimilios Tsouvelekakis created SPARK-42647: -- Summary: Remove aliases from deprecated numpy data types Key: SPARK-42647 URL: https://issues.apache.org/jira/browse/SPARK-42647 Project: Spark

[jira] [Commented] (SPARK-42553) NonReserved keyword "interval" can't be column name

2023-03-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695498#comment-17695498 ] Dongjoon Hyun commented on SPARK-42553: --- Since RC2 tag is created, I changed the Fixed Version

[jira] [Updated] (SPARK-42553) NonReserved keyword "interval" can't be column name

2023-03-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42553: -- Fix Version/s: 3.4.1 (was: 3.4.0) > NonReserved keyword "interval"

[jira] [Updated] (SPARK-42644) Add `hive` dependency to `connect` module

2023-03-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42644: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Add `hive` dependency to `connect`

[jira] [Resolved] (SPARK-42644) Add `hive` dependency to `connect` module

2023-03-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42644. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40246

[jira] [Assigned] (SPARK-42644) Add `hive` dependency to `connect` module

2023-03-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42644: - Assignee: Dongjoon Hyun > Add `hive` dependency to `connect` module >

[jira] [Resolved] (SPARK-42553) NonReserved keyword "interval" can't be column name

2023-03-01 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42553. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40195

[jira] [Assigned] (SPARK-42553) NonReserved keyword "interval" can't be column name

2023-03-01 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42553: Assignee: jiang13021 > NonReserved keyword "interval" can't be column name >

[jira] [Updated] (SPARK-42642) Make Python the first code example tab in the Spark documentation

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Summary: Make Python the first code example tab in the Spark documentation (was: Make Python

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Description: Python is the most approachable and most popular language so it should be the

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Description: Python is the most approachable and most popular language so it should be the

[jira] [Commented] (SPARK-42646) Upgrad cyclonedx from 2.7.3 to 2.7.5

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695465#comment-17695465 ] Apache Spark commented on SPARK-42646: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-42646) Upgrad cyclonedx from 2.7.3 to 2.7.5

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42646: Assignee: Apache Spark > Upgrad cyclonedx from 2.7.3 to 2.7.5 >

[jira] [Assigned] (SPARK-42646) Upgrad cyclonedx from 2.7.3 to 2.7.5

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42646: Assignee: (was: Apache Spark) > Upgrad cyclonedx from 2.7.3 to 2.7.5 >

[jira] [Assigned] (SPARK-42644) Add `hive` dependency to `connect` module

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42644: Assignee: (was: Apache Spark) > Add `hive` dependency to `connect` module >

[jira] [Assigned] (SPARK-42644) Add `hive` dependency to `connect` module

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42644: Assignee: Apache Spark > Add `hive` dependency to `connect` module >

[jira] [Commented] (SPARK-42644) Add `hive` dependency to `connect` module

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695464#comment-17695464 ] Apache Spark commented on SPARK-42644: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-42646) Upgrad cyclonedx from 2.7.3 to 2.7.5

2023-03-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-42646: Description:

[jira] [Created] (SPARK-42646) Upgrad cyclonedx from 2.7.3 to 2.7.5

2023-03-01 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-42646: --- Summary: Upgrad cyclonedx from 2.7.3 to 2.7.5 Key: SPARK-42646 URL: https://issues.apache.org/jira/browse/SPARK-42646 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-42645) Introduce feature to allow for function caching across input rows.

2023-03-01 Thread Michael Tong (Jira)
Michael Tong created SPARK-42645: Summary: Introduce feature to allow for function caching across input rows. Key: SPARK-42645 URL: https://issues.apache.org/jira/browse/SPARK-42645 Project: Spark

[jira] [Created] (SPARK-42644) Add `hive` dependency to `connect` module

2023-03-01 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42644: - Summary: Add `hive` dependency to `connect` module Key: SPARK-42644 URL: https://issues.apache.org/jira/browse/SPARK-42644 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-42521) Add NULL values for INSERT commands with user-specified lists of fewer columns than the target table

2023-03-01 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42521: -- Assignee: Daniel > Add NULL values for INSERT commands with user-specified lists of

[jira] [Resolved] (SPARK-42521) Add NULL values for INSERT commands with user-specified lists of fewer columns than the target table

2023-03-01 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42521. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40229

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Description: Python is the most approachable and most popular language so it should be the

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Attachment: Screenshot 2023-03-01 at 8.10.22 PM.png > Make Python the first code example tab

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Attachment: Screenshot 2023-03-01 at 8.10.08 PM.png > Make Python the first code example tab

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Description: Python is the most approachable and most popular language so it should be the

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Description: Python is the most approachable and most popular language so it should be the

[jira] [Commented] (SPARK-42643) Implement `spark.udf.registerJavaFunction`

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695429#comment-17695429 ] Apache Spark commented on SPARK-42643: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42643) Implement `spark.udf.registerJavaFunction`

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42643: Assignee: Apache Spark > Implement `spark.udf.registerJavaFunction` >

[jira] [Assigned] (SPARK-42643) Implement `spark.udf.registerJavaFunction`

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42643: Assignee: (was: Apache Spark) > Implement `spark.udf.registerJavaFunction` >

[jira] [Commented] (SPARK-41823) DataFrame.join creating ambiguous column names

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695428#comment-17695428 ] Apache Spark commented on SPARK-41823: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-42643) Implement `spark.udf.registerJavaFunction`

2023-03-01 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-42643: Summary: Implement `spark.udf.registerJavaFunction` Key: SPARK-42643 URL: https://issues.apache.org/jira/browse/SPARK-42643 Project: Spark Issue Type:

[jira] [Updated] (SPARK-42642) Make Python the first code example tab

2023-03-01 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42642: -- Summary: Make Python the first code example tab (was: Make Python the first code example tab

[jira] [Created] (SPARK-42642) Make Python the first code example tab -

2023-03-01 Thread Allan Folting (Jira)
Allan Folting created SPARK-42642: - Summary: Make Python the first code example tab - Key: SPARK-42642 URL: https://issues.apache.org/jira/browse/SPARK-42642 Project: Spark Issue Type:

[jira] [Updated] (SPARK-39316) Merge PromotePrecision and CheckOverflow into decimal binary arithmetic

2023-03-01 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-39316: -- Description: Fix the bug of `TypeCoercion`, for example: {code:java} SELECT CAST(1 AS DECIMAL(28,

[jira] [Assigned] (SPARK-42641) Upgrade buf to v1.15.0

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42641: Assignee: (was: Apache Spark) > Upgrade buf to v1.15.0 > -- > >

[jira] [Assigned] (SPARK-42641) Upgrade buf to v1.15.0

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42641: Assignee: Apache Spark > Upgrade buf to v1.15.0 > -- > >

[jira] [Commented] (SPARK-42641) Upgrade buf to v1.15.0

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695404#comment-17695404 ] Apache Spark commented on SPARK-42641: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-42641) Upgrade buf to v1.15.0

2023-03-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-42641: - Summary: Upgrade buf to v1.15.0 Key: SPARK-42641 URL: https://issues.apache.org/jira/browse/SPARK-42641 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-42631) Support custom extensions in Spark Connect Scala client

2023-03-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-42631: -- Epic Link: SPARK-42554 > Support custom extensions in Spark Connect Scala client >

[jira] [Resolved] (SPARK-42631) Support custom extensions in Spark Connect Scala client

2023-03-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42631. --- Fix Version/s: 3.4.1 Assignee: Tom van Bussel Resolution: Fixed >

[jira] [Assigned] (SPARK-42640) Remove stale entries from the excluding rules for CompabilitySuite

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42640: Assignee: Apache Spark (was: Rui Wang) > Remove stale entries from the excluding rules

[jira] [Assigned] (SPARK-42640) Remove stale entries from the excluding rules for CompabilitySuite

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42640: Assignee: Rui Wang (was: Apache Spark) > Remove stale entries from the excluding rules

[jira] [Commented] (SPARK-42640) Remove stale entries from the excluding rules for CompabilitySuite

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695387#comment-17695387 ] Apache Spark commented on SPARK-42640: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-42639) Add createDataFrame/createDataset to SparkSession

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695386#comment-17695386 ] Apache Spark commented on SPARK-42639: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-42639) Add createDataFrame/createDataset to SparkSession

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42639: Assignee: Apache Spark (was: Herman van Hövell) > Add createDataFrame/createDataset to

[jira] [Assigned] (SPARK-42639) Add createDataFrame/createDataset to SparkSession

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42639: Assignee: Herman van Hövell (was: Apache Spark) > Add createDataFrame/createDataset to

[jira] [Created] (SPARK-42640) Remove stale entries from the excluding rules for CompabilitySuite

2023-03-01 Thread Rui Wang (Jira)
Rui Wang created SPARK-42640: Summary: Remove stale entries from the excluding rules for CompabilitySuite Key: SPARK-42640 URL: https://issues.apache.org/jira/browse/SPARK-42640 Project: Spark

[jira] [Created] (SPARK-42639) Add createDataFrame/createDataset to SparkSession

2023-03-01 Thread Jira
Herman van Hövell created SPARK-42639: - Summary: Add createDataFrame/createDataset to SparkSession Key: SPARK-42639 URL: https://issues.apache.org/jira/browse/SPARK-42639 Project: Spark

[jira] [Assigned] (SPARK-42639) Add createDataFrame/createDataset to SparkSession

2023-03-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-42639: - Assignee: Herman van Hövell > Add createDataFrame/createDataset to

[jira] [Resolved] (SPARK-42493) Spark SQL, DataFrames and Datasets Guide - make Python the first code example tab

2023-03-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42493. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40087

[jira] [Assigned] (SPARK-42493) Spark SQL, DataFrames and Datasets Guide - make Python the first code example tab

2023-03-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42493: Assignee: Allan Folting > Spark SQL, DataFrames and Datasets Guide - make Python the

[jira] [Resolved] (SPARK-42613) PythonRunner should set OMP_NUM_THREADS to task cpus instead of executor cores by default

2023-03-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42613. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40212

[jira] [Assigned] (SPARK-42613) PythonRunner should set OMP_NUM_THREADS to task cpus instead of executor cores by default

2023-03-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42613: Assignee: John Zhuge > PythonRunner should set OMP_NUM_THREADS to task cpus instead of

[jira] [Resolved] (SPARK-42632) Fix scala paths in tests

2023-03-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42632. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40235

[jira] [Resolved] (SPARK-42637) Add SparkSession.stop

2023-03-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42637. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40239

[jira] [Assigned] (SPARK-42458) createDataFrame should support DDL string as schema

2023-03-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42458: Assignee: Takuya Ueshin > createDataFrame should support DDL string as schema >

[jira] [Resolved] (SPARK-42458) createDataFrame should support DDL string as schema

2023-03-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42458. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40240

[jira] [Assigned] (SPARK-42458) createDataFrame should support DDL string as schema

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42458: Assignee: Apache Spark > createDataFrame should support DDL string as schema >

[jira] [Commented] (SPARK-42458) createDataFrame should support DDL string as schema

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695351#comment-17695351 ] Apache Spark commented on SPARK-42458: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42458) createDataFrame should support DDL string as schema

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42458: Assignee: (was: Apache Spark) > createDataFrame should support DDL string as schema

[jira] [Commented] (SPARK-40159) Aggregate should be group only after collapse project to aggregate

2023-03-01 Thread Ritika Maheshwari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695327#comment-17695327 ] Ritika Maheshwari commented on SPARK-40159: --- This issue seems to have been resolved by

[jira] [Created] (SPARK-42638) current_user() is blocked from VALUES, but current_timestamp() is not

2023-03-01 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-42638: Summary: current_user() is blocked from VALUES, but current_timestamp() is not Key: SPARK-42638 URL: https://issues.apache.org/jira/browse/SPARK-42638 Project: Spark

[jira] [Commented] (SPARK-42633) Use the actual schema in a LocalRelation

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695280#comment-17695280 ] Apache Spark commented on SPARK-42633: -- User 'hvanhovell' has created a pull request for this

[jira] [Commented] (SPARK-42637) Add SparkSession.stop

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695279#comment-17695279 ] Apache Spark commented on SPARK-42637: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42635: Assignee: (was: Apache Spark) > Several counter-intuitive behaviours in the

[jira] [Commented] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695278#comment-17695278 ] Apache Spark commented on SPARK-42635: -- User 'chenhao-db' has created a pull request for this

[jira] [Assigned] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42635: Assignee: Apache Spark > Several counter-intuitive behaviours in the TimestampAdd

[jira] [Created] (SPARK-42637) Add SparkSession.stop

2023-03-01 Thread Jira
Herman van Hövell created SPARK-42637: - Summary: Add SparkSession.stop Key: SPARK-42637 URL: https://issues.apache.org/jira/browse/SPARK-42637 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-42636) Audit annotation usage

2023-03-01 Thread Jira
Herman van Hövell created SPARK-42636: - Summary: Audit annotation usage Key: SPARK-42636 URL: https://issues.apache.org/jira/browse/SPARK-42636 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-42634) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42634: --- Description: (was: # When the time is close to daylight saving time transition, the result may

[jira] [Closed] (SPARK-42634) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li closed SPARK-42634. -- This is a duplicate, created by mistake. > Several counter-intuitive behaviours in the TimestampAdd

[jira] [Resolved] (SPARK-42634) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li resolved SPARK-42634. Resolution: Fixed duplicate > Several counter-intuitive behaviours in the TimestampAdd

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Component/s: SQL (was: Spark Core) > Several counter-intuitive behaviours in

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Component/s: (was: SQL) > Several counter-intuitive behaviours in the TimestampAdd expression >

[jira] [Resolved] (SPARK-41843) Implement SparkSession.udf

2023-03-01 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-41843. --- Fix Version/s: 3.4.0 Resolution: Fixed > Implement SparkSession.udf >

[jira] [Commented] (SPARK-38735) Test the error class: INTERNAL_ERROR

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695259#comment-17695259 ] Apache Spark commented on SPARK-38735: -- User 'the8thC' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38735) Test the error class: INTERNAL_ERROR

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38735: Assignee: (was: Apache Spark) > Test the error class: INTERNAL_ERROR >

[jira] [Commented] (SPARK-38735) Test the error class: INTERNAL_ERROR

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695261#comment-17695261 ] Apache Spark commented on SPARK-38735: -- User 'the8thC' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38735) Test the error class: INTERNAL_ERROR

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38735: Assignee: Apache Spark > Test the error class: INTERNAL_ERROR >

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Commented] (SPARK-42631) Support custom extensions in Spark Connect Scala client

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695254#comment-17695254 ] Apache Spark commented on SPARK-42631: -- User 'tomvanbussel' has created a pull request for this

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Assigned] (SPARK-42631) Support custom extensions in Spark Connect Scala client

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42631: Assignee: Apache Spark > Support custom extensions in Spark Connect Scala client >

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Assigned] (SPARK-42631) Support custom extensions in Spark Connect Scala client

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42631: Assignee: (was: Apache Spark) > Support custom extensions in Spark Connect Scala

[jira] [Commented] (SPARK-42631) Support custom extensions in Spark Connect Scala client

2023-03-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695252#comment-17695252 ] Apache Spark commented on SPARK-42631: -- User 'tomvanbussel' has created a pull request for this

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-39993) Spark on Kubernetes doesn't filter data by date

2023-03-01 Thread Hanna Liashchuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanna Liashchuk updated SPARK-39993: Affects Version/s: (was: 3.3.2) > Spark on Kubernetes doesn't filter data by date >

  1   2   >