[jira] [Commented] (SPARK-41290) Support GENERATED ALWAYS AS in create table

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640184#comment-17640184 ] Apache Spark commented on SPARK-41290: -- User 'allisonport-db' has created a pull request for this

[jira] [Commented] (SPARK-41290) Support GENERATED ALWAYS AS in create table

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640183#comment-17640183 ] Apache Spark commented on SPARK-41290: -- User 'allisonport-db' has created a pull request for this

[jira] [Assigned] (SPARK-41290) Support GENERATED ALWAYS AS in create table

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41290: Assignee: Apache Spark > Support GENERATED ALWAYS AS in create table >

[jira] [Assigned] (SPARK-41290) Support GENERATED ALWAYS AS in create table

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41290: Assignee: (was: Apache Spark) > Support GENERATED ALWAYS AS in create table >

[jira] [Updated] (SPARK-41303) Assign a name to the error class _LEGACY_ERROR_TEMP_2422

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-41303: - Description: Assign a name to the legacy error class _LEGACY_ERROR_TEMP_2422, improve error message and

[jira] [Created] (SPARK-41303) Assign a name to the error class _LEGACY_ERROR_TEMP_2422

2022-11-28 Thread Max Gekk (Jira)
Max Gekk created SPARK-41303: Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2422 Key: SPARK-41303 URL: https://issues.apache.org/jira/browse/SPARK-41303 Project: Spark Issue Type:

[jira] [Created] (SPARK-41302) Assign a name to the error class _LEGACY_ERROR_TEMP_1185

2022-11-28 Thread Max Gekk (Jira)
Max Gekk created SPARK-41302: Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_1185 Key: SPARK-41302 URL: https://issues.apache.org/jira/browse/SPARK-41302 Project: Spark Issue Type:

[jira] [Updated] (SPARK-41302) Assign a name to the error class _LEGACY_ERROR_TEMP_1185

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-41302: - Description: Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1185, improve error message and

[jira] [Resolved] (SPARK-41180) Assign an error class to "Cannot parse the data type"

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41180. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38754

[jira] [Assigned] (SPARK-41180) Assign an error class to "Cannot parse the data type"

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41180: Assignee: Yang Jie > Assign an error class to "Cannot parse the data type" >

[jira] [Assigned] (SPARK-41301) SparkSession.range should treat end as optional

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41301: Assignee: Apache Spark > SparkSession.range should treat end as optional >

[jira] [Assigned] (SPARK-41301) SparkSession.range should treat end as optional

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41301: Assignee: (was: Apache Spark) > SparkSession.range should treat end as optional >

[jira] [Commented] (SPARK-41301) SparkSession.range should treat end as optional

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640107#comment-17640107 ] Apache Spark commented on SPARK-41301: -- User 'grundprinzip' has created a pull request for this

[jira] [Created] (SPARK-41301) SparkSession.range should treat end as optional

2022-11-28 Thread Martin Grund (Jira)
Martin Grund created SPARK-41301: Summary: SparkSession.range should treat end as optional Key: SPARK-41301 URL: https://issues.apache.org/jira/browse/SPARK-41301 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-41300) Unset Read.schema is incorrectly read when unset

2022-11-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-41300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-41300. --- Fix Version/s: 3.4.0 Assignee: Martin Grund Resolution: Fixed >

[jira] [Assigned] (SPARK-41254) YarnAllocator.rpIdToYarnResource map is not properly updated

2022-11-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41254: Assignee: Zhang Liang > YarnAllocator.rpIdToYarnResource map is not properly updated >

[jira] [Resolved] (SPARK-41254) YarnAllocator.rpIdToYarnResource map is not properly updated

2022-11-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41254. -- Fix Version/s: 3.2.4 3.3.2 3.4.0 Resolution:

[jira] [Assigned] (SPARK-41300) Unset Read.schema is incorrectly read when unset

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41300: Assignee: Apache Spark > Unset Read.schema is incorrectly read when unset >

[jira] [Commented] (SPARK-41300) Unset Read.schema is incorrectly read when unset

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640027#comment-17640027 ] Apache Spark commented on SPARK-41300: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-41300) Unset Read.schema is incorrectly read when unset

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41300: Assignee: (was: Apache Spark) > Unset Read.schema is incorrectly read when unset >

[jira] [Created] (SPARK-41300) Unset Read.schema is incorrectly read when unset

2022-11-28 Thread Martin Grund (Jira)
Martin Grund created SPARK-41300: Summary: Unset Read.schema is incorrectly read when unset Key: SPARK-41300 URL: https://issues.apache.org/jira/browse/SPARK-41300 Project: Spark Issue Type:

[jira] [Updated] (SPARK-41299) OOM when filter pushdown `last_day` function

2022-11-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-41299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] André F. updated SPARK-41299: - Description: Using the following transformation on Spark 3.3.1: {code:java} df.where($"date" ===

[jira] [Updated] (SPARK-41299) OOM when filter pushdown `last_day` function

2022-11-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-41299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] André F. updated SPARK-41299: - Description: Using the following transformation on Spark 3.3.1: {code:java} df.where($"date" ===

[jira] [Created] (SPARK-41299) OOM when filter pushdown `last_day` function

2022-11-28 Thread Jira
André F. created SPARK-41299: Summary: OOM when filter pushdown `last_day` function Key: SPARK-41299 URL: https://issues.apache.org/jira/browse/SPARK-41299 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-41298) Getting Count on data frame is giving the performance issue

2022-11-28 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-41298: Description: We are invoking  below query on Teradata  1) Dataframe df = spark.format("jdbc"). .

[jira] [Created] (SPARK-41298) Getting Count on data frame is giving the performance issue

2022-11-28 Thread Ramakrishna (Jira)
Ramakrishna created SPARK-41298: --- Summary: Getting Count on data frame is giving the performance issue Key: SPARK-41298 URL: https://issues.apache.org/jira/browse/SPARK-41298 Project: Spark

[jira] [Updated] (SPARK-41293) Code cleanup for assertXXX methods in ExpressionTypeCheckingSuite

2022-11-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41293: - Summary: Code cleanup for assertXXX methods in ExpressionTypeCheckingSuite (was: Deduplicate helper

[jira] [Assigned] (SPARK-41293) Deduplicate helper method in ExpressionTypeCheckingSuite

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41293: Assignee: Yang Jie > Deduplicate helper method in ExpressionTypeCheckingSuite >

[jira] [Resolved] (SPARK-41293) Deduplicate helper method in ExpressionTypeCheckingSuite

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41293. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38820

[jira] [Updated] (SPARK-41297) Support string sql expressions in DF.where()

2022-11-28 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund updated SPARK-41297: - Priority: Blocker (was: Major) > Support string sql expressions in DF.where() >

[jira] [Created] (SPARK-41297) Support string sql expressions in DF.where()

2022-11-28 Thread Martin Grund (Jira)
Martin Grund created SPARK-41297: Summary: Support string sql expressions in DF.where() Key: SPARK-41297 URL: https://issues.apache.org/jira/browse/SPARK-41297 Project: Spark Issue Type:

[jira] [Updated] (SPARK-41296) Assign a name to the error class _LEGACY_ERROR_TEMP_1106

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-41296: - Description: Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1106, improve error message and

[jira] [Updated] (SPARK-41295) Assign a name to the error class _LEGACY_ERROR_TEMP_1105

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-41295: - Description: Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1105, improve error message and

[jira] [Created] (SPARK-41296) Assign a name to the error class _LEGACY_ERROR_TEMP_1106

2022-11-28 Thread Max Gekk (Jira)
Max Gekk created SPARK-41296: Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_1106 Key: SPARK-41296 URL: https://issues.apache.org/jira/browse/SPARK-41296 Project: Spark Issue Type:

[jira] [Created] (SPARK-41295) Assign a name to the error class _LEGACY_ERROR_TEMP_1105

2022-11-28 Thread Max Gekk (Jira)
Max Gekk created SPARK-41295: Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_1105 Key: SPARK-41295 URL: https://issues.apache.org/jira/browse/SPARK-41295 Project: Spark Issue Type:

[jira] [Updated] (SPARK-41294) Assign a name to the error class _LEGACY_ERROR_TEMP_1203

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-41294: - Description: Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1203, improve error message and

[jira] [Created] (SPARK-41294) Assign a name to the error class _LEGACY_ERROR_TEMP_1203

2022-11-28 Thread Max Gekk (Jira)
Max Gekk created SPARK-41294: Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_1203 Key: SPARK-41294 URL: https://issues.apache.org/jira/browse/SPARK-41294 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41294) Assign a name to the error class _LEGACY_ERROR_TEMP_1203

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41294: Assignee: (was: BingKun Pan) > Assign a name to the error class _LEGACY_ERROR_TEMP_1203 >

[jira] [Updated] (SPARK-41294) Assign a name to the error class _LEGACY_ERROR_TEMP_1203

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-41294: - Fix Version/s: (was: 3.4.0) > Assign a name to the error class _LEGACY_ERROR_TEMP_1203 >

[jira] [Assigned] (SPARK-41287) Add a test workflow to help test image in fork repo

2022-11-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-41287: --- Assignee: Yikun Jiang > Add a test workflow to help test image in fork repo >

[jira] [Resolved] (SPARK-41287) Add a test workflow to help test image in fork repo

2022-11-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-41287. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 26

[jira] [Assigned] (SPARK-41293) Deduplicate helper method in ExpressionTypeCheckingSuite

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41293: Assignee: (was: Apache Spark) > Deduplicate helper method in

[jira] [Commented] (SPARK-41293) Deduplicate helper method in ExpressionTypeCheckingSuite

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639910#comment-17639910 ] Apache Spark commented on SPARK-41293: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41293) Deduplicate helper method in ExpressionTypeCheckingSuite

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41293: Assignee: Apache Spark > Deduplicate helper method in ExpressionTypeCheckingSuite >

[jira] [Resolved] (SPARK-41273) Update plugins to latest versions

2022-11-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41273. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38809

[jira] [Assigned] (SPARK-41273) Update plugins to latest versions

2022-11-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41273: - Assignee: BingKun Pan > Update plugins to latest versions >

[jira] [Updated] (SPARK-41293) Deduplicate helper method in ExpressionTypeCheckingSuite

2022-11-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41293: - Description:

[jira] [Created] (SPARK-41293) Deduplicate helper method in ExpressionTypeCheckingSuite

2022-11-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-41293: Summary: Deduplicate helper method in ExpressionTypeCheckingSuite Key: SPARK-41293 URL: https://issues.apache.org/jira/browse/SPARK-41293 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41148) Implement `DataFrame.dropna ` and `DataFrame.na.drop `

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41148: Assignee: Ruifeng Zheng (was: Apache Spark) > Implement `DataFrame.dropna ` and

[jira] [Assigned] (SPARK-41148) Implement `DataFrame.dropna ` and `DataFrame.na.drop `

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41148: Assignee: Apache Spark (was: Ruifeng Zheng) > Implement `DataFrame.dropna ` and

[jira] [Commented] (SPARK-41148) Implement `DataFrame.dropna ` and `DataFrame.na.drop `

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639898#comment-17639898 ] Apache Spark commented on SPARK-41148: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41148) Implement `DataFrame.dropna ` and `DataFrame.na.drop `

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639897#comment-17639897 ] Apache Spark commented on SPARK-41148: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41238) Support more datatypes

2022-11-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639892#comment-17639892 ] Apache Spark commented on SPARK-41238: -- User 'zhengruifeng' has created a pull request for this

[jira] [Resolved] (SPARK-41272) Assign a name to the error class _LEGACY_ERROR_TEMP_2019

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41272. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38808

[jira] [Assigned] (SPARK-41272) Assign a name to the error class _LEGACY_ERROR_TEMP_2019

2022-11-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41272: Assignee: BingKun Pan > Assign a name to the error class _LEGACY_ERROR_TEMP_2019 >

[jira] [Resolved] (SPARK-41003) BHJ LeftAnti does not update numOutputRows when codegen is disabled

2022-11-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41003. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38489

[jira] [Assigned] (SPARK-41003) BHJ LeftAnti does not update numOutputRows when codegen is disabled

2022-11-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41003: --- Assignee: dzcxzl > BHJ LeftAnti does not update numOutputRows when codegen is disabled >

<    1   2