[jira] [Resolved] (SPARK-39415) Local mode supports HadoopDelegationTokenManager

2022-06-08 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl resolved SPARK-39415. Resolution: Duplicate > Local mode supports HadoopDelegationTokenManager >

[jira] [Resolved] (SPARK-39421) Sphinx build fails with "node class 'meta' is already registered, its visitors will be overridden"

2022-06-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39421. -- Fix Version/s: 3.3.0 3.2.2 3.4.0 Assignee:

[jira] [Updated] (SPARK-39421) Sphinx build fails with "node class 'meta' is already registered, its visitors will be overridden"

2022-06-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39421: - Affects Version/s: (was: 3.1.2) (was: 3.0.3) > Sphinx build

[jira] [Commented] (SPARK-39425) Add migration guide for PS behavior changes

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551954#comment-17551954 ] Apache Spark commented on SPARK-39425: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39425) Add migration guide for PS behavior changes

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39425: Assignee: Apache Spark > Add migration guide for PS behavior changes >

[jira] [Commented] (SPARK-39425) Add migration guide for PS behavior changes

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551953#comment-17551953 ] Apache Spark commented on SPARK-39425: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39425) Add migration guide for PS behavior changes

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39425: Assignee: (was: Apache Spark) > Add migration guide for PS behavior changes >

[jira] [Created] (SPARK-39426) Subquery star select creates broken plan in case of self join

2022-06-08 Thread Denis (Jira)
Denis created SPARK-39426: - Summary: Subquery star select creates broken plan in case of self join Key: SPARK-39426 URL: https://issues.apache.org/jira/browse/SPARK-39426 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39424) `Run documentation build` failed in master branch GA

2022-06-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551934#comment-17551934 ] Yang Jie commented on SPARK-39424: -- Thanks ~ > `Run documentation build` failed in master branch GA >

[jira] [Resolved] (SPARK-39424) `Run documentation build` failed in master branch GA

2022-06-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39424. -- Resolution: Duplicate Thanks! I actually already created a JIRA and fix :-) > `Run

[jira] [Created] (SPARK-39425) Add migration guide for PS behavior changes

2022-06-08 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-39425: --- Summary: Add migration guide for PS behavior changes Key: SPARK-39425 URL: https://issues.apache.org/jira/browse/SPARK-39425 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39424) `Run documentation build` failed in master branch GA

2022-06-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551925#comment-17551925 ] Yang Jie commented on SPARK-39424: -- cc [~hyukjin.kwon]  > `Run documentation build` failed in master

[jira] [Created] (SPARK-39424) `Run documentation build` failed in master branch GA

2022-06-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-39424: Summary: `Run documentation build` failed in master branch GA Key: SPARK-39424 URL: https://issues.apache.org/jira/browse/SPARK-39424 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-39236) Make CreateTable API and ListTables API compatible

2022-06-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39236. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36586

[jira] [Assigned] (SPARK-39236) Make CreateTable API and ListTables API compatible

2022-06-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39236: --- Assignee: Rui Wang > Make CreateTable API and ListTables API compatible >

[jira] [Updated] (SPARK-39423) Spark Sql create table using jbdc add preSql option

2022-06-08 Thread WeiNan Zhao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WeiNan Zhao updated SPARK-39423: Description: In my recent process of using Spark Sql, I tried to use create using jdbc to create

[jira] [Updated] (SPARK-39423) Spark Sql create table using jbdc add preSql option

2022-06-08 Thread WeiNan Zhao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WeiNan Zhao updated SPARK-39423: Attachment: image-2022-06-09-10-48-05-347.png > Spark Sql create table using jbdc add preSql

[jira] [Created] (SPARK-39423) Spark Sql create table using jbdc add preSql option

2022-06-08 Thread WeiNan Zhao (Jira)
WeiNan Zhao created SPARK-39423: --- Summary: Spark Sql create table using jbdc add preSql option Key: SPARK-39423 URL: https://issues.apache.org/jira/browse/SPARK-39423 Project: Spark Issue

[jira] [Commented] (SPARK-37670) Support predicate pushdown and column pruning for de-duped CTEs

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551914#comment-17551914 ] Apache Spark commented on SPARK-37670: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-39422) SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with unsupported serde configurations

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551909#comment-17551909 ] Apache Spark commented on SPARK-39422: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-39422) SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with unsupported serde configurations

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551907#comment-17551907 ] Apache Spark commented on SPARK-39422: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Created] (SPARK-39422) SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with unsupported serde configurations

2022-06-08 Thread Josh Rosen (Jira)
Josh Rosen created SPARK-39422: -- Summary: SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with unsupported serde configurations Key: SPARK-39422 URL: https://issues.apache.org/jira/browse/SPARK-39422

[jira] [Updated] (SPARK-39422) SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with unsupported serde configurations

2022-06-08 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-39422: --- Priority: Minor (was: Major) > SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with

[jira] [Updated] (SPARK-39422) SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with unsupported serde configurations

2022-06-08 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-39422: --- Description: If you run `SHOW CREATE TABLE` against a Hive table which uses an unsupported Serde

[jira] [Assigned] (SPARK-39422) SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with unsupported serde configurations

2022-06-08 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-39422: -- Assignee: Josh Rosen > SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with

[jira] [Updated] (SPARK-39422) SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with unsupported serde configurations

2022-06-08 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-39422: --- Environment: (was: If you run `SHOW CREATE TABLE` against a Hive table which uses an

[jira] [Assigned] (SPARK-39349) Add a CheckError() method to SparkFunSuite

2022-06-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39349: --- Assignee: Serge Rielau > Add a CheckError() method to SparkFunSuite >

[jira] [Resolved] (SPARK-39349) Add a CheckError() method to SparkFunSuite

2022-06-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39349. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36693

[jira] [Resolved] (SPARK-39410) Exclude rules in analyzer

2022-06-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39410. -- Resolution: Invalid > Exclude rules in analyzer > -- > >

[jira] [Commented] (SPARK-39410) Exclude rules in analyzer

2022-06-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551887#comment-17551887 ] Hyukjin Kwon commented on SPARK-39410: -- Analyzer rules cannot be excluded for Spark SQL to work.

[jira] [Updated] (SPARK-39420) Support ANALYZE TABLE on v2 tables

2022-06-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39420: - Priority: Major (was: Blocker) > Support ANALYZE TABLE on v2 tables >

[jira] [Assigned] (SPARK-39421) Sphinx build fails with "node class 'meta' is already registered, its visitors will be overridden"

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39421: Assignee: (was: Apache Spark) > Sphinx build fails with "node class 'meta' is

[jira] [Commented] (SPARK-39421) Sphinx build fails with "node class 'meta' is already registered, its visitors will be overridden"

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551886#comment-17551886 ] Apache Spark commented on SPARK-39421: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-39421) Sphinx build fails with "node class 'meta' is already registered, its visitors will be overridden"

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39421: Assignee: Apache Spark > Sphinx build fails with "node class 'meta' is already

[jira] [Updated] (SPARK-39421) Sphinx build fails with "node class 'meta' is already registered, its visitors will be overridden"

2022-06-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39421: - Affects Version/s: 3.2.1 3.1.2 3.0.3

[jira] [Created] (SPARK-39421) Sphinx build fails with "node class 'meta' is already registered, its visitors will be overridden"

2022-06-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-39421: Summary: Sphinx build fails with "node class 'meta' is already registered, its visitors will be overridden" Key: SPARK-39421 URL:

[jira] [Updated] (SPARK-39421) Sphinx build fails with "node class 'meta' is already registered, its visitors will be overridden"

2022-06-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39421: - Environment: (was: {code} Moving to python/docs directory and building sphinx. Running

[jira] [Updated] (SPARK-39421) Sphinx build fails with "node class 'meta' is already registered, its visitors will be overridden"

2022-06-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39421: - Description: {code} Moving to python/docs directory and building sphinx. Running Sphinx v3.0.4

[jira] [Created] (SPARK-39420) Support ANALYZE TABLE on v2 tables

2022-06-08 Thread Felipe (Jira)
Felipe created SPARK-39420: -- Summary: Support ANALYZE TABLE on v2 tables Key: SPARK-39420 URL: https://issues.apache.org/jira/browse/SPARK-39420 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-39418) DECODE docs refer to Oracle instead of Spark

2022-06-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39418. - Resolution: Duplicate > DECODE docs refer to Oracle instead of Spark >

[jira] [Commented] (SPARK-39418) DECODE docs refer to Oracle instead of Spark

2022-06-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551877#comment-17551877 ] Wenchen Fan commented on SPARK-39418: - yea this has been fixed by

[jira] [Resolved] (SPARK-39400) spark-sql remain hive resource download dir after exit

2022-06-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39400. - Resolution: Fixed Issue resolved by pull request 36786

[jira] [Assigned] (SPARK-39400) spark-sql remain hive resource download dir after exit

2022-06-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39400: --- Assignee: angerszhu > spark-sql remain hive resource download dir after exit >

[jira] [Assigned] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39419: Assignee: (was: Apache Spark) > When the comparator of ArraySort returns null, it

[jira] [Commented] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551867#comment-17551867 ] Apache Spark commented on SPARK-39419: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551866#comment-17551866 ] Apache Spark commented on SPARK-39419: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39419: Assignee: Apache Spark > When the comparator of ArraySort returns null, it should fail.

[jira] [Created] (SPARK-39419) When the comparator of ArraySort returns null, it should fail.

2022-06-08 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-39419: - Summary: When the comparator of ArraySort returns null, it should fail. Key: SPARK-39419 URL: https://issues.apache.org/jira/browse/SPARK-39419 Project: Spark

[jira] [Commented] (SPARK-39418) DECODE docs refer to Oracle instead of Spark

2022-06-08 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551801#comment-17551801 ] Bruce Robbins commented on SPARK-39418: --- Possibly a dup of SPARK-39286? > DECODE docs refer to

[jira] [Created] (SPARK-39418) DECODE docs refer to Oracle instead of Spark

2022-06-08 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-39418: Summary: DECODE docs refer to Oracle instead of Spark Key: SPARK-39418 URL: https://issues.apache.org/jira/browse/SPARK-39418 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-39393) Parquet data source only supports push-down predicate filters for non-repeated primitive types

2022-06-08 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39393. Fix Version/s: 3.1.3 3.3.0 3.2.2 3.4.0

[jira] [Updated] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-39417: --- Target Version/s: 3.3.0 > Handle Null partition values in PartitioningUtils >

[jira] [Updated] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-39417: --- Fix Version/s: (was: 3.3.0) > Handle Null partition values in PartitioningUtils >

[jira] [Resolved] (SPARK-39412) IllegalStateException from connector does not work well with error class framework

2022-06-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39412. -- Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-39412) IllegalStateException from connector does not work well with error class framework

2022-06-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-39412: Assignee: Max Gekk > IllegalStateException from connector does not work well with error class >

[jira] [Updated] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Prashant Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Singh updated SPARK-39417: --- Affects Version/s: 3.3.0 (was: 3.2.1) > Handle Null partition

[jira] [Commented] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Prashant Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551731#comment-17551731 ] Prashant Singh commented on SPARK-39417: Appologies, the problem I think is only in 3.3.0 seems

[jira] [Commented] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551722#comment-17551722 ] Josh Rosen commented on SPARK-39417: I see that the "affected versions" is currently set to 3.2.1.

[jira] [Assigned] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39417: Assignee: Apache Spark > Handle Null partition values in PartitioningUtils >

[jira] [Assigned] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39417: Assignee: (was: Apache Spark) > Handle Null partition values in PartitioningUtils >

[jira] [Commented] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551715#comment-17551715 ] Apache Spark commented on SPARK-39417: -- User 'singhpk234' has created a pull request for this

[jira] [Updated] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Prashant Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Singh updated SPARK-39417: --- Description: partitions with null values we get a NPE on partition discovery, earlier we

[jira] [Commented] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Prashant Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551706#comment-17551706 ] Prashant Singh commented on SPARK-39417: PR : https://github.com/apache/spark/pull/36810/files

[jira] [Updated] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Prashant Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Singh updated SPARK-39417: --- Description: table with partitions will null values fails with NPE, during partition

[jira] [Updated] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Prashant Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Singh updated SPARK-39417: --- Description: table with partitions will null values fails with NPE, during partition

[jira] [Commented] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Prashant Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551701#comment-17551701 ] Prashant Singh commented on SPARK-39417: adding a PR for this shortly > Handle Null partition

[jira] [Created] (SPARK-39417) Handle Null partition values in PartitioningUtils

2022-06-08 Thread Prashant Singh (Jira)
Prashant Singh created SPARK-39417: -- Summary: Handle Null partition values in PartitioningUtils Key: SPARK-39417 URL: https://issues.apache.org/jira/browse/SPARK-39417 Project: Spark Issue

[jira] [Updated] (SPARK-39416) When raising an exception, pass parameters as a map instead of an array

2022-06-08 Thread Serge Rielau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Rielau updated SPARK-39416: - Description: We have moved away from c-style parameters in error message texts towards

[jira] [Created] (SPARK-39416) When raising an exception, pass parameters as a map instead of an array

2022-06-08 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-39416: Summary: When raising an exception, pass parameters as a map instead of an array Key: SPARK-39416 URL: https://issues.apache.org/jira/browse/SPARK-39416 Project:

[jira] [Resolved] (SPARK-39413) Capitalize sql keywords in JDBCV2Suite

2022-06-08 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39413. Fix Version/s: 3.4.0 Assignee: jiaan.geng Resolution: Fixed > Capitalize sql

[jira] [Commented] (SPARK-39415) Local mode supports HadoopDelegationTokenManager

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551647#comment-17551647 ] Apache Spark commented on SPARK-39415: -- User 'cxzl25' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39415) Local mode supports HadoopDelegationTokenManager

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39415: Assignee: (was: Apache Spark) > Local mode supports HadoopDelegationTokenManager >

[jira] [Assigned] (SPARK-39415) Local mode supports HadoopDelegationTokenManager

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39415: Assignee: Apache Spark > Local mode supports HadoopDelegationTokenManager >

[jira] [Updated] (SPARK-39415) Local mode supports HadoopDelegationTokenManager

2022-06-08 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-39415: --- Summary: Local mode supports HadoopDelegationTokenManager (was: Local mode supports

[jira] [Created] (SPARK-39415) Local mode supports delegationTokenManager

2022-06-08 Thread dzcxzl (Jira)
dzcxzl created SPARK-39415: -- Summary: Local mode supports delegationTokenManager Key: SPARK-39415 URL: https://issues.apache.org/jira/browse/SPARK-39415 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-39414) Upgrade Scala to 2.12.16

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39414: Assignee: (was: Apache Spark) > Upgrade Scala to 2.12.16 >

[jira] [Commented] (SPARK-39414) Upgrade Scala to 2.12.16

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551596#comment-17551596 ] Apache Spark commented on SPARK-39414: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39414) Upgrade Scala to 2.12.16

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39414: Assignee: Apache Spark > Upgrade Scala to 2.12.16 > > >

[jira] [Commented] (SPARK-39414) Upgrade Scala to 2.12.16

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551595#comment-17551595 ] Apache Spark commented on SPARK-39414: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-39414) Upgrade Scala to 2.12.16

2022-06-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-39414: Summary: Upgrade Scala to 2.12.16 Key: SPARK-39414 URL: https://issues.apache.org/jira/browse/SPARK-39414 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-38852) Better Data Source V2 operator pushdown framework

2022-06-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38852: --- Description: Currently, Spark supports push down Filters and Aggregates to data source. However,

[jira] [Updated] (SPARK-38852) Better Data Source V2 operator pushdown framework

2022-06-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38852: --- Description: Currently, Spark supports push down Filters and Aggregates to data source. However,

[jira] [Updated] (SPARK-38852) Better Data Source V2 operator pushdown framework

2022-06-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38852: --- Description: Currently, Spark supports push down Filters and Aggregates to data source. However,

[jira] [Assigned] (SPARK-39398) when doing iteration compute in graphx, checkpoint need support storagelevel

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39398: Assignee: (was: Apache Spark) > when doing iteration compute in graphx, checkpoint

[jira] [Assigned] (SPARK-39398) when doing iteration compute in graphx, checkpoint need support storagelevel

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39398: Assignee: Apache Spark > when doing iteration compute in graphx, checkpoint need

[jira] [Commented] (SPARK-39398) when doing iteration compute in graphx, checkpoint need support storagelevel

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551497#comment-17551497 ] Apache Spark commented on SPARK-39398: -- User 'wwli05' has created a pull request for this issue:

[jira] [Updated] (SPARK-39411) Release candidates do not have the correct version for PySpark

2022-06-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39411: - Fix Version/s: 3.3.1 > Release candidates do not have the correct version for PySpark >

[jira] [Resolved] (SPARK-39404) Unable to query _metadata in streaming if getBatch returns multiple logical nodes in the DataFrame

2022-06-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-39404. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36801

[jira] [Assigned] (SPARK-39404) Unable to query _metadata in streaming if getBatch returns multiple logical nodes in the DataFrame

2022-06-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-39404: Assignee: Yaohua Zhao > Unable to query _metadata in streaming if getBatch returns

[jira] [Comment Edited] (SPARK-23207) Shuffle+Repartition on an DataFrame could lead to incorrect answers

2022-06-08 Thread Igor Berman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551465#comment-17551465 ] Igor Berman edited comment on SPARK-23207 at 6/8/22 8:36 AM: - We are still

[jira] [Commented] (SPARK-23207) Shuffle+Repartition on an DataFrame could lead to incorrect answers

2022-06-08 Thread Igor Berman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551465#comment-17551465 ] Igor Berman commented on SPARK-23207: - We are still facing this issue in production with v3.1.2 at

[jira] [Assigned] (SPARK-39412) IllegalStateException from connector does not work well with error class framework

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39412: Assignee: (was: Apache Spark) > IllegalStateException from connector does not work

[jira] [Assigned] (SPARK-39412) IllegalStateException from connector does not work well with error class framework

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39412: Assignee: Apache Spark > IllegalStateException from connector does not work well with

[jira] [Commented] (SPARK-39413) Capitalize sql keywords in JDBCV2Suite

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551464#comment-17551464 ] Apache Spark commented on SPARK-39413: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39413) Capitalize sql keywords in JDBCV2Suite

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39413: Assignee: (was: Apache Spark) > Capitalize sql keywords in JDBCV2Suite >

[jira] [Assigned] (SPARK-39413) Capitalize sql keywords in JDBCV2Suite

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39413: Assignee: Apache Spark > Capitalize sql keywords in JDBCV2Suite >

[jira] [Commented] (SPARK-39412) IllegalStateException from connector does not work well with error class framework

2022-06-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551463#comment-17551463 ] Apache Spark commented on SPARK-39412: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-39411) Release candidates do not have the correct version for PySpark

2022-06-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39411. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36803

[jira] [Assigned] (SPARK-39411) Release candidates do not have the correct version for PySpark

2022-06-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39411: Assignee: Hyukjin Kwon > Release candidates do not have the correct version for PySpark

[jira] [Created] (SPARK-39413) Capitalize sql keywords in JDBCV2Suite

2022-06-08 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-39413: -- Summary: Capitalize sql keywords in JDBCV2Suite Key: SPARK-39413 URL: https://issues.apache.org/jira/browse/SPARK-39413 Project: Spark Issue Type: Sub-task

  1   2   >