[jira] [Resolved] (SPARK-40979) Keep removed executor info in decommission state

2022-11-16 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40979. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-40979) Keep removed executor info in decommission state

2022-11-16 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-40979: --- Assignee: Zhongwei Zhu > Keep removed executor info in decommission state

[jira] [Commented] (SPARK-41017) Support column pruning with multiple nondeterministic Filters

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635174#comment-17635174 ] Apache Spark commented on SPARK-41017: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-41017) Support column pruning with multiple nondeterministic Filters

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635175#comment-17635175 ] Apache Spark commented on SPARK-41017: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-41017) Support column pruning with multiple nondeterministic Filters

2022-11-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-41017. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38511

[jira] [Assigned] (SPARK-41151) Keep built-in file _metadata column nullable value consistent

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41151: Assignee: Apache Spark > Keep built-in file _metadata column nullable value consistent >

[jira] [Assigned] (SPARK-41151) Keep built-in file _metadata column nullable value consistent

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41151: Assignee: (was: Apache Spark) > Keep built-in file _metadata column nullable value

[jira] [Commented] (SPARK-41151) Keep built-in file _metadata column nullable value consistent

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635156#comment-17635156 ] Apache Spark commented on SPARK-41151: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Resolved] (SPARK-41149) Fix `SparkSession.builder.config` to support bool

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41149. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38673

[jira] [Assigned] (SPARK-41149) Fix `SparkSession.builder.config` to support bool

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41149: Assignee: Haejoon Lee > Fix `SparkSession.builder.config` to support bool >

[jira] [Created] (SPARK-41169) Implement `DataFrame.drop`

2022-11-16 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41169: - Summary: Implement `DataFrame.drop` Key: SPARK-41169 URL: https://issues.apache.org/jira/browse/SPARK-41169 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-41168) Spark Master OOM when Worker No space left on device

2022-11-16 Thread pin_zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pin_zhang updated SPARK-41168: -- Description: Spark master + 1 Spark workers (One is No space left on device) 1. Submit a app with 2

[jira] [Updated] (SPARK-41168) Spark Master OOM when Worker No space left on device

2022-11-16 Thread pin_zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pin_zhang updated SPARK-41168: -- Description: Spark master + 1 Spark workers (One is No space left on device) 1. Submit a app with 2

[jira] [Updated] (SPARK-41168) Spark Master OOM when Worker No space left on device

2022-11-16 Thread pin_zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pin_zhang updated SPARK-41168: -- Description: Spark master + 1 Spark workers (One is ) Submit a app with 2 instance, 1. Spark worker

[jira] [Updated] (SPARK-41168) Spark Master OOM when Worker No space left on device

2022-11-16 Thread pin_zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pin_zhang updated SPARK-41168: -- Description: 1. Spark worker Caused by large number of executors kept in spark master memory

[jira] [Commented] (SPARK-41167) Optimize LikeSimplification rule to improve multi like performance

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635135#comment-17635135 ] Apache Spark commented on SPARK-41167: -- User 'wankunde' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41167) Optimize LikeSimplification rule to improve multi like performance

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41167: Assignee: (was: Apache Spark) > Optimize LikeSimplification rule to improve multi

[jira] [Commented] (SPARK-41167) Optimize LikeSimplification rule to improve multi like performance

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635137#comment-17635137 ] Apache Spark commented on SPARK-41167: -- User 'wankunde' has created a pull request for this issue:

[jira] [Created] (SPARK-41168) Spark Master OOM when Worker No space left on device

2022-11-16 Thread pin_zhang (Jira)
pin_zhang created SPARK-41168: - Summary: Spark Master OOM when Worker No space left on device Key: SPARK-41168 URL: https://issues.apache.org/jira/browse/SPARK-41168 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41167) Optimize LikeSimplification rule to improve multi like performance

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41167: Assignee: Apache Spark > Optimize LikeSimplification rule to improve multi like

[jira] [Commented] (SPARK-41165) Arrow collect should factor in failures

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635125#comment-17635125 ] Apache Spark commented on SPARK-41165: -- User 'hvanhovell' has created a pull request for this

[jira] [Commented] (SPARK-41165) Arrow collect should factor in failures

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635124#comment-17635124 ] Apache Spark commented on SPARK-41165: -- User 'hvanhovell' has created a pull request for this

[jira] [Created] (SPARK-41167) Optimize LikeSimplification rule to improve multi like performance

2022-11-16 Thread Wan Kun (Jira)
Wan Kun created SPARK-41167: --- Summary: Optimize LikeSimplification rule to improve multi like performance Key: SPARK-41167 URL: https://issues.apache.org/jira/browse/SPARK-41167 Project: Spark

[jira] [Assigned] (SPARK-41048) Improve output partitioning and ordering with AQE cache

2022-11-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41048: --- Assignee: XiDuo You > Improve output partitioning and ordering with AQE cache >

[jira] [Resolved] (SPARK-41048) Improve output partitioning and ordering with AQE cache

2022-11-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41048. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38558

[jira] [Commented] (SPARK-41166) Check errorSubClass of DataTypeMismatch in *ExpressionSuites

2022-11-16 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635099#comment-17635099 ] BingKun Pan commented on SPARK-41166: - I work on it. > Check errorSubClass of DataTypeMismatch in

[jira] [Created] (SPARK-41166) Check errorSubClass of DataTypeMismatch in *ExpressionSuites

2022-11-16 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-41166: --- Summary: Check errorSubClass of DataTypeMismatch in *ExpressionSuites Key: SPARK-41166 URL: https://issues.apache.org/jira/browse/SPARK-41166 Project: Spark

[jira] [Commented] (SPARK-23497) Sparklyr Applications doesn't disconnect spark driver in client mode

2022-11-16 Thread bharath kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635096#comment-17635096 ] bharath kumar commented on SPARK-23497: --- This is no longer a problem, tested recently with

[jira] [Created] (SPARK-41165) Arrow collect should factor in failures

2022-11-16 Thread Jira
Herman van Hövell created SPARK-41165: - Summary: Arrow collect should factor in failures Key: SPARK-41165 URL: https://issues.apache.org/jira/browse/SPARK-41165 Project: Spark Issue

[jira] [Commented] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

2022-11-16 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635083#comment-17635083 ] Ramakrishna commented on SPARK-41070: - Do I need to do raise any ticket for this. > Performance

[jira] [Commented] (SPARK-40657) Add support for compiled classes (Java classes)

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635082#comment-17635082 ] Apache Spark commented on SPARK-40657: -- User 'rangadi' has created a pull request for this issue:

[jira] [Updated] (SPARK-40671) Support driver service labels

2022-11-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40671: -- Summary: Support driver service labels (was: Configurability on driver service labels) >

[jira] [Resolved] (SPARK-41075) Can't build Spark docker image with Java 17

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41075. -- Resolution: Invalid > Can't build Spark docker image with Java 17 >

[jira] [Comment Edited] (SPARK-41075) Can't build Spark docker image with Java 17

2022-11-16 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635071#comment-17635071 ] Yikun Jiang edited comment on SPARK-41075 at 11/17/22 1:56 AM: --- I think

[jira] [Commented] (SPARK-41075) Can't build Spark docker image with Java 17

2022-11-16 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635071#comment-17635071 ] Yikun Jiang commented on SPARK-41075: - I think the `kubernetes/dockerfiles/spark/` is for binary

[jira] [Updated] (SPARK-40671) Configurability on driver service labels

2022-11-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40671: -- Priority: Minor (was: Major) > Configurability on driver service labels >

[jira] [Updated] (SPARK-40671) Configurability on driver service labels

2022-11-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40671: -- Affects Version/s: 3.4.0 (was: 3.1.2)

[jira] [Assigned] (SPARK-40671) Configurability on driver service labels

2022-11-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40671: - Assignee: Shiqi Sun > Configurability on driver service labels >

[jira] [Resolved] (SPARK-40671) Configurability on driver service labels

2022-11-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40671. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38679

[jira] [Assigned] (SPARK-41150) Document debugging with PySpark memory profiler

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41150: Assignee: Xinrong Meng > Document debugging with PySpark memory profiler >

[jira] [Resolved] (SPARK-41150) Document debugging with PySpark memory profiler

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41150. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38677

[jira] [Resolved] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41070. -- Resolution: Invalid > Performance issue when Spark SQL connects with TeraData >

[jira] [Commented] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635065#comment-17635065 ] Hyukjin Kwon commented on SPARK-41070: -- Sounds more like a question than an issue. I suspect this

[jira] [Commented] (SPARK-41075) Can't build Spark docker image with Java 17

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635063#comment-17635063 ] Hyukjin Kwon commented on SPARK-41075: -- cc [~dongjoon][~yikun][~holden]FYI > Can't build Spark

[jira] [Commented] (SPARK-41125) Simple call to createDataFrame fails with PicklingError but only on python3.11

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635062#comment-17635062 ] Hyukjin Kwon commented on SPARK-41125: -- We haven't added the official support of Python 3.11 yet.

[jira] [Updated] (SPARK-41163) Spark 3.2.2 storage.ShuffleBlockFetcherIterator and TransportResponseHandler issue

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41163: - Flags: (was: Important) > Spark 3.2.2 storage.ShuffleBlockFetcherIterator and

[jira] [Resolved] (SPARK-41090) Enhance Dataset.createTempView testing coverage for db_name.view_name

2022-11-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41090. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38595

[jira] [Assigned] (SPARK-41090) Enhance Dataset.createTempView testing coverage for db_name.view_name

2022-11-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41090: --- Assignee: Rui Wang > Enhance Dataset.createTempView testing coverage for db_name.view_name

[jira] [Updated] (SPARK-41163) Spark 3.2.2 storage.ShuffleBlockFetcherIterator and TransportResponseHandler issue

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41163: - Target Version/s: (was: 3.2.2) > Spark 3.2.2 storage.ShuffleBlockFetcherIterator and

[jira] [Updated] (SPARK-41163) Spark 3.2.2 storage.ShuffleBlockFetcherIterator and TransportResponseHandler issue

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41163: - Fix Version/s: (was: 3.2.3) > Spark 3.2.2 storage.ShuffleBlockFetcherIterator and

[jira] [Resolved] (SPARK-41118) to_number/try_to_number throws NullPointerException when format is null

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41118. -- Fix Version/s: 3.4.0 Assignee: Bruce Robbins Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-39420) Support ANALYZE TABLE on v2 tables

2022-11-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39420: -- External issue ID: (was: https://github.com/delta-io/delta/pull/840) > Support ANALYZE

[jira] [Updated] (SPARK-39420) Support ANALYZE TABLE on v2 tables

2022-11-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39420: -- Component/s: SQL (was: Optimizer) > Support ANALYZE TABLE on v2 tables >

[jira] [Updated] (SPARK-39420) Support ANALYZE TABLE on v2 tables

2022-11-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39420: -- Affects Version/s: 3.4.0 (was: 3.2.1) > Support ANALYZE TABLE on

[jira] [Resolved] (SPARK-41115) Add ClientType to proto to indicate which client sends a request

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41115. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38630

[jira] [Assigned] (SPARK-41115) Add ClientType to proto to indicate which client sends a request

2022-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41115: Assignee: Rui Wang > Add ClientType to proto to indicate which client sends a request >

[jira] [Assigned] (SPARK-40671) Configurability on driver service labels

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40671: Assignee: Apache Spark > Configurability on driver service labels >

[jira] [Commented] (SPARK-40671) Configurability on driver service labels

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635029#comment-17635029 ] Apache Spark commented on SPARK-40671: -- User 'huskysun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40671) Configurability on driver service labels

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40671: Assignee: (was: Apache Spark) > Configurability on driver service labels >

[jira] [Commented] (SPARK-40671) Configurability on driver service labels

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635028#comment-17635028 ] Apache Spark commented on SPARK-40671: -- User 'huskysun' has created a pull request for this issue:

[jira] [Updated] (SPARK-41115) Add ClientType to proto to indicate which client sends a request

2022-11-16 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-41115: - Summary: Add ClientType to proto to indicate which client sends a request (was: Add ClientType Enum to

[jira] [Assigned] (SPARK-40940) Fix the unsupported ops checker to allow chaining of stateful operators

2022-11-16 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-40940: Assignee: Wei Liu > Fix the unsupported ops checker to allow chaining of stateful

[jira] [Resolved] (SPARK-40940) Fix the unsupported ops checker to allow chaining of stateful operators

2022-11-16 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-40940. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38503

[jira] [Resolved] (SPARK-41155) Add error message to SchemaColumnConvertNotSupportedException

2022-11-16 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-41155. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38669

[jira] [Commented] (SPARK-41164) Update relations.proto to follow Connect Proto development guidance

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635001#comment-17635001 ] Apache Spark commented on SPARK-41164: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41164) Update relations.proto to follow Connect Proto development guidance

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41164: Assignee: (was: Apache Spark) > Update relations.proto to follow Connect Proto

[jira] [Assigned] (SPARK-41164) Update relations.proto to follow Connect Proto development guidance

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41164: Assignee: Apache Spark > Update relations.proto to follow Connect Proto development

[jira] [Commented] (SPARK-41164) Update relations.proto to follow Connect Proto development guidance

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635000#comment-17635000 ] Apache Spark commented on SPARK-41164: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-41164) Update relations.proto to follow Connect Proto development guidance

2022-11-16 Thread Rui Wang (Jira)
Rui Wang created SPARK-41164: Summary: Update relations.proto to follow Connect Proto development guidance Key: SPARK-41164 URL: https://issues.apache.org/jira/browse/SPARK-41164 Project: Spark

[jira] [Updated] (SPARK-41163) Spark 3.2.2 storage.ShuffleBlockFetcherIterator and TransportResponseHandler issue

2022-11-16 Thread Dmitry Kravchuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Kravchuk updated SPARK-41163: Summary: Spark 3.2.2 storage.ShuffleBlockFetcherIterator and TransportResponseHandler

[jira] [Updated] (SPARK-41163) Spark 3.2.2 storage.ShuffleBlockFetcherIterator and TransportResponseHandler issue

2022-11-16 Thread Dmitry Kravchuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Kravchuk updated SPARK-41163: Attachment: pom.xml > Spark 3.2.2 storage.ShuffleBlockFetcherIterator and

[jira] [Updated] (SPARK-41163) Spark 3.2.2 storage.ShuffleBlockFetcherIterator and TransportResponseHandler issue

2022-11-16 Thread Dmitry Kravchuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Kravchuk updated SPARK-41163: Attachment: container_1668606650061_0087_01_57.txt > Spark 3.2.2

[jira] [Updated] (SPARK-41163) Spark 3.2.2 ShuffleBlockFetcherIterator issue

2022-11-16 Thread Dmitry Kravchuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Kravchuk updated SPARK-41163: Summary: Spark 3.2.2 ShuffleBlockFetcherIterator issue (was: Spark 3.2.2 ) > Spark 3.2.2

[jira] [Created] (SPARK-41163) Spark 3.2.2

2022-11-16 Thread Dmitry Kravchuk (Jira)
Dmitry Kravchuk created SPARK-41163: --- Summary: Spark 3.2.2 Key: SPARK-41163 URL: https://issues.apache.org/jira/browse/SPARK-41163 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-41150) Document debugging with PySpark memory profiler

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634984#comment-17634984 ] Apache Spark commented on SPARK-41150: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-41150) Document debugging with PySpark memory profiler

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41150: Assignee: Apache Spark > Document debugging with PySpark memory profiler >

[jira] [Commented] (SPARK-41150) Document debugging with PySpark memory profiler

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634983#comment-17634983 ] Apache Spark commented on SPARK-41150: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-41150) Document debugging with PySpark memory profiler

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41150: Assignee: (was: Apache Spark) > Document debugging with PySpark memory profiler >

[jira] [Updated] (SPARK-41150) Document debugging with PySpark memory profiler

2022-11-16 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41150: - Component/s: Documentation > Document debugging with PySpark memory profiler >

[jira] [Updated] (SPARK-41119) Python file to be passed as argument using command-line option for PySpark

2022-11-16 Thread Lingaraj Gowdar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingaraj Gowdar updated SPARK-41119: Summary: Python file to be passed as argument using command-line option for PySpark

[jira] [Resolved] (SPARK-39799) DataSourceV2: View catalog interface

2022-11-16 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-39799. -- Fix Version/s: 3.4.0 Resolution: Fixed > DataSourceV2: View catalog interface >

[jira] [Assigned] (SPARK-39799) DataSourceV2: View catalog interface

2022-11-16 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-39799: Assignee: John Zhuge > DataSourceV2: View catalog interface >

[jira] [Resolved] (SPARK-41139) Improve error message for PYTHON_UDF_IN_ON_CLAUSE

2022-11-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41139. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38657

[jira] [Assigned] (SPARK-41139) Improve error message for PYTHON_UDF_IN_ON_CLAUSE

2022-11-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41139: Assignee: Haejoon Lee > Improve error message for PYTHON_UDF_IN_ON_CLAUSE >

[jira] [Resolved] (SPARK-41158) Use `checkError()` to check `DATATYPE_MISMATCH` in `DataFrameFunctionsSuite`

2022-11-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41158. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38671

[jira] [Assigned] (SPARK-41158) Use `checkError()` to check `DATATYPE_MISMATCH` in `DataFrameFunctionsSuite`

2022-11-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41158: Assignee: Yang Jie > Use `checkError()` to check `DATATYPE_MISMATCH` in

[jira] [Commented] (SPARK-41162) Anti-join must not be pushed below aggregation with ambiguous predicates

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634894#comment-17634894 ] Apache Spark commented on SPARK-41162: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Commented] (SPARK-41162) Anti-join must not be pushed below aggregation with ambiguous predicates

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634893#comment-17634893 ] Apache Spark commented on SPARK-41162: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41162) Anti-join must not be pushed below aggregation with ambiguous predicates

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41162: Assignee: Apache Spark > Anti-join must not be pushed below aggregation with ambiguous

[jira] [Assigned] (SPARK-41162) Anti-join must not be pushed below aggregation with ambiguous predicates

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41162: Assignee: (was: Apache Spark) > Anti-join must not be pushed below aggregation with

[jira] [Updated] (SPARK-41162) Anti-join must not be pushed below aggregation with ambiguous predicates

2022-11-16 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-41162: -- Description: The following query should return a single row as all values for {{id}} except

[jira] [Created] (SPARK-41162) Anti-join must not be pushed below aggregation with ambiguous predicates

2022-11-16 Thread Enrico Minack (Jira)
Enrico Minack created SPARK-41162: - Summary: Anti-join must not be pushed below aggregation with ambiguous predicates Key: SPARK-41162 URL: https://issues.apache.org/jira/browse/SPARK-41162 Project:

[jira] [Assigned] (SPARK-41161) Upgrade `scala-parser-combinators` to 2.1.1

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41161: Assignee: (was: Apache Spark) > Upgrade `scala-parser-combinators` to 2.1.1 >

[jira] [Assigned] (SPARK-41161) Upgrade `scala-parser-combinators` to 2.1.1

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41161: Assignee: Apache Spark > Upgrade `scala-parser-combinators` to 2.1.1 >

[jira] [Commented] (SPARK-41161) Upgrade `scala-parser-combinators` to 2.1.1

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634882#comment-17634882 ] Apache Spark commented on SPARK-41161: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-41161) Upgrade `scala-parser-combinators` to 2.1.1

2022-11-16 Thread Yang Jie (Jira)
Yang Jie created SPARK-41161: Summary: Upgrade `scala-parser-combinators` to 2.1.1 Key: SPARK-41161 URL: https://issues.apache.org/jira/browse/SPARK-41161 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-41160) An error is reported when submitting a task to the yarn that enabled the timeline service

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634808#comment-17634808 ] Apache Spark commented on SPARK-41160: -- User 'xiuzhu9527' has created a pull request for this

[jira] [Assigned] (SPARK-41160) An error is reported when submitting a task to the yarn that enabled the timeline service

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41160: Assignee: Apache Spark > An error is reported when submitting a task to the yarn that

[jira] [Commented] (SPARK-41160) An error is reported when submitting a task to the yarn that enabled the timeline service

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634807#comment-17634807 ] Apache Spark commented on SPARK-41160: -- User 'xiuzhu9527' has created a pull request for this

[jira] [Assigned] (SPARK-41160) An error is reported when submitting a task to the yarn that enabled the timeline service

2022-11-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41160: Assignee: (was: Apache Spark) > An error is reported when submitting a task to the

  1   2   >