[jira] [Assigned] (SPARK-40906) `Mode` should copy keys before inserting into Map

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40906: Assignee: (was: Apache Spark) > `Mode` should copy keys before inserting into Map >

[jira] [Assigned] (SPARK-40906) `Mode` should copy keys before inserting into Map

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40906: Assignee: Apache Spark > `Mode` should copy keys before inserting into Map >

[jira] [Commented] (SPARK-40906) `Mode` should copy keys before inserting into Map

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623547#comment-17623547 ] Apache Spark commented on SPARK-40906: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-40906) `Mode` should copy keys before inserting into Map

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623548#comment-17623548 ] Apache Spark commented on SPARK-40906: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40905) Upgrade rocksdbjni to 7.7.3

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40905: Assignee: Apache Spark > Upgrade rocksdbjni to 7.7.3 > --- > >

[jira] [Commented] (SPARK-40905) Upgrade rocksdbjni to 7.7.3

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623545#comment-17623545 ] Apache Spark commented on SPARK-40905: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40905) Upgrade rocksdbjni to 7.7.3

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40905: Assignee: (was: Apache Spark) > Upgrade rocksdbjni to 7.7.3 >

[jira] [Updated] (SPARK-40906) `Mode` should copy keys before inserting into Map

2022-10-24 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-40906: -- Summary: `Mode` should copy keys before inserting into Map (was: Mode should copy keys

[jira] [Created] (SPARK-40906) Mode should copy keys before inserting into Map

2022-10-24 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40906: - Summary: Mode should copy keys before inserting into Map Key: SPARK-40906 URL: https://issues.apache.org/jira/browse/SPARK-40906 Project: Spark Issue

[jira] [Commented] (SPARK-40708) Auto update table statistics based on write metrics

2022-10-24 Thread Jackey Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623543#comment-17623543 ] Jackey Lee commented on SPARK-40708: Maybe we can use `CommitProtocol`, which can return more

[jira] [Created] (SPARK-40905) Upgrade rocksdbjni to 7.7.3

2022-10-24 Thread Yang Jie (Jira)
Yang Jie created SPARK-40905: Summary: Upgrade rocksdbjni to 7.7.3 Key: SPARK-40905 URL: https://issues.apache.org/jira/browse/SPARK-40905 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-40793) Row-level Runtime Filtering cannot be enabled when externalTable has no stats

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40793: Assignee: Apache Spark > Row-level Runtime Filtering cannot be enabled when

[jira] [Assigned] (SPARK-40793) Row-level Runtime Filtering cannot be enabled when externalTable has no stats

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40793: Assignee: (was: Apache Spark) > Row-level Runtime Filtering cannot be enabled when

[jira] [Commented] (SPARK-40793) Row-level Runtime Filtering cannot be enabled when externalTable has no stats

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623536#comment-17623536 ] Apache Spark commented on SPARK-40793: -- User 'chenminghua8' has created a pull request for this

[jira] [Resolved] (SPARK-40899) UserContext should be extensible

2022-10-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40899. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38374

[jira] [Assigned] (SPARK-40899) UserContext should be extensible

2022-10-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40899: --- Assignee: Martin Grund > UserContext should be extensible >

[jira] [Commented] (SPARK-40708) Auto update table statistics based on write metrics

2022-10-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623533#comment-17623533 ] Yang Jie commented on SPARK-40708: -- After SPARK-38573,  CommandUtils#updateTableStats method begin to

[jira] [Commented] (SPARK-40888) Check error classes in HiveQuerySuite

2022-10-24 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623530#comment-17623530 ] BingKun Pan commented on SPARK-40888: - I will do it. > Check error classes in HiveQuerySuite >

[jira] [Commented] (SPARK-40793) Row-level Runtime Filtering cannot be enabled when externalTable has no stats

2022-10-24 Thread chenminghua (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623525#comment-17623525 ] chenminghua commented on SPARK-40793: - [https://github.com/apache/spark/pull/38381] is the

[jira] [Commented] (SPARK-38934) Provider TemporaryAWSCredentialsProvider has no credentials

2022-10-24 Thread Lily Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623521#comment-17623521 ] Lily Kim commented on SPARK-38934: -- Great! {color:#FF}*Setting fs.s3a.bucket.probe to 2*{color}

[jira] [Resolved] (SPARK-40855) Add CONTRIBUTING.md to apache/spark-docker

2022-10-24 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40855. - Assignee: Qian Sun Resolution: Fixed > Add CONTRIBUTING.md to apache/spark-docker >

[jira] [Commented] (SPARK-40855) Add CONTRIBUTING.md to apache/spark-docker

2022-10-24 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623512#comment-17623512 ] Yikun Jiang commented on SPARK-40855: - Resolved by https://github.com/apache/spark-docker/pull/19 >

[jira] [Commented] (SPARK-36057) SPIP: Support Customized Kubernetes Schedulers

2022-10-24 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623509#comment-17623509 ] Yikun Jiang commented on SPARK-36057: - [~dongjoon] Thanks! > SPIP: Support Customized Kubernetes

[jira] [Commented] (SPARK-36057) SPIP: Support Customized Kubernetes Schedulers

2022-10-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623505#comment-17623505 ] Yuming Wang commented on SPARK-36057: - Thank you [~dongjoon]. > SPIP: Support Customized Kubernetes

[jira] [Resolved] (SPARK-40904) Support zsh in K8s `entrypoint.sh`

2022-10-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40904. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38380

[jira] [Assigned] (SPARK-40904) Support zsh in K8s `entrypoint.sh`

2022-10-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40904: - Assignee: Dongjoon Hyun > Support zsh in K8s `entrypoint.sh` >

[jira] [Commented] (SPARK-40904) Support zsh in K8s `entrypoint.sh`

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623448#comment-17623448 ] Apache Spark commented on SPARK-40904: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-40904) Support zsh in K8s `entrypoint.sh`

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40904: Assignee: Apache Spark > Support zsh in K8s `entrypoint.sh` >

[jira] [Assigned] (SPARK-40904) Support zsh in K8s `entrypoint.sh`

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40904: Assignee: (was: Apache Spark) > Support zsh in K8s `entrypoint.sh` >

[jira] [Commented] (SPARK-40904) Support zsh in K8s `entrypoint.sh`

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623447#comment-17623447 ] Apache Spark commented on SPARK-40904: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-40904) Support zsh in K8s `entrypoint.sh`

2022-10-24 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-40904: - Summary: Support zsh in K8s `entrypoint.sh` Key: SPARK-40904 URL: https://issues.apache.org/jira/browse/SPARK-40904 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-40903) Avoid reordering decimal Add for canonicalization

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40903: Assignee: Gengliang Wang (was: Apache Spark) > Avoid reordering decimal Add for

[jira] [Commented] (SPARK-40903) Avoid reordering decimal Add for canonicalization

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623387#comment-17623387 ] Apache Spark commented on SPARK-40903: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-40903) Avoid reordering decimal Add for canonicalization

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40903: Assignee: Apache Spark (was: Gengliang Wang) > Avoid reordering decimal Add for

[jira] [Created] (SPARK-40903) Avoid reordering decimal Add for canonicalization

2022-10-24 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40903: -- Summary: Avoid reordering decimal Add for canonicalization Key: SPARK-40903 URL: https://issues.apache.org/jira/browse/SPARK-40903 Project: Spark Issue

[jira] [Commented] (SPARK-36057) SPIP: Support Customized Kubernetes Schedulers

2022-10-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623363#comment-17623363 ] Dongjoon Hyun commented on SPARK-36057: --- FYI, [~yumwang] . This is resolved at 3.3.1. > SPIP:

[jira] [Resolved] (SPARK-36057) SPIP: Support Customized Kubernetes Schedulers

2022-10-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36057. --- Fix Version/s: 3.3.1 Resolution: Done Since Apache Spark 3.3.1, Apache Spark

[jira] [Updated] (SPARK-38190) Add fair-share scheduling integration test

2022-10-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38190: -- Parent: (was: SPARK-36057) Issue Type: Test (was: Sub-task) > Add fair-share

[jira] [Commented] (SPARK-38621) Add volcano module to release-build.sh

2022-10-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623359#comment-17623359 ] Dongjoon Hyun commented on SPARK-38621: --- I converted this to the independent Jira issue. > Add

[jira] [Updated] (SPARK-38621) Add volcano module to release-build.sh

2022-10-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38621: -- Parent: (was: SPARK-36057) Issue Type: Improvement (was: Sub-task) > Add volcano

[jira] [Resolved] (SPARK-40902) Quick submission of drivers in tests to mesos scheduler results in dropping drivers

2022-10-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40902. --- Fix Version/s: 3.4.0 3.2.3 3.3.2 Assignee:

[jira] [Updated] (SPARK-40902) Quick submission of drivers in tests to mesos scheduler results in dropping drivers

2022-10-24 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-40902: Priority: Minor (was: Major) > Quick submission of drivers in tests to mesos

[jira] [Commented] (SPARK-40902) Quick submission of drivers in tests to mesos scheduler results in dropping drivers

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623290#comment-17623290 ] Apache Spark commented on SPARK-40902: -- User 'mridulm' has created a pull request for this issue:

[jira] [Commented] (SPARK-40902) Quick submission of drivers in tests to mesos scheduler results in dropping drivers

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623288#comment-17623288 ] Apache Spark commented on SPARK-40902: -- User 'mridulm' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40902) Quick submission of drivers in tests to mesos scheduler results in dropping drivers

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40902: Assignee: Apache Spark > Quick submission of drivers in tests to mesos scheduler results

[jira] [Assigned] (SPARK-40902) Quick submission of drivers in tests to mesos scheduler results in dropping drivers

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40902: Assignee: (was: Apache Spark) > Quick submission of drivers in tests to mesos

[jira] [Commented] (SPARK-40901) Unable to store Spark Driver logs with Absolute Hadoop based URI FS Path

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623278#comment-17623278 ] Apache Spark commented on SPARK-40901: -- User 'swamirishi' has created a pull request for this

[jira] [Commented] (SPARK-40901) Unable to store Spark Driver logs with Absolute Hadoop based URI FS Path

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623279#comment-17623279 ] Apache Spark commented on SPARK-40901: -- User 'swamirishi' has created a pull request for this

[jira] [Assigned] (SPARK-40901) Unable to store Spark Driver logs with Absolute Hadoop based URI FS Path

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40901: Assignee: (was: Apache Spark) > Unable to store Spark Driver logs with Absolute

[jira] [Assigned] (SPARK-40901) Unable to store Spark Driver logs with Absolute Hadoop based URI FS Path

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40901: Assignee: Apache Spark > Unable to store Spark Driver logs with Absolute Hadoop based

[jira] [Updated] (SPARK-40901) Unable to store Spark Driver logs with Absolute Hadoop based URI FS Path

2022-10-24 Thread Swaminathan Balachandran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swaminathan Balachandran updated SPARK-40901: - Description: Spark Config: spark.driver.log.dfsDir doesn't support

[jira] [Commented] (SPARK-40902) Quick submission of drivers in tests to mesos scheduler results in dropping drivers

2022-10-24 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623270#comment-17623270 ] Mridul Muralidharan commented on SPARK-40902: - +CC [~dongjoon], [~yumwang] > Quick

[jira] [Created] (SPARK-40902) Quick submission of drivers in tests to mesos scheduler results in dropping drivers

2022-10-24 Thread Mridul Muralidharan (Jira)
Mridul Muralidharan created SPARK-40902: --- Summary: Quick submission of drivers in tests to mesos scheduler results in dropping drivers Key: SPARK-40902 URL: https://issues.apache.org/jira/browse/SPARK-40902

[jira] [Created] (SPARK-40901) Unable to store Spark Driver logs with Absolute Hadoop based URI FS Path

2022-10-24 Thread Swaminathan Balachandran (Jira)
Swaminathan Balachandran created SPARK-40901: Summary: Unable to store Spark Driver logs with Absolute Hadoop based URI FS Path Key: SPARK-40901 URL: https://issues.apache.org/jira/browse/SPARK-40901

[jira] [Resolved] (SPARK-40750) Migrate type check failures of math expressions onto error classes

2022-10-24 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40750. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38332

[jira] [Assigned] (SPARK-40750) Migrate type check failures of math expressions onto error classes

2022-10-24 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40750: Assignee: BingKun Pan > Migrate type check failures of math expressions onto error classes >

[jira] [Assigned] (SPARK-40817) Remote spark.jars URIs ignored for Spark on Kubernetes in cluster mode

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40817: Assignee: (was: Apache Spark) > Remote spark.jars URIs ignored for Spark on

[jira] [Commented] (SPARK-40817) Remote spark.jars URIs ignored for Spark on Kubernetes in cluster mode

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623267#comment-17623267 ] Apache Spark commented on SPARK-40817: -- User 'antonipp' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40817) Remote spark.jars URIs ignored for Spark on Kubernetes in cluster mode

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40817: Assignee: Apache Spark > Remote spark.jars URIs ignored for Spark on Kubernetes in

[jira] [Resolved] (SPARK-40857) Allow configurable GPRC interceptors for Spark Connect

2022-10-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40857. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38320

[jira] [Assigned] (SPARK-40857) Allow configurable GPRC interceptors for Spark Connect

2022-10-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40857: --- Assignee: Martin Grund > Allow configurable GPRC interceptors for Spark Connect >

[jira] (SPARK-30105) Add StreamingQueryListener support to PySpark

2022-10-24 Thread Eric (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30105 ] Eric deleted comment on SPARK-30105: -- was (Author: ladoe00): Fixed by SPARK-38759 > Add StreamingQueryListener support to PySpark > - > >

[jira] [Commented] (SPARK-30105) Add StreamingQueryListener support to PySpark

2022-10-24 Thread Eric (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623227#comment-17623227 ] Eric commented on SPARK-30105: -- Fixed by SPARK-38759 > Add StreamingQueryListener support to PySpark >

[jira] [Updated] (SPARK-40851) TimestampFormatter behavior changed when using the latest Java 8/11/17

2022-10-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40851: - Fix Version/s: 3.3.2 (was: 3.3.1) > TimestampFormatter behavior changed

[jira] [Resolved] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40738. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38228

[jira] [Assigned] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40738: Assignee: Phil Walker > spark-shell fails with "bad array subscript" in cygwin or msys

[jira] [Resolved] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40739. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38228

[jira] [Updated] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40739: - Priority: Minor (was: Major) > "sbt packageBin" fails in cygwin or other windows bash session

[jira] [Assigned] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40739: Assignee: Phil Walker > "sbt packageBin" fails in cygwin or other windows bash session >

[jira] [Updated] (SPARK-39977) Remove unnecessary guava exclusion from jackson-module-scala

2022-10-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39977: - Priority: Trivial (was: Major) > Remove unnecessary guava exclusion from jackson-module-scala

[jira] [Resolved] (SPARK-39977) Remove unnecessary guava exclusion from jackson-module-scala

2022-10-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39977. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37405

[jira] [Assigned] (SPARK-39977) Remove unnecessary guava exclusion from jackson-module-scala

2022-10-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39977: Assignee: Cheng Pan > Remove unnecessary guava exclusion from jackson-module-scala >

[jira] [Comment Edited] (SPARK-34966) Avoid shuffle if join type do not match

2022-10-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315591#comment-17315591 ] Yuming Wang edited comment on SPARK-34966 at 10/24/22 11:37 AM:

[jira] [Resolved] (SPARK-32082) Project Zen: Improving Python usability

2022-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32082. -- Resolution: Done > Project Zen: Improving Python usability >

[jira] [Updated] (SPARK-32082) Project Zen: Improving Python usability

2022-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32082: - Fix Version/s: 3.4.0 > Project Zen: Improving Python usability >

[jira] [Updated] (SPARK-23258) Should not split Arrow record batches based on row count

2022-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23258: - Epic Link: (was: SPARK-32082) > Should not split Arrow record batches based on row count >

[jira] [Resolved] (SPARK-39705) Adding examples for 'Column' Documentation

2022-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39705. -- Resolution: Duplicate > Adding examples for 'Column' Documentation >

[jira] [Resolved] (SPARK-33247) Improve examples and scenarios in docstrings

2022-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33247. -- Resolution: Fixed > Improve examples and scenarios in docstrings >

[jira] [Assigned] (SPARK-40897) Add missing PySpark APIs to References

2022-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40897: Assignee: Ruifeng Zheng > Add missing PySpark APIs to References >

[jira] [Resolved] (SPARK-40897) Add missing PySpark APIs to References

2022-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40897. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38373

[jira] [Commented] (SPARK-40900) Reimplement `frequentItems` with dataframe operations

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623097#comment-17623097 ] Apache Spark commented on SPARK-40900: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40900) Reimplement `frequentItems` with dataframe operations

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40900: Assignee: Apache Spark > Reimplement `frequentItems` with dataframe operations >

[jira] [Assigned] (SPARK-40900) Reimplement `frequentItems` with dataframe operations

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40900: Assignee: (was: Apache Spark) > Reimplement `frequentItems` with dataframe

[jira] [Created] (SPARK-40900) Reimplement `frequentItems` with dataframe operations

2022-10-24 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40900: - Summary: Reimplement `frequentItems` with dataframe operations Key: SPARK-40900 URL: https://issues.apache.org/jira/browse/SPARK-40900 Project: Spark

[jira] [Assigned] (SPARK-40891) Check error classes in TableIdentifierParserSuite

2022-10-24 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40891: Assignee: BingKun Pan > Check error classes in TableIdentifierParserSuite >

[jira] [Resolved] (SPARK-40891) Check error classes in TableIdentifierParserSuite

2022-10-24 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40891. -- Resolution: Fixed Issue resolved by pull request 38364 [https://github.com/apache/spark/pull/38364]

[jira] [Assigned] (SPARK-40896) Fix doctest for `Index.(isin|isnull|notnull)` to work properly with pandas 1.5

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40896: Assignee: (was: Apache Spark) > Fix doctest for `Index.(isin|isnull|notnull)` to

[jira] [Assigned] (SPARK-40896) Fix doctest for `Index.(isin|isnull|notnull)` to work properly with pandas 1.5

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40896: Assignee: Apache Spark > Fix doctest for `Index.(isin|isnull|notnull)` to work properly

[jira] [Commented] (SPARK-40896) Fix doctest for `Index.(isin|isnull|notnull)` to work properly with pandas 1.5

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623080#comment-17623080 ] Apache Spark commented on SPARK-40896: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-40899) UserContext should be extensible

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623067#comment-17623067 ] Apache Spark commented on SPARK-40899: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-40899) UserContext should be extensible

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40899: Assignee: Apache Spark > UserContext should be extensible >

[jira] [Commented] (SPARK-40899) UserContext should be extensible

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623065#comment-17623065 ] Apache Spark commented on SPARK-40899: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-40899) UserContext should be extensible

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40899: Assignee: (was: Apache Spark) > UserContext should be extensible >

[jira] [Created] (SPARK-40899) UserContext should be extensible

2022-10-24 Thread Martin Grund (Jira)
Martin Grund created SPARK-40899: Summary: UserContext should be extensible Key: SPARK-40899 URL: https://issues.apache.org/jira/browse/SPARK-40899 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-34265) Instrument Python UDF execution using SQL Metrics

2022-10-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34265: --- Assignee: Luca Canali > Instrument Python UDF execution using SQL Metrics >

[jira] [Resolved] (SPARK-34265) Instrument Python UDF execution using SQL Metrics

2022-10-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34265. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 33559

[jira] [Assigned] (SPARK-40898) Quote function names in datatype mismatch errors

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40898: Assignee: Max Gekk (was: Apache Spark) > Quote function names in datatype mismatch

[jira] [Assigned] (SPARK-40898) Quote function names in datatype mismatch errors

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40898: Assignee: Apache Spark (was: Max Gekk) > Quote function names in datatype mismatch

[jira] [Commented] (SPARK-40898) Quote function names in datatype mismatch errors

2022-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623055#comment-17623055 ] Apache Spark commented on SPARK-40898: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-40898) Quote function names in datatype mismatch errors

2022-10-24 Thread Max Gekk (Jira)
Max Gekk created SPARK-40898: Summary: Quote function names in datatype mismatch errors Key: SPARK-40898 URL: https://issues.apache.org/jira/browse/SPARK-40898 Project: Spark Issue Type:

  1   2   >