[jira] [Commented] (SPARK-39063) Remove `finalize()` from `LevelDB/RocksDBIterator`

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533413#comment-17533413 ] Apache Spark commented on SPARK-39063: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-39093) Dividing interval by integral can result in codegen compilation error

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533409#comment-17533409 ] Apache Spark commented on SPARK-39093: -- User 'bersprockets' has created a pull request for this

[jira] [Commented] (SPARK-39093) Dividing interval by integral can result in codegen compilation error

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533408#comment-17533408 ] Apache Spark commented on SPARK-39093: -- User 'bersprockets' has created a pull request for this

[jira] [Commented] (SPARK-39124) Upgrade rocksdbjni to 7.1.2

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533377#comment-17533377 ] Apache Spark commented on SPARK-39124: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39124) Upgrade rocksdbjni to 7.1.2

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39124: Assignee: (was: Apache Spark) > Upgrade rocksdbjni to 7.1.2 >

[jira] [Assigned] (SPARK-39124) Upgrade rocksdbjni to 7.1.2

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39124: Assignee: Apache Spark > Upgrade rocksdbjni to 7.1.2 > --- > >

[jira] [Commented] (SPARK-39124) Upgrade rocksdbjni to 7.1.2

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533376#comment-17533376 ] Apache Spark commented on SPARK-39124: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-39124) Upgrade rocksdbjni to 7.1.2

2022-05-07 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39124: - Summary: Upgrade rocksdbjni to 7.1.2 Key: SPARK-39124 URL: https://issues.apache.org/jira/browse/SPARK-39124 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-38688) Use error classes in the compilation errors of deserializer

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533375#comment-17533375 ] Apache Spark commented on SPARK-38688: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-38688) Use error classes in the compilation errors of deserializer

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38688: Assignee: (was: Apache Spark) > Use error classes in the compilation errors of

[jira] [Assigned] (SPARK-38688) Use error classes in the compilation errors of deserializer

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38688: Assignee: Apache Spark > Use error classes in the compilation errors of deserializer >

[jira] [Resolved] (SPARK-39026) Add k8s tolerations support for apache spark

2022-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39026. --- Fix Version/s: (was: 3.4.0) Resolution: Duplicate This issue is closed as

[jira] [Resolved] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

2022-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39025. --- Resolution: Duplicate This issue is closed as a duplicate of SPARK-24434 because there is

[jira] [Updated] (SPARK-39006) Show a directional error message for PVC Dynamic Allocation Failure

2022-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39006: -- Priority: Minor (was: Major) > Show a directional error message for PVC Dynamic Allocation

[jira] [Assigned] (SPARK-39006) Show a directional error message for PVC Dynamic Allocation Failure

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39006: Assignee: qian (was: Apache Spark) > Show a directional error message for PVC Dynamic

[jira] [Reopened] (SPARK-39006) Show a directional error message for PVC Dynamic Allocation Failure

2022-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-39006: --- > Show a directional error message for PVC Dynamic Allocation Failure >

[jira] [Updated] (SPARK-39006) Show a directional error message for PVC Dynamic Allocation Failure

2022-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39006: -- Affects Version/s: 3.4.0 (was: 3.1.0) > Show a directional error

[jira] [Assigned] (SPARK-39006) Show a directional error message for PVC Dynamic Allocation Failure

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39006: Assignee: Apache Spark (was: qian) > Show a directional error message for PVC Dynamic

[jira] [Resolved] (SPARK-39006) Show a directional error message for PVC Dynamic Allocation Failure

2022-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39006. --- Fix Version/s: 3.4.0 Resolution: Fixed This is resolved via

[jira] [Assigned] (SPARK-39006) Show a directional error message for PVC Dynamic Allocation Failure

2022-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39006: - Assignee: qian > Show a directional error message for PVC Dynamic Allocation Failure >

[jira] [Resolved] (SPARK-39123) Upgrade `org.scalatestplus:mockito` to 3.2.12.0

2022-05-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39123. --- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed This is resolved

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over

2022-05-07 Thread Itay Bittan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533313#comment-17533313 ] Itay Bittan commented on SPARK-28594: - Hi,   Just want to highlight the cost (in terms of money)

[jira] [Commented] (SPARK-39097) Improve the test coverage for pyspark/taskcontext.py

2022-05-07 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533251#comment-17533251 ] pralabhkumar commented on SPARK-39097: -- [~hyukjin.kwon]  While analysis the unit test cases for

[jira] [Updated] (SPARK-39097) Improve the test coverage for pyspark/taskcontext.py

2022-05-07 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pralabhkumar updated SPARK-39097: - Description: Improve the test coverage of taskcontext.py (was: Improve the test coverage of

[jira] [Assigned] (SPARK-39123) Upgrade `org.scalatestplus:mockito` to 3.2.12.0

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39123: Assignee: Apache Spark > Upgrade `org.scalatestplus:mockito` to 3.2.12.0 >

[jira] [Commented] (SPARK-39123) Upgrade `org.scalatestplus:mockito` to 3.2.12.0

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533239#comment-17533239 ] Apache Spark commented on SPARK-39123: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39123) Upgrade `org.scalatestplus:mockito` to 3.2.12.0

2022-05-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39123: Assignee: (was: Apache Spark) > Upgrade `org.scalatestplus:mockito` to 3.2.12.0 >

[jira] [Resolved] (SPARK-39114) ml.optim.aggregator avoid re-allocating buffers

2022-05-07 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-39114. -- Fix Version/s: 3.4.0 Resolution: Resolved > ml.optim.aggregator avoid re-allocating

[jira] [Created] (SPARK-39123) Upgrade `org.scalatestplus:mockito` to 3.2.12.0

2022-05-07 Thread Yang Jie (Jira)
Yang Jie created SPARK-39123: Summary: Upgrade `org.scalatestplus:mockito` to 3.2.12.0 Key: SPARK-39123 URL: https://issues.apache.org/jira/browse/SPARK-39123 Project: Spark Issue Type:

[jira] [Created] (SPARK-39122) Python UDF does not follow the conditional expression evaluation order

2022-05-07 Thread XiDuo You (Jira)
XiDuo You created SPARK-39122: - Summary: Python UDF does not follow the conditional expression evaluation order Key: SPARK-39122 URL: https://issues.apache.org/jira/browse/SPARK-39122 Project: Spark

[jira] [Resolved] (SPARK-39121) Fix doc format/syntax error

2022-05-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39121. -- Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-39121) Fix doc format/syntax error

2022-05-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-39121: Assignee: Yikun Jiang > Fix doc format/syntax error > --- > >