[jira] [Commented] (SPARK-32850) Simply the RPC message flow of decommission

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263933#comment-17263933 ] Apache Spark commented on SPARK-32850: -- User 'ulysses-you' has created a pull request for this

[jira] [Comment Edited] (SPARK-19169) columns changed orc table encouter 'IndexOutOfBoundsException' when read the old schema files

2021-01-12 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263927#comment-17263927 ] bianqi edited comment on SPARK-19169 at 1/13/21, 7:16 AM: -- [~hyukjin.kwon]

[jira] [Comment Edited] (SPARK-19169) columns changed orc table encouter 'IndexOutOfBoundsException' when read the old schema files

2021-01-12 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263927#comment-17263927 ] bianqi edited comment on SPARK-19169 at 1/13/21, 7:14 AM: -- [~hyukjin.kwon]

[jira] [Comment Edited] (SPARK-19169) columns changed orc table encouter 'IndexOutOfBoundsException' when read the old schema files

2021-01-12 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263927#comment-17263927 ] bianqi edited comment on SPARK-19169 at 1/13/21, 7:13 AM: -- [~hyukjin.kwon]

[jira] [Commented] (SPARK-19169) columns changed orc table encouter 'IndexOutOfBoundsException' when read the old schema files

2021-01-12 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263927#comment-17263927 ] bianqi commented on SPARK-19169: [~hyukjin.kwon] [~srowen] Hello, in our scenario, using spark 232

[jira] [Comment Edited] (SPARK-19169) columns changed orc table encouter 'IndexOutOfBoundsException' when read the old schema files

2021-01-12 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17165657#comment-17165657 ] bianqi edited comment on SPARK-19169 at 1/13/21, 6:59 AM: -- [~hyukjin.kwon]     

[jira] [Issue Comment Deleted] (SPARK-19169) columns changed orc table encouter 'IndexOutOfBoundsException' when read the old schema files

2021-01-12 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated SPARK-19169: --- Comment: was deleted (was: [~hyukjin.kwon]     

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

2021-01-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263909#comment-17263909 ] Dongjoon Hyun commented on SPARK-25075: --- [~stephenk]. Apache Spark release script doesn't have

[jira] [Updated] (SPARK-34095) Spark 3 is giving WARN while running job

2021-01-12 Thread Sachit Murarka (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sachit Murarka updated SPARK-34095: --- Description: I am running Spark 3.0.1 with Java11. Getting the following WARN.   WARNING:

[jira] [Created] (SPARK-34095) Spark 3 is giving WARN while running job

2021-01-12 Thread Sachit Murarka (Jira)
Sachit Murarka created SPARK-34095: -- Summary: Spark 3 is giving WARN while running job Key: SPARK-34095 URL: https://issues.apache.org/jira/browse/SPARK-34095 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-34084) ALTER TABLE .. ADD PARTITION does not update table stats

2021-01-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-34084: Fix Version/s: 3.1.1 3.0.2 > ALTER TABLE .. ADD PARTITION does not update

[jira] [Resolved] (SPARK-34071) Check stats of cached table after altering

2021-01-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34071. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31131

[jira] [Commented] (SPARK-34092) Stage level RestFul API support filter by task status

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263884#comment-17263884 ] Apache Spark commented on SPARK-34092: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34092) Stage level RestFul API support filter by task status

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34092: Assignee: Apache Spark > Stage level RestFul API support filter by task status >

[jira] [Assigned] (SPARK-34092) Stage level RestFul API support filter by task status

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34092: Assignee: (was: Apache Spark) > Stage level RestFul API support filter by task

[jira] [Commented] (SPARK-34092) Stage level RestFul API support filter by task status

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263883#comment-17263883 ] Apache Spark commented on SPARK-34092: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-24815) Structured Streaming should support dynamic allocation

2021-01-12 Thread Rajat Goel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263876#comment-17263876 ] Rajat Goel commented on SPARK-24815: Is there any updates/progress on this feature especially for

[jira] [Assigned] (SPARK-34094) Extends StringTranslate to support unicode characters whose code point >= U+10000

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34094: Assignee: Kousuke Saruta (was: Apache Spark) > Extends StringTranslate to support

[jira] [Commented] (SPARK-34094) Extends StringTranslate to support unicode characters whose code point >= U+10000

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263874#comment-17263874 ] Apache Spark commented on SPARK-34094: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34094) Extends StringTranslate to support unicode characters whose code point >= U+10000

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34094: Assignee: Apache Spark (was: Kousuke Saruta) > Extends StringTranslate to support

[jira] [Updated] (SPARK-34094) Extends StringTranslate to support unicode characters whose code point >= U+10000

2021-01-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34094: --- Description: Currently, StringTranslate works with only unicode characters whose code point

[jira] [Updated] (SPARK-34094) Extends StringTranslate to support unicode characters whose code point >= U+10000

2021-01-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34094: --- Summary: Extends StringTranslate to support unicode characters whose code point >= U+1

[jira] [Created] (SPARK-34094) Extends StringTranslate to support unicode characters whose code point >= 0x10000

2021-01-12 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34094: -- Summary: Extends StringTranslate to support unicode characters whose code point >= 0x1 Key: SPARK-34094 URL: https://issues.apache.org/jira/browse/SPARK-34094

[jira] [Assigned] (SPARK-34093) param maxDepth should check upper bound

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34093: Assignee: Apache Spark > param maxDepth should check upper bound >

[jira] [Commented] (SPARK-34093) param maxDepth should check upper bound

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263871#comment-17263871 ] Apache Spark commented on SPARK-34093: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-34093) param maxDepth should check upper bound

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34093: Assignee: (was: Apache Spark) > param maxDepth should check upper bound >

[jira] [Commented] (SPARK-34093) param maxDepth should check upper bound

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263872#comment-17263872 ] Apache Spark commented on SPARK-34093: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-34093) param maxDepth should check upper bound

2021-01-12 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-34093: Summary: param maxDepth should check upper bound Key: SPARK-34093 URL: https://issues.apache.org/jira/browse/SPARK-34093 Project: Spark Issue Type:

[jira] [Created] (SPARK-34092) Stage level RestFul API support filter by task status

2021-01-12 Thread angerszhu (Jira)
angerszhu created SPARK-34092: - Summary: Stage level RestFul API support filter by task status Key: SPARK-34092 URL: https://issues.apache.org/jira/browse/SPARK-34092 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-34085) History server missing failed stage

2021-01-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-34085. - Resolution: Invalid > History server missing failed stage > ---

[jira] [Commented] (SPARK-34033) SparkR Daemon Initialization

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263841#comment-17263841 ] Apache Spark commented on SPARK-34033: -- User 'WamBamBoozle' has created a pull request for this

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

2021-01-12 Thread Stephen Kestle (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263837#comment-17263837 ] Stephen Kestle commented on SPARK-25075: [~dongjoon] can you add context about points 1 and 2

[jira] [Resolved] (SPARK-34090) HadoopDelegationTokenManager.isServiceEnabled used in KafkaTokenUtil.needTokenUpdate needs to be cached because it slows down Kafka stream processing in case of delegat

2021-01-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34090. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 31154

[jira] [Updated] (SPARK-34090) HadoopDelegationTokenManager.isServiceEnabled used in KafkaTokenUtil.needTokenUpdate needs to be cached because it slows down Kafka stream processing in case of delegati

2021-01-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34090: - Fix Version/s: (was: 3.1.0) 3.1.1 >

[jira] [Assigned] (SPARK-34090) HadoopDelegationTokenManager.isServiceEnabled used in KafkaTokenUtil.needTokenUpdate needs to be cached because it slows down Kafka stream processing in case of delegat

2021-01-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34090: Assignee: Gabor Somogyi > HadoopDelegationTokenManager.isServiceEnabled used in >

[jira] [Updated] (SPARK-34051) Support 32-bit unicode escape in string literals

2021-01-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34051: --- Priority: Minor (was: Major) > Support 32-bit unicode escape in string literals >

[jira] [Assigned] (SPARK-34080) Add UnivariateFeatureSelector to deprecate existing selectors

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34080: Assignee: (was: Apache Spark) > Add UnivariateFeatureSelector to deprecate existing

[jira] [Commented] (SPARK-34080) Add UnivariateFeatureSelector to deprecate existing selectors

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263754#comment-17263754 ] Apache Spark commented on SPARK-34080: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34080) Add UnivariateFeatureSelector to deprecate existing selectors

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34080: Assignee: Apache Spark > Add UnivariateFeatureSelector to deprecate existing selectors >

[jira] [Commented] (SPARK-34080) Add UnivariateFeatureSelector to deprecate existing selectors

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263752#comment-17263752 ] Apache Spark commented on SPARK-34080: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-32338) Add overload for slice that accepts Columns or Int

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263725#comment-17263725 ] Apache Spark commented on SPARK-32338: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-32338) Add overload for slice that accepts Columns or Int

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263724#comment-17263724 ] Apache Spark commented on SPARK-32338: -- User 'ueshin' has created a pull request for this issue:

[jira] [Updated] (SPARK-32691) Update commons-crypto to v1.1.0

2021-01-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32691: -- Fix Version/s: 3.0.2 > Update commons-crypto to v1.1.0 > --- > >

[jira] [Assigned] (SPARK-34069) Kill barrier tasks should respect SPARK_JOB_INTERRUPT_ON_CANCEL

2021-01-12 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-34069: --- Assignee: ulysses you > Kill barrier tasks should respect

[jira] [Resolved] (SPARK-34069) Kill barrier tasks should respect SPARK_JOB_INTERRUPT_ON_CANCEL

2021-01-12 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-34069. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request

[jira] [Commented] (SPARK-34084) ALTER TABLE .. ADD PARTITION does not update table stats

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263582#comment-17263582 ] Apache Spark commented on SPARK-34084: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34084) ALTER TABLE .. ADD PARTITION does not update table stats

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263581#comment-17263581 ] Apache Spark commented on SPARK-34084: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34084) ALTER TABLE .. ADD PARTITION does not update table stats

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263571#comment-17263571 ] Apache Spark commented on SPARK-34084: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263499#comment-17263499 ] Apache Spark commented on SPARK-34087: -- User 'cfmcgrady' has created a pull request for this issue:

[jira] [Commented] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263498#comment-17263498 ] Apache Spark commented on SPARK-34087: -- User 'cfmcgrady' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34087: Assignee: (was: Apache Spark) > a memory leak occurs when we clone the spark session

[jira] [Assigned] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34087: Assignee: Apache Spark > a memory leak occurs when we clone the spark session >

[jira] [Resolved] (SPARK-34091) Shuffle batch fetch can't be disabled once it's enabled previously

2021-01-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34091. - Fix Version/s: 3.1.1 Resolution: Fixed Issue resolved by pull request 31155

[jira] [Assigned] (SPARK-34091) Shuffle batch fetch can't be disabled once it's enabled previously

2021-01-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34091: --- Assignee: wuyi > Shuffle batch fetch can't be disabled once it's enabled previously >

[jira] [Commented] (SPARK-31144) Wrap java.lang.Error with an exception for QueryExecutionListener.onFailure

2021-01-12 Thread Alex Vayda (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263425#comment-17263425 ] Alex Vayda commented on SPARK-31144: Don't you think that wrapping an {{Error}} into {{Exception}},

[jira] [Resolved] (SPARK-34084) ALTER TABLE .. ADD PARTITION does not update table stats

2021-01-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34084. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31149

[jira] [Assigned] (SPARK-34084) ALTER TABLE .. ADD PARTITION does not update table stats

2021-01-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34084: --- Assignee: Maxim Gekk > ALTER TABLE .. ADD PARTITION does not update table stats >

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263346#comment-17263346 ] Apache Spark commented on SPARK-34053: -- User 'potiuk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263347#comment-17263347 ] Apache Spark commented on SPARK-34053: -- User 'potiuk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34091) Shuffle batch fetch can't be disabled once it's enabled previously

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263343#comment-17263343 ] Apache Spark commented on SPARK-34091: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34091) Shuffle batch fetch can't be disabled once it's enabled previously

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34091: Assignee: Apache Spark > Shuffle batch fetch can't be disabled once it's enabled

[jira] [Assigned] (SPARK-34091) Shuffle batch fetch can't be disabled once it's enabled previously

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34091: Assignee: (was: Apache Spark) > Shuffle batch fetch can't be disabled once it's

[jira] [Commented] (SPARK-34090) HadoopDelegationTokenManager.isServiceEnabled used in KafkaTokenUtil.needTokenUpdate needs to be cached because it slows down Kafka stream processing in case of delega

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263338#comment-17263338 ] Apache Spark commented on SPARK-34090: -- User 'gaborgsomogyi' has created a pull request for this

[jira] [Assigned] (SPARK-34090) HadoopDelegationTokenManager.isServiceEnabled used in KafkaTokenUtil.needTokenUpdate needs to be cached because it slows down Kafka stream processing in case of delegat

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34090: Assignee: (was: Apache Spark) > HadoopDelegationTokenManager.isServiceEnabled used

[jira] [Assigned] (SPARK-34090) HadoopDelegationTokenManager.isServiceEnabled used in KafkaTokenUtil.needTokenUpdate needs to be cached because it slows down Kafka stream processing in case of delegat

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34090: Assignee: Apache Spark > HadoopDelegationTokenManager.isServiceEnabled used in >

[jira] [Commented] (SPARK-34090) HadoopDelegationTokenManager.isServiceEnabled used in KafkaTokenUtil.needTokenUpdate needs to be cached because it slows down Kafka stream processing in case of delega

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263336#comment-17263336 ] Apache Spark commented on SPARK-34090: -- User 'gaborgsomogyi' has created a pull request for this

[jira] [Created] (SPARK-34091) Shuffle batch fetch can't be disabled once it's enabled previously

2021-01-12 Thread wuyi (Jira)
wuyi created SPARK-34091: Summary: Shuffle batch fetch can't be disabled once it's enabled previously Key: SPARK-34091 URL: https://issues.apache.org/jira/browse/SPARK-34091 Project: Spark Issue

[jira] [Created] (SPARK-34090) HadoopDelegationTokenManager.isServiceEnabled used in KafkaTokenUtil.needTokenUpdate needs to be cached because it slows down Kafka stream processing in case of delegati

2021-01-12 Thread Gabor Somogyi (Jira)
Gabor Somogyi created SPARK-34090: - Summary: HadoopDelegationTokenManager.isServiceEnabled used in KafkaTokenUtil.needTokenUpdate needs to be cached because it slows down Kafka stream processing in case of delegation token Key:

[jira] [Commented] (SPARK-34089) MemoryConsumer's memory mode should respect MemoryManager's memory mode

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263318#comment-17263318 ] Apache Spark commented on SPARK-34089: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34089) MemoryConsumer's memory mode should respect MemoryManager's memory mode

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34089: Assignee: (was: Apache Spark) > MemoryConsumer's memory mode should respect

[jira] [Assigned] (SPARK-34089) MemoryConsumer's memory mode should respect MemoryManager's memory mode

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34089: Assignee: Apache Spark > MemoryConsumer's memory mode should respect MemoryManager's

[jira] [Commented] (SPARK-34089) MemoryConsumer's memory mode should respect MemoryManager's memory mode

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263316#comment-17263316 ] Apache Spark commented on SPARK-34089: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Created] (SPARK-34089) MemoryConsumer's memory mode should respect MemoryManager's memory mode

2021-01-12 Thread wuyi (Jira)
wuyi created SPARK-34089: Summary: MemoryConsumer's memory mode should respect MemoryManager's memory mode Key: SPARK-34089 URL: https://issues.apache.org/jira/browse/SPARK-34089 Project: Spark

[jira] [Assigned] (SPARK-34088) Rename all decommission configurations to use the same namespace "spark.decommission.*"

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34088: Assignee: (was: Apache Spark) > Rename all decommission configurations to use the

[jira] [Commented] (SPARK-34088) Rename all decommission configurations to use the same namespace "spark.decommission.*"

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263289#comment-17263289 ] Apache Spark commented on SPARK-34088: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34088) Rename all decommission configurations to use the same namespace "spark.decommission.*"

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34088: Assignee: Apache Spark > Rename all decommission configurations to use the same

[jira] [Updated] (SPARK-34088) Rename all decommission configurations to use the same namespace "spark.decommission.*"

2021-01-12 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-34088: - Description: Currently, decommission configurations are using difference namespaces, e.g.,  *

[jira] [Comment Edited] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Fu Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263266#comment-17263266 ] Fu Chen edited comment on SPARK-34087 at 1/12/21, 12:03 PM: *bug replay*

[jira] [Created] (SPARK-34088) Rename all decommission configurations to fix same namespace "spark.decommission.*"

2021-01-12 Thread wuyi (Jira)
wuyi created SPARK-34088: Summary: Rename all decommission configurations to fix same namespace "spark.decommission.*" Key: SPARK-34088 URL: https://issues.apache.org/jira/browse/SPARK-34088 Project: Spark

[jira] [Comment Edited] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Fu Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263266#comment-17263266 ] Fu Chen edited comment on SPARK-34087 at 1/12/21, 12:02 PM: *bug replay*

[jira] [Updated] (SPARK-34088) Rename all decommission configurations to use the same namespace "spark.decommission.*"

2021-01-12 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-34088: - Summary: Rename all decommission configurations to use the same namespace "spark.decommission.*" (was: Rename

[jira] [Updated] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Fu Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fu Chen updated SPARK-34087: Attachment: 1610451044690.jpg > a memory leak occurs when we clone the spark session >

[jira] [Issue Comment Deleted] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Fu Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fu Chen updated SPARK-34087: Comment: was deleted (was: *bug replay* here is code for replay this bug: {code:java} test("bug replay")

[jira] [Commented] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Fu Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263266#comment-17263266 ] Fu Chen commented on SPARK-34087: - *bug replay* here is code for replay this bug: {code:java} test("bug

[jira] [Commented] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Fu Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263264#comment-17263264 ] Fu Chen commented on SPARK-34087: - *bug replay* here is code for replay this bug: {code:java} test("bug

[jira] [Updated] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Fu Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fu Chen updated SPARK-34087: Attachment: (was: 1610451044690.jpg) > a memory leak occurs when we clone the spark session >

[jira] [Updated] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Fu Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fu Chen updated SPARK-34087: Attachment: 1610451044690.jpg > a memory leak occurs when we clone the spark session >

[jira] [Created] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-12 Thread Fu Chen (Jira)
Fu Chen created SPARK-34087: --- Summary: a memory leak occurs when we clone the spark session Key: SPARK-34087 URL: https://issues.apache.org/jira/browse/SPARK-34087 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-34086) RaiseError generates too much code and may fails codegen in length check for char varchar

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34086: Assignee: (was: Apache Spark) > RaiseError generates too much code and may fails

[jira] [Assigned] (SPARK-34086) RaiseError generates too much code and may fails codegen in length check for char varchar

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34086: Assignee: Apache Spark > RaiseError generates too much code and may fails codegen in

[jira] [Commented] (SPARK-34086) RaiseError generates too much code and may fails codegen in length check for char varchar

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263251#comment-17263251 ] Apache Spark commented on SPARK-34086: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Updated] (SPARK-34086) RaiseError generates too much code and may fails codegen in length check for char varchar

2021-01-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34086: - Summary: RaiseError generates too much code and may fails codegen in length check for char varchar

[jira] [Created] (SPARK-34086) RaiseError generates too much code and may fails codegen

2021-01-12 Thread Kent Yao (Jira)
Kent Yao created SPARK-34086: Summary: RaiseError generates too much code and may fails codegen Key: SPARK-34086 URL: https://issues.apache.org/jira/browse/SPARK-34086 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34085) History server missing failed stage

2021-01-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-34085: Attachment: image-2021-01-12-18-30-45-862.png > History server missing failed stage >

[jira] [Updated] (SPARK-34085) History server missing failed stage

2021-01-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-34085: Description: It is missing the failed stage(261716). !image-2021-01-12-18-30-45-862.png! was:

[jira] [Created] (SPARK-34085) History server missing failed stage

2021-01-12 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-34085: --- Summary: History server missing failed stage Key: SPARK-34085 URL: https://issues.apache.org/jira/browse/SPARK-34085 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-34084) ALTER TABLE .. ADD PARTITION does not update table stats

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34084: Assignee: (was: Apache Spark) > ALTER TABLE .. ADD PARTITION does not update table

[jira] [Assigned] (SPARK-34084) ALTER TABLE .. ADD PARTITION does not update table stats

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34084: Assignee: Apache Spark > ALTER TABLE .. ADD PARTITION does not update table stats >

[jira] [Commented] (SPARK-34084) ALTER TABLE .. ADD PARTITION does not update table stats

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263222#comment-17263222 ] Apache Spark commented on SPARK-34084: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33867) java.time.Instant and java.time.LocalDate not handled in org.apache.spark.sql.jdbc.JdbcDialect#compileValue

2021-01-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33867: Assignee: (was: Apache Spark) > java.time.Instant and java.time.LocalDate not

  1   2   >