[jira] [Comment Edited] (SPARK-34295) Allow option similar to mapreduce.job.hdfs-servers.token-renewal.exclude

[ https://issues.apache.org/jira/browse/SPARK-34295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284588#comment-17284588 ] L. C. Hsieh edited comment on SPARK-34295 at 2/15/21, 7:39 AM: --- To prevent

[jira] [Commented] (SPARK-34295) Allow option similar to mapreduce.job.hdfs-servers.token-renewal.exclude

[ https://issues.apache.org/jira/browse/SPARK-34295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284588#comment-17284588 ] L. C. Hsieh commented on SPARK-34295: - To prevent other questioning about the assignee, I have the

[jira] [Assigned] (SPARK-34438) Python Driver is not correctly detected using presigned URLs

[ https://issues.apache.org/jira/browse/SPARK-34438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34438: Assignee: (was: Apache Spark) > Python Driver is not correctly detected using

[jira] [Commented] (SPARK-34438) Python Driver is not correctly detected using presigned URLs

[ https://issues.apache.org/jira/browse/SPARK-34438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284535#comment-17284535 ] Apache Spark commented on SPARK-34438: -- User 'scravy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34438) Python Driver is not correctly detected using presigned URLs

[ https://issues.apache.org/jira/browse/SPARK-34438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34438: Assignee: Apache Spark > Python Driver is not correctly detected using presigned URLs >

[jira] [Commented] (SPARK-34438) Python Driver is not correctly detected using presigned URLs

[ https://issues.apache.org/jira/browse/SPARK-34438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284533#comment-17284533 ] Apache Spark commented on SPARK-34438: -- User 'scravy' has created a pull request for this issue:

[jira] [Commented] (SPARK-34438) Python Driver is not correctly detected using presigned URLs

[ https://issues.apache.org/jira/browse/SPARK-34438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284531#comment-17284531 ] Julian Fleischer commented on SPARK-34438: -- I am proposing a patch here: 

[jira] [Updated] (SPARK-34438) Python Driver is not correctly detected using presigned URLs

[ https://issues.apache.org/jira/browse/SPARK-34438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julian Fleischer updated SPARK-34438: - Priority: Minor (was: Major) > Python Driver is not correctly detected using presigned

[jira] [Created] (SPARK-34438) Python Driver is not correctly detected using presigned URLs

Julian Fleischer created SPARK-34438: Summary: Python Driver is not correctly detected using presigned URLs Key: SPARK-34438 URL: https://issues.apache.org/jira/browse/SPARK-34438 Project: Spark

[jira] [Assigned] (SPARK-34434) Mention DS rebase options in SparkUpgradeException

[ https://issues.apache.org/jira/browse/SPARK-34434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34434: - Assignee: Maxim Gekk > Mention DS rebase options in SparkUpgradeException >

[jira] [Resolved] (SPARK-34434) Mention DS rebase options in SparkUpgradeException

[ https://issues.apache.org/jira/browse/SPARK-34434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34434. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31562

[jira] [Comment Edited] (SPARK-34427) Session window support in SS

[ https://issues.apache.org/jira/browse/SPARK-34427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284507#comment-17284507 ] Jungtaek Lim edited comment on SPARK-34427 at 2/15/21, 12:50 AM: - OK I

[jira] [Comment Edited] (SPARK-34427) Session window support in SS

[ https://issues.apache.org/jira/browse/SPARK-34427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284507#comment-17284507 ] Jungtaek Lim edited comment on SPARK-34427 at 2/15/21, 12:49 AM: - OK I

[jira] [Commented] (SPARK-34427) Session window support in SS

[ https://issues.apache.org/jira/browse/SPARK-34427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284507#comment-17284507 ] Jungtaek Lim commented on SPARK-34427: -- OK I agree it's going to meaningless argue. I should have

[jira] [Commented] (SPARK-34427) Session window support in SS

[ https://issues.apache.org/jira/browse/SPARK-34427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284504#comment-17284504 ] L. C. Hsieh commented on SPARK-34427: - Sigh...do you ever see that I say I want to ignore

[jira] [Assigned] (SPARK-34416) Support avroSchemaUrl in addition to avroSchema

[ https://issues.apache.org/jira/browse/SPARK-34416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34416: - Assignee: Ohad Raviv > Support avroSchemaUrl in addition to avroSchema >

[jira] [Resolved] (SPARK-34416) Support avroSchemaUrl in addition to avroSchema

[ https://issues.apache.org/jira/browse/SPARK-34416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34416. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31543

[jira] [Commented] (SPARK-34427) Session window support in SS

[ https://issues.apache.org/jira/browse/SPARK-34427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284496#comment-17284496 ] Jungtaek Lim commented on SPARK-34427: -- This assignee case is quite different from what I've seen

[jira] [Comment Edited] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284491#comment-17284491 ] Jungtaek Lim edited comment on SPARK-34198 at 2/14/21, 8:02 PM: Thanks

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284491#comment-17284491 ] Jungtaek Lim commented on SPARK-34198: -- Thanks for considering it. I think it would be the best

[jira] [Commented] (SPARK-34435) ArrayIndexOutOfBoundsException when select in different case

[ https://issues.apache.org/jira/browse/SPARK-34435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284489#comment-17284489 ] Enver Osmanov commented on SPARK-34435: --- [~ymajid] , it is absolutely ok with me. If you will have

[jira] [Comment Edited] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284479#comment-17284479 ] Reynold Xin edited comment on SPARK-34198 at 2/14/21, 6:59 PM: --- I don't

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284479#comment-17284479 ] Reynold Xin commented on SPARK-34198: - I don't know the intricate details of it but I suspect it's a

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284478#comment-17284478 ] L. C. Hsieh commented on SPARK-34198: - Thanks [~rxin]. Is the implementation used in Databricks a

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284474#comment-17284474 ] Reynold Xin commented on SPARK-34198: - [~kabhwan] let me talk to the team that built our internal

[jira] [Commented] (SPARK-34435) ArrayIndexOutOfBoundsException when select in different case

[ https://issues.apache.org/jira/browse/SPARK-34435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284434#comment-17284434 ] Yousif Majid commented on SPARK-34435: -- Hey [~Enverest], I would like to work on this if that's ok

[jira] [Comment Edited] (SPARK-34432) add a java implementation for the simple writable data source

[ https://issues.apache.org/jira/browse/SPARK-34432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284424#comment-17284424 ] Kevin Pis edited comment on SPARK-34432 at 2/14/21, 3:30 PM: - Hi

[jira] [Commented] (SPARK-34432) add a java implementation for the simple writable data source

[ https://issues.apache.org/jira/browse/SPARK-34432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284424#comment-17284424 ] Kevin Pis commented on SPARK-34432: --- Hi [~cloud_fan]!   Sorry to bother you, but Could you help me to

[jira] [Assigned] (SPARK-34437) Update Spark SQL guide about rebase DS options and SQL configs

[ https://issues.apache.org/jira/browse/SPARK-34437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34437: Assignee: (was: Apache Spark) > Update Spark SQL guide about rebase DS options and

[jira] [Commented] (SPARK-34437) Update Spark SQL guide about rebase DS options and SQL configs

[ https://issues.apache.org/jira/browse/SPARK-34437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284423#comment-17284423 ] Apache Spark commented on SPARK-34437: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34437) Update Spark SQL guide about rebase DS options and SQL configs

[ https://issues.apache.org/jira/browse/SPARK-34437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34437: Assignee: Apache Spark > Update Spark SQL guide about rebase DS options and SQL configs

[jira] [Updated] (SPARK-34432) add a java implementation for the simple writable data source

[ https://issues.apache.org/jira/browse/SPARK-34432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Pis updated SPARK-34432: -- Affects Version/s: (was: 3.1.1) 3.0.1 > add a java implementation for the

[jira] [Created] (SPARK-34437) Update Spark SQL guide about rebase DS options and SQL configs

Maxim Gekk created SPARK-34437: -- Summary: Update Spark SQL guide about rebase DS options and SQL configs Key: SPARK-34437 URL: https://issues.apache.org/jira/browse/SPARK-34437 Project: Spark

[jira] [Commented] (SPARK-16745) Spark job completed however have to wait for 13 mins (data size is small)

[ https://issues.apache.org/jira/browse/SPARK-16745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284416#comment-17284416 ] Abhay Dandekar commented on SPARK-16745: +1. Getting same issue on standalone spark 3.0.1

[jira] [Assigned] (SPARK-34436) DPP support LIKE ANY/ALL

[ https://issues.apache.org/jira/browse/SPARK-34436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34436: Assignee: (was: Apache Spark) > DPP support LIKE ANY/ALL >

[jira] [Commented] (SPARK-34436) DPP support LIKE ANY/ALL

[ https://issues.apache.org/jira/browse/SPARK-34436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284414#comment-17284414 ] Apache Spark commented on SPARK-34436: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34436) DPP support LIKE ANY/ALL

[ https://issues.apache.org/jira/browse/SPARK-34436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34436: Assignee: Apache Spark > DPP support LIKE ANY/ALL > > >

[jira] [Created] (SPARK-34436) DPP support LIKE ANY/ALL

Yuming Wang created SPARK-34436: --- Summary: DPP support LIKE ANY/ALL Key: SPARK-34436 URL: https://issues.apache.org/jira/browse/SPARK-34436 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-34435) ArrayIndexOutOfBoundsException when select in different case

[ https://issues.apache.org/jira/browse/SPARK-34435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enver Osmanov updated SPARK-34435: -- Description: h5. Actual behavior: Select column with different case after remapping fail

[jira] [Updated] (SPARK-34435) ArrayIndexOutOfBoundsException when select in different case

[ https://issues.apache.org/jira/browse/SPARK-34435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enver Osmanov updated SPARK-34435: -- Description: h5. Actual behavior: Select column with different case after remapping fail

[jira] [Updated] (SPARK-34435) ArrayIndexOutOfBoundsException when select in different case

[ https://issues.apache.org/jira/browse/SPARK-34435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enver Osmanov updated SPARK-34435: -- Description: h5. Actual behavior: Select column with different case after remapping fail

[jira] [Updated] (SPARK-34435) ArrayIndexOutOfBoundsException when select in different case

[ https://issues.apache.org/jira/browse/SPARK-34435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enver Osmanov updated SPARK-34435: -- Description: h5. Actual behavior: Select column with different case after remapping fail

[jira] [Created] (SPARK-34435) ArrayIndexOutOfBoundsException when select in different case

Enver Osmanov created SPARK-34435: - Summary: ArrayIndexOutOfBoundsException when select in different case Key: SPARK-34435 URL: https://issues.apache.org/jira/browse/SPARK-34435 Project: Spark

[jira] [Updated] (SPARK-34435) ArrayIndexOutOfBoundsException when select in different case

[ https://issues.apache.org/jira/browse/SPARK-34435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enver Osmanov updated SPARK-34435: -- Description: Actual behavior: Select column with different case after remapping fail with

[jira] [Updated] (SPARK-34435) ArrayIndexOutOfBoundsException when select in different case

[ https://issues.apache.org/jira/browse/SPARK-34435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enver Osmanov updated SPARK-34435: -- Environment: (was: Actual behavior: Select column with different case after remapping fail

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284381#comment-17284381 ] L. C. Hsieh commented on SPARK-34198: - I'd tend to take as the baseline from

[jira] [Commented] (SPARK-34434) Mention DS rebase options in SparkUpgradeException

[ https://issues.apache.org/jira/browse/SPARK-34434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284371#comment-17284371 ] Apache Spark commented on SPARK-34434: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34434) Mention DS rebase options in SparkUpgradeException

[ https://issues.apache.org/jira/browse/SPARK-34434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284370#comment-17284370 ] Apache Spark commented on SPARK-34434: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34434) Mention DS rebase options in SparkUpgradeException

[ https://issues.apache.org/jira/browse/SPARK-34434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34434: Assignee: Apache Spark > Mention DS rebase options in SparkUpgradeException >

[jira] [Assigned] (SPARK-34434) Mention DS rebase options in SparkUpgradeException

[ https://issues.apache.org/jira/browse/SPARK-34434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34434: Assignee: (was: Apache Spark) > Mention DS rebase options in SparkUpgradeException

[jira] [Commented] (SPARK-34427) Session window support in SS

[ https://issues.apache.org/jira/browse/SPARK-34427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284368#comment-17284368 ] L. C. Hsieh commented on SPARK-34427: - Please check the JIRA history and I don't think this is

[jira] [Created] (SPARK-34434) Mention DS rebase options in SparkUpgradeException

Maxim Gekk created SPARK-34434: -- Summary: Mention DS rebase options in SparkUpgradeException Key: SPARK-34434 URL: https://issues.apache.org/jira/browse/SPARK-34434 Project: Spark Issue Type: