[jira] [Comment Edited] (SPARK-29890) Unable to fill na with 0 with duplicate columns

2021-01-17 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267059#comment-17267059 ] Peter Toth edited comment on SPARK-29890 at 1/18/21, 7:57 AM: -- [~imback82],

[jira] [Commented] (SPARK-29890) Unable to fill na with 0 with duplicate columns

2021-01-17 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267059#comment-17267059 ] Peter Toth commented on SPARK-29890: [~imback82], yes, that's a good example. `fill` didn't throw

[jira] [Created] (SPARK-34150) Strip Null literal.sql in resolve alias

2021-01-17 Thread ulysses you (Jira)
ulysses you created SPARK-34150: --- Summary: Strip Null literal.sql in resolve alias Key: SPARK-34150 URL: https://issues.apache.org/jira/browse/SPARK-34150 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34149) DSv2: `ALTER TABLE .. ADD PARTITION` does not refresh table cache

2021-01-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34149: --- Description: For example, the test below: {code:scala} test("SPARK-X: refresh cache in

[jira] [Created] (SPARK-34149) DSv2: `ALTER TABLE .. ADD PARTITION` does not refresh table cache

2021-01-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34149: -- Summary: DSv2: `ALTER TABLE .. ADD PARTITION` does not refresh table cache Key: SPARK-34149 URL: https://issues.apache.org/jira/browse/SPARK-34149 Project: Spark

[jira] [Commented] (SPARK-34064) Broadcast job is not aborted even the SQL statement canceled

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267055#comment-17267055 ] Apache Spark commented on SPARK-34064: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Updated] (SPARK-33354) New explicit cast syntax rules in ANSI mode

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33354: - Fix Version/s: (was: 3.1.1) 3.1.0 > New explicit cast syntax rules in

[jira] [Updated] (SPARK-33354) New explicit cast syntax rules in ANSI mode

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33354: - Fix Version/s: (was: 3.1.0) 3.1.1 > New explicit cast syntax rules in

[jira] [Updated] (SPARK-33819) SingleFileEventLogFileReader/RollingEventLogFilesFileReader should be `package private`

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33819: - Fix Version/s: (was: 3.1.0) 3.1.1 >

[jira] [Updated] (SPARK-34069) Kill barrier tasks should respect SPARK_JOB_INTERRUPT_ON_CANCEL

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34069: - Fix Version/s: (was: 3.1.0) 3.1.1 > Kill barrier tasks should respect

[jira] [Updated] (SPARK-34103) Fix MiMaExcludes by moving SPARK-23429 from 2.4.x to 3.0.x

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34103: - Fix Version/s: (was: 3.1.0) 3.1.1 > Fix MiMaExcludes by moving

[jira] [Updated] (SPARK-34041) Miscellaneous cleanup for new PySpark documentation

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34041: - Fix Version/s: (was: 3.1.0) 3.1.1 > Miscellaneous cleanup for new

[jira] [Updated] (SPARK-33100) Support parse the sql statements with c-style comments

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33100: - Fix Version/s: (was: 3.1.0) 3.1.1 > Support parse the sql statements

[jira] [Updated] (SPARK-33796) Show hidden text from the left menu of Spark Doc

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33796: - Fix Version/s: (was: 3.1.0) 3.1.1 > Show hidden text from the left menu

[jira] [Updated] (SPARK-30681) Add higher order functions API to PySpark

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30681: - Fix Version/s: (was: 3.1.1) 3.1.0 > Add higher order functions API to

[jira] [Updated] (SPARK-30681) Add higher order functions API to PySpark

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30681: - Fix Version/s: (was: 3.1.0) 3.1.1 > Add higher order functions API to

[jira] [Updated] (SPARK-34021) Fix hyper links in SparkR documentation for CRAN submission

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34021: - Fix Version/s: (was: 3.1.0) 3.1.1 > Fix hyper links in SparkR

[jira] [Resolved] (SPARK-34139) UnresolvedRelation should retain SQL text position

2021-01-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34139. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31209

[jira] [Assigned] (SPARK-34139) UnresolvedRelation should retain SQL text position

2021-01-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34139: --- Assignee: Terry Kim > UnresolvedRelation should retain SQL text position >

[jira] [Assigned] (SPARK-33696) Upgrade built-in Hive to 2.3.8

2021-01-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33696: - Assignee: Yuming Wang > Upgrade built-in Hive to 2.3.8 >

[jira] [Resolved] (SPARK-33696) Upgrade built-in Hive to 2.3.8

2021-01-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33696. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30657

[jira] [Commented] (SPARK-33913) Upgrade Kafka to 2.7.0

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267028#comment-17267028 ] Apache Spark commented on SPARK-33913: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33913) Upgrade Kafka to 2.7.0

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267027#comment-17267027 ] Apache Spark commented on SPARK-33913: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-30682) Add higher order functions API to SparkR

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266998#comment-17266998 ] Apache Spark commented on SPARK-30682: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-30682) Add higher order functions API to SparkR

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266997#comment-17266997 ] Apache Spark commented on SPARK-30682: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-33819) SingleFileEventLogFileReader/RollingEventLogFilesFileReader should be `package private`

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266989#comment-17266989 ] Apache Spark commented on SPARK-33819: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-33819) SingleFileEventLogFileReader/RollingEventLogFilesFileReader should be `package private`

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266988#comment-17266988 ] Apache Spark commented on SPARK-33819: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-33819) SingleFileEventLogFileReader/RollingEventLogFilesFileReader should be `package private`

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266987#comment-17266987 ] Apache Spark commented on SPARK-33819: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Updated] (SPARK-31168) Upgrade Scala to 2.12.13

2021-01-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31168: -- Parent: SPARK-33772 Issue Type: Sub-task (was: Improvement) > Upgrade Scala to

[jira] [Commented] (SPARK-29890) Unable to fill na with 0 with duplicate columns

2021-01-17 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266970#comment-17266970 ] Terry Kim commented on SPARK-29890: --- [~petertoth] Could you share the example and the behavior change?

[jira] [Commented] (SPARK-31168) Upgrade Scala to 2.12.13

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266969#comment-17266969 ] Apache Spark commented on SPARK-31168: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-31168) Upgrade Scala to 2.12.13

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266968#comment-17266968 ] Apache Spark commented on SPARK-31168: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-34080) Add UnivariateFeatureSelector to deprecate existing selectors

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266966#comment-17266966 ] Apache Spark commented on SPARK-34080: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-34080) Add UnivariateFeatureSelector to deprecate existing selectors

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266964#comment-17266964 ] Apache Spark commented on SPARK-34080: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-34142) Support Fallback Storage Cleanup during stopping SparkContext

2021-01-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34142: - Assignee: Dongjoon Hyun > Support Fallback Storage Cleanup during stopping

[jira] [Resolved] (SPARK-34142) Support Fallback Storage Cleanup during stopping SparkContext

2021-01-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34142. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31215

[jira] [Resolved] (SPARK-33730) Standardize warning types

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33730. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30985

[jira] [Resolved] (SPARK-34125) Make EventLoggingListener.codecMap thread-safe

2021-01-17 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-34125. -- Fix Version/s: 2.4.8 Resolution: Fixed Issue resolved by pull request 31194

[jira] [Assigned] (SPARK-34125) Make EventLoggingListener.codecMap thread-safe

2021-01-17 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-34125: Assignee: dzcxzl > Make EventLoggingListener.codecMap thread-safe >

[jira] [Commented] (SPARK-34148) Move general StateStore tests to StateStoreSuiteBase

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266938#comment-17266938 ] Apache Spark commented on SPARK-34148: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34148) Move general StateStore tests to StateStoreSuiteBase

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34148: Assignee: Apache Spark (was: L. C. Hsieh) > Move general StateStore tests to

[jira] [Assigned] (SPARK-34148) Move general StateStore tests to StateStoreSuiteBase

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34148: Assignee: L. C. Hsieh (was: Apache Spark) > Move general StateStore tests to

[jira] [Commented] (SPARK-34148) Move general StateStore tests to StateStoreSuiteBase

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266937#comment-17266937 ] Apache Spark commented on SPARK-34148: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-34148) Move general StateStore tests to StateStoreSuiteBase

2021-01-17 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-34148: --- Summary: Move general StateStore tests to StateStoreSuiteBase Key: SPARK-34148 URL: https://issues.apache.org/jira/browse/SPARK-34148 Project: Spark Issue

[jira] [Resolved] (SPARK-34123) Faster way to display/render entries in HistoryPage (Spark history server summary page)

2021-01-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34123. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31191

[jira] [Assigned] (SPARK-34123) Faster way to display/render entries in HistoryPage (Spark history server summary page)

2021-01-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34123: Assignee: Mohanad Elsafty > Faster way to display/render entries in HistoryPage (Spark

[jira] [Commented] (SPARK-34147) Keep data partitioning in TPCDSQueryBenchmark when CBO is enabled

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266889#comment-17266889 ] Apache Spark commented on SPARK-34147: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-34147) Keep data partitioning in TPCDSQueryBenchmark when CBO is enabled

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34147: Assignee: (was: Apache Spark) > Keep data partitioning in TPCDSQueryBenchmark when

[jira] [Assigned] (SPARK-34147) Keep data partitioning in TPCDSQueryBenchmark when CBO is enabled

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34147: Assignee: Apache Spark > Keep data partitioning in TPCDSQueryBenchmark when CBO is

[jira] [Commented] (SPARK-34147) Keep data partitioning in TPCDSQueryBenchmark when CBO is enabled

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266888#comment-17266888 ] Apache Spark commented on SPARK-34147: -- User 'peter-toth' has created a pull request for this

[jira] [Created] (SPARK-34147) Keep data partitioning in TPCDSQueryBenchmark when CBO is enabled

2021-01-17 Thread Peter Toth (Jira)
Peter Toth created SPARK-34147: -- Summary: Keep data partitioning in TPCDSQueryBenchmark when CBO is enabled Key: SPARK-34147 URL: https://issues.apache.org/jira/browse/SPARK-34147 Project: Spark

[jira] [Commented] (SPARK-34146) "*" should not throw Exception in SparkGetSchemasOperation

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266848#comment-17266848 ] Apache Spark commented on SPARK-34146: -- User 'pan3793' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34146) "*" should not throw Exception in SparkGetSchemasOperation

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34146: Assignee: (was: Apache Spark) > "*" should not throw Exception in

[jira] [Commented] (SPARK-34146) "*" should not throw Exception in SparkGetSchemasOperation

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266847#comment-17266847 ] Apache Spark commented on SPARK-34146: -- User 'pan3793' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34146) "*" should not throw Exception in SparkGetSchemasOperation

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34146: Assignee: Apache Spark > "*" should not throw Exception in SparkGetSchemasOperation >

[jira] [Updated] (SPARK-34146) "*" should not crash in SparkGetSchemasOperation

2021-01-17 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan updated SPARK-34146: -- Description: HiveServer2 treat "*" as list all databases, but spark will throw `Exception` when

[jira] [Updated] (SPARK-34146) "*" should not throw Exception in SparkGetSchemasOperation

2021-01-17 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan updated SPARK-34146: -- Summary: "*" should not throw Exception in SparkGetSchemasOperation (was: "*" should not crash in

[jira] [Updated] (SPARK-34146) "*" should not crash in SparkGetSchemasOperation

2021-01-17 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan updated SPARK-34146: -- Description: HiveServer2 treat "*" as list all databases, but spark will crashed when handle global

[jira] [Created] (SPARK-34146) "*" should not crash in SparkGetSchemasOperation

2021-01-17 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-34146: - Summary: "*" should not crash in SparkGetSchemasOperation Key: SPARK-34146 URL: https://issues.apache.org/jira/browse/SPARK-34146 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-34145) Combine scalar subqueries

2021-01-17 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-34145: --- Summary: Combine scalar subqueries Key: SPARK-34145 URL: https://issues.apache.org/jira/browse/SPARK-34145 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-34144) java.time.Instant and java.time.LocalDate not handled when writing to tables

2021-01-17 Thread Cristi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cristi updated SPARK-34144: --- Summary: java.time.Instant and java.time.LocalDate not handled when writing to tables (was:

[jira] [Updated] (SPARK-34144) java.time.Instant and java.time.LocalDate not handled not handled when writing to tables

2021-01-17 Thread Cristi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cristi updated SPARK-34144: --- Description: When using the new java time API (spark.sql.datetime.java8API.enabled=true) LocalDate and

[jira] [Commented] (SPARK-34115) Long runtime on many environment variables

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266764#comment-17266764 ] Hyukjin Kwon commented on SPARK-34115: -- I think you can try and see if it works when we switch

[jira] [Created] (SPARK-34144) java.time.Instant and java.time.LocalDate not handled not handled when writing to tables

2021-01-17 Thread Cristi (Jira)
Cristi created SPARK-34144: -- Summary: java.time.Instant and java.time.LocalDate not handled not handled when writing to tables Key: SPARK-34144 URL: https://issues.apache.org/jira/browse/SPARK-34144

[jira] [Commented] (SPARK-34121) Intersect operator missing rowCount when CBO enabled

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266763#comment-17266763 ] Hyukjin Kwon commented on SPARK-34121: -- [~yumwang] mind filling the PR description? > Intersect

[jira] [Commented] (SPARK-34126) SQL running error, spark does not exit, resulting in data quality problems

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266762#comment-17266762 ] Hyukjin Kwon commented on SPARK-34126: -- [~shikui] can you provide a self-contained reproducible

[jira] [Commented] (SPARK-34131) NPE when driver.podTemplateFile defines no containers

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266760#comment-17266760 ] Hyukjin Kwon commented on SPARK-34131: -- cc [~holdenkarau] and [~dongjoon] FYI > NPE when

[jira] [Resolved] (SPARK-33245) Add built-in UDF - GETBIT

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33245. -- Resolution: Won't Fix > Add built-in UDF - GETBIT > -- > >

[jira] [Commented] (SPARK-34143) Adding partitions to fully partitioned v2 table

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266742#comment-17266742 ] Apache Spark commented on SPARK-34143: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34143) Adding partitions to fully partitioned v2 table

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266741#comment-17266741 ] Apache Spark commented on SPARK-34143: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34143) Adding partitions to fully partitioned v2 table

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34143: Assignee: (was: Apache Spark) > Adding partitions to fully partitioned v2 table >

[jira] [Assigned] (SPARK-34143) Adding partitions to fully partitioned v2 table

2021-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34143: Assignee: Apache Spark > Adding partitions to fully partitioned v2 table >

[jira] [Created] (SPARK-34143) Adding partitions to fully partitioned v2 table

2021-01-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34143: -- Summary: Adding partitions to fully partitioned v2 table Key: SPARK-34143 URL: https://issues.apache.org/jira/browse/SPARK-34143 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-34111) Deconflict the jars jakarta.servlet-api-4.0.3.jar and javax.servlet-api-3.1.0.jar

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34111: Assignee: Kent Yao > Deconflict the jars jakarta.servlet-api-4.0.3.jar and >

[jira] [Updated] (SPARK-34111) Deconflict the jars jakarta.servlet-api-4.0.3.jar and javax.servlet-api-3.1.0.jar

2021-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34111: - Priority: Critical (was: Blocker) > Deconflict the jars jakarta.servlet-api-4.0.3.jar and >