[jira] [Created] (SPARK-33599) Group exception messages in catalyst/analysis

2020-11-29 Thread Allison Wang (Jira)
Allison Wang created SPARK-33599: Summary: Group exception messages in catalyst/analysis Key: SPARK-33599 URL: https://issues.apache.org/jira/browse/SPARK-33599 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33542) Group exception messages in catalyst/catalog

2020-11-29 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33542: - Description: Group all exception messages in `catalyst/catalog`. ||Filename||Count||

[jira] [Assigned] (SPARK-33597) Support REGEXP_LIKE for consistent with mainstream databases

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33597: Assignee: Apache Spark > Support REGEXP_LIKE for consistent with mainstream databases >

[jira] [Assigned] (SPARK-33597) Support REGEXP_LIKE for consistent with mainstream databases

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33597: Assignee: (was: Apache Spark) > Support REGEXP_LIKE for consistent with mainstream

[jira] [Commented] (SPARK-33597) Support REGEXP_LIKE for consistent with mainstream databases

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240530#comment-17240530 ] Apache Spark commented on SPARK-33597: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-33597) Support REGEXP_LIKE for consistent with mainstream databases

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240531#comment-17240531 ] Apache Spark commented on SPARK-33597: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-33598) Support Java Class with circular references

2020-11-29 Thread jacklzg (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacklzg updated SPARK-33598: Description: If the target Java data class has a circular reference, Spark will fail fast from creating

[jira] [Updated] (SPARK-33598) Support Java Class with circular references

2020-11-29 Thread jacklzg (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacklzg updated SPARK-33598: Description: If the target Java data class has a circular reference, Spark will fail fast from creating

[jira] [Created] (SPARK-33598) Support Java Class with circular references

2020-11-29 Thread jacklzg (Jira)
jacklzg created SPARK-33598: --- Summary: Support Java Class with circular references Key: SPARK-33598 URL: https://issues.apache.org/jira/browse/SPARK-33598 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-33597) Support REGEXP_LIKE for consistent with mainstream databases

2020-11-29 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33597: -- Summary: Support REGEXP_LIKE for consistent with mainstream databases Key: SPARK-33597 URL: https://issues.apache.org/jira/browse/SPARK-33597 Project: Spark

[jira] [Created] (SPARK-33596) NPE when there is no EventTime

2020-11-29 Thread Genmao Yu (Jira)
Genmao Yu created SPARK-33596: - Summary: NPE when there is no EventTime Key: SPARK-33596 URL: https://issues.apache.org/jira/browse/SPARK-33596 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-28325) Support ANSI SQL:SIMILAR TO ... ESCAPE syntax

2020-11-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-28325: --- Description: {code:java} ::= ::= [ NOT ] SIMILAR TO [ ESCAPE ] ::= ::= | ::= |

[jira] [Commented] (SPARK-28506) not handling usage of group function and window function at some conditions

2020-11-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240505#comment-17240505 ] jiaan.geng commented on SPARK-28506: I runed the similar sql show below: {code:java} SELECT

[jira] [Resolved] (SPARK-33595) Run PySpark coverage only in the master branch

2020-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33595. -- Resolution: Invalid Resolved by setting Jenkins environment variables. > Run PySpark

[jira] [Comment Edited] (SPARK-29638) Spark handles 'NaN' as 0 in sums

2020-11-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240498#comment-17240498 ] jiaan.geng edited comment on SPARK-29638 at 11/30/20, 6:18 AM: --- I runed

[jira] [Commented] (SPARK-29638) Spark handles 'NaN' as 0 in sums

2020-11-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240498#comment-17240498 ] jiaan.geng commented on SPARK-29638: {code:java} SELECT a, b, SUM(b) OVER(ORDER BY A ROWS

[jira] [Updated] (SPARK-33595) Run PySpark coverage only in the master branch

2020-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33595: - Issue Type: Test (was: Improvement) > Run PySpark coverage only in the master branch >

[jira] [Created] (SPARK-33595) Run PySpark coverage only in the master branch

2020-11-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-33595: Summary: Run PySpark coverage only in the master branch Key: SPARK-33595 URL: https://issues.apache.org/jira/browse/SPARK-33595 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-33448) Support CACHE/UNCACHE TABLE for v2 tables

2020-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33448. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30403

[jira] [Assigned] (SPARK-33448) Support CACHE/UNCACHE TABLE for v2 tables

2020-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33448: --- Assignee: Terry Kim > Support CACHE/UNCACHE TABLE for v2 tables >

[jira] [Resolved] (SPARK-32976) Support column list in INSERT statement

2020-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32976. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29893

[jira] [Assigned] (SPARK-32976) Support column list in INSERT statement

2020-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32976: --- Assignee: Kent Yao > Support column list in INSERT statement >

[jira] [Assigned] (SPARK-33567) DSv2: Use callback instead of passing Spark session and v2 relation for refreshing cache

2020-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33567: --- Assignee: Chao Sun > DSv2: Use callback instead of passing Spark session and v2 relation

[jira] [Resolved] (SPARK-33567) DSv2: Use callback instead of passing Spark session and v2 relation for refreshing cache

2020-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33567. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30491

[jira] [Updated] (SPARK-33592) Pyspark ML Validator params in estimatorParamMaps may be lost after saving and reloading

2020-11-29 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-33592: --- Summary: Pyspark ML Validator params in estimatorParamMaps may be lost after saving and reloading

[jira] [Assigned] (SPARK-33594) Forbid binary type as partition column

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33594: Assignee: (was: Apache Spark) > Forbid binary type as partition column >

[jira] [Assigned] (SPARK-33594) Forbid binary type as partition column

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33594: Assignee: Apache Spark > Forbid binary type as partition column >

[jira] [Commented] (SPARK-33594) Forbid binary type as partition column

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240467#comment-17240467 ] Apache Spark commented on SPARK-33594: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-33594) Forbid binary type as partition column

2020-11-29 Thread angerszhu (Jira)
angerszhu created SPARK-33594: - Summary: Forbid binary type as partition column Key: SPARK-33594 URL: https://issues.apache.org/jira/browse/SPARK-33594 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-28646) Allow usage of `count` only for parameterless aggregate function

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28646: Assignee: Apache Spark > Allow usage of `count` only for parameterless aggregate

[jira] [Commented] (SPARK-28646) Allow usage of `count` only for parameterless aggregate function

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240455#comment-17240455 ] Apache Spark commented on SPARK-28646: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

2020-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240456#comment-17240456 ] Hyukjin Kwon commented on SPARK-33571: -- cc [~maxgekk] FYI > Handling of hybrid to proleptic

[jira] [Assigned] (SPARK-28646) Allow usage of `count` only for parameterless aggregate function

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28646: Assignee: Apache Spark > Allow usage of `count` only for parameterless aggregate

[jira] [Assigned] (SPARK-28646) Allow usage of `count` only for parameterless aggregate function

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28646: Assignee: (was: Apache Spark) > Allow usage of `count` only for parameterless

[jira] [Commented] (SPARK-33593) Parquet vector reader incorrect with binary partition value

2020-11-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240454#comment-17240454 ] angerszhu commented on SPARK-33593: --- raise a pr soon > Parquet vector reader incorrect with binary

[jira] [Created] (SPARK-33593) Parquet vector reader incorrect with binary partition value

2020-11-29 Thread angerszhu (Jira)
angerszhu created SPARK-33593: - Summary: Parquet vector reader incorrect with binary partition value Key: SPARK-33593 URL: https://issues.apache.org/jira/browse/SPARK-33593 Project: Spark Issue

[jira] [Commented] (SPARK-33572) Datetime building should fail if the year, month, ..., second combination is invalid

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240453#comment-17240453 ] Apache Spark commented on SPARK-33572: -- User 'waitinfuture' has created a pull request for this

[jira] [Assigned] (SPARK-33572) Datetime building should fail if the year, month, ..., second combination is invalid

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33572: Assignee: (was: Apache Spark) > Datetime building should fail if the year, month,

[jira] [Commented] (SPARK-33572) Datetime building should fail if the year, month, ..., second combination is invalid

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240452#comment-17240452 ] Apache Spark commented on SPARK-33572: -- User 'waitinfuture' has created a pull request for this

[jira] [Assigned] (SPARK-33572) Datetime building should fail if the year, month, ..., second combination is invalid

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33572: Assignee: Apache Spark > Datetime building should fail if the year, month, ..., second

[jira] [Issue Comment Deleted] (SPARK-33498) Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

2020-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33498: - Comment: was deleted (was: User 'leanken' has created a pull request for this issue:

[jira] [Commented] (SPARK-33576) PythonException: An exception was thrown from a UDF: 'OSError: Invalid IPC message: negative bodyLength'.

2020-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240451#comment-17240451 ] Hyukjin Kwon commented on SPARK-33576: -- - Are you able to provide the full reproducer with smaller

[jira] [Commented] (SPARK-33498) Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240449#comment-17240449 ] Apache Spark commented on SPARK-33498: -- User 'leanken' has created a pull request for this issue:

[jira] [Commented] (SPARK-33592) Pyspark ML Validator writer may lost params in estimatorParamMaps

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240435#comment-17240435 ] Apache Spark commented on SPARK-33592: -- User 'WeichenXu123' has created a pull request for this

[jira] [Commented] (SPARK-33592) Pyspark ML Validator writer may lost params in estimatorParamMaps

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240436#comment-17240436 ] Apache Spark commented on SPARK-33592: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-33592) Pyspark ML Validator writer may lost params in estimatorParamMaps

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33592: Assignee: Weichen Xu (was: Apache Spark) > Pyspark ML Validator writer may lost params

[jira] [Assigned] (SPARK-33592) Pyspark ML Validator writer may lost params in estimatorParamMaps

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33592: Assignee: Apache Spark (was: Weichen Xu) > Pyspark ML Validator writer may lost params

[jira] [Resolved] (SPARK-33582) Partition predicate pushdown into Hive metastore support not-equals

2020-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33582. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30534

[jira] [Assigned] (SPARK-33589) Close opened session if the initialization fails

2020-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33589: Assignee: Yuming Wang > Close opened session if the initialization fails >

[jira] [Resolved] (SPARK-33589) Close opened session if the initialization fails

2020-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33589. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30536

[jira] [Resolved] (SPARK-33578) enableHiveSupport is invalid after sparkContext that without hive support created

2020-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33578. -- Resolution: Won't Fix > enableHiveSupport is invalid after sparkContext that without hive

[jira] [Updated] (SPARK-33589) Close opened session if the initialization fails

2020-11-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33589: Summary: Close opened session if the initialization fails (was: Add try catch when opening

[jira] [Updated] (SPARK-33592) Pyspark ML Validator writer may lost params in estimatorParamMaps

2020-11-29 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-33592: --- Description: Two typical cases to reproduce it: (1) {code:python} tokenizer =

[jira] [Assigned] (SPARK-33592) Pyspark ML Validator writer may lost params in estimatorParamMaps

2020-11-29 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-33592: -- Assignee: Weichen Xu > Pyspark ML Validator writer may lost params in estimatorParamMaps >

[jira] [Updated] (SPARK-33592) Pyspark ML Validator writer may lost params in estimatorParamMaps

2020-11-29 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-33592: --- Description: Two typical cases to reproduce it: (1) {code:python} tokenizer =

[jira] [Created] (SPARK-33592) Pyspark ML Validator writer may lost params in estimatorParamMaps

2020-11-29 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-33592: -- Summary: Pyspark ML Validator writer may lost params in estimatorParamMaps Key: SPARK-33592 URL: https://issues.apache.org/jira/browse/SPARK-33592 Project: Spark

[jira] [Assigned] (SPARK-33517) Incorrect menu item display and link in PySpark Usage Guide for Pandas with Apache Arrow

2020-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33517: Assignee: liucht-inspur (was: Apache Spark) > Incorrect menu item display and link in

[jira] [Assigned] (SPARK-33517) Incorrect menu item display and link in PySpark Usage Guide for Pandas with Apache Arrow

2020-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33517: Assignee: Apache Spark > Incorrect menu item display and link in PySpark Usage Guide for

[jira] [Resolved] (SPARK-33517) Incorrect menu item display and link in PySpark Usage Guide for Pandas with Apache Arrow

2020-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33517. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30466

[jira] [Resolved] (SPARK-33585) The comment for SQLContext.tables() doesn't mention the `database` column

2020-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33585. --- Fix Version/s: 2.4.8 3.0.2 3.1.0 Resolution:

[jira] [Assigned] (SPARK-33585) The comment for SQLContext.tables() doesn't mention the `database` column

2020-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33585: - Assignee: Maxim Gekk > The comment for SQLContext.tables() doesn't mention the

[jira] [Resolved] (SPARK-33588) Partition spec in SHOW TABLE EXTENDED doesn't respect `spark.sql.caseSensitive`

2020-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33588. --- Fix Version/s: 3.1.0 Assignee: Maxim Gekk Resolution: Fixed This is

[jira] [Updated] (SPARK-33588) Partition spec in SHOW TABLE EXTENDED doesn't respect `spark.sql.caseSensitive`

2020-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33588: -- Affects Version/s: (was: 3.0.2) (was: 2.4.8)

[jira] [Assigned] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33591: Assignee: Apache Spark > NULL is recognized as the "null" string in partition specs >

[jira] [Commented] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240356#comment-17240356 ] Apache Spark commented on SPARK-33591: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33591: Assignee: (was: Apache Spark) > NULL is recognized as the "null" string in partition

[jira] [Assigned] (SPARK-33587) Kill the executor on nested fatal errors

2020-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33587: - Assignee: Shixiong Zhu > Kill the executor on nested fatal errors >

[jira] [Resolved] (SPARK-33587) Kill the executor on nested fatal errors

2020-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33587. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30528

[jira] [Updated] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2020-11-29 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33591: --- Issue Type: Bug (was: Improvement) > NULL is recognized as the "null" string in partition specs >

[jira] [Updated] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2020-11-29 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33591: --- Issue Type: Improvement (was: Bug) > NULL is recognized as the "null" string in partition specs >

[jira] [Created] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2020-11-29 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33591: -- Summary: NULL is recognized as the "null" string in partition specs Key: SPARK-33591 URL: https://issues.apache.org/jira/browse/SPARK-33591 Project: Spark Issue

[jira] [Assigned] (SPARK-33590) Missing submenus for Performance Tuning in Spark SQL Guide

2020-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33590: - Assignee: Kazuaki Ishizaki > Missing submenus for Performance Tuning in Spark SQL

[jira] [Resolved] (SPARK-33590) Missing submenus for Performance Tuning in Spark SQL Guide

2020-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33590. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30537

[jira] [Updated] (SPARK-33531) [SQL] Reduce shuffle task number when calling CollectLimitExec#executeToIterator

2020-11-29 Thread Mori[A]rty (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mori[A]rty updated SPARK-33531: --- Description: Currently, when invoking CollectLimitExec#executeToIterator, a single-partition

[jira] [Updated] (SPARK-33531) [SQL] Reduce shuffle task number when calling CollectLimitExec#executeToIterator

2020-11-29 Thread Mori[A]rty (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mori[A]rty updated SPARK-33531: --- Summary: [SQL] Reduce shuffle task number when calling CollectLimitExec#executeToIterator (was:

[jira] [Commented] (SPARK-33590) Missing submenus for Performance Tuning in Spark SQL Guide

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240284#comment-17240284 ] Apache Spark commented on SPARK-33590: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33590) Missing submenus for Performance Tuning in Spark SQL Guide

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33590: Assignee: (was: Apache Spark) > Missing submenus for Performance Tuning in Spark SQL

[jira] [Commented] (SPARK-33590) Missing submenus for Performance Tuning in Spark SQL Guide

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240282#comment-17240282 ] Apache Spark commented on SPARK-33590: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33590) Missing submenus for Performance Tuning in Spark SQL Guide

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33590: Assignee: Apache Spark > Missing submenus for Performance Tuning in Spark SQL Guide >

[jira] [Created] (SPARK-33590) Missing submenus for Performance Tuning in Spark SQL Guide

2020-11-29 Thread Kazuaki Ishizaki (Jira)
Kazuaki Ishizaki created SPARK-33590: Summary: Missing submenus for Performance Tuning in Spark SQL Guide Key: SPARK-33590 URL: https://issues.apache.org/jira/browse/SPARK-33590 Project: Spark

[jira] [Updated] (SPARK-33590) Missing submenus for Performance Tuning in Spark SQL Guide

2020-11-29 Thread Kazuaki Ishizaki (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-33590: - Attachment: image-2020-11-30-00-04-07-969.png > Missing submenus for Performance Tuning

[jira] [Updated] (SPARK-33590) Missing submenus for Performance Tuning in Spark SQL Guide

2020-11-29 Thread Kazuaki Ishizaki (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-33590: - Description: Sub-menus for \{Coalesce Hints for SQL Queries} and {Adaptive Query

[jira] [Commented] (SPARK-33589) Add try catch when opening session

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240260#comment-17240260 ] Apache Spark commented on SPARK-33589: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-33589) Add try catch when opening session

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240259#comment-17240259 ] Apache Spark commented on SPARK-33589: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33589) Add try catch when opening session

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33589: Assignee: (was: Apache Spark) > Add try catch when opening session >

[jira] [Assigned] (SPARK-33589) Add try catch when opening session

2020-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33589: Assignee: Apache Spark > Add try catch when opening session >

[jira] [Created] (SPARK-33589) Add try catch when opening session

2020-11-29 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33589: --- Summary: Add try catch when opening session Key: SPARK-33589 URL: https://issues.apache.org/jira/browse/SPARK-33589 Project: Spark Issue Type: Bug