[jira] [Updated] (SPARK-37004) Job cancellation causes py4j errors on Jupyter due to pinned thread mode

2021-10-13 Thread Xiangrui Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-37004: -- Description: Spark 3.2.0 turned on py4j pinned thread mode by default (SPARK-35303).

[jira] [Updated] (SPARK-37004) Job cancellation causes py4j errors on Jupyter due to pinned thread mode

2021-10-13 Thread Xiangrui Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-37004: -- Issue Type: Bug (was: Improvement) > Job cancellation causes py4j errors on Jupyter due to

[jira] [Updated] (SPARK-37004) Job cancellation causes py4j errors on Jupyter due to pinned thread mode

2021-10-13 Thread Xiangrui Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-37004: -- Attachment: pinned.ipynb > Job cancellation causes py4j errors on Jupyter due to pinned

[jira] [Created] (SPARK-37004) Job cancellation causes py4j errors on Jupyter due to pinned thread mode

2021-10-13 Thread Xiangrui Meng (Jira)
Xiangrui Meng created SPARK-37004: - Summary: Job cancellation causes py4j errors on Jupyter due to pinned thread mode Key: SPARK-37004 URL: https://issues.apache.org/jira/browse/SPARK-37004 Project:

[jira] [Assigned] (SPARK-35973) DataSourceV2: Support SHOW CATALOGS

2021-10-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35973: --- Assignee: PengLei > DataSourceV2: Support SHOW CATALOGS >

[jira] [Resolved] (SPARK-35973) DataSourceV2: Support SHOW CATALOGS

2021-10-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35973. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34232

[jira] [Assigned] (SPARK-37003) Merge INSERT related docs

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37003: Assignee: Apache Spark > Merge INSERT related docs > - > >

[jira] [Assigned] (SPARK-37003) Merge INSERT related docs

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37003: Assignee: (was: Apache Spark) > Merge INSERT related docs >

[jira] [Commented] (SPARK-37003) Merge INSERT related docs

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428600#comment-17428600 ] Apache Spark commented on SPARK-37003: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-37002) Introduce the 'compute.check_identical_indices' option

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428599#comment-17428599 ] Apache Spark commented on SPARK-37002: -- User 'dchvn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37002) Introduce the 'compute.check_identical_indices' option

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37002: Assignee: Apache Spark > Introduce the 'compute.check_identical_indices' option >

[jira] [Commented] (SPARK-37002) Introduce the 'compute.check_identical_indices' option

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428598#comment-17428598 ] Apache Spark commented on SPARK-37002: -- User 'dchvn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37002) Introduce the 'compute.check_identical_indices' option

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37002: Assignee: (was: Apache Spark) > Introduce the 'compute.check_identical_indices'

[jira] [Commented] (SPARK-36858) Spark API to apply same function to multiple columns

2021-10-13 Thread Armand BERGES (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428596#comment-17428596 ] Armand BERGES commented on SPARK-36858: --- Honestly, I feel a little dumb to not to have think at it

[jira] [Created] (SPARK-37003) Merge INSERT related docs

2021-10-13 Thread angerszhu (Jira)
angerszhu created SPARK-37003: - Summary: Merge INSERT related docs Key: SPARK-37003 URL: https://issues.apache.org/jira/browse/SPARK-37003 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-37002) Introduce the 'compute.check_identical_indices' option

2021-10-13 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37002: --- Summary: Introduce the 'compute.check_identical_indices' option (was: Introduce the

[jira] [Created] (SPARK-37002) Introduce the 'compute.check_identical_index' option

2021-10-13 Thread dch nguyen (Jira)
dch nguyen created SPARK-37002: -- Summary: Introduce the 'compute.check_identical_index' option Key: SPARK-37002 URL: https://issues.apache.org/jira/browse/SPARK-37002 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36994) Upgrade Apache Thrift

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428581#comment-17428581 ] Apache Spark commented on SPARK-36994: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-36994) Upgrade Apache Thrift

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428579#comment-17428579 ] Apache Spark commented on SPARK-36994: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-36994) Upgrade Apache Thrift

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36994: Assignee: Apache Spark > Upgrade Apache Thrift > - > >

[jira] [Assigned] (SPARK-36994) Upgrade Apache Thrift

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36994: Assignee: (was: Apache Spark) > Upgrade Apache Thrift > - > >

[jira] [Updated] (SPARK-36546) Make unionByName null-filling behavior work with array of struct columns

2021-10-13 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36546: Affects Version/s: (was: 3.1.1) 3.3.0 > Make unionByName null-filling

[jira] [Commented] (SPARK-36984) Misleading Spark Streaming source documentation

2021-10-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428566#comment-17428566 ] Hyukjin Kwon commented on SPARK-36984: -- Yeah we should fix the docs. feel free to edit - we don't

[jira] [Assigned] (SPARK-36546) Make unionByName null-filling behavior work with array of struct columns

2021-10-13 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36546: --- Assignee: Adam Binford > Make unionByName null-filling behavior work with array of struct

[jira] [Resolved] (SPARK-36546) Make unionByName null-filling behavior work with array of struct columns

2021-10-13 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36546. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34246

[jira] [Resolved] (SPARK-36988) What ciphers spark support for internode communication?

2021-10-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36988. -- Resolution: Invalid > What ciphers spark support for internode communication? >

[jira] [Commented] (SPARK-36988) What ciphers spark support for internode communication?

2021-10-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428564#comment-17428564 ] Hyukjin Kwon commented on SPARK-36988: -- For questions, let's interact with Spark mailing list

[jira] [Updated] (SPARK-36999) Document the command ALTER TABLE RECOVER PARTITIONS

2021-10-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36999: - Labels: starter (was: Starter starter) > Document the command ALTER TABLE RECOVER PARTITIONS >

[jira] [Commented] (SPARK-36993) Fix json_tuple throw NPE if fields exist no foldable null value

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428557#comment-17428557 ] Apache Spark commented on SPARK-36993: -- User 'ulysses-you' has created a pull request for this

[jira] [Updated] (SPARK-36646) Push down group by partition column for Aggregate (Min/Max/Count) for Parquet

2021-10-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36646: - Summary: Push down group by partition column for Aggregate (Min/Max/Count) for Parquet (was:

[jira] [Assigned] (SPARK-37001) Disable two level of map for final hash aggregation by default

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37001: Assignee: (was: Apache Spark) > Disable two level of map for final hash aggregation

[jira] [Assigned] (SPARK-37001) Disable two level of map for final hash aggregation by default

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37001: Assignee: Apache Spark > Disable two level of map for final hash aggregation by default

[jira] [Commented] (SPARK-37001) Disable two level of map for final hash aggregation by default

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428529#comment-17428529 ] Apache Spark commented on SPARK-37001: -- User 'c21' has created a pull request for this issue:

[jira] [Created] (SPARK-37001) Disable two level of map for final hash aggregation by default

2021-10-13 Thread Cheng Su (Jira)
Cheng Su created SPARK-37001: Summary: Disable two level of map for final hash aggregation by default Key: SPARK-37001 URL: https://issues.apache.org/jira/browse/SPARK-37001 Project: Spark

[jira] [Resolved] (SPARK-36990) Long columns cannot read columns with INT32 type in the parquet file

2021-10-13 Thread Catalin Toda (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catalin Toda resolved SPARK-36990. -- Resolution: Duplicate > Long columns cannot read columns with INT32 type in the parquet file

[jira] [Assigned] (SPARK-37000) Add type hints to python/pyspark/sql/util.py

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37000: Assignee: (was: Apache Spark) > Add type hints to python/pyspark/sql/util.py >

[jira] [Assigned] (SPARK-37000) Add type hints to python/pyspark/sql/util.py

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37000: Assignee: Apache Spark > Add type hints to python/pyspark/sql/util.py >

[jira] [Commented] (SPARK-37000) Add type hints to python/pyspark/sql/util.py

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428523#comment-17428523 ] Apache Spark commented on SPARK-37000: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37000) Add type hints to python/pyspark/sql/util.py

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37000: Assignee: Apache Spark > Add type hints to python/pyspark/sql/util.py >

[jira] [Commented] (SPARK-37000) Add type hints to python/pyspark/sql/util.py

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428524#comment-17428524 ] Apache Spark commented on SPARK-37000: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-35640) Refactor Parquet vectorized reader to remove duplicated code paths

2021-10-13 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428522#comment-17428522 ] Chao Sun commented on SPARK-35640: -- [~catalinii] this change seems unrelated since it's only in Spark

[jira] [Commented] (SPARK-35640) Refactor Parquet vectorized reader to remove duplicated code paths

2021-10-13 Thread Catalin Toda (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428520#comment-17428520 ] Catalin Toda commented on SPARK-35640: -- I opened https://issues.apache.org/jira/browse/SPARK-36990

[jira] [Updated] (SPARK-37000) Add type hints to python/pyspark/sql/util.py

2021-10-13 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-37000: -- Description: Add type hints for python/pyspark/sql/utils.py. > Add type hints to

[jira] [Created] (SPARK-37000) Add type hints to python/pyspark/sql/util.py

2021-10-13 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-37000: - Summary: Add type hints to python/pyspark/sql/util.py Key: SPARK-37000 URL: https://issues.apache.org/jira/browse/SPARK-37000 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37000) Add type hints to python/pyspark/sql/util.py

2021-10-13 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428475#comment-17428475 ] Takuya Ueshin commented on SPARK-37000: --- I'm working on this. > Add type hints to

[jira] [Resolved] (SPARK-36982) Migrate SHOW NAMESPACES to use V2 command by default

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36982. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34255

[jira] [Assigned] (SPARK-36982) Migrate SHOW NAMESPACES to use V2 command by default

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36982: Assignee: Terry Kim > Migrate SHOW NAMESPACES to use V2 command by default >

[jira] [Assigned] (SPARK-36991) Inline type hints for spark/python/pyspark/sql/streaming.py

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36991: Assignee: (was: Apache Spark) > Inline type hints for

[jira] [Commented] (SPARK-36991) Inline type hints for spark/python/pyspark/sql/streaming.py

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428444#comment-17428444 ] Apache Spark commented on SPARK-36991: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-36991) Inline type hints for spark/python/pyspark/sql/streaming.py

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36991: Assignee: Apache Spark > Inline type hints for spark/python/pyspark/sql/streaming.py >

[jira] [Updated] (SPARK-36999) Document the command ALTER TABLE RECOVER PARTITIONS

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36999: - Labels: Starter starter (was: ) > Document the command ALTER TABLE RECOVER PARTITIONS >

[jira] [Created] (SPARK-36999) Document the command ALTER TABLE RECOVER PARTITIONS

2021-10-13 Thread Max Gekk (Jira)
Max Gekk created SPARK-36999: Summary: Document the command ALTER TABLE RECOVER PARTITIONS Key: SPARK-36999 URL: https://issues.apache.org/jira/browse/SPARK-36999 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36998) Handle concurrent eviction of same application in SHS

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428384#comment-17428384 ] Apache Spark commented on SPARK-36998: -- User 'thejdeep' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36998) Handle concurrent eviction of same application in SHS

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36998: Assignee: Apache Spark > Handle concurrent eviction of same application in SHS >

[jira] [Assigned] (SPARK-36998) Handle concurrent eviction of same application in SHS

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36998: Assignee: (was: Apache Spark) > Handle concurrent eviction of same application in

[jira] [Created] (SPARK-36998) Handle concurrent eviction of same application in SHS

2021-10-13 Thread Thejdeep Gudivada (Jira)
Thejdeep Gudivada created SPARK-36998: - Summary: Handle concurrent eviction of same application in SHS Key: SPARK-36998 URL: https://issues.apache.org/jira/browse/SPARK-36998 Project: Spark

[jira] [Assigned] (SPARK-32161) Hide JVM traceback for SparkUpgradeException

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32161: Assignee: (was: Apache Spark) > Hide JVM traceback for SparkUpgradeException >

[jira] [Assigned] (SPARK-32161) Hide JVM traceback for SparkUpgradeException

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32161: Assignee: Apache Spark > Hide JVM traceback for SparkUpgradeException >

[jira] [Commented] (SPARK-32161) Hide JVM traceback for SparkUpgradeException

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428345#comment-17428345 ] Apache Spark commented on SPARK-32161: -- User 'pralabhkumar' has created a pull request for this

[jira] [Updated] (SPARK-36993) Fix json_tuple throw NPE if fields exist no foldable null value

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36993: - Fix Version/s: (was: 3.2.0) 3.2.1 > Fix json_tuple throw NPE if fields exist no

[jira] [Updated] (SPARK-36993) Fix json_tuple throw NPE if fields exist no foldable null value

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36993: - Fix Version/s: 3.3.0 > Fix json_tuple throw NPE if fields exist no foldable null value >

[jira] [Resolved] (SPARK-36949) Fix CREATE TABLE AS SELECT of ANSI intervals

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36949. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34259

[jira] [Assigned] (SPARK-36949) Fix CREATE TABLE AS SELECT of ANSI intervals

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36949: Assignee: Max Gekk > Fix CREATE TABLE AS SELECT of ANSI intervals >

[jira] [Resolved] (SPARK-36993) Fix json_tuple throw NPE if fields exist no foldable null value

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36993. -- Fix Version/s: 3.1.3 3.2.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-36993) Fix json_tuple throw NPE if fields exist no foldable null value

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36993: Assignee: XiDuo You > Fix json_tuple throw NPE if fields exist no foldable null value >

[jira] [Commented] (SPARK-36868) Migrate CreateFunctionStatement to v2 command framework

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428301#comment-17428301 ] Apache Spark commented on SPARK-36868: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-36868) Migrate CreateFunctionStatement to v2 command framework

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428300#comment-17428300 ] Apache Spark commented on SPARK-36868: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36871) Migrate CreateViewStatement to v2 command

2021-10-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36871: --- Assignee: Huaxin Gao > Migrate CreateViewStatement to v2 command >

[jira] [Resolved] (SPARK-36871) Migrate CreateViewStatement to v2 command

2021-10-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36871. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34131

[jira] [Commented] (SPARK-32161) Hide JVM traceback for SparkUpgradeException

2021-10-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428228#comment-17428228 ] Hyukjin Kwon commented on SPARK-32161: -- Please go ahead! > Hide JVM traceback for

[jira] [Commented] (SPARK-32161) Hide JVM traceback for SparkUpgradeException

2021-10-13 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428185#comment-17428185 ] pralabhkumar commented on SPARK-32161: -- [~hyukjin.kwon]   Please let me if I can work on this .  

[jira] [Resolved] (SPARK-36921) The DIV function should support ANSI intervals

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36921. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34257

[jira] [Assigned] (SPARK-36921) The DIV function should support ANSI intervals

2021-10-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36921: Assignee: PengLei > The DIV function should support ANSI intervals >

[jira] [Commented] (SPARK-36997) Test type hints against examples

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428145#comment-17428145 ] Apache Spark commented on SPARK-36997: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36997) Test type hints against examples

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36997: Assignee: Apache Spark > Test type hints against examples >

[jira] [Commented] (SPARK-36997) Test type hints against examples

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428143#comment-17428143 ] Apache Spark commented on SPARK-36997: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36997) Test type hints against examples

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36997: Assignee: (was: Apache Spark) > Test type hints against examples >

[jira] [Commented] (SPARK-36996) fixing "SQL column nullable setting not retained as part of spark read" issue

2021-10-13 Thread Senthil Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428141#comment-17428141 ] Senthil Kumar commented on SPARK-36996: --- Sample Output after this changes: SQL : mysql> CREATE

[jira] [Commented] (SPARK-36996) fixing "SQL column nullable setting not retained as part of spark read" issue

2021-10-13 Thread Senthil Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428140#comment-17428140 ] Senthil Kumar commented on SPARK-36996: --- We need to consider 2 scenarios   # maintain NULLABLE

[jira] [Created] (SPARK-36997) Test type hints against examples

2021-10-13 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-36997: -- Summary: Test type hints against examples Key: SPARK-36997 URL: https://issues.apache.org/jira/browse/SPARK-36997 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-36996) fixing "SQL column nullable setting not retained as part of spark read" issue

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36996: Assignee: Apache Spark > fixing "SQL column nullable setting not retained as part of

[jira] [Assigned] (SPARK-36996) fixing "SQL column nullable setting not retained as part of spark read" issue

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36996: Assignee: (was: Apache Spark) > fixing "SQL column nullable setting not retained as

[jira] [Commented] (SPARK-36996) fixing "SQL column nullable setting not retained as part of spark read" issue

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428137#comment-17428137 ] Apache Spark commented on SPARK-36996: -- User 'senthh' has created a pull request for this issue:

[jira] [Resolved] (SPARK-36855) Uniformly execute the mergeContinuousShuffleBlockIdsIfNeeded method first

2021-10-13 Thread jinhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jinhai resolved SPARK-36855. Resolution: Not A Problem > Uniformly execute the mergeContinuousShuffleBlockIdsIfNeeded method first >

[jira] [Assigned] (SPARK-36438) Support list-like Python objects for Series comparison

2021-10-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36438: Assignee: Haejoon Lee > Support list-like Python objects for Series comparison >

[jira] [Resolved] (SPARK-36438) Support list-like Python objects for Series comparison

2021-10-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36438. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34114

[jira] [Commented] (SPARK-36996) fixing "SQL column nullable setting not retained as part of spark read" issue

2021-10-13 Thread Senthil Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428104#comment-17428104 ] Senthil Kumar commented on SPARK-36996: --- Based on further analysis, Spark is hard-coding

[jira] [Commented] (SPARK-36996) fixing "SQL column nullable setting not retained as part of spark read" issue

2021-10-13 Thread Senthil Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428105#comment-17428105 ] Senthil Kumar commented on SPARK-36996: --- I m working on this > fixing "SQL column nullable

[jira] [Created] (SPARK-36996) fixing "SQL column nullable setting not retained as part of spark read" issue

2021-10-13 Thread Senthil Kumar (Jira)
Senthil Kumar created SPARK-36996: - Summary: fixing "SQL column nullable setting not retained as part of spark read" issue Key: SPARK-36996 URL: https://issues.apache.org/jira/browse/SPARK-36996

[jira] [Assigned] (SPARK-36995) Add new SQLFileCommitProtocol

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36995: Assignee: Apache Spark > Add new SQLFileCommitProtocol > - >

[jira] [Commented] (SPARK-36995) Add new SQLFileCommitProtocol

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428082#comment-17428082 ] Apache Spark commented on SPARK-36995: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-36995) Add new SQLFileCommitProtocol

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36995: Assignee: (was: Apache Spark) > Add new SQLFileCommitProtocol >

[jira] [Updated] (SPARK-36989) Migrate type hint data tests

2021-10-13 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-36989: --- Component/s: Tests > Migrate type hint data tests > >

[jira] [Updated] (SPARK-36989) Migrate type hint data tests

2021-10-13 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-36989: --- Issue Type: Improvement (was: Bug) > Migrate type hint data tests >

[jira] [Commented] (SPARK-35141) Support two level map for final hash aggregation

2021-10-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428075#comment-17428075 ] Apache Spark commented on SPARK-35141: -- User 'c21' has created a pull request for this issue:

[jira] [Commented] (SPARK-36717) Wrong order of variable initialization may lead to incorrect behavior

2021-10-13 Thread Alexey Diomin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428061#comment-17428061 ] Alexey Diomin commented on SPARK-36717: --- please update "fix versions" commit was not included in

[jira] [Created] (SPARK-36995) Add new SQLFileCommitProtocol

2021-10-13 Thread angerszhu (Jira)
angerszhu created SPARK-36995: - Summary: Add new SQLFileCommitProtocol Key: SPARK-36995 URL: https://issues.apache.org/jira/browse/SPARK-36995 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34990) Add ParquetEncryptionSuite

2021-10-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-34990: --- Priority: Minor (was: Major) > Add ParquetEncryptionSuite > -- > >

[jira] [Updated] (SPARK-34990) Add ParquetEncryptionSuite

2021-10-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-34990: --- Issue Type: Test (was: New Feature) > Add ParquetEncryptionSuite >

[jira] [Resolved] (SPARK-36973) Deduplicate prepare data method for HistogramPlotBase and KdePlotBase

2021-10-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36973. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34251

  1   2   >