[jira] [Resolved] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

2021-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34128. --- Fix Version/s: 3.1.2 3.2.0 Assignee: Kent Yao Resolution:

[jira] [Updated] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

2021-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34128: -- Issue Type: Bug (was: Improvement) > Suppress excessive logging of TTransportExceptions in

[jira] [Resolved] (SPARK-32384) repartitionAndSortWithinPartitions avoid shuffle with same partitioner

2021-03-19 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-32384. -- Fix Version/s: 3.2.0 Assignee: zhengruifeng Resolution: Fixed Resolved by 

[jira] [Updated] (SPARK-34776) Catalyst error on on certain struct operation (Couldn't find _gen_alias_)

2021-03-19 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34776: - Fix Version/s: 3.0.3 2.4.8 > Catalyst error on on certain struct

[jira] [Resolved] (SPARK-34796) Codegen compilation error for query with LIMIT operator and without AQE

2021-03-19 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34796. -- Fix Version/s: 3.2.0 Assignee: Cheng Su Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-33122) Remove redundant aggregates in the Optimzier

2021-03-19 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33122. -- Fix Version/s: 3.2.0 Assignee: Tanel Kiis Resolution: Fixed Resolved

[jira] [Updated] (SPARK-34719) fail if the view query has duplicated column names

2021-03-19 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34719: - Fix Version/s: 3.0.3 > fail if the view query has duplicated column names >

[jira] [Commented] (SPARK-34776) Catalyst error on on certain struct operation (Couldn't find _gen_alias_)

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305262#comment-17305262 ] Apache Spark commented on SPARK-34776: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-34776) Catalyst error on on certain struct operation (Couldn't find _gen_alias_)

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305260#comment-17305260 ] Apache Spark commented on SPARK-34776: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34700) SessionCatalog's createTempView/createGlobalTempView should accept TemporaryViewRelation

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34700: Assignee: (was: Apache Spark) > SessionCatalog's createTempView/createGlobalTempView

[jira] [Assigned] (SPARK-34700) SessionCatalog's createTempView/createGlobalTempView should accept TemporaryViewRelation

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34700: Assignee: Apache Spark > SessionCatalog's createTempView/createGlobalTempView should

[jira] [Commented] (SPARK-34700) SessionCatalog's createTempView/createGlobalTempView should accept TemporaryViewRelation

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305231#comment-17305231 ] Apache Spark commented on SPARK-34700: -- User 'imback82' has created a pull request for this issue:

[jira] [Updated] (SPARK-34774) The `change-scala- version.sh` script not replaced scala.version property correctly

2021-03-19 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34774: - Fix Version/s: 2.4.8 > The `change-scala- version.sh` script not replaced scala.version

[jira] [Created] (SPARK-34806) Helper class for batch Dataset.observe()

2021-03-19 Thread Enrico Minack (Jira)
Enrico Minack created SPARK-34806: - Summary: Helper class for batch Dataset.observe() Key: SPARK-34806 URL: https://issues.apache.org/jira/browse/SPARK-34806 Project: Spark Issue Type: New

[jira] [Comment Edited] (SPARK-34780) Cached Table (parquet) with old Configs Used

2021-03-19 Thread Michael Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305162#comment-17305162 ] Michael Chen edited comment on SPARK-34780 at 3/19/21, 8:00 PM: I used

[jira] [Comment Edited] (SPARK-34780) Cached Table (parquet) with old Configs Used

2021-03-19 Thread Michael Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305162#comment-17305162 ] Michael Chen edited comment on SPARK-34780 at 3/19/21, 8:00 PM: I used

[jira] [Commented] (SPARK-34780) Cached Table (parquet) with old Configs Used

2021-03-19 Thread Michael Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305162#comment-17305162 ] Michael Chen commented on SPARK-34780: -- I used computeStats because it was a simple way to display

[jira] [Commented] (SPARK-33534) Allow specifying a minimum number of bytes in a split of a file

2021-03-19 Thread Suhas Jaladi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305154#comment-17305154 ] Suhas Jaladi commented on SPARK-33534: -- [~nielsbasjes], Just checking if you have any alternate

[jira] [Assigned] (SPARK-34775) Push down limit through window when partitionSpec is not empty

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34775: Assignee: Apache Spark > Push down limit through window when partitionSpec is not empty

[jira] [Assigned] (SPARK-34775) Push down limit through window when partitionSpec is not empty

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34775: Assignee: (was: Apache Spark) > Push down limit through window when partitionSpec is

[jira] [Commented] (SPARK-34775) Push down limit through window when partitionSpec is not empty

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305151#comment-17305151 ] Apache Spark commented on SPARK-34775: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34776) Catalyst error on on certain struct operation (Couldn't find _gen_alias_)

2021-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34776: - Assignee: L. C. Hsieh > Catalyst error on on certain struct operation (Couldn't find

[jira] [Resolved] (SPARK-34776) Catalyst error on on certain struct operation (Couldn't find _gen_alias_)

2021-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34776. --- Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-34780) Cached Table (parquet) with old Configs Used

2021-03-19 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305109#comment-17305109 ] Chao Sun commented on SPARK-34780: -- Thanks for the reporting [~mikechen], the test case you provided is

[jira] [Updated] (SPARK-34805) PySpark loses metadata in DataFrame fields when selecting nested columns

2021-03-19 Thread Mark Ressler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Ressler updated SPARK-34805: - Attachment: jsonMetadataTest.py > PySpark loses metadata in DataFrame fields when selecting

[jira] [Created] (SPARK-34805) PySpark loses metadata in DataFrame fields when selecting nested columns

2021-03-19 Thread Mark Ressler (Jira)
Mark Ressler created SPARK-34805: Summary: PySpark loses metadata in DataFrame fields when selecting nested columns Key: SPARK-34805 URL: https://issues.apache.org/jira/browse/SPARK-34805 Project:

[jira] [Resolved] (SPARK-24374) SPIP: Support Barrier Execution Mode in Apache Spark

2021-03-19 Thread Xiangrui Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-24374. --- Fix Version/s: 2.4.0 Target Version/s: 2.4.0 Resolution: Fixed I'm marking

[jira] [Commented] (SPARK-34804) registerFunction shouldnt be logging warning message for same function being re-registered

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305067#comment-17305067 ] Apache Spark commented on SPARK-34804: -- User 'sumeetmi2' has created a pull request for this issue:

[jira] [Commented] (SPARK-34804) registerFunction shouldnt be logging warning message for same function being re-registered

2021-03-19 Thread Sumeet Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305066#comment-17305066 ] Sumeet Sharma commented on SPARK-34804: --- Proposed changes:

[jira] [Commented] (SPARK-34804) registerFunction shouldnt be logging warning message for same function being re-registered

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305065#comment-17305065 ] Apache Spark commented on SPARK-34804: -- User 'sumeetmi2' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34804) registerFunction shouldnt be logging warning message for same function being re-registered

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34804: Assignee: Apache Spark > registerFunction shouldnt be logging warning message for same

[jira] [Assigned] (SPARK-34804) registerFunction shouldnt be logging warning message for same function being re-registered

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34804: Assignee: (was: Apache Spark) > registerFunction shouldnt be logging warning message

[jira] [Commented] (SPARK-34600) Support user defined types in Pandas UDF

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305038#comment-17305038 ] Apache Spark commented on SPARK-34600: -- User 'eddyxu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34803) Util methods requiring certain versions of Pandas & PyArrow don't pass through the raised ImportError

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34803: Assignee: (was: Apache Spark) > Util methods requiring certain versions of Pandas &

[jira] [Assigned] (SPARK-34803) Util methods requiring certain versions of Pandas & PyArrow don't pass through the raised ImportError

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34803: Assignee: Apache Spark > Util methods requiring certain versions of Pandas & PyArrow

[jira] [Commented] (SPARK-34803) Util methods requiring certain versions of Pandas & PyArrow don't pass through the raised ImportError

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305004#comment-17305004 ] Apache Spark commented on SPARK-34803: -- User 'johnhany97' has created a pull request for this

[jira] [Commented] (SPARK-34803) Util methods requiring certain versions of Pandas & PyArrow don't pass through the raised ImportError

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305003#comment-17305003 ] Apache Spark commented on SPARK-34803: -- User 'johnhany97' has created a pull request for this

[jira] [Commented] (SPARK-34803) Util methods requiring certain versions of Pandas & PyArrow don't pass through the raised ImportError

2021-03-19 Thread John Hany (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305001#comment-17305001 ] John Hany commented on SPARK-34803: --- I've gone ahead and opened 

[jira] [Updated] (SPARK-34804) registerFunction shouldnt be logging warning message for same function being re-registered

2021-03-19 Thread Sumeet Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumeet Sharma updated SPARK-34804: -- Description: {code:java} test("function registry warning") { implicit val ss = spark import

[jira] [Commented] (SPARK-34802) Optimize Optimizer defaultBatches rule order

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304997#comment-17304997 ] Apache Spark commented on SPARK-34802: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34802) Optimize Optimizer defaultBatches rule order

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34802: Assignee: (was: Apache Spark) > Optimize Optimizer defaultBatches rule order >

[jira] [Assigned] (SPARK-34802) Optimize Optimizer defaultBatches rule order

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34802: Assignee: Apache Spark > Optimize Optimizer defaultBatches rule order >

[jira] [Created] (SPARK-34804) registerFunction shouldnt be logging warning message for same function being re-registered

2021-03-19 Thread Sumeet Sharma (Jira)
Sumeet Sharma created SPARK-34804: - Summary: registerFunction shouldnt be logging warning message for same function being re-registered Key: SPARK-34804 URL: https://issues.apache.org/jira/browse/SPARK-34804

[jira] [Created] (SPARK-34803) Util methods requiring certain versions of Pandas & PyArrow don't pass through the raised ImportError

2021-03-19 Thread John Hany (Jira)
John Hany created SPARK-34803: - Summary: Util methods requiring certain versions of Pandas & PyArrow don't pass through the raised ImportError Key: SPARK-34803 URL: https://issues.apache.org/jira/browse/SPARK-34803

[jira] [Assigned] (SPARK-34783) Support remote template files via spark.jars

2021-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34783: - Assignee: Dongjoon Hyun > Support remote template files via spark.jars >

[jira] [Updated] (SPARK-34783) Support remote template files

2021-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34783: -- Summary: Support remote template files (was: Support remote template files via spark.jars)

[jira] [Resolved] (SPARK-34783) Support remote template files via spark.jars

2021-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34783. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31877

[jira] [Created] (SPARK-34802) Optimize Optimizer defaultBatches rule order

2021-03-19 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-34802: --- Summary: Optimize Optimizer defaultBatches rule order Key: SPARK-34802 URL: https://issues.apache.org/jira/browse/SPARK-34802 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-34793) Prohibit saving of day-time and year-month intervals

2021-03-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34793. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31884

[jira] [Resolved] (SPARK-34798) Fix incorrect join condition

2021-03-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-34798. - Fix Version/s: 3.0.3 3.1.2 3.2.0 Resolution: Fixed

[jira] [Assigned] (SPARK-34798) Fix incorrect join condition

2021-03-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-34798: --- Assignee: Hongyi Zhang > Fix incorrect join condition > > >

[jira] [Commented] (SPARK-27790) Support ANSI SQL INTERVAL types

2021-03-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304965#comment-17304965 ] Max Gekk commented on SPARK-27790: -- > how will DateTime addition work with the new intervals?

[jira] [Commented] (SPARK-34525) Update Spark Create Table DDL Docs

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304937#comment-17304937 ] Apache Spark commented on SPARK-34525: -- User 'nikriek' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34525) Update Spark Create Table DDL Docs

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34525: Assignee: Apache Spark > Update Spark Create Table DDL Docs >

[jira] [Commented] (SPARK-34525) Update Spark Create Table DDL Docs

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304936#comment-17304936 ] Apache Spark commented on SPARK-34525: -- User 'nikriek' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34525) Update Spark Create Table DDL Docs

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34525: Assignee: (was: Apache Spark) > Update Spark Create Table DDL Docs >

[jira] [Commented] (SPARK-34790) Fail in fetch shuffle blocks in batch when i/o encryption is enabled.

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304905#comment-17304905 ] Apache Spark commented on SPARK-34790: -- User 'hezuojiao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34790) Fail in fetch shuffle blocks in batch when i/o encryption is enabled.

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34790: Assignee: Apache Spark > Fail in fetch shuffle blocks in batch when i/o encryption is

[jira] [Commented] (SPARK-34790) Fail in fetch shuffle blocks in batch when i/o encryption is enabled.

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304900#comment-17304900 ] Apache Spark commented on SPARK-34790: -- User 'hezuojiao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34790) Fail in fetch shuffle blocks in batch when i/o encryption is enabled.

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34790: Assignee: (was: Apache Spark) > Fail in fetch shuffle blocks in batch when i/o

[jira] [Created] (SPARK-34801) java.lang.NoSuchMethodException: org.apache.hadoop.hive.ql.metadata.Hive.loadPartition

2021-03-19 Thread zhaojk (Jira)
zhaojk created SPARK-34801: -- Summary: java.lang.NoSuchMethodException: org.apache.hadoop.hive.ql.metadata.Hive.loadPartition Key: SPARK-34801 URL: https://issues.apache.org/jira/browse/SPARK-34801 Project:

[jira] [Issue Comment Deleted] (SPARK-34673) Select queries fail with Error: java.lang.IllegalArgumentException: Error: name expected at the position 10 of 'decimal(2,-2)' but '-' is found. (state=,c

2021-03-19 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Raj Boudh updated SPARK-34673: Comment: was deleted (was: btw this issue is coming due to hive serde :  {code:java}

[jira] [Commented] (SPARK-34673) Select queries fail with Error: java.lang.IllegalArgumentException: Error: name expected at the position 10 of 'decimal(2,-2)' but '-' is found. (state=,code=0)

2021-03-19 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304760#comment-17304760 ] Ankit Raj Boudh commented on SPARK-34673: - btw this issue is coming due to hive serde : 

[jira] [Comment Edited] (SPARK-34673) Select queries fail with Error: java.lang.IllegalArgumentException: Error: name expected at the position 10 of 'decimal(2,-2)' but '-' is found. (state=,code=0)

2021-03-19 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304736#comment-17304736 ] Ankit Raj Boudh edited comment on SPARK-34673 at 3/19/21, 9:10 AM: ---  

[jira] [Comment Edited] (SPARK-34673) Select queries fail with Error: java.lang.IllegalArgumentException: Error: name expected at the position 10 of 'decimal(2,-2)' but '-' is found. (state=,code=0)

2021-03-19 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304736#comment-17304736 ] Ankit Raj Boudh edited comment on SPARK-34673 at 3/19/21, 9:05 AM: ---  

[jira] [Comment Edited] (SPARK-34673) Select queries fail with Error: java.lang.IllegalArgumentException: Error: name expected at the position 10 of 'decimal(2,-2)' but '-' is found. (state=,code=0)

2021-03-19 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304736#comment-17304736 ] Ankit Raj Boudh edited comment on SPARK-34673 at 3/19/21, 9:03 AM: ---

[jira] [Commented] (SPARK-34673) Select queries fail with Error: java.lang.IllegalArgumentException: Error: name expected at the position 10 of 'decimal(2,-2)' but '-' is found. (state=,code=0)

2021-03-19 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304736#comment-17304736 ] Ankit Raj Boudh commented on SPARK-34673: - [~hyukjin.kwon] , I have checked this case in

[jira] [Updated] (SPARK-34673) Select queries fail with Error: java.lang.IllegalArgumentException: Error: name expected at the position 10 of 'decimal(2,-2)' but '-' is found. (state=,code=0)

2021-03-19 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Raj Boudh updated SPARK-34673: Attachment: Screenshot 2021-03-19 at 1.33.54 PM.png > Select queries fail with Error:

[jira] [Commented] (SPARK-34776) Catalyst error on on certain struct operation (Couldn't find _gen_alias_)

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304711#comment-17304711 ] Apache Spark commented on SPARK-34776: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34776) Catalyst error on on certain struct operation (Couldn't find _gen_alias_)

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34776: Assignee: (was: Apache Spark) > Catalyst error on on certain struct operation

[jira] [Assigned] (SPARK-34776) Catalyst error on on certain struct operation (Couldn't find _gen_alias_)

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34776: Assignee: Apache Spark > Catalyst error on on certain struct operation (Couldn't find

[jira] [Commented] (SPARK-34776) Catalyst error on on certain struct operation (Couldn't find _gen_alias_)

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304709#comment-17304709 ] Apache Spark commented on SPARK-34776: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-34776) Catalyst error on on certain struct operation (Couldn't find _gen_alias_)

2021-03-19 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34776: Affects Version/s: 3.2.0 > Catalyst error on on certain struct operation (Couldn't find

[jira] [Commented] (SPARK-32899) Support submit application with user-defined cluster manager

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304689#comment-17304689 ] Apache Spark commented on SPARK-32899: -- User 'ConeyLiu' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-34651) Improve ZSTD support

2021-03-19 Thread Stanislav Savulchik (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304676#comment-17304676 ] Stanislav Savulchik edited comment on SPARK-34651 at 3/19/21, 7:18 AM:

[jira] [Commented] (SPARK-34651) Improve ZSTD support

2021-03-19 Thread Stanislav Savulchik (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304676#comment-17304676 ] Stanislav Savulchik commented on SPARK-34651: - [~dongjoon] I noticed that "zstd" is not

[jira] [Commented] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304669#comment-17304669 ] Apache Spark commented on SPARK-34128: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34128: Assignee: (was: Apache Spark) > Suppress excessive logging of TTransportExceptions

[jira] [Assigned] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34128: Assignee: Apache Spark > Suppress excessive logging of TTransportExceptions in Spark

[jira] [Commented] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304668#comment-17304668 ] Apache Spark commented on SPARK-34128: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-34719) fail if the view query has duplicated column names

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304657#comment-17304657 ] Apache Spark commented on SPARK-34719: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-34774) The `change-scala- version.sh` script not replaced scala.version property correctly

2021-03-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304656#comment-17304656 ] Apache Spark commented on SPARK-34774: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-34792) Restore previous behaviour of randomSplit from spark-2.4.7 in spark-3

2021-03-19 Thread kondziolka9ld (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304654#comment-17304654 ] kondziolka9ld commented on SPARK-34792: --- [~dongjoon] > This doesn't look like a bug. It is why I

[jira] [Commented] (SPARK-34790) Fail in fetch shuffle blocks in batch when i/o encryption is enabled.

2021-03-19 Thread hezuojiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304651#comment-17304651 ] hezuojiao commented on SPARK-34790: --- Thanks for reply, I posted the failure message above in more

[jira] [Updated] (SPARK-34790) Fail in fetch shuffle blocks in batch when i/o encryption is enabled.

2021-03-19 Thread hezuojiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hezuojiao updated SPARK-34790: -- Description: When set spark.io.encryption.enabled=true, lots of test cases in  AdaptiveQueryExecSuite