[jira] [Comment Edited] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

2022-01-03 Thread jerryMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468405#comment-17468405 ] jerryMa edited comment on SPARK-28990 at 1/4/22, 7:45 AM: -- i us

[jira] [Comment Edited] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

2022-01-03 Thread jerryMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468405#comment-17468405 ] jerryMa edited comment on SPARK-28990 at 1/4/22, 7:36 AM: -- i us

[jira] [Comment Edited] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

2022-01-03 Thread jerryMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468405#comment-17468405 ] jerryMa edited comment on SPARK-28990 at 1/4/22, 7:35 AM: -- i us

[jira] [Commented] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

2022-01-03 Thread jerryMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468405#comment-17468405 ] jerryMa commented on SPARK-28990: - i use spark-sql run a sql file,but also ocurrs error

[jira] [Assigned] (SPARK-37804) Unify v1 and v2 CREATE NAMESPACE tests

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37804: Assignee: Terry Kim (was: Apache Spark) > Unify v1 and v2 CREATE NAMESPACE tests > -

[jira] [Assigned] (SPARK-37804) Unify v1 and v2 CREATE NAMESPACE tests

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37804: Assignee: Apache Spark (was: Terry Kim) > Unify v1 and v2 CREATE NAMESPACE tests > -

[jira] [Commented] (SPARK-37804) Unify v1 and v2 CREATE NAMESPACE tests

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468388#comment-17468388 ] Apache Spark commented on SPARK-37804: -- User 'imback82' has created a pull request

[jira] [Assigned] (SPARK-37804) Unify v1 and v2 CREATE NAMESPACE tests

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37804: Assignee: Apache Spark (was: Terry Kim) > Unify v1 and v2 CREATE NAMESPACE tests > -

[jira] [Assigned] (SPARK-37786) StreamingQueryListener should also support SQLConf

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37786: Assignee: (was: Apache Spark) > StreamingQueryListener should also support SQLConf >

[jira] [Assigned] (SPARK-37786) StreamingQueryListener should also support SQLConf

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37786: Assignee: Apache Spark > StreamingQueryListener should also support SQLConf > ---

[jira] [Updated] (SPARK-37804) Unify v1 and v2 CREATE NAMESPACE tests

2022-01-03 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-37804: -- Description: Extract CREATE NAMESPACE tests to the common place to run them for V1 and v2 datasources.

[jira] [Created] (SPARK-37804) Unify v1 and v2 CREATE NAMESPACE tests

2022-01-03 Thread Terry Kim (Jira)
Terry Kim created SPARK-37804: - Summary: Unify v1 and v2 CREATE NAMESPACE tests Key: SPARK-37804 URL: https://issues.apache.org/jira/browse/SPARK-37804 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-37786) StreamingQueryListener should also support SQLConf

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468386#comment-17468386 ] Apache Spark commented on SPARK-37786: -- User 'AngersZh' has created a pull requ

[jira] [Resolved] (SPARK-37800) TreeNode.argString incorrectly formats arguments of type Set[_]

2022-01-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37800. - Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-37800) TreeNode.argString incorrectly formats arguments of type Set[_]

2022-01-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37800: --- Assignee: Simeon Simeonov > TreeNode.argString incorrectly formats arguments of type Set[_]

[jira] [Updated] (SPARK-37797) Spark Thrift Server's query timeout doesn't cancel the synchronous query

2022-01-03 Thread ramakrishna chilaka (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramakrishna chilaka updated SPARK-37797: Description: override protected def cleanup(): Unit = { if (runInBackground) {

[jira] [Updated] (SPARK-37797) Spark Thrift Server's query timeout doesn't cancel the synchronous query

2022-01-03 Thread ramakrishna chilaka (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramakrishna chilaka updated SPARK-37797: Description: override protected def cleanup(): Unit = { if (runInBackground) {

[jira] [Comment Edited] (SPARK-37787) Long running Spark Job(Spark ThriftServer) throw HDFS_DELEGATE_TOKEN not found in cache Exception

2022-01-03 Thread huangzhir (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468329#comment-17468329 ] huangzhir edited comment on SPARK-37787 at 1/4/22, 2:54 AM:

[jira] [Resolved] (SPARK-37780) QueryExecutionListener should also support SQLConf

2022-01-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37780. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35059 [https://gi

[jira] [Assigned] (SPARK-37780) QueryExecutionListener should also support SQLConf

2022-01-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37780: Assignee: angerszhu > QueryExecutionListener should also support SQLConf > --

[jira] [Commented] (SPARK-37787) Long running Spark Job(Spark ThriftServer) throw HDFS_DELEGATE_TOKEN not found in cache Exception

2022-01-03 Thread huangzhir (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468329#comment-17468329 ] huangzhir commented on SPARK-37787: --- This is because HadoopFSDelegationTokenProvider.o

[jira] [Commented] (SPARK-37723) Support tuple for non-MultiIndex column name.

2022-01-03 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468312#comment-17468312 ] Haejoon Lee commented on SPARK-37723: - Sure! > Support tuple for non-MultiIndex col

[jira] [Assigned] (SPARK-37802) composite field name like `field name` doesn't work with Aggregate push down

2022-01-03 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-37802: -- Assignee: Huaxin Gao > composite field name like `field name` doesn't work with Aggregate pus

[jira] [Commented] (SPARK-37723) Support tuple for non-MultiIndex column name.

2022-01-03 Thread Kanthi Subramanian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468296#comment-17468296 ] Kanthi Subramanian commented on SPARK-37723: Thanks, will get started and wi

[jira] [Assigned] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37803: Assignee: Apache Spark > When deserializing an Orc struct, reuse the result row when poss

[jira] [Assigned] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37803: Assignee: (was: Apache Spark) > When deserializing an Orc struct, reuse the result ro

[jira] [Commented] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468295#comment-17468295 ] Apache Spark commented on SPARK-37803: -- User 'bersprockets' has created a pull requ

[jira] [Commented] (SPARK-37723) Support tuple for non-MultiIndex column name.

2022-01-03 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468290#comment-17468290 ] Haejoon Lee commented on SPARK-37723: - [~subkanthi] You can take this one, please go

[jira] [Commented] (SPARK-34931) CoarseGrainedExecutorBackend send wrong 'Reason' when executor exits which leading to job failed.

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468289#comment-17468289 ] Apache Spark commented on SPARK-34931: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-37723) Support tuple for non-MultiIndex column name.

2022-01-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468288#comment-17468288 ] Hyukjin Kwon commented on SPARK-37723: -- [~itholic] are you working on this? > Supp

[jira] [Updated] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

2022-01-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37803: -- Attachment: pr_results.txt > When deserializing an Orc struct, reuse the result row when possi

[jira] [Updated] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

2022-01-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37803: -- Attachment: master_results.txt > When deserializing an Orc struct, reuse the result row when p

[jira] [Commented] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

2022-01-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468283#comment-17468283 ] Bruce Robbins commented on SPARK-37803: --- I will attempt a PR in the next few hours

[jira] [Created] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

2022-01-03 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-37803: - Summary: When deserializing an Orc struct, reuse the result row when possible Key: SPARK-37803 URL: https://issues.apache.org/jira/browse/SPARK-37803 Project: Spark

[jira] [Resolved] (SPARK-37801) List PyPy3 installed libraries in build_and_test workflow

2022-01-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37801. --- Fix Version/s: 3.3.0 Assignee: Yikun Jiang Resolution: Fixed This is resolve

[jira] [Commented] (SPARK-37723) Support tuple for non-MultiIndex column name.

2022-01-03 Thread Kanthi Subramanian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468096#comment-17468096 ] Kanthi Subramanian commented on SPARK-37723: Hi [~itholic] , is someone work

[jira] [Commented] (SPARK-37660) Spark-3.2.0 Fetch Hbase Data not working

2022-01-03 Thread Bhavya Raj Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467991#comment-17467991 ] Bhavya Raj Sharma commented on SPARK-37660: --- any update on this? > Spark-3.2.

[jira] [Updated] (SPARK-37617) In CTAS,replace alias to normal column that satisfy parquet schema

2022-01-03 Thread jiahong.li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiahong.li updated SPARK-37617: --- Fix Version/s: 3.3.0 (was: 3.2.0) > In CTAS,replace alias to normal column th

[jira] [Commented] (SPARK-29683) Job failed due to executor failures all available nodes are blacklisted

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467924#comment-17467924 ] Apache Spark commented on SPARK-29683: -- User 'sungpeo' has created a pull request f

[jira] [Commented] (SPARK-29683) Job failed due to executor failures all available nodes are blacklisted

2022-01-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467921#comment-17467921 ] Apache Spark commented on SPARK-29683: -- User 'sungpeo' has created a pull request f