[jira] [Updated] (SPARK-37759) Add ARM based self-hosted runner to Apache Spark

2022-01-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-37759: Description: For Spark Test Runner: {code:bash} # Prepare the custom runner mkdir actions-runner

[jira] [Updated] (SPARK-37759) Add ARM based self-hosted runner to Apache Spark

2022-01-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-37759: Description: {code:bash} # Prepare the custom runner mkdir actions-runner && cd actions-runner

[jira] [Updated] (SPARK-37759) Add ARM based self-hosted runner to Apache Spark

2022-01-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-37759: Description: {code:shell} # Prepare the custom runner mkdir actions-runner && cd actions-runner

[jira] [Updated] (SPARK-37759) Add ARM based self-hosted runner to Apache Spark

2022-01-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-37759: Description: # Prepare the custom runner mkdir actions-runner && cd actions-runner curl -o

[jira] [Resolved] (SPARK-37822) SQL function `split` should return an array of non-nullable elements

2022-01-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37822. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35111

[jira] [Assigned] (SPARK-37822) SQL function `split` should return an array of non-nullable elements

2022-01-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37822: --- Assignee: Shardul Mahadik > SQL function `split` should return an array of non-nullable

[jira] [Assigned] (SPARK-37825) Make spark beeline be able to handle javaOpts

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37825: Assignee: Apache Spark > Make spark beeline be able to handle javaOpts >

[jira] [Commented] (SPARK-37825) Make spark beeline be able to handle javaOpts

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469747#comment-17469747 ] Apache Spark commented on SPARK-37825: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37825) Make spark beeline be able to handle javaOpts

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37825: Assignee: (was: Apache Spark) > Make spark beeline be able to handle javaOpts >

[jira] [Updated] (SPARK-37810) Executor Rolling in Kubernetes environment

2022-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37810: -- Labels: releasenotes (was: ) > Executor Rolling in Kubernetes environment >

[jira] [Closed] (SPARK-37028) Add a 'kill' executor link in the Web UI.

2022-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-37028. - > Add a 'kill' executor link in the Web UI. > -- > >

[jira] [Resolved] (SPARK-37028) Add a 'kill' executor link in the Web UI.

2022-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37028. --- Resolution: Won't Do > Add a 'kill' executor link in the Web UI. >

[jira] [Resolved] (SPARK-37824) Document K8s executor rolling configurations

2022-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37824. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35114

[jira] [Assigned] (SPARK-37824) Document K8s executor rolling configurations

2022-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37824: - Assignee: Dongjoon Hyun > Document K8s executor rolling configurations >

[jira] [Commented] (SPARK-37787) Long running Spark Job(Spark ThriftServer) throw HDFS_DELEGATE_TOKEN not found in cache Exception

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469712#comment-17469712 ] Apache Spark commented on SPARK-37787: -- User 'huangzhir' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37787) Long running Spark Job(Spark ThriftServer) throw HDFS_DELEGATE_TOKEN not found in cache Exception

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37787: Assignee: Apache Spark > Long running Spark Job(Spark ThriftServer) throw

[jira] [Commented] (SPARK-37787) Long running Spark Job(Spark ThriftServer) throw HDFS_DELEGATE_TOKEN not found in cache Exception

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469707#comment-17469707 ] Apache Spark commented on SPARK-37787: -- User 'huangzhir' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37787) Long running Spark Job(Spark ThriftServer) throw HDFS_DELEGATE_TOKEN not found in cache Exception

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37787: Assignee: (was: Apache Spark) > Long running Spark Job(Spark ThriftServer) throw

[jira] [Updated] (SPARK-37825) Make spark beeline be able to handle javaOpts

2022-01-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-37825: - Issue Type: Improvement (was: Bug) > Make spark beeline be able to handle javaOpts >

[jira] [Created] (SPARK-37825) Make spark beeline be able to handle javaOpts

2022-01-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-37825: Summary: Make spark beeline be able to handle javaOpts Key: SPARK-37825 URL: https://issues.apache.org/jira/browse/SPARK-37825 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-37824) Document K8s executor rolling configurations

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469685#comment-17469685 ] Apache Spark commented on SPARK-37824: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37824) Document K8s executor rolling configurations

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37824: Assignee: Apache Spark > Document K8s executor rolling configurations >

[jira] [Assigned] (SPARK-37824) Document K8s executor rolling configurations

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37824: Assignee: (was: Apache Spark) > Document K8s executor rolling configurations >

[jira] [Commented] (SPARK-37824) Document K8s executor rolling configurations

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469684#comment-17469684 ] Apache Spark commented on SPARK-37824: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-37824) Document K8s executor rolling configurations

2022-01-05 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37824: - Summary: Document K8s executor rolling configurations Key: SPARK-37824 URL: https://issues.apache.org/jira/browse/SPARK-37824 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37636) Migrate CREATE NAMESPACE to use v2 command by default

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469682#comment-17469682 ] Apache Spark commented on SPARK-37636: -- User 'imback82' has created a pull request for this issue:

[jira] [Commented] (SPARK-37636) Migrate CREATE NAMESPACE to use v2 command by default

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469681#comment-17469681 ] Apache Spark commented on SPARK-37636: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37636) Migrate CREATE NAMESPACE to use v2 command by default

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37636: Assignee: Apache Spark > Migrate CREATE NAMESPACE to use v2 command by default >

[jira] [Assigned] (SPARK-37636) Migrate CREATE NAMESPACE to use v2 command by default

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37636: Assignee: (was: Apache Spark) > Migrate CREATE NAMESPACE to use v2 command by

[jira] [Resolved] (SPARK-37819) Add OUTLIER executor roll policy and use it by default

2022-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37819. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35109

[jira] [Commented] (SPARK-37823) Add `is-changed.py` dev script

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469666#comment-17469666 ] Apache Spark commented on SPARK-37823: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37823) Add `is-changed.py` dev script

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37823: Assignee: (was: Apache Spark) > Add `is-changed.py` dev script >

[jira] [Commented] (SPARK-37823) Add `is-changed.py` dev script

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469664#comment-17469664 ] Apache Spark commented on SPARK-37823: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37823) Add `is-changed.py` dev script

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37823: Assignee: Apache Spark > Add `is-changed.py` dev script > --

[jira] [Created] (SPARK-37823) Add `is-changed.py` dev script

2022-01-05 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37823: - Summary: Add `is-changed.py` dev script Key: SPARK-37823 URL: https://issues.apache.org/jira/browse/SPARK-37823 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-37822) SQL function `split` should return an array of non-nullable elements

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37822: Assignee: (was: Apache Spark) > SQL function `split` should return an array of

[jira] [Assigned] (SPARK-37822) SQL function `split` should return an array of non-nullable elements

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37822: Assignee: Apache Spark > SQL function `split` should return an array of non-nullable

[jira] [Commented] (SPARK-37822) SQL function `split` should return an array of non-nullable elements

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469658#comment-17469658 ] Apache Spark commented on SPARK-37822: -- User 'shardulm94' has created a pull request for this

[jira] [Commented] (SPARK-37758) [PYSPARK] Enable PySpark scheduled job on ARM based self-hosted runner

2022-01-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469654#comment-17469654 ] Yikun Jiang commented on SPARK-37758: - {code:java} sudo apt install docker.io sudo gpasswd -a $USER

[jira] [Comment Edited] (SPARK-37757) [Scala] Enable Spark test scheduled job on ARM based self-hosted runner

2022-01-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469653#comment-17469653 ] Yikun Jiang edited comment on SPARK-37757 at 1/6/22, 3:34 AM: --  

[jira] [Commented] (SPARK-37757) [Scala] Enable Spark test scheduled job on ARM based self-hosted runner

2022-01-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469653#comment-17469653 ] Yikun Jiang commented on SPARK-37757: -   {code:java} sudo apt update sudo apt-get install

[jira] [Created] (SPARK-37822) SQL function `split` should return an array of non-nullable elements

2022-01-05 Thread Shardul Mahadik (Jira)
Shardul Mahadik created SPARK-37822: --- Summary: SQL function `split` should return an array of non-nullable elements Key: SPARK-37822 URL: https://issues.apache.org/jira/browse/SPARK-37822 Project:

[jira] [Commented] (SPARK-37757) [Scala] Enable Spark test scheduled job on ARM based self-hosted runner

2022-01-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469646#comment-17469646 ] Yikun Jiang commented on SPARK-37757: - `apt install libssl-dev`, then it's stable to passed, because

[jira] [Assigned] (SPARK-37820) Replace ApacheCommonBase64 with JavaBase64 for string fucntions

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37820: Assignee: Apache Spark > Replace ApacheCommonBase64 with JavaBase64 for string fucntions

[jira] [Commented] (SPARK-37820) Replace ApacheCommonBase64 with JavaBase64 for string fucntions

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469643#comment-17469643 ] Apache Spark commented on SPARK-37820: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37820) Replace ApacheCommonBase64 with JavaBase64 for string fucntions

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37820: Assignee: (was: Apache Spark) > Replace ApacheCommonBase64 with JavaBase64 for

[jira] [Updated] (SPARK-37821) spark thrift server RDD ID overflow lead sql execute failed

2022-01-05 Thread muhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37821: --- Description: this problem will happen in long run spark application,such as thrift server; as only one

[jira] [Created] (SPARK-37821) spark thrift server RDD ID overflow lead sql execute failed

2022-01-05 Thread muhong (Jira)
muhong created SPARK-37821: -- Summary: spark thrift server RDD ID overflow lead sql execute failed Key: SPARK-37821 URL: https://issues.apache.org/jira/browse/SPARK-37821 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37820) Replace ApacheCommonBase64 with JavaBase64 for fucntions

2022-01-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-37820: - Summary: Replace ApacheCommonBase64 with JavaBase64 for fucntions (was: Replace ApacheCommonBase64

[jira] [Updated] (SPARK-37820) Replace ApacheCommonBase64 with JavaBase64 for string fucntions

2022-01-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-37820: - Summary: Replace ApacheCommonBase64 with JavaBase64 for string fucntions (was: Replace

[jira] [Created] (SPARK-37820) Replace ApacheCommonBase64 with JavaBase64 for

2022-01-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-37820: Summary: Replace ApacheCommonBase64 with JavaBase64 for Key: SPARK-37820 URL: https://issues.apache.org/jira/browse/SPARK-37820 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-37367) Reenable exception test in DDLParserSuite.create view -- basic

2022-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37367: Assignee: angerszhu > Reenable exception test in DDLParserSuite.create view -- basic >

[jira] [Resolved] (SPARK-37367) Reenable exception test in DDLParserSuite.create view -- basic

2022-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37367. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35040

[jira] [Commented] (SPARK-37491) Fix Series.asof when values of the series is not sorted

2022-01-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469589#comment-17469589 ] Haejoon Lee commented on SPARK-37491: - [~pralabhkumar] Sure, please go ahead! > Fix Series.asof

[jira] [Resolved] (SPARK-37812) When deserializing an Orc struct, reuse the result row when possible

2022-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37812. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35090

[jira] [Assigned] (SPARK-37812) When deserializing an Orc struct, reuse the result row when possible

2022-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37812: - Assignee: Bruce Robbins > When deserializing an Orc struct, reuse the result row when

[jira] [Assigned] (SPARK-37819) Add OUTLIER executor roll policy and use it by default

2022-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37819: - Assignee: Dongjoon Hyun > Add OUTLIER executor roll policy and use it by default >

[jira] [Commented] (SPARK-37819) Add OUTLIER executor roll policy and use it by default

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469565#comment-17469565 ] Apache Spark commented on SPARK-37819: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37819) Add OUTLIER executor roll policy and use it by default

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37819: Assignee: (was: Apache Spark) > Add OUTLIER executor roll policy and use it by

[jira] [Commented] (SPARK-37819) Add OUTLIER executor roll policy and use it by default

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469564#comment-17469564 ] Apache Spark commented on SPARK-37819: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37819) Add OUTLIER executor roll policy and use it by default

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37819: Assignee: Apache Spark > Add OUTLIER executor roll policy and use it by default >

[jira] [Created] (SPARK-37819) Add OUTLIER executor roll policy and use it by default

2022-01-05 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37819: - Summary: Add OUTLIER executor roll policy and use it by default Key: SPARK-37819 URL: https://issues.apache.org/jira/browse/SPARK-37819 Project: Spark

[jira] [Updated] (SPARK-37710) Add detailed error message for java.io.IOException occurring on Kryo flow

2022-01-05 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-37710: --- Description: *Input/output error* usually points environmental issues such as disk

[jira] [Updated] (SPARK-37710) Add detailed error message for java.io.IOException occurring on Kryo flow

2022-01-05 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-37710: --- Summary: Add detailed error message for java.io.IOException occurring on Kryo flow

[jira] [Assigned] (SPARK-37802) composite field name like `field name` doesn't work with Aggregate push down

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37802: Assignee: Apache Spark (was: Huaxin Gao) > composite field name like `field name`

[jira] [Commented] (SPARK-37802) composite field name like `field name` doesn't work with Aggregate push down

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469508#comment-17469508 ] Apache Spark commented on SPARK-37802: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37802) composite field name like `field name` doesn't work with Aggregate push down

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37802: Assignee: Huaxin Gao (was: Apache Spark) > composite field name like `field name`

[jira] [Commented] (SPARK-37802) composite field name like `field name` doesn't work with Aggregate push down

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469509#comment-17469509 ] Apache Spark commented on SPARK-37802: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37788) ColumnOrName vs Column in PySpark Functions module

2022-01-05 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37788. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37788) ColumnOrName vs Column in PySpark Functions module

2022-01-05 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37788: -- Assignee: Daniel Davies > ColumnOrName vs Column in PySpark Functions module

[jira] [Commented] (SPARK-37491) Fix Series.asof when values of the series is not sorted

2022-01-05 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469471#comment-17469471 ] pralabhkumar commented on SPARK-37491: -- I would like to work on this . Basically the problem is in

[jira] [Comment Edited] (SPARK-37491) Fix Series.asof when values of the series is not sorted

2022-01-05 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469471#comment-17469471 ] pralabhkumar edited comment on SPARK-37491 at 1/5/22, 6:27 PM: --- I would

[jira] [Assigned] (SPARK-36879) Support Parquet v2 data page encodings for the vectorized path

2022-01-05 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-36879: Assignee: Parth Chandra > Support Parquet v2 data page encodings for the vectorized path >

[jira] [Resolved] (SPARK-36879) Support Parquet v2 data page encodings for the vectorized path

2022-01-05 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-36879. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34471

[jira] [Updated] (SPARK-37796) ByteArrayMethods arrayEquals should fast skip the check of aligning with unaligned platform

2022-01-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37796: - Priority: Minor (was: Major) > ByteArrayMethods arrayEquals should fast skip the check of

[jira] [Assigned] (SPARK-37796) ByteArrayMethods arrayEquals should fast skip the check of aligning with unaligned platform

2022-01-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37796: Assignee: XiDuo You > ByteArrayMethods arrayEquals should fast skip the check of

[jira] [Resolved] (SPARK-37796) ByteArrayMethods arrayEquals should fast skip the check of aligning with unaligned platform

2022-01-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37796. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35078

[jira] [Resolved] (SPARK-37817) Remove unreachable code in complexTypeExtractors.scala

2022-01-05 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-37817. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35106

[jira] [Commented] (SPARK-37818) Add option for show create table command

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469245#comment-17469245 ] Apache Spark commented on SPARK-37818: -- User 'Peng-Lei' has created a pull request for this issue:

[jira] [Commented] (SPARK-37818) Add option for show create table command

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469244#comment-17469244 ] Apache Spark commented on SPARK-37818: -- User 'Peng-Lei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37818) Add option for show create table command

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37818: Assignee: Apache Spark > Add option for show create table command >

[jira] [Assigned] (SPARK-37818) Add option for show create table command

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37818: Assignee: (was: Apache Spark) > Add option for show create table command >

[jira] [Created] (SPARK-37818) Add option for show create table command

2022-01-05 Thread PengLei (Jira)
PengLei created SPARK-37818: --- Summary: Add option for show create table command Key: SPARK-37818 URL: https://issues.apache.org/jira/browse/SPARK-37818 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-36593) [Deprecated] Support the Volcano Job API

2022-01-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-36593: Summary: [Deprecated] Support the Volcano Job API (was: Support the Volcano Job API) >

[jira] [Updated] (SPARK-36061) Add Volcano feature step

2022-01-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-36061: Description: Create a PodGroup with user specified minimum resources required > Add Volcano

[jira] [Updated] (SPARK-36061) Add Volcano feature step

2022-01-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-36061: Summary: Add Volcano feature step (was: Create a PodGroup with user specified minimum resources

[jira] [Commented] (SPARK-37814) Migrating from log4j 1 to log4j 2

2022-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469178#comment-17469178 ] Steve Loughran commented on SPARK-37814: be good to link to all issues related to this, e.g test

[jira] [Resolved] (SPARK-37816) Create table like should change to current user

2022-01-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-37816. --- Resolution: Won't Fix > Create table like should change to current user >

[jira] [Commented] (SPARK-37817) Remove unreachable code in complexTypeExtractors.scala

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469159#comment-17469159 ] Apache Spark commented on SPARK-37817: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-37817) Remove unreachable code in complexTypeExtractors.scala

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37817: Assignee: Gengliang Wang (was: Apache Spark) > Remove unreachable code in

[jira] [Commented] (SPARK-37817) Remove unreachable code in complexTypeExtractors.scala

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469157#comment-17469157 ] Apache Spark commented on SPARK-37817: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-37817) Remove unreachable code in complexTypeExtractors.scala

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37817: Assignee: Apache Spark (was: Gengliang Wang) > Remove unreachable code in

[jira] [Created] (SPARK-37817) Remove unreachable code in complexTypeExtractors.scala

2022-01-05 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-37817: -- Summary: Remove unreachable code in complexTypeExtractors.scala Key: SPARK-37817 URL: https://issues.apache.org/jira/browse/SPARK-37817 Project: Spark

[jira] [Created] (SPARK-37816) Create table like should change to current user

2022-01-05 Thread angerszhu (Jira)
angerszhu created SPARK-37816: - Summary: Create table like should change to current user Key: SPARK-37816 URL: https://issues.apache.org/jira/browse/SPARK-37816 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-37815) Fix the github action job "test_report"

2022-01-05 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-37815. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35104

[jira] [Assigned] (SPARK-37815) Fix the github action job "test_report"

2022-01-05 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-37815: -- Assignee: Gengliang Wang > Fix the github action job "test_report" >

[jira] [Commented] (SPARK-37800) TreeNode.argString incorrectly formats arguments of type Set[_]

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469141#comment-17469141 ] Apache Spark commented on SPARK-37800: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization

2022-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37779: - Fix Version/s: (was: 3.1.3) (was: 3.0.4) > Make ColumnarToRowExec

[jira] [Commented] (SPARK-37815) Fix the github action job "test_report"

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469114#comment-17469114 ] Apache Spark commented on SPARK-37815: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-37815) Fix the github action job "test_report"

2022-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469113#comment-17469113 ] Apache Spark commented on SPARK-37815: -- User 'gengliangwang' has created a pull request for this

  1   2   >