[jira] [Resolved] (SPARK-40992) Support toDF(columnNames) in Connect DSL

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40992. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38475

[jira] [Assigned] (SPARK-40992) Support toDF(columnNames) in Connect DSL

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40992: --- Assignee: Rui Wang > Support toDF(columnNames) in Connect DSL >

[jira] [Assigned] (SPARK-41056) Fix new R_LIBS_SITE behavior introduced in R 4.2

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41056: Assignee: Hyukjin Kwon > Fix new R_LIBS_SITE behavior introduced in R 4.2 >

[jira] [Resolved] (SPARK-41056) Fix new R_LIBS_SITE behavior introduced in R 4.2

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41056. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38570

[jira] [Created] (SPARK-41073) Spark ThriftServer generate huge amounts of DelegationToken

2022-11-08 Thread zhengchenyu (Jira)
zhengchenyu created SPARK-41073: --- Summary: Spark ThriftServer generate huge amounts of DelegationToken Key: SPARK-41073 URL: https://issues.apache.org/jira/browse/SPARK-41073 Project: Spark

[jira] [Assigned] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41058: --- Assignee: Deng Ziming > Removing unused code in connect > ---

[jira] [Resolved] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41058. - Resolution: Fixed Issue resolved by pull request 38491

[jira] [Commented] (SPARK-41064) Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630780#comment-17630780 ] Apache Spark commented on SPARK-41064: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41064) Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41064: Assignee: Ruifeng Zheng (was: Apache Spark) > Implement `DataFrame.crosstab` and

[jira] [Commented] (SPARK-41064) Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630779#comment-17630779 ] Apache Spark commented on SPARK-41064: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41064) Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41064: Assignee: Apache Spark (was: Ruifeng Zheng) > Implement `DataFrame.crosstab` and

[jira] [Created] (SPARK-41072) Convert the internal error about failed stream to user-facing error

2022-11-08 Thread Max Gekk (Jira)
Max Gekk created SPARK-41072: Summary: Convert the internal error about failed stream to user-facing error Key: SPARK-41072 URL: https://issues.apache.org/jira/browse/SPARK-41072 Project: Spark

[jira] [Commented] (SPARK-41071) Metaspace OOM when Local run dev/make-distribution.sh

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630772#comment-17630772 ] Apache Spark commented on SPARK-41071: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41071) Metaspace OOM when Local run dev/make-distribution.sh

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41071: Assignee: (was: Apache Spark) > Metaspace OOM when Local run

[jira] [Assigned] (SPARK-41071) Metaspace OOM when Local run dev/make-distribution.sh

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41071: Assignee: Apache Spark > Metaspace OOM when Local run dev/make-distribution.sh >

[jira] [Commented] (SPARK-41071) Metaspace OOM when Local run dev/make-distribution.sh

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630768#comment-17630768 ] Apache Spark commented on SPARK-41071: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-41071) Metaspace OOM when Local run dev/make-distribution.sh

2022-11-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630761#comment-17630761 ] Yang Jie commented on SPARK-41071: -- cc [~hyukjin.kwon]  [~yumwang]  I run  {code:java}

[jira] [Commented] (SPARK-41062) Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630760#comment-17630760 ] Apache Spark commented on SPARK-41062: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41062) Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41062: Assignee: (was: Apache Spark) > Rename UNSUPPORTED_CORRELATED_REFERENCE to

[jira] [Assigned] (SPARK-41062) Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41062: Assignee: Apache Spark > Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE

[jira] [Updated] (SPARK-41071) Metaspace OOM when Local run dev/make-distribution.sh

2022-11-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41071: - Summary: Metaspace OOM when Local run dev/make-distribution.sh (was: Metaspace OOm when Local run

[jira] [Created] (SPARK-41071) Metaspace OOm when Local run dev/make-distribution.sh

2022-11-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-41071: Summary: Metaspace OOm when Local run dev/make-distribution.sh Key: SPARK-41071 URL: https://issues.apache.org/jira/browse/SPARK-41071 Project: Spark Issue Type:

[jira] [Updated] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

2022-11-08 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-41070: Description: We are connecting Tera data from spark SQL with below API {color:#ff8b00}Dataset

[jira] [Updated] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

2022-11-08 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-41070: Description: We are connecting Tera data from spark SQL with below API {color:#ff8b00}Dataset

[jira] [Created] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

2022-11-08 Thread Ramakrishna (Jira)
Ramakrishna created SPARK-41070: --- Summary: Performance issue when Spark SQL connects with TeraData Key: SPARK-41070 URL: https://issues.apache.org/jira/browse/SPARK-41070 Project: Spark Issue

[jira] [Commented] (SPARK-40948) Introduce new error class: PATH_NOT_FOUND

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630757#comment-17630757 ] Apache Spark commented on SPARK-40948: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-40948) Introduce new error class: PATH_NOT_FOUND

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630758#comment-17630758 ] Apache Spark commented on SPARK-40948: -- User 'itholic' has created a pull request for this issue:

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Affects Version/s: 3.1.2 > Spark Submitter generates a ConfigMap with the same name >

[jira] [Commented] (SPARK-41063) `hive-thriftserver` module compilation deadlock

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630744#comment-17630744 ] Hyukjin Kwon commented on SPARK-41063: -- Is this from our CI? > `hive-thriftserver` module

[jira] [Commented] (SPARK-41063) `hive-thriftserver` module compilation deadlock

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630742#comment-17630742 ] Hyukjin Kwon commented on SPARK-41063: -- I am aware of this issue but I don't exactly know how to

[jira] [Created] (SPARK-41069) Implement `DataFrame.approxQuantile` and `DataFrame.stat.approxQuantile`

2022-11-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41069: - Summary: Implement `DataFrame.approxQuantile` and `DataFrame.stat.approxQuantile` Key: SPARK-41069 URL: https://issues.apache.org/jira/browse/SPARK-41069 Project:

[jira] [Created] (SPARK-41068) Implement `DataFrame.stat.corr`

2022-11-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41068: - Summary: Implement `DataFrame.stat.corr` Key: SPARK-41068 URL: https://issues.apache.org/jira/browse/SPARK-41068 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41067) Implement `DataFrame.stat.cov`

2022-11-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41067: - Summary: Implement `DataFrame.stat.cov` Key: SPARK-41067 URL: https://issues.apache.org/jira/browse/SPARK-41067 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Description: There's a problem with submitting spark jobs to K8s cluster: the library

[jira] [Created] (SPARK-41066) Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy `

2022-11-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41066: - Summary: Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy ` Key: SPARK-41066 URL: https://issues.apache.org/jira/browse/SPARK-41066 Project: Spark

[jira] [Created] (SPARK-41065) Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems `

2022-11-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41065: - Summary: Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems ` Key: SPARK-41065 URL: https://issues.apache.org/jira/browse/SPARK-41065 Project: Spark

[jira] [Assigned] (SPARK-41064) Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

2022-11-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41064: - Assignee: Ruifeng Zheng > Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

[jira] [Created] (SPARK-41064) Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab`

2022-11-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41064: - Summary: Implement `DataFrame.crosstab` and `DataFrame.stat.crosstab` Key: SPARK-41064 URL: https://issues.apache.org/jira/browse/SPARK-41064 Project: Spark

[jira] [Assigned] (SPARK-40917) Add a dedicated logical plan for `Summary`

2022-11-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40917: - Assignee: Ruifeng Zheng > Add a dedicated logical plan for `Summary` >

[jira] [Resolved] (SPARK-40917) Add a dedicated logical plan for `Summary`

2022-11-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40917. --- Resolution: Workaround > Add a dedicated logical plan for `Summary` >

[jira] [Commented] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630737#comment-17630737 ] Apache Spark commented on SPARK-41060: -- User '19Serhii99' has created a pull request for this

[jira] [Assigned] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41060: Assignee: (was: Apache Spark) > Spark Submitter generates a ConfigMap with the same

[jira] [Commented] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630736#comment-17630736 ] Apache Spark commented on SPARK-41060: -- User '19Serhii99' has created a pull request for this

[jira] [Assigned] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41060: Assignee: Apache Spark > Spark Submitter generates a ConfigMap with the same name >

[jira] [Commented] (SPARK-40513) SPIP: Support Docker Official Image for Spark

2022-11-08 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630735#comment-17630735 ] Yikun Jiang commented on SPARK-40513: - Enable Github Autolink references for spark-docker

[jira] [Commented] (SPARK-40513) SPIP: Support Docker Official Image for Spark

2022-11-08 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630733#comment-17630733 ] Yikun Jiang commented on SPARK-40513: - Add secrets.DOCKER_USER and secrets.DOCKER_TOKEN for

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Description: There's a problem with submitting spark jobs to K8s cluster: the library

[jira] [Commented] (SPARK-41063) `hive-thriftserver` module compilation deadlock

2022-11-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630731#comment-17630731 ] Yang Jie commented on SPARK-41063: -- cc [~hyukjin.kwon]  > `hive-thriftserver` module compilation

[jira] [Commented] (SPARK-41051) Optimize ProcfsMetrics file acquisition

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630730#comment-17630730 ] Apache Spark commented on SPARK-41051: -- User 'Narcasserun' has created a pull request for this

[jira] [Commented] (SPARK-41063) `hive-thriftserver` module compilation deadlock

2022-11-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630729#comment-17630729 ] Yang Jie commented on SPARK-41063: --   Always printing similar logs in a loop   {code:java}

[jira] [Created] (SPARK-41063) `hive-thriftserver` module compilation deadlock

2022-11-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-41063: Summary: `hive-thriftserver` module compilation deadlock Key: SPARK-41063 URL: https://issues.apache.org/jira/browse/SPARK-41063 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-41051) Optimize ProcfsMetrics file acquisition

2022-11-08 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-41051. - Fix Version/s: 3.4.0 (was: 3.3.2) Resolution:

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Description: There's a problem with submitting spark job to K8s cluster: the library

[jira] [Created] (SPARK-41062) Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE

2022-11-08 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41062: --- Summary: Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE Key: SPARK-41062 URL: https://issues.apache.org/jira/browse/SPARK-41062 Project: Spark

[jira] [Commented] (SPARK-41062) Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE

2022-11-08 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630724#comment-17630724 ] Haejoon Lee commented on SPARK-41062: - I'm working on it > Rename UNSUPPORTED_CORRELATED_REFERENCE

[jira] [Commented] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630723#comment-17630723 ] Apache Spark commented on SPARK-41061: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Serhii Nesterov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Description: There's a problem with submitting spark job to K8s cluster: the library

[jira] [Assigned] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41061: Assignee: Apache Spark > Support SelectExpr which apply Projection by expressions in

[jira] [Commented] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630720#comment-17630720 ] Apache Spark commented on SPARK-41061: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41061: Assignee: (was: Apache Spark) > Support SelectExpr which apply Projection by

[jira] [Assigned] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41059: Assignee: (was: Apache Spark) > Rename _LEGACY_ERROR_TEMP_2420 to

[jira] [Assigned] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41059: Assignee: Apache Spark > Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION >

[jira] [Commented] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630718#comment-17630718 ] Apache Spark commented on SPARK-41059: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41059: Assignee: Apache Spark > Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION >

[jira] [Commented] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630719#comment-17630719 ] Apache Spark commented on SPARK-41059: -- User 'itholic' has created a pull request for this issue:

[jira] [Created] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

2022-11-08 Thread Rui Wang (Jira)
Rui Wang created SPARK-41061: Summary: Support SelectExpr which apply Projection by expressions in Strings in Connect DSL Key: SPARK-41061 URL: https://issues.apache.org/jira/browse/SPARK-41061 Project:

[jira] [Created] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

2022-11-08 Thread Serhii Nesterov (Jira)
Serhii Nesterov created SPARK-41060: --- Summary: Spark Submitter generates a ConfigMap with the same name Key: SPARK-41060 URL: https://issues.apache.org/jira/browse/SPARK-41060 Project: Spark

[jira] [Created] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41059: --- Summary: Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION Key: SPARK-41059 URL: https://issues.apache.org/jira/browse/SPARK-41059 Project: Spark

[jira] [Commented] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

2022-11-08 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630716#comment-17630716 ] Haejoon Lee commented on SPARK-41059: - I'm working on it > Rename _LEGACY_ERROR_TEMP_2420 to

[jira] [Commented] (SPARK-37555) spark-sql should pass last unclosed comment to backend and execute throw a exception

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630715#comment-17630715 ] Apache Spark commented on SPARK-37555: -- User 'AngersZh' has created a pull request for this

[jira] [Resolved] (SPARK-41039) Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41039. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38550

[jira] [Assigned] (SPARK-41039) Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41039: Assignee: Yang Jie > Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13 >

[jira] [Updated] (SPARK-41039) Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41039: - Priority: Trivial (was: Major) > Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13

[jira] [Commented] (SPARK-41057) Support other data type conversion in the DataTypeProtoConverter

2022-11-08 Thread Deng Ziming (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630711#comment-17630711 ] Deng Ziming commented on SPARK-41057: - Thank you [~amaliujia] , I'm willing to have a try.欄 >

[jira] [Comment Edited] (SPARK-41057) Support other data type conversion in the DataTypeProtoConverter

2022-11-08 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630706#comment-17630706 ] Rui Wang edited comment on SPARK-41057 at 11/9/22 2:55 AM: --- [~dengziming]

[jira] [Assigned] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41058: Assignee: (was: Apache Spark) > Removing unused code in connect >

[jira] [Assigned] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41058: Assignee: Apache Spark > Removing unused code in connect >

[jira] [Commented] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630709#comment-17630709 ] Apache Spark commented on SPARK-41058: -- User 'dengziming' has created a pull request for this

[jira] [Assigned] (SPARK-41056) Fix new R_LIBS_SITE behavior introduced in R 4.2

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41056: Assignee: Apache Spark > Fix new R_LIBS_SITE behavior introduced in R 4.2 >

[jira] [Commented] (SPARK-41056) Fix new R_LIBS_SITE behavior introduced in R 4.2

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630708#comment-17630708 ] Apache Spark commented on SPARK-41056: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41056) Fix new R_LIBS_SITE behavior introduced in R 4.2

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41056: Assignee: (was: Apache Spark) > Fix new R_LIBS_SITE behavior introduced in R 4.2 >

[jira] [Created] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Deng Ziming (Jira)
Deng Ziming created SPARK-41058: --- Summary: Removing unused code in connect Key: SPARK-41058 URL: https://issues.apache.org/jira/browse/SPARK-41058 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41057) Support other data type conversion in the DataTypeProtoConverter

2022-11-08 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630706#comment-17630706 ] Rui Wang commented on SPARK-41057: -- @dengziming Are you interested in this JIRA? > Support other data

[jira] [Updated] (SPARK-41057) Support other data type conversion in the DataTypeProtoConverter

2022-11-08 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-41057: - Description: In

[jira] [Created] (SPARK-41057) Support other data type conversion in the DataTypeProtoConverter

2022-11-08 Thread Rui Wang (Jira)
Rui Wang created SPARK-41057: Summary: Support other data type conversion in the DataTypeProtoConverter Key: SPARK-41057 URL: https://issues.apache.org/jira/browse/SPARK-41057 Project: Spark

[jira] [Created] (SPARK-41056) Fix new R_LIBS_SITE behavior introduced in R 4.2

2022-11-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41056: Summary: Fix new R_LIBS_SITE behavior introduced in R 4.2 Key: SPARK-41056 URL: https://issues.apache.org/jira/browse/SPARK-41056 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41055) Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630699#comment-17630699 ] Apache Spark commented on SPARK-41055: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-41055) Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630698#comment-17630698 ] Apache Spark commented on SPARK-41055: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41055) Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41055: Assignee: Apache Spark > Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE >

[jira] [Assigned] (SPARK-41055) Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41055: Assignee: (was: Apache Spark) > Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

[jira] [Commented] (SPARK-41046) Support CreateView in Connect DSL

2022-11-08 Thread Deng Ziming (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630696#comment-17630696 ] Deng Ziming commented on SPARK-41046: - [~amaliujia] Aha, I'll review your code when free. > Support

[jira] [Commented] (SPARK-41055) Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

2022-11-08 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630694#comment-17630694 ] Haejoon Lee commented on SPARK-41055: - I'm working on it > Rename _LEGACY_ERROR_TEMP_2424 to

[jira] [Created] (SPARK-41055) Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE

2022-11-08 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41055: --- Summary: Rename _LEGACY_ERROR_TEMP_2424 to GROUP_BY_AGGREGATE Key: SPARK-41055 URL: https://issues.apache.org/jira/browse/SPARK-41055 Project: Spark Issue

[jira] [Assigned] (SPARK-41035) Incorrect results or NPE when a literal is reused across distinct aggregations

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41035: Assignee: Bruce Robbins > Incorrect results or NPE when a literal is reused across

[jira] [Resolved] (SPARK-41035) Incorrect results or NPE when a literal is reused across distinct aggregations

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41035. -- Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution:

[jira] [Resolved] (SPARK-40569) Add smoke test in standalone cluster for spark-docker

2022-11-08 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40569. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 21

[jira] [Commented] (SPARK-41051) Optimize ProcfsMetrics file acquisition

2022-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630685#comment-17630685 ] Apache Spark commented on SPARK-41051: -- User 'Narcasserun' has created a pull request for this

[jira] [Resolved] (SPARK-40852) Implement `DataFrame.summary`

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40852. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38318

[jira] [Commented] (SPARK-41047) round function with negative scale value runs failed

2022-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630676#comment-17630676 ] Hyukjin Kwon commented on SPARK-41047: -- cc [~wuyi] [~cloud_fan]. This seems from

[jira] [Updated] (SPARK-41050) Upgrade scalafmt from 3.5.9 to 3.6.1

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41050: - Priority: Trivial (was: Minor) > Upgrade scalafmt from 3.5.9 to 3.6.1 >

  1   2   >