[jira] [Updated] (SPARK-45158) There are ProblemFilters in the wrong place in MimaExcludes.scala.

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45158: - Affects Version/s: (was: 4.0.0) > There are ProblemFilters in the wrong place in

[jira] [Updated] (SPARK-45158) There are ProblemFilters in the wrong place in MimaExcludes.scala.

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45158: - Issue Type: Improvement (was: Bug) > There are ProblemFilters in the wrong place in

[jira] [Updated] (SPARK-43570) Enable DateOpsTests.test_rsub for pandas 2.0.0.

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43570: --- Labels: pull-request-available (was: ) > Enable DateOpsTests.test_rsub for pandas 2.0.0. >

[jira] [Resolved] (SPARK-43571) Enable DateOpsTests.test_sub for pandas 2.0.0.

2023-09-13 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43571. - Fix Version/s: 4.0.0 Target Version/s: 4.0.0 Resolution: Fixed This is fixed

[jira] [Resolved] (SPARK-43570) Enable DateOpsTests.test_rsub for pandas 2.0.0.

2023-09-13 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43570. - Fix Version/s: 4.0.0 Target Version/s: 4.0.0 Resolution: Fixed This is fixed

[jira] [Updated] (SPARK-44647) SPJ: Support SPJ when join key is subset of partition keys

2023-09-13 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-44647: - Summary: SPJ: Support SPJ when join key is subset of partition keys (was: Support SPJ when join key is

[jira] [Updated] (SPARK-45161) Bump `previousSparkVersion` to 3.5.0

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45161: --- Labels: pull-request-available (was: ) > Bump `previousSparkVersion` to 3.5.0 >

[jira] [Created] (SPARK-45161) Bump `previousSparkVersion` to 3.5.0

2023-09-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-45161: Summary: Bump `previousSparkVersion` to 3.5.0 Key: SPARK-45161 URL: https://issues.apache.org/jira/browse/SPARK-45161 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-45143) Make PySpark compatible with PyArrow 13.0.0

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45143: --- Labels: pull-request-available (was: ) > Make PySpark compatible with PyArrow 13.0.0 >

[jira] [Updated] (SPARK-40497) Upgrade Scala to 2.13.11

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-40497: --- Labels: pull-request-available (was: ) > Upgrade Scala to 2.13.11 >

[jira] [Updated] (SPARK-45160) The default value of ‘spark.executor.logs.rolling.strategy’ on the official website is incorrect

2023-09-13 Thread chenyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenyu updated SPARK-45160: --- Attachment: execute different logic.png > The default value of ‘spark.executor.logs.rolling.strategy’ on

[jira] [Updated] (SPARK-45160) The default value of ‘spark.executor.logs.rolling.strategy’ on the official website is incorrect

2023-09-13 Thread chenyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenyu updated SPARK-45160: --- Attachment: the default value.png > The default value of ‘spark.executor.logs.rolling.strategy’ on the

[jira] [Updated] (SPARK-45160) The default value of ‘spark.executor.logs.rolling.strategy’ on the official website is incorrect

2023-09-13 Thread chenyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenyu updated SPARK-45160: --- Attachment: the value on the official website.png > The default value of

[jira] [Created] (SPARK-45160) The default value of ‘spark.executor.logs.rolling.strategy’ on the official website is incorrect

2023-09-13 Thread chenyu (Jira)
chenyu created SPARK-45160: -- Summary: The default value of ‘spark.executor.logs.rolling.strategy’ on the official website is incorrect Key: SPARK-45160 URL: https://issues.apache.org/jira/browse/SPARK-45160

[jira] [Assigned] (SPARK-45056) Add process termination tests for Python foreachBatch and StreamingQueryListener

2023-09-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45056: Assignee: Wei Liu > Add process termination tests for Python foreachBatch and >

[jira] [Resolved] (SPARK-45056) Add process termination tests for Python foreachBatch and StreamingQueryListener

2023-09-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45056. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42779

[jira] [Resolved] (SPARK-36191) Support ORDER BY and LIMIT to be on the correlation path

2023-09-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36191. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42705

[jira] [Assigned] (SPARK-36191) Support ORDER BY and LIMIT to be on the correlation path

2023-09-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36191: --- Assignee: Allison Wang > Support ORDER BY and LIMIT to be on the correlation path >

[jira] [Resolved] (SPARK-45135) Make utils.eventually a parameterized decorator

2023-09-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45135. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42891

[jira] [Assigned] (SPARK-45135) Make utils.eventually a parameterized decorator

2023-09-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45135: - Assignee: Ruifeng Zheng > Make utils.eventually a parameterized decorator >

[jira] [Updated] (SPARK-43523) Memory leak in Spark UI

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43523: --- Labels: pull-request-available (was: ) > Memory leak in Spark UI > ---

[jira] [Updated] (SPARK-40037) Upgrade com.google.crypto.tink:tink from 1.6.1 to 1.7.0

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-40037: --- Labels: pull-request-available (was: ) > Upgrade com.google.crypto.tink:tink from 1.6.1 to

[jira] [Updated] (SPARK-45120) Upgrade d3 from v3 to v7(v7.8.5) and apply api changes in UI

2023-09-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45120: - Fix Version/s: (was: 4.0.0) > Upgrade d3 from v3 to v7(v7.8.5) and apply api changes in UI

[jira] [Reopened] (SPARK-45120) Upgrade d3 from v3 to v7(v7.8.5) and apply api changes in UI

2023-09-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-45120: -- Assignee: (was: Kent Yao) Reverted in

[jira] [Updated] (SPARK-45159) Handle named arguments only when necessary

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45159: --- Labels: pull-request-available (was: ) > Handle named arguments only when necessary >

[jira] [Created] (SPARK-45159) Handle named arguments only when necessary

2023-09-13 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-45159: - Summary: Handle named arguments only when necessary Key: SPARK-45159 URL: https://issues.apache.org/jira/browse/SPARK-45159 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45158) There are ProblemFilters in the wrong place in MimaExcludes.scala.

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45158: - Component/s: Build (was: Project Infra) > There are ProblemFilters in the wrong

[jira] [Updated] (SPARK-45158) There are ProblemFilters in the wrong place in MimaExcludes.scala.

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45158: --- Labels: pull-request-available (was: ) > There are ProblemFilters in the wrong place in

[jira] [Created] (SPARK-45158) There are ProblemFilters in the wrong place in MimaExcludes.scala.

2023-09-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-45158: Summary: There are ProblemFilters in the wrong place in MimaExcludes.scala. Key: SPARK-45158 URL: https://issues.apache.org/jira/browse/SPARK-45158 Project: Spark

[jira] [Updated] (SPARK-44496) Move Interfaces needed by SCSC to sql/api

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44496: --- Labels: pull-request-available (was: ) > Move Interfaces needed by SCSC to sql/api >

[jira] [Resolved] (SPARK-45144) Downgrade scala-maven-plugin to 4.7.1

2023-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45144. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42899

[jira] [Assigned] (SPARK-45144) Downgrade scala-maven-plugin to 4.7.1

2023-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45144: - Assignee: Yang Jie > Downgrade scala-maven-plugin to 4.7.1 >

[jira] [Updated] (SPARK-45157) Avoid repeated `if` checks in [On|Off|HeapColumnVector.java

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45157: --- Labels: pull-request-available (was: ) > Avoid repeated `if` checks in

[jira] [Assigned] (SPARK-45157) Avoid repeated `if` checks in [On|Off|HeapColumnVector.java

2023-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45157: - Assignee: Wenchen Fan > Avoid repeated `if` checks in [On|Off|HeapColumnVector.java >

[jira] [Resolved] (SPARK-45157) Avoid repeated `if` checks in [On|Off|HeapColumnVector.java

2023-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45157. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42903

[jira] [Created] (SPARK-45157) Avoid repeated `if` checks in [On|Off|HeapColumnVector.java

2023-09-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45157: - Summary: Avoid repeated `if` checks in [On|Off|HeapColumnVector.java Key: SPARK-45157 URL: https://issues.apache.org/jira/browse/SPARK-45157 Project: Spark

[jira] [Updated] (SPARK-45154) Pyspark DecisionTreeClassifier: results and tree structure in spark3 very different from that of the spark2 version on the same data and with the same hyperparameters.

2023-09-13 Thread Oumar Nour (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oumar Nour updated SPARK-45154: --- Labels: decisiontree pyspark3 spark2 spark3 (was: ) > Pyspark DecisionTreeClassifier: results and

[jira] [Created] (SPARK-45156) Wrap inputName by backticks in the NON_FOLDABLE_INPUT error class

2023-09-13 Thread Max Gekk (Jira)
Max Gekk created SPARK-45156: Summary: Wrap inputName by backticks in the NON_FOLDABLE_INPUT error class Key: SPARK-45156 URL: https://issues.apache.org/jira/browse/SPARK-45156 Project: Spark

[jira] [Updated] (SPARK-45155) Add API Docs

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45155: --- Labels: pull-request-available (was: ) > Add API Docs > > >

[jira] [Updated] (SPARK-45154) Pyspark DecisionTreeClassifier: results and tree structure in spark3 very different from that of the spark2 version on the same data and with the same hyperparameters.

2023-09-13 Thread Oumar Nour (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oumar Nour updated SPARK-45154: --- Language: Python3 pyspark spark3 Spark2 (was: Python3 pyspark) > Pyspark DecisionTreeClassifier:

[jira] [Created] (SPARK-45155) Add API Docs

2023-09-13 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-45155: Summary: Add API Docs Key: SPARK-45155 URL: https://issues.apache.org/jira/browse/SPARK-45155 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-45120) Upgrade d3 from v3 to v7(v7.8.5) and apply api changes in UI

2023-09-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764686#comment-17764686 ] Hudson commented on SPARK-45120: User 'yaooqinn' has created a pull request for this issue:

[jira] [Resolved] (SPARK-45146) The default value of ‘spark. submit. deployMode’ on the official website is incorrect

2023-09-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45146. -- Fix Version/s: 3.3.4 3.5.1 4.0.0

[jira] [Updated] (SPARK-45153) Rebalance testing time for `pyspark-pandas-connect-part1`

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45153: --- Labels: pull-request-available (was: ) > Rebalance testing time for

[jira] [Assigned] (SPARK-45146) The default value of ‘spark. submit. deployMode’ on the official website is incorrect

2023-09-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45146: Assignee: chenyu > The default value of ‘spark. submit. deployMode’ on the official

[jira] [Updated] (SPARK-45146) The default value of ‘spark. submit. deployMode’ on the official website is incorrect

2023-09-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45146: - Priority: Minor (was: Major) > The default value of ‘spark. submit. deployMode’ on the

[jira] [Updated] (SPARK-45154) Pyspark DecisionTreeClassifier: results and tree structure in spark3 very different from that of the spark2 version on the same data and with the same hyperparameters.

2023-09-13 Thread Oumar Nour (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oumar Nour updated SPARK-45154: --- Description: Hello, I have an engine running on spark2 using a DecisionTreeClassifier model using

[jira] [Updated] (SPARK-45154) Pyspark DecisionTreeClassifier: results and tree structure in spark3 very different from that of the spark2 version on the same data and with the same hyperparameters.

2023-09-13 Thread Oumar Nour (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oumar Nour updated SPARK-45154: --- Description: Hello, I have an engine running on spark2 using a DecisionTreeClassifier model using

[jira] [Created] (SPARK-45154) Pyspark DecisionTreeClassifier: results and tree structure in spark3 very different from that of the spark2 version on the same data and with the same hyperparameters.

2023-09-13 Thread Oumar Nour (Jira)
Oumar Nour created SPARK-45154: -- Summary: Pyspark DecisionTreeClassifier: results and tree structure in spark3 very different from that of the spark2 version on the same data and with the same hyperparameters. Key: SPARK-45154

[jira] [Created] (SPARK-45153) Rebalance testing time for `pyspark-pandas-connect-part1`

2023-09-13 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-45153: --- Summary: Rebalance testing time for `pyspark-pandas-connect-part1` Key: SPARK-45153 URL: https://issues.apache.org/jira/browse/SPARK-45153 Project: Spark

[jira] [Updated] (SPARK-45142) Specify the range for Spark Connect dependencies in pyspark base image

2023-09-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45142: - Fix Version/s: 3.5.1 > Specify the range for Spark Connect dependencies in pyspark base image >

[jira] [Assigned] (SPARK-45142) Specify the range for Spark Connect dependencies in pyspark base image

2023-09-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45142: Assignee: Hyukjin Kwon > Specify the range for Spark Connect dependencies in pyspark

[jira] [Resolved] (SPARK-45142) Specify the range for Spark Connect dependencies in pyspark base image

2023-09-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45142. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42898

[jira] [Updated] (SPARK-45005) Reducing the CI time for slow pyspark-pandas-connect tests

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45005: --- Labels: pull-request-available (was: ) > Reducing the CI time for slow

[jira] [Updated] (SPARK-45150) ChromeUISeleniumSuite test failed

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45150: --- Labels: pull-request-available (was: ) > ChromeUISeleniumSuite test failed >

[jira] [Created] (SPARK-45152) Add left-inclusive Param to Bucketizer

2023-09-13 Thread Simon Tao (Jira)
Simon Tao created SPARK-45152: - Summary: Add left-inclusive Param to Bucketizer Key: SPARK-45152 URL: https://issues.apache.org/jira/browse/SPARK-45152 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-45148) Upgrade ScalaTest to the 3.2.17 series.

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45148: --- Labels: pull-request-available (was: ) > Upgrade ScalaTest to the 3.2.17 series. >

[jira] [Resolved] (SPARK-45149) flaky test: RocksDBBackendChromeUIHistoryServerSuite

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45149. -- Resolution: Won't Fix It may be a problem with my local disk, close this one > flaky test:

[jira] [Updated] (SPARK-45151) Direct Task ThreadDump

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45151: --- Labels: pull-request-available (was: ) > Direct Task ThreadDump > -- >

[jira] [Updated] (SPARK-45149) flaky test: RocksDBBackendChromeUIHistoryServerSuite

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45149: - Summary: flaky test: RocksDBBackendChromeUIHistoryServerSuite (was:

[jira] [Resolved] (SPARK-45139) Add DatabricksDialect to handle SQL type conversion

2023-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45139. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42896

[jira] [Assigned] (SPARK-45139) Add DatabricksDialect to handle SQL type conversion

2023-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45139: - Assignee: Ivan Sadikov > Add DatabricksDialect to handle SQL type conversion >

[jira] [Created] (SPARK-45151) Direct Task ThreadDump

2023-09-13 Thread Kent Yao (Jira)
Kent Yao created SPARK-45151: Summary: Direct Task ThreadDump Key: SPARK-45151 URL: https://issues.apache.org/jira/browse/SPARK-45151 Project: Spark Issue Type: Sub-task Components:

[jira] [Resolved] (SPARK-45147) Remove System.setSecurityManager usage

2023-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45147. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42901

[jira] [Assigned] (SPARK-45034) Support deterministic mode function

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45034: -- Assignee: (was: Apache Spark) > Support deterministic mode function >

[jira] [Assigned] (SPARK-45034) Support deterministic mode function

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45034: -- Assignee: Apache Spark > Support deterministic mode function >

[jira] [Assigned] (SPARK-45034) Support deterministic mode function

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45034: -- Assignee: Apache Spark > Support deterministic mode function >

[jira] [Assigned] (SPARK-45034) Support deterministic mode function

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45034: -- Assignee: (was: Apache Spark) > Support deterministic mode function >

[jira] [Updated] (SPARK-45149) RocksDBBackendChromeUIHistoryServerSuite test failed

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45149: - Description: build/sbt -Dguava.version=31.1-jre

[jira] [Created] (SPARK-45150) ChromeUISeleniumSuite test failed

2023-09-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-45150: Summary: ChromeUISeleniumSuite test failed Key: SPARK-45150 URL: https://issues.apache.org/jira/browse/SPARK-45150 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-45149) RocksDBBackendChromeUIHistoryServerSuite test failed

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45149: - Issue Type: Bug (was: Improvement) > RocksDBBackendChromeUIHistoryServerSuite test failed >

[jira] [Created] (SPARK-45149) RocksDBBackendChromeUIHistoryServerSuite test failed

2023-09-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-45149: Summary: RocksDBBackendChromeUIHistoryServerSuite test failed Key: SPARK-45149 URL: https://issues.apache.org/jira/browse/SPARK-45149 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45148) Upgrade ScalaTest to the 3.2.17 series.

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45148: - Summary: Upgrade ScalaTest to the 3.2.17 series. (was: Upgraded ScalaTest to the 3.2.17 series.) >

[jira] [Created] (SPARK-45148) Upgraded ScalaTest to the 3.2.17 series.

2023-09-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-45148: Summary: Upgraded ScalaTest to the 3.2.17 series. Key: SPARK-45148 URL: https://issues.apache.org/jira/browse/SPARK-45148 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-45141) Pin `pyarrow==12.0.1` in CI

2023-09-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45141. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42897

[jira] [Assigned] (SPARK-45141) Pin `pyarrow==12.0.1` in CI

2023-09-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45141: - Assignee: Ruifeng Zheng > Pin `pyarrow==12.0.1` in CI > --- >

[jira] [Resolved] (SPARK-45145) Add JavaSparkSQLCli example

2023-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45145. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42900

[jira] [Assigned] (SPARK-45145) Add JavaSparkSQLCli example

2023-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45145: - Assignee: Dongjoon Hyun > Add JavaSparkSQLCli example > --- >

[jira] [Commented] (SPARK-45146) The default value of ‘spark. submit. deployMode’ on the official website is incorrect

2023-09-13 Thread chenyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764526#comment-17764526 ] chenyu commented on SPARK-45146: I had submit a pr to resolve this question.

[jira] [Updated] (SPARK-45146) The default value of ‘spark. submit. deployMode’ on the official website is incorrect

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45146: --- Labels: pull-request-available (was: ) > The default value of ‘spark. submit. deployMode’

[jira] [Updated] (SPARK-45147) Remove System.setSecurityManager usage

2023-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45147: -- Parent: SPARK-43831 Issue Type: Sub-task (was: Improvement) > Remove

[jira] [Assigned] (SPARK-45147) Remove System.setSecurityManager usage

2023-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45147: - Assignee: Dongjoon Hyun > Remove System.setSecurityManager usage >

[jira] [Commented] (SPARK-45115) No way to exclude jars setting to classpath while doing spark-submit

2023-09-13 Thread Sumanto Pal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764524#comment-17764524 ] Sumanto Pal commented on SPARK-45115: - _"Spark provides a user classpath first feature that might

[jira] [Updated] (SPARK-45147) Remove System.setSecurityManager usage

2023-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45147: --- Labels: pull-request-available (was: ) > Remove System.setSecurityManager usage >

[jira] [Updated] (SPARK-45147) Remove System.setSecurityManager usage

2023-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45147: -- Summary: Remove System.setSecurityManager usage (was: Remove System.setSecurityManager) >

[jira] [Created] (SPARK-45147) Remove System.setSecurityManager

2023-09-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45147: - Summary: Remove System.setSecurityManager Key: SPARK-45147 URL: https://issues.apache.org/jira/browse/SPARK-45147 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45144) Downgrade scala-maven-plugin to 4.7.1

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45144: - Description: The `scala-maven-plugin` versions 4.7.2 and later will try to automatically append the

[jira] [Updated] (SPARK-45146) The default value of ‘spark. submit. deployMode’ on the official website is incorrect

2023-09-13 Thread chenyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenyu updated SPARK-45146: --- Attachment: the value on the official website.png > The default value of ‘spark. submit. deployMode’ on the

[jira] [Updated] (SPARK-45146) The default value of ‘spark. submit. deployMode’ on the official website is incorrect

2023-09-13 Thread chenyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenyu updated SPARK-45146: --- Attachment: the default value.png > The default value of ‘spark. submit. deployMode’ on the official

[jira] [Created] (SPARK-45146) The default value of ‘spark. submit. deployMode’ on the official website is incorrect

2023-09-13 Thread chenyu (Jira)
chenyu created SPARK-45146: -- Summary: The default value of ‘spark. submit. deployMode’ on the official website is incorrect Key: SPARK-45146 URL: https://issues.apache.org/jira/browse/SPARK-45146 Project: