[jira] [Created] (SPARK-42508) Extract the common .ml classes to `mllib-common`

Ruifeng Zheng created SPARK-42508: - Summary: Extract the common .ml classes to `mllib-common` Key: SPARK-42508 URL: https://issues.apache.org/jira/browse/SPARK-42508 Project: Spark Issue

[jira] [Commented] (SPARK-42507) Simplify ORC schema merging conflict error check

[ https://issues.apache.org/jira/browse/SPARK-42507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691420#comment-17691420 ] Apache Spark commented on SPARK-42507: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42507) Simplify ORC schema merging conflict error check

[ https://issues.apache.org/jira/browse/SPARK-42507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42507: Assignee: (was: Apache Spark) > Simplify ORC schema merging conflict error check >

[jira] [Commented] (SPARK-42507) Simplify ORC schema merging conflict error check

[ https://issues.apache.org/jira/browse/SPARK-42507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691419#comment-17691419 ] Apache Spark commented on SPARK-42507: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42507) Simplify ORC schema merging conflict error check

[ https://issues.apache.org/jira/browse/SPARK-42507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42507: Assignee: Apache Spark > Simplify ORC schema merging conflict error check >

[jira] [Updated] (SPARK-42507) Simplify ORC schema merging conflict error check

[ https://issues.apache.org/jira/browse/SPARK-42507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42507: -- Summary: Simplify ORC schema merging conflict error check (was: Simplify schema merging

[jira] [Created] (SPARK-42507) Simplify schema merging conflict error check

Dongjoon Hyun created SPARK-42507: - Summary: Simplify schema merging conflict error check Key: SPARK-42507 URL: https://issues.apache.org/jira/browse/SPARK-42507 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-37099) Introduce a rank-based filter to optimize top-k computation

[ https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37099: --- Assignee: jiaan.geng > Introduce a rank-based filter to optimize top-k computation >

[jira] [Resolved] (SPARK-37099) Introduce a rank-based filter to optimize top-k computation

[ https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37099. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 38799

[jira] [Assigned] (SPARK-42506) Fix Sort's maxRowsPerPartition if maxRows does not exist

[ https://issues.apache.org/jira/browse/SPARK-42506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42506: Assignee: (was: Apache Spark) > Fix Sort's maxRowsPerPartition if maxRows does not

[jira] [Assigned] (SPARK-42506) Fix Sort's maxRowsPerPartition if maxRows does not exist

[ https://issues.apache.org/jira/browse/SPARK-42506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42506: Assignee: Apache Spark > Fix Sort's maxRowsPerPartition if maxRows does not exist >

[jira] [Commented] (SPARK-42506) Fix Sort's maxRowsPerPartition if maxRows does not exist

[ https://issues.apache.org/jira/browse/SPARK-42506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691414#comment-17691414 ] Apache Spark commented on SPARK-42506: -- User 'wangyum' has created a pull request for this issue:

[jira] [Created] (SPARK-42506) Fix Sort's maxRowsPerPartition if maxRows does not exist

Yuming Wang created SPARK-42506: --- Summary: Fix Sort's maxRowsPerPartition if maxRows does not exist Key: SPARK-42506 URL: https://issues.apache.org/jira/browse/SPARK-42506 Project: Spark Issue

[jira] [Created] (SPARK-42505) Apply entrypoint template change to 3.3.0/3.3.1

Yikun Jiang created SPARK-42505: --- Summary: Apply entrypoint template change to 3.3.0/3.3.1 Key: SPARK-42505 URL: https://issues.apache.org/jira/browse/SPARK-42505 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-42494) Add official image Dockerfile for Spark v3.3.2

[ https://issues.apache.org/jira/browse/SPARK-42494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-42494. - Resolution: Fixed Resolved by https://github.com/apache/spark-docker/pull/30 > Add official

[jira] [Assigned] (SPARK-42494) Add official image Dockerfile for Spark v3.3.2

[ https://issues.apache.org/jira/browse/SPARK-42494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-42494: --- Assignee: Yikun Jiang > Add official image Dockerfile for Spark v3.3.2 >

[jira] [Commented] (SPARK-40278) Used databricks spark-sql-pref with Spark 3.3 to run 3TB tpcds test failed

[ https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691395#comment-17691395 ] Yang Jie commented on SPARK-40278: -- SQL not failed, UI may break. [~ulysses] explained this at

[jira] [Comment Edited] (SPARK-40278) Used databricks spark-sql-pref with Spark 3.3 to run 3TB tpcds test failed

[ https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691395#comment-17691395 ] Yang Jie edited comment on SPARK-40278 at 2/21/23 5:49 AM: --- SQL not failed, UI

[jira] [Commented] (SPARK-42503) Spark SQL should do further validation on join condition fields

[ https://issues.apache.org/jira/browse/SPARK-42503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691391#comment-17691391 ] ming95 commented on SPARK-42503: I test hive and mysql , they also do not have this validation .

[jira] [Commented] (SPARK-40278) Used databricks spark-sql-pref with Spark 3.3 to run 3TB tpcds test failed

[ https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691388#comment-17691388 ] Yuming Wang commented on SPARK-40278: - [~LuciferYang] Is this issue still exist? > Used databricks

[jira] [Commented] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691387#comment-17691387 ] Yuming Wang commented on SPARK-40610: - [~icyjhl] What's your dt data type? date, string or

[jira] [Assigned] (SPARK-42504) NestedColumnAliasing support pruning adjacent projects

[ https://issues.apache.org/jira/browse/SPARK-42504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42504: Assignee: Apache Spark > NestedColumnAliasing support pruning adjacent projects >

[jira] [Commented] (SPARK-42504) NestedColumnAliasing support pruning adjacent projects

[ https://issues.apache.org/jira/browse/SPARK-42504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691354#comment-17691354 ] Apache Spark commented on SPARK-42504: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-42504) NestedColumnAliasing support pruning adjacent projects

[ https://issues.apache.org/jira/browse/SPARK-42504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42504: Assignee: (was: Apache Spark) > NestedColumnAliasing support pruning adjacent

[jira] [Updated] (SPARK-42504) NestedColumnAliasing support pruning adjacent projects

[ https://issues.apache.org/jira/browse/SPARK-42504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-42504: -- Description: CollapseProject won't combine adjacent projects into one, e.g. non-cheap expression has

[jira] [Created] (SPARK-42504) NestedColumnAliasing support pruning adjacent projects

XiDuo You created SPARK-42504: - Summary: NestedColumnAliasing support pruning adjacent projects Key: SPARK-42504 URL: https://issues.apache.org/jira/browse/SPARK-42504 Project: Spark Issue Type:

[jira] [Updated] (SPARK-42501) High level design doc for Spark ML

[ https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42501: - Parent: SPARK-42471 Issue Type: Sub-task (was: New Feature) > High level design doc

[jira] [Updated] (SPARK-42412) Initial prototype implementation for PySparkML

[ https://issues.apache.org/jira/browse/SPARK-42412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42412: - Epic Link: (was: SPARK-39375) > Initial prototype implementation for PySparkML >

[jira] [Updated] (SPARK-42412) Initial prototype implementation for PySparkML

[ https://issues.apache.org/jira/browse/SPARK-42412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42412: - Parent: SPARK-42471 Issue Type: Sub-task (was: New Feature) > Initial prototype

[jira] [Updated] (SPARK-42412) Initial prototype implementation for PySparkML

[ https://issues.apache.org/jira/browse/SPARK-42412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42412: - Epic Link: SPARK-39375 > Initial prototype implementation for PySparkML >

[jira] [Updated] (SPARK-42501) High level design doc for Spark ML

[ https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42501: - Parent: (was: SPARK-39375) Issue Type: New Feature (was: Sub-task) > High level

[jira] [Updated] (SPARK-42412) Initial prototype implementation for PySparkML

[ https://issues.apache.org/jira/browse/SPARK-42412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42412: - Parent: (was: SPARK-39375) Issue Type: New Feature (was: Sub-task) > Initial

[jira] [Updated] (SPARK-42502) scala: accept user_agent in spark connect's connection string

[ https://issues.apache.org/jira/browse/SPARK-42502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42502: - Fix Version/s: (was: 3.4.0) > scala: accept user_agent in spark connect's connection string

[jira] [Assigned] (SPARK-42502) scala: accept user_agent in spark connect's connection string

[ https://issues.apache.org/jira/browse/SPARK-42502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42502: Assignee: (was: Niranjan Jayakar) > scala: accept user_agent in spark connect's

[jira] [Commented] (SPARK-42503) Spark SQL should do further validation on join condition fields

[ https://issues.apache.org/jira/browse/SPARK-42503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691321#comment-17691321 ] Yuming Wang commented on SPARK-42503: - Do other databases also have this validation? > Spark SQL

[jira] [Updated] (SPARK-42503) Spark SQL should do further validation on join condition fields

[ https://issues.apache.org/jira/browse/SPARK-42503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-42503: Fix Version/s: (was: 3.4.0) > Spark SQL should do further validation on join condition fields

[jira] [Updated] (SPARK-42503) Spark SQL should do further validation on join condition fields

[ https://issues.apache.org/jira/browse/SPARK-42503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-42503: Target Version/s: (was: 3.4.0) > Spark SQL should do further validation on join condition

[jira] [Commented] (SPARK-41823) DataFrame.join creating ambiguous column names

[ https://issues.apache.org/jira/browse/SPARK-41823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691290#comment-17691290 ] Apache Spark commented on SPARK-41823: -- User 'grundprinzip' has created a pull request for this

[jira] [Commented] (SPARK-41823) DataFrame.join creating ambiguous column names

[ https://issues.apache.org/jira/browse/SPARK-41823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691288#comment-17691288 ] Apache Spark commented on SPARK-41823: -- User 'grundprinzip' has created a pull request for this

[jira] [Commented] (SPARK-41823) DataFrame.join creating ambiguous column names

[ https://issues.apache.org/jira/browse/SPARK-41823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691289#comment-17691289 ] Apache Spark commented on SPARK-41823: -- User 'grundprinzip' has created a pull request for this

[jira] [Commented] (SPARK-41812) DataFrame.join: ambiguous column

[ https://issues.apache.org/jira/browse/SPARK-41812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691287#comment-17691287 ] Apache Spark commented on SPARK-41812: -- User 'grundprinzip' has created a pull request for this

[jira] [Resolved] (SPARK-41952) Upgrade Parquet to fix off-heap memory leaks in Zstd codec

[ https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-41952. -- Fix Version/s: 3.2.4 3.4.0 3.3.3 Resolution: Fixed >

[jira] [Assigned] (SPARK-41952) Upgrade Parquet to fix off-heap memory leaks in Zstd codec

[ https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-41952: Assignee: Cheng Pan > Upgrade Parquet to fix off-heap memory leaks in Zstd codec >

[jira] [Commented] (SPARK-42467) Spark Connect Scala Client: GroupBy and Aggregation

[ https://issues.apache.org/jira/browse/SPARK-42467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691264#comment-17691264 ] Rui Wang commented on SPARK-42467: -- Yes we gonna need to support cube/rollup/groupingsets along with

[jira] [Updated] (SPARK-42503) Spark SQL should do further validation on join condition fields

[ https://issues.apache.org/jira/browse/SPARK-42503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ming95 updated SPARK-42503: --- Description: In Spark SQL, the conditions for the join use fields that are allowed to be fields

[jira] [Commented] (SPARK-42503) Spark SQL should do further validation on join condition fields

[ https://issues.apache.org/jira/browse/SPARK-42503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691235#comment-17691235 ] ming95 commented on SPARK-42503: [~yumwang] [~gurwls223] cc > Spark SQL should do further

[jira] [Created] (SPARK-42503) Spark SQL should do further validation on join condition fields

ming95 created SPARK-42503: -- Summary: Spark SQL should do further validation on join condition fields Key: SPARK-42503 URL: https://issues.apache.org/jira/browse/SPARK-42503 Project: Spark

[jira] [Updated] (SPARK-42502) scala: accept user_agent in spark connect's connection string

[ https://issues.apache.org/jira/browse/SPARK-42502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niranjan Jayakar updated SPARK-42502: - Description: Currently, the Spark Connect service's {{client_type}} attribute (which is

[jira] [Created] (SPARK-42502) scala: accept user_agent in spark connect's connection string

Niranjan Jayakar created SPARK-42502: Summary: scala: accept user_agent in spark connect's connection string Key: SPARK-42502 URL: https://issues.apache.org/jira/browse/SPARK-42502 Project: Spark

[jira] [Updated] (SPARK-42477) python: accept user_agent in spark connect's connection string

[ https://issues.apache.org/jira/browse/SPARK-42477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niranjan Jayakar updated SPARK-42477: - Summary: python: accept user_agent in spark connect's connection string (was: accept

[jira] [Resolved] (SPARK-42498) reduce spark connect service retry time

[ https://issues.apache.org/jira/browse/SPARK-42498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niranjan Jayakar resolved SPARK-42498. -- Resolution: Abandoned > reduce spark connect service retry time >

[jira] [Updated] (SPARK-42498) reduce spark connect service retry time

[ https://issues.apache.org/jira/browse/SPARK-42498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niranjan Jayakar updated SPARK-42498: - Summary: reduce spark connect service retry time (was: make spark connect retries

[jira] [Updated] (SPARK-42498) make spark connect retries configurat

[ https://issues.apache.org/jira/browse/SPARK-42498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niranjan Jayakar updated SPARK-42498: - Summary: make spark connect retries configurat (was: reduce spark connect service

[jira] [Assigned] (SPARK-42423) Add metadata column file block start and length

[ https://issues.apache.org/jira/browse/SPARK-42423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42423: --- Assignee: XiDuo You > Add metadata column file block start and length >

[jira] [Resolved] (SPARK-42423) Add metadata column file block start and length

[ https://issues.apache.org/jira/browse/SPARK-42423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42423. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39996

[jira] [Assigned] (SPARK-42476) Spark Connect API reference.

[ https://issues.apache.org/jira/browse/SPARK-42476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42476: Assignee: Haejoon Lee > Spark Connect API reference. > > >

[jira] [Resolved] (SPARK-42476) Spark Connect API reference.

[ https://issues.apache.org/jira/browse/SPARK-42476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42476. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40067

[jira] [Assigned] (SPARK-42490) Upgrade protobuf-java to 3.22.0

[ https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42490: Assignee: Yang Jie > Upgrade protobuf-java to 3.22.0 > --- >

[jira] [Resolved] (SPARK-42490) Upgrade protobuf-java to 3.22.0

[ https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42490. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40084

[jira] [Updated] (SPARK-42490) Upgrade protobuf-java to 3.22.0

[ https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42490: - Priority: Minor (was: Major) > Upgrade protobuf-java to 3.22.0 >

[jira] [Resolved] (SPARK-42489) Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0

[ https://issues.apache.org/jira/browse/SPARK-42489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42489. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40083

[jira] [Assigned] (SPARK-42489) Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0

[ https://issues.apache.org/jira/browse/SPARK-42489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42489: Assignee: Yang Jie > Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0 >

[jira] [Resolved] (SPARK-42477) accept user_agent in spark connect's connection string

[ https://issues.apache.org/jira/browse/SPARK-42477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42477. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40054

[jira] [Assigned] (SPARK-42477) accept user_agent in spark connect's connection string

[ https://issues.apache.org/jira/browse/SPARK-42477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42477: Assignee: Niranjan Jayakar > accept user_agent in spark connect's connection string >

[jira] [Comment Edited] (SPARK-42501) High level design doc for Spark ML

[ https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691169#comment-17691169 ] Weichen Xu edited comment on SPARK-42501 at 2/20/23 1:25 PM: - The doc is not

[jira] [Updated] (SPARK-42501) High level design doc for Spark ML

[ https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-42501: --- Description: (was: Please find the HLD doc for spark ML via spark connect

[jira] [Commented] (SPARK-42501) High level design doc for Spark ML

[ https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691169#comment-17691169 ] Weichen Xu commented on SPARK-42501: CC [~mengxr] [~grundprinzip-db] [~podongfeng] [~srowen] Thanks!

[jira] [Assigned] (SPARK-42501) High level design doc for Spark ML

[ https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-42501: -- Assignee: Weichen Xu > High level design doc for Spark ML >

[jira] [Updated] (SPARK-42501) High level design doc for Spark ML

[ https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-42501: --- Description: Please find the HLD doc for spark ML via spark connect

[jira] [Updated] (SPARK-42501) High level design doc for Spark ML

[ https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-42501: --- Component/s: Connect Documentation > High level design doc for Spark ML >

[jira] [Created] (SPARK-42501) High level design doc for Spark ML

Weichen Xu created SPARK-42501: -- Summary: High level design doc for Spark ML Key: SPARK-42501 URL: https://issues.apache.org/jira/browse/SPARK-42501 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-41741) [SQL] ParquetFilters StringStartsWith push down matching string do not use UTF-8

[ https://issues.apache.org/jira/browse/SPARK-41741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-41741. - Resolution: Fixed > [SQL] ParquetFilters StringStartsWith push down matching string do not use

[jira] [Assigned] (SPARK-41741) [SQL] ParquetFilters StringStartsWith push down matching string do not use UTF-8

[ https://issues.apache.org/jira/browse/SPARK-41741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-41741: --- Fix Version/s: 3.4.0 3.3.3 Assignee: Yuming Wang > [SQL]

[jira] [Commented] (SPARK-42500) ConstantPropagation support more cases

[ https://issues.apache.org/jira/browse/SPARK-42500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691136#comment-17691136 ] Apache Spark commented on SPARK-42500: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42500) ConstantPropagation support more cases

[ https://issues.apache.org/jira/browse/SPARK-42500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42500: Assignee: Apache Spark > ConstantPropagation support more cases >

[jira] [Assigned] (SPARK-42500) ConstantPropagation support more cases

[ https://issues.apache.org/jira/browse/SPARK-42500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42500: Assignee: (was: Apache Spark) > ConstantPropagation support more cases >

[jira] [Commented] (SPARK-42500) ConstantPropagation support more cases

[ https://issues.apache.org/jira/browse/SPARK-42500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691135#comment-17691135 ] Apache Spark commented on SPARK-42500: -- User 'wangyum' has created a pull request for this issue:

[jira] [Created] (SPARK-42500) ConstantPropagation support more cases

Yuming Wang created SPARK-42500: --- Summary: ConstantPropagation support more cases Key: SPARK-42500 URL: https://issues.apache.org/jira/browse/SPARK-42500 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42486) Upgrade ZooKeeper from 3.6.3 to 3.6.4

[ https://issues.apache.org/jira/browse/SPARK-42486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-42486: Affects Version/s: 3.4.0 > Upgrade ZooKeeper from 3.6.3 to 3.6.4 >

[jira] [Created] (SPARK-42499) Support for Runtime SQL configuration

Ruifeng Zheng created SPARK-42499: - Summary: Support for Runtime SQL configuration Key: SPARK-42499 URL: https://issues.apache.org/jira/browse/SPARK-42499 Project: Spark Issue Type: Umbrella

[jira] [Resolved] (SPARK-41959) Improve v1 writes with empty2null

[ https://issues.apache.org/jira/browse/SPARK-41959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41959. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39475

[jira] [Commented] (SPARK-41324) Follow-up on JDK-8180450

[ https://issues.apache.org/jira/browse/SPARK-41324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691072#comment-17691072 ] Yang Jie commented on SPARK-41324: -- >From the affected versions of

[jira] [Resolved] (SPARK-42398) refine default column value framework

[ https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42398. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40049

[jira] [Assigned] (SPARK-42398) refine default column value framework

[ https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42398: --- Assignee: Wenchen Fan > refine default column value framework >

[jira] [Commented] (SPARK-42498) reduce spark connect service retry time

[ https://issues.apache.org/jira/browse/SPARK-42498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691056#comment-17691056 ] Apache Spark commented on SPARK-42498: -- User 'nija-at' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42498) reduce spark connect service retry time

[ https://issues.apache.org/jira/browse/SPARK-42498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42498: Assignee: Apache Spark > reduce spark connect service retry time >

[jira] [Assigned] (SPARK-42498) reduce spark connect service retry time

[ https://issues.apache.org/jira/browse/SPARK-42498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42498: Assignee: (was: Apache Spark) > reduce spark connect service retry time >