Ruifeng Zheng created SPARK-42508:
-
Summary: Extract the common .ml classes to `mllib-common`
Key: SPARK-42508
URL: https://issues.apache.org/jira/browse/SPARK-42508
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-42507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691420#comment-17691420
]
Apache Spark commented on SPARK-42507:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42507:
Assignee: (was: Apache Spark)
> Simplify ORC schema merging conflict error check
>
[
https://issues.apache.org/jira/browse/SPARK-42507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691419#comment-17691419
]
Apache Spark commented on SPARK-42507:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42507:
Assignee: Apache Spark
> Simplify ORC schema merging conflict error check
>
[
https://issues.apache.org/jira/browse/SPARK-42507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-42507:
--
Summary: Simplify ORC schema merging conflict error check (was: Simplify
schema merging
Dongjoon Hyun created SPARK-42507:
-
Summary: Simplify schema merging conflict error check
Key: SPARK-42507
URL: https://issues.apache.org/jira/browse/SPARK-42507
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-37099:
---
Assignee: jiaan.geng
> Introduce a rank-based filter to optimize top-k computation
>
[
https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-37099.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 38799
[
https://issues.apache.org/jira/browse/SPARK-42506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42506:
Assignee: (was: Apache Spark)
> Fix Sort's maxRowsPerPartition if maxRows does not
[
https://issues.apache.org/jira/browse/SPARK-42506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42506:
Assignee: Apache Spark
> Fix Sort's maxRowsPerPartition if maxRows does not exist
>
[
https://issues.apache.org/jira/browse/SPARK-42506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691414#comment-17691414
]
Apache Spark commented on SPARK-42506:
--
User 'wangyum' has created a pull request for this issue:
Yuming Wang created SPARK-42506:
---
Summary: Fix Sort's maxRowsPerPartition if maxRows does not exist
Key: SPARK-42506
URL: https://issues.apache.org/jira/browse/SPARK-42506
Project: Spark
Issue
Yikun Jiang created SPARK-42505:
---
Summary: Apply entrypoint template change to 3.3.0/3.3.1
Key: SPARK-42505
URL: https://issues.apache.org/jira/browse/SPARK-42505
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-42494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang resolved SPARK-42494.
-
Resolution: Fixed
Resolved by https://github.com/apache/spark-docker/pull/30
> Add official
[
https://issues.apache.org/jira/browse/SPARK-42494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang reassigned SPARK-42494:
---
Assignee: Yikun Jiang
> Add official image Dockerfile for Spark v3.3.2
>
[
https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691395#comment-17691395
]
Yang Jie commented on SPARK-40278:
--
SQL not failed, UI may break. [~ulysses] explained this at
[
https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691395#comment-17691395
]
Yang Jie edited comment on SPARK-40278 at 2/21/23 5:49 AM:
---
SQL not failed, UI
[
https://issues.apache.org/jira/browse/SPARK-42503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691391#comment-17691391
]
ming95 commented on SPARK-42503:
I test hive and mysql , they also do not have this validation .
[
https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691388#comment-17691388
]
Yuming Wang commented on SPARK-40278:
-
[~LuciferYang] Is this issue still exist?
> Used databricks
[
https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691387#comment-17691387
]
Yuming Wang commented on SPARK-40610:
-
[~icyjhl] What's your dt data type? date, string or
[
https://issues.apache.org/jira/browse/SPARK-42504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42504:
Assignee: Apache Spark
> NestedColumnAliasing support pruning adjacent projects
>
[
https://issues.apache.org/jira/browse/SPARK-42504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691354#comment-17691354
]
Apache Spark commented on SPARK-42504:
--
User 'ulysses-you' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42504:
Assignee: (was: Apache Spark)
> NestedColumnAliasing support pruning adjacent
[
https://issues.apache.org/jira/browse/SPARK-42504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-42504:
--
Description:
CollapseProject won't combine adjacent projects into one, e.g. non-cheap
expression has
XiDuo You created SPARK-42504:
-
Summary: NestedColumnAliasing support pruning adjacent projects
Key: SPARK-42504
URL: https://issues.apache.org/jira/browse/SPARK-42504
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-42501:
-
Parent: SPARK-42471
Issue Type: Sub-task (was: New Feature)
> High level design doc
[
https://issues.apache.org/jira/browse/SPARK-42412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-42412:
-
Epic Link: (was: SPARK-39375)
> Initial prototype implementation for PySparkML
>
[
https://issues.apache.org/jira/browse/SPARK-42412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-42412:
-
Parent: SPARK-42471
Issue Type: Sub-task (was: New Feature)
> Initial prototype
[
https://issues.apache.org/jira/browse/SPARK-42412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-42412:
-
Epic Link: SPARK-39375
> Initial prototype implementation for PySparkML
>
[
https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-42501:
-
Parent: (was: SPARK-39375)
Issue Type: New Feature (was: Sub-task)
> High level
[
https://issues.apache.org/jira/browse/SPARK-42412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-42412:
-
Parent: (was: SPARK-39375)
Issue Type: New Feature (was: Sub-task)
> Initial
[
https://issues.apache.org/jira/browse/SPARK-42502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-42502:
-
Fix Version/s: (was: 3.4.0)
> scala: accept user_agent in spark connect's connection string
[
https://issues.apache.org/jira/browse/SPARK-42502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-42502:
Assignee: (was: Niranjan Jayakar)
> scala: accept user_agent in spark connect's
[
https://issues.apache.org/jira/browse/SPARK-42503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691321#comment-17691321
]
Yuming Wang commented on SPARK-42503:
-
Do other databases also have this validation?
> Spark SQL
[
https://issues.apache.org/jira/browse/SPARK-42503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-42503:
Fix Version/s: (was: 3.4.0)
> Spark SQL should do further validation on join condition fields
[
https://issues.apache.org/jira/browse/SPARK-42503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-42503:
Target Version/s: (was: 3.4.0)
> Spark SQL should do further validation on join condition
[
https://issues.apache.org/jira/browse/SPARK-41823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691290#comment-17691290
]
Apache Spark commented on SPARK-41823:
--
User 'grundprinzip' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-41823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691288#comment-17691288
]
Apache Spark commented on SPARK-41823:
--
User 'grundprinzip' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-41823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691289#comment-17691289
]
Apache Spark commented on SPARK-41823:
--
User 'grundprinzip' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-41812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691287#comment-17691287
]
Apache Spark commented on SPARK-41812:
--
User 'grundprinzip' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-41952.
--
Fix Version/s: 3.2.4
3.4.0
3.3.3
Resolution: Fixed
>
[
https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-41952:
Assignee: Cheng Pan
> Upgrade Parquet to fix off-heap memory leaks in Zstd codec
>
[
https://issues.apache.org/jira/browse/SPARK-42467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691264#comment-17691264
]
Rui Wang commented on SPARK-42467:
--
Yes we gonna need to support cube/rollup/groupingsets along with
[
https://issues.apache.org/jira/browse/SPARK-42503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ming95 updated SPARK-42503:
---
Description:
In Spark SQL, the conditions for the join use fields that are allowed to be
fields
[
https://issues.apache.org/jira/browse/SPARK-42503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691235#comment-17691235
]
ming95 commented on SPARK-42503:
[~yumwang] [~gurwls223] cc
> Spark SQL should do further
ming95 created SPARK-42503:
--
Summary: Spark SQL should do further validation on join condition
fields
Key: SPARK-42503
URL: https://issues.apache.org/jira/browse/SPARK-42503
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Niranjan Jayakar updated SPARK-42502:
-
Description:
Currently, the Spark Connect service's {{client_type}} attribute (which is
Niranjan Jayakar created SPARK-42502:
Summary: scala: accept user_agent in spark connect's connection
string
Key: SPARK-42502
URL: https://issues.apache.org/jira/browse/SPARK-42502
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Niranjan Jayakar updated SPARK-42477:
-
Summary: python: accept user_agent in spark connect's connection string
(was: accept
[
https://issues.apache.org/jira/browse/SPARK-42498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Niranjan Jayakar resolved SPARK-42498.
--
Resolution: Abandoned
> reduce spark connect service retry time
>
[
https://issues.apache.org/jira/browse/SPARK-42498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Niranjan Jayakar updated SPARK-42498:
-
Summary: reduce spark connect service retry time (was: make spark connect
retries
[
https://issues.apache.org/jira/browse/SPARK-42498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Niranjan Jayakar updated SPARK-42498:
-
Summary: make spark connect retries configurat (was: reduce spark connect
service
[
https://issues.apache.org/jira/browse/SPARK-42423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-42423:
---
Assignee: XiDuo You
> Add metadata column file block start and length
>
[
https://issues.apache.org/jira/browse/SPARK-42423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-42423.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39996
[
https://issues.apache.org/jira/browse/SPARK-42476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-42476:
Assignee: Haejoon Lee
> Spark Connect API reference.
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-42476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-42476.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 40067
[
https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-42490:
Assignee: Yang Jie
> Upgrade protobuf-java to 3.22.0
> ---
>
[
https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-42490.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40084
[
https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-42490:
-
Priority: Minor (was: Major)
> Upgrade protobuf-java to 3.22.0
>
[
https://issues.apache.org/jira/browse/SPARK-42489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-42489.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40083
[
https://issues.apache.org/jira/browse/SPARK-42489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-42489:
Assignee: Yang Jie
> Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0
>
[
https://issues.apache.org/jira/browse/SPARK-42477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-42477.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 40054
[
https://issues.apache.org/jira/browse/SPARK-42477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-42477:
Assignee: Niranjan Jayakar
> accept user_agent in spark connect's connection string
>
[
https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691169#comment-17691169
]
Weichen Xu edited comment on SPARK-42501 at 2/20/23 1:25 PM:
-
The doc is not
[
https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-42501:
---
Description: (was: Please find the HLD doc for spark ML via spark
connect
[
https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691169#comment-17691169
]
Weichen Xu commented on SPARK-42501:
CC [~mengxr] [~grundprinzip-db] [~podongfeng] [~srowen] Thanks!
[
https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu reassigned SPARK-42501:
--
Assignee: Weichen Xu
> High level design doc for Spark ML
>
[
https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-42501:
---
Description: Please find the HLD doc for spark ML via spark connect
[
https://issues.apache.org/jira/browse/SPARK-42501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-42501:
---
Component/s: Connect
Documentation
> High level design doc for Spark ML
>
Weichen Xu created SPARK-42501:
--
Summary: High level design doc for Spark ML
Key: SPARK-42501
URL: https://issues.apache.org/jira/browse/SPARK-42501
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-41741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-41741.
-
Resolution: Fixed
> [SQL] ParquetFilters StringStartsWith push down matching string do not use
[
https://issues.apache.org/jira/browse/SPARK-41741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-41741:
---
Fix Version/s: 3.4.0
3.3.3
Assignee: Yuming Wang
> [SQL]
[
https://issues.apache.org/jira/browse/SPARK-42500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691136#comment-17691136
]
Apache Spark commented on SPARK-42500:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42500:
Assignee: Apache Spark
> ConstantPropagation support more cases
>
[
https://issues.apache.org/jira/browse/SPARK-42500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42500:
Assignee: (was: Apache Spark)
> ConstantPropagation support more cases
>
[
https://issues.apache.org/jira/browse/SPARK-42500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691135#comment-17691135
]
Apache Spark commented on SPARK-42500:
--
User 'wangyum' has created a pull request for this issue:
Yuming Wang created SPARK-42500:
---
Summary: ConstantPropagation support more cases
Key: SPARK-42500
URL: https://issues.apache.org/jira/browse/SPARK-42500
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-42486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bjørn Jørgensen updated SPARK-42486:
Affects Version/s: 3.4.0
> Upgrade ZooKeeper from 3.6.3 to 3.6.4
>
Ruifeng Zheng created SPARK-42499:
-
Summary: Support for Runtime SQL configuration
Key: SPARK-42499
URL: https://issues.apache.org/jira/browse/SPARK-42499
Project: Spark
Issue Type: Umbrella
[
https://issues.apache.org/jira/browse/SPARK-41959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-41959.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39475
[
https://issues.apache.org/jira/browse/SPARK-41324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691072#comment-17691072
]
Yang Jie commented on SPARK-41324:
--
>From the affected versions of
[
https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-42398.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 40049
[
https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-42398:
---
Assignee: Wenchen Fan
> refine default column value framework
>
[
https://issues.apache.org/jira/browse/SPARK-42498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691056#comment-17691056
]
Apache Spark commented on SPARK-42498:
--
User 'nija-at' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42498:
Assignee: Apache Spark
> reduce spark connect service retry time
>
[
https://issues.apache.org/jira/browse/SPARK-42498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42498:
Assignee: (was: Apache Spark)
> reduce spark connect service retry time
>
87 matches
Mail list logo