[jira] [Updated] (SPARK-37967) ConstantFolding/ Literal.create support ObjectType

2022-01-19 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-37967: -- Summary: ConstantFolding/ Literal.create support ObjectType (was: Literal support ObjectType) >

[jira] [Created] (SPARK-37967) Literal support ObjectType

2022-01-19 Thread angerszhu (Jira)
angerszhu created SPARK-37967: - Summary: Literal support ObjectType Key: SPARK-37967 URL: https://issues.apache.org/jira/browse/SPARK-37967 Project: Spark Issue Type: Task Components:

[jira] [Commented] (SPARK-37948) Disable mapreduce.fileoutputcommitter.algorithm.version=2 by default

2022-01-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479096#comment-17479096 ] Hyukjin Kwon commented on SPARK-37948: -- The problem is that users might intentionally enable v2

[jira] [Updated] (SPARK-37954) old columns should not be available after select or drop

2022-01-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37954: - Component/s: SQL > old columns should not be available after select or drop >

[jira] [Resolved] (SPARK-37839) DS V2 supports partial aggregate push-down AVG

2022-01-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37839. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35130

[jira] [Assigned] (SPARK-37839) DS V2 supports partial aggregate push-down AVG

2022-01-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37839: --- Assignee: jiaan.geng > DS V2 supports partial aggregate push-down AVG >

[jira] [Assigned] (SPARK-37966) Static insert should write _SUCCESS under partition path

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37966: Assignee: Apache Spark > Static insert should write _SUCCESS under partition path >

[jira] [Assigned] (SPARK-37966) Static insert should write _SUCCESS under partition path

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37966: Assignee: (was: Apache Spark) > Static insert should write _SUCCESS under partition

[jira] [Commented] (SPARK-37966) Static insert should write _SUCCESS under partition path

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479082#comment-17479082 ] Apache Spark commented on SPARK-37966: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-37965) Remove check field name when reading/writing existing data in ORC

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479079#comment-17479079 ] Apache Spark commented on SPARK-37965: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-37965) Remove check field name when reading/writing existing data in ORC

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37965: Assignee: Apache Spark > Remove check field name when reading/writing existing data in

[jira] [Assigned] (SPARK-37965) Remove check field name when reading/writing existing data in ORC

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37965: Assignee: (was: Apache Spark) > Remove check field name when reading/writing

[jira] [Created] (SPARK-37966) Static insert should write _SUCCESS under partition path

2022-01-19 Thread angerszhu (Jira)
angerszhu created SPARK-37966: - Summary: Static insert should write _SUCCESS under partition path Key: SPARK-37966 URL: https://issues.apache.org/jira/browse/SPARK-37966 Project: Spark Issue

[jira] [Updated] (SPARK-37965) Remove check field name when reading/writing existing data in ORC

2022-01-19 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-37965: -- Summary: Remove check field name when reading/writing existing data in ORC (was: Remove check field

[jira] [Updated] (SPARK-37965) Remove check field name when reading/writing existing data in ORC

2022-01-19 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-37965: -- Description: Remove check field name when reading existing data in Orc > Remove check field name when

[jira] [Created] (SPARK-37965) Remove check field name when reading existing data in parquet

2022-01-19 Thread angerszhu (Jira)
angerszhu created SPARK-37965: - Summary: Remove check field name when reading existing data in parquet Key: SPARK-37965 URL: https://issues.apache.org/jira/browse/SPARK-37965 Project: Spark

[jira] [Created] (SPARK-37964) Replace usages of slaveTracker to workerTracker in MapOutputTrackerSuite

2022-01-19 Thread Venkata krishnan Sowrirajan (Jira)
Venkata krishnan Sowrirajan created SPARK-37964: --- Summary: Replace usages of slaveTracker to workerTracker in MapOutputTrackerSuite Key: SPARK-37964 URL:

[jira] [Updated] (SPARK-37957) Deterministic flag is not handled for V2 functions

2022-01-19 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-37957: - Fix Version/s: 3.2.1 > Deterministic flag is not handled for V2 functions >

[jira] [Resolved] (SPARK-37957) Deterministic flag is not handled for V2 functions

2022-01-19 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-37957. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35243

[jira] [Assigned] (SPARK-37154) Inline type hints for python/pyspark/rdd.py

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37154: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/rdd.py >

[jira] [Assigned] (SPARK-37154) Inline type hints for python/pyspark/rdd.py

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37154: Assignee: Apache Spark > Inline type hints for python/pyspark/rdd.py >

[jira] [Commented] (SPARK-37154) Inline type hints for python/pyspark/rdd.py

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478948#comment-17478948 ] Apache Spark commented on SPARK-37154: -- User 'zero323' has created a pull request for this issue:

[jira] [Closed] (SPARK-37910) Spark executor self-exiting due to driver disassociated in Kubernetes with client deploy-mode

2022-01-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-37910. - > Spark executor self-exiting due to driver disassociated in Kubernetes with > client deploy-mode

[jira] [Resolved] (SPARK-37910) Spark executor self-exiting due to driver disassociated in Kubernetes with client deploy-mode

2022-01-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37910. --- Resolution: Invalid > Spark executor self-exiting due to driver disassociated in Kubernetes

[jira] [Commented] (SPARK-37910) Spark executor self-exiting due to driver disassociated in Kubernetes with client deploy-mode

2022-01-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478934#comment-17478934 ] Dongjoon Hyun commented on SPARK-37910: --- Hi, [~Silen]. Apache Spark JIRA issue is not supposed to

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

2022-01-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478907#comment-17478907 ] Dongjoon Hyun commented on SPARK-24432: --- [~pralabhkumar]. What you are looking at is not a single

[jira] [Assigned] (SPARK-37934) Upgrade Jetty version to 9.4.44

2022-01-19 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37934: Assignee: Sajith A > Upgrade Jetty version to 9.4.44 > --- >

[jira] [Resolved] (SPARK-37934) Upgrade Jetty version to 9.4.44

2022-01-19 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37934. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35230

[jira] [Updated] (SPARK-37934) Upgrade Jetty version to 9.4.44

2022-01-19 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37934: - Issue Type: Improvement (was: Bug) > Upgrade Jetty version to 9.4.44 >

[jira] [Commented] (SPARK-37690) Recursive view `df` detected (cycle: `df` -> `df`)

2022-01-19 Thread Kiran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478861#comment-17478861 ] Kiran commented on SPARK-37690: --- Got this issue with spark 3.2.0. Looking for workarounds but none worked

[jira] [Assigned] (SPARK-37928) Add Parquet Data Page V2 bench scenario to DataSourceReadBenchmark

2022-01-19 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-37928: Assignee: Yang Jie > Add Parquet Data Page V2 bench scenario to DataSourceReadBenchmark >

[jira] [Resolved] (SPARK-37928) Add Parquet Data Page V2 bench scenario to DataSourceReadBenchmark

2022-01-19 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-37928. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35226

[jira] [Resolved] (SPARK-37959) Fix the UT of checking norm in KMeans & BiKMeans

2022-01-19 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-37959. Fix Version/s: 3.2.1 3.3.0 Assignee: zhengruifeng (was: Apache Spark)

[jira] [Commented] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

2022-01-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478698#comment-17478698 ] Wenchen Fan commented on SPARK-32165: - I'm closing this as it won't happen in the real world. There

[jira] [Resolved] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

2022-01-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32165. - Resolution: Not A Problem > SessionState leaks SparkListener with multiple SparkSession >

[jira] [Commented] (SPARK-30661) KMeans blockify input vectors

2022-01-19 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478678#comment-17478678 ] Sean R. Owen commented on SPARK-30661: -- How much difference does it make? I'm weighing the cost of

[jira] [Resolved] (SPARK-37955) PartitioningAwareFileIndex->basePath incorrectly contains the partition filters

2022-01-19 Thread Andreas Chatzistergiou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andreas Chatzistergiou resolved SPARK-37955. Resolution: Not A Bug > PartitioningAwareFileIndex->basePath incorrectly

[jira] [Commented] (SPARK-37963) Need to update Partition URI after renaming table in InMemoryCatalog

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478635#comment-17478635 ] Apache Spark commented on SPARK-37963: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-37963) Need to update Partition URI after renaming table in InMemoryCatalog

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37963: Assignee: Gengliang Wang (was: Apache Spark) > Need to update Partition URI after

[jira] [Assigned] (SPARK-37963) Need to update Partition URI after renaming table in InMemoryCatalog

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37963: Assignee: Apache Spark (was: Gengliang Wang) > Need to update Partition URI after

[jira] [Created] (SPARK-37963) Need to update Partition URI after renaming table in InMemoryCatalog

2022-01-19 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-37963: -- Summary: Need to update Partition URI after renaming table in InMemoryCatalog Key: SPARK-37963 URL: https://issues.apache.org/jira/browse/SPARK-37963 Project:

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

2022-01-19 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478618#comment-17478618 ] pralabhkumar commented on SPARK-24432: -- [~dongjoon]  one quick question .  - The K8s dynamic

[jira] [Commented] (SPARK-34805) PySpark loses metadata in DataFrame fields when selecting nested columns

2022-01-19 Thread Kevin Wallimann (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478610#comment-17478610 ] Kevin Wallimann commented on SPARK-34805: - The problem happens in Scala as well. I attached a

[jira] [Updated] (SPARK-34805) PySpark loses metadata in DataFrame fields when selecting nested columns

2022-01-19 Thread Kevin Wallimann (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wallimann updated SPARK-34805: Attachment: nested_columns_metadata.scala > PySpark loses metadata in DataFrame fields

[jira] [Commented] (SPARK-37932) Analyzer can fail when join left side and right side are the same view

2022-01-19 Thread Zhixiong Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478590#comment-17478590 ] Zhixiong Chen commented on SPARK-37932: --- I'm working on > Analyzer can fail when join left side

[jira] [Comment Edited] (SPARK-37932) Analyzer can fail when join left side and right side are the same view

2022-01-19 Thread Feng Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478542#comment-17478542 ] Feng Zhu edited comment on SPARK-37932 at 1/19/22, 10:31 AM: - test 

[jira] [Comment Edited] (SPARK-37932) Analyzer can fail when join left side and right side are the same view

2022-01-19 Thread Feng Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478542#comment-17478542 ] Feng Zhu edited comment on SPARK-37932 at 1/19/22, 10:30 AM: - test 

[jira] [Commented] (SPARK-37932) Analyzer can fail when join left side and right side are the same view

2022-01-19 Thread Feng Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478542#comment-17478542 ] Feng Zhu commented on SPARK-37932: -- test  {code:scala} test("SPARK-37932: view join view self with

[jira] (SPARK-37932) Analyzer can fail when join left side and right side are the same view

2022-01-19 Thread Feng Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37932 ] Feng Zhu deleted comment on SPARK-37932: -- was (Author: fishcus): {code:scala}  {code}  > Analyzer can fail when join left side and right side are the same view >

[jira] [Commented] (SPARK-37932) Analyzer can fail when join left side and right side are the same view

2022-01-19 Thread Feng Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478537#comment-17478537 ] Feng Zhu commented on SPARK-37932: -- {code:scala}  {code}  > Analyzer can fail when join left side and

[jira] [Commented] (SPARK-37910) Spark executor self-exiting due to driver disassociated in Kubernetes with client deploy-mode

2022-01-19 Thread Petri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478482#comment-17478482 ] Petri commented on SPARK-37910: --- Also the error message we get in the executor is pretty vague:  Executor

[jira] [Commented] (SPARK-37910) Spark executor self-exiting due to driver disassociated in Kubernetes with client deploy-mode

2022-01-19 Thread Petri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478478#comment-17478478 ] Petri commented on SPARK-37910: --- In deployment.yaml we have: * name: POD_NAME valueFrom: fieldRef:

[jira] [Commented] (SPARK-37962) Cannot fetch remote jar correctly

2022-01-19 Thread Jinpeng Chi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478469#comment-17478469 ] Jinpeng Chi commented on SPARK-37962: - The root cause was that the link I had encoded was decoded >

[jira] [Updated] (SPARK-37962) Cannot fetch remote jar correctly

2022-01-19 Thread Jinpeng Chi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinpeng Chi updated SPARK-37962: Description: When my Jar link address is encoded, the Jar cannot be pulled correctly Log:

[jira] [Updated] (SPARK-37962) Cannot fetch remote jar correctly

2022-01-19 Thread Jinpeng Chi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinpeng Chi updated SPARK-37962: Attachment: image-2022-01-19-17-21-53-011.png > Cannot fetch remote jar correctly >

[jira] [Updated] (SPARK-37962) Cannot fetch remote jar correctly

2022-01-19 Thread Jinpeng Chi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinpeng Chi updated SPARK-37962: Attachment: image-2022-01-19-17-18-24-795.png > Cannot fetch remote jar correctly >

[jira] [Created] (SPARK-37962) Cannot fetch remote jar correctly

2022-01-19 Thread Jinpeng Chi (Jira)
Jinpeng Chi created SPARK-37962: --- Summary: Cannot fetch remote jar correctly Key: SPARK-37962 URL: https://issues.apache.org/jira/browse/SPARK-37962 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-37961) override maxRows/maxRowsPerPartition for some logical operators

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37961: Assignee: (was: Apache Spark) > override maxRows/maxRowsPerPartition for some

[jira] [Commented] (SPARK-37915) Push down deterministic projection through SQL UNION

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478451#comment-17478451 ] Apache Spark commented on SPARK-37915: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37961) override maxRows/maxRowsPerPartition for some logical operators

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37961: Assignee: Apache Spark > override maxRows/maxRowsPerPartition for some logical operators

[jira] [Commented] (SPARK-37961) override maxRows/maxRowsPerPartition for some logical operators

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478452#comment-17478452 ] Apache Spark commented on SPARK-37961: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-37960) Support aggregate push down SUM(CASE ... WHEN ... ELSE ... END)

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37960: Assignee: (was: Apache Spark) > Support aggregate push down SUM(CASE ... WHEN ...

[jira] [Assigned] (SPARK-37960) Support aggregate push down SUM(CASE ... WHEN ... ELSE ... END)

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37960: Assignee: Apache Spark > Support aggregate push down SUM(CASE ... WHEN ... ELSE ... END)

[jira] [Commented] (SPARK-37960) Support aggregate push down SUM(CASE ... WHEN ... ELSE ... END)

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478445#comment-17478445 ] Apache Spark commented on SPARK-37960: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37951) Refactor ImageFileFormatSuite

2022-01-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37951: --- Assignee: angerszhu > Refactor ImageFileFormatSuite > - > >

[jira] [Resolved] (SPARK-37951) Refactor ImageFileFormatSuite

2022-01-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37951. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35237

[jira] [Created] (SPARK-37961) override maxRows/maxRowsPerPartition for some logical operators

2022-01-19 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-37961: Summary: override maxRows/maxRowsPerPartition for some logical operators Key: SPARK-37961 URL: https://issues.apache.org/jira/browse/SPARK-37961 Project: Spark

[jira] [Updated] (SPARK-37960) Support aggregate push down SUM(CASE ... WHEN ... ELSE ... END)

2022-01-19 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37960: --- Description: Currently, Spark supports aggregate push down SUM(column) into JDBC data source.

[jira] [Updated] (SPARK-37960) Support aggregate push down SUM(CASE ... WHEN ... ELSE ... END)

2022-01-19 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37960: --- Summary: Support aggregate push down SUM(CASE ... WHEN ... ELSE ... END) (was: Support complete

[jira] [Commented] (SPARK-30661) KMeans blockify input vectors

2022-01-19 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478437#comment-17478437 ] zhengruifeng commented on SPARK-30661: -- recently, I spend some time on testing blockify kmeans and

[jira] [Created] (SPARK-37960) Support complete push down SUM(CASE ... WHEN ... ELSE ... END)

2022-01-19 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37960: -- Summary: Support complete push down SUM(CASE ... WHEN ... ELSE ... END) Key: SPARK-37960 URL: https://issues.apache.org/jira/browse/SPARK-37960 Project: Spark

[jira] [Assigned] (SPARK-37959) Fix the UT of checking norm in KMeans & BiKMeans

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37959: Assignee: Apache Spark > Fix the UT of checking norm in KMeans & BiKMeans >

[jira] [Assigned] (SPARK-37959) Fix the UT of checking norm in KMeans & BiKMeans

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37959: Assignee: (was: Apache Spark) > Fix the UT of checking norm in KMeans & BiKMeans >

[jira] [Assigned] (SPARK-37959) Fix the UT of checking norm in KMeans & BiKMeans

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37959: Assignee: Apache Spark > Fix the UT of checking norm in KMeans & BiKMeans >

[jira] [Commented] (SPARK-37959) Fix the UT of checking norm in KMeans & BiKMeans

2022-01-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478405#comment-17478405 ] Apache Spark commented on SPARK-37959: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-37959) Fix the UT of checking norm in KMeans & BiKMeans

2022-01-19 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-37959: Summary: Fix the UT of checking norm in KMeans & BiKMeans Key: SPARK-37959 URL: https://issues.apache.org/jira/browse/SPARK-37959 Project: Spark Issue Type: