zhengruifeng created SPARK-37959:
Summary: Fix the UT of checking norm in KMeans & BiKMeans
Key: SPARK-37959
URL: https://issues.apache.org/jira/browse/SPARK-37959
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-37959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478405#comment-17478405
]
Apache Spark commented on SPARK-37959:
--
User 'zhengruifeng' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-37959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37959:
Assignee: Apache Spark
> Fix the UT of checking norm in KMeans & BiKMeans
> -
[
https://issues.apache.org/jira/browse/SPARK-37959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37959:
Assignee: (was: Apache Spark)
> Fix the UT of checking norm in KMeans & BiKMeans
> --
[
https://issues.apache.org/jira/browse/SPARK-37959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37959:
Assignee: Apache Spark
> Fix the UT of checking norm in KMeans & BiKMeans
> -
jiaan.geng created SPARK-37960:
--
Summary: Support complete push down SUM(CASE ... WHEN ... ELSE ...
END)
Key: SPARK-37960
URL: https://issues.apache.org/jira/browse/SPARK-37960
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-30661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478437#comment-17478437
]
zhengruifeng commented on SPARK-30661:
--
recently, I spend some time on testing bloc
[
https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-37960:
---
Summary: Support aggregate push down SUM(CASE ... WHEN ... ELSE ... END)
(was: Support complete pus
[
https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-37960:
---
Description:
Currently, Spark supports aggregate push down SUM(column) into JDBC data source.
SUM(CA
zhengruifeng created SPARK-37961:
Summary: override maxRows/maxRowsPerPartition for some logical
operators
Key: SPARK-37961
URL: https://issues.apache.org/jira/browse/SPARK-37961
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-37951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-37951:
---
Assignee: angerszhu
> Refactor ImageFileFormatSuite
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-37951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-37951.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35237
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478445#comment-17478445
]
Apache Spark commented on SPARK-37960:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37960:
Assignee: (was: Apache Spark)
> Support aggregate push down SUM(CASE ... WHEN ... ELS
[
https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37960:
Assignee: Apache Spark
> Support aggregate push down SUM(CASE ... WHEN ... ELSE ... END)
[
https://issues.apache.org/jira/browse/SPARK-37961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37961:
Assignee: Apache Spark
> override maxRows/maxRowsPerPartition for some logical operators
[
https://issues.apache.org/jira/browse/SPARK-37961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478452#comment-17478452
]
Apache Spark commented on SPARK-37961:
--
User 'zhengruifeng' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-37915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478451#comment-17478451
]
Apache Spark commented on SPARK-37915:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-37961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37961:
Assignee: (was: Apache Spark)
> override maxRows/maxRowsPerPartition for some logical
[
https://issues.apache.org/jira/browse/SPARK-37962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jinpeng Chi updated SPARK-37962:
Attachment: image-2022-01-19-17-18-24-795.png
> Cannot fetch remote jar correctly
> --
Jinpeng Chi created SPARK-37962:
---
Summary: Cannot fetch remote jar correctly
Key: SPARK-37962
URL: https://issues.apache.org/jira/browse/SPARK-37962
Project: Spark
Issue Type: Bug
Com
[
https://issues.apache.org/jira/browse/SPARK-37962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jinpeng Chi updated SPARK-37962:
Attachment: image-2022-01-19-17-21-53-011.png
> Cannot fetch remote jar correctly
> --
[
https://issues.apache.org/jira/browse/SPARK-37962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jinpeng Chi updated SPARK-37962:
Description:
When my Jar link address is encoded, the Jar cannot be pulled correctly
Log:
!image
[
https://issues.apache.org/jira/browse/SPARK-37962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478469#comment-17478469
]
Jinpeng Chi commented on SPARK-37962:
-
The root cause was that the link I had encode
[
https://issues.apache.org/jira/browse/SPARK-37910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478478#comment-17478478
]
Petri commented on SPARK-37910:
---
In deployment.yaml we have:
* name: POD_NAME
valueFrom:
[
https://issues.apache.org/jira/browse/SPARK-37910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478482#comment-17478482
]
Petri commented on SPARK-37910:
---
Also the error message we get in the executor is pretty v
[
https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478537#comment-17478537
]
Feng Zhu commented on SPARK-37932:
--
{code:scala}
{code}
> Analyzer can fail when jo
[ https://issues.apache.org/jira/browse/SPARK-37932 ]
Feng Zhu deleted comment on SPARK-37932:
--
was (Author: fishcus):
{code:scala}
{code}
> Analyzer can fail when join left side and right side are the same view
> --
[
https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478542#comment-17478542
]
Feng Zhu commented on SPARK-37932:
--
test
{code:scala}
test("SPARK-37932: view join v
[
https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478542#comment-17478542
]
Feng Zhu edited comment on SPARK-37932 at 1/19/22, 10:30 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478542#comment-17478542
]
Feng Zhu edited comment on SPARK-37932 at 1/19/22, 10:31 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478590#comment-17478590
]
Zhixiong Chen commented on SPARK-37932:
---
I'm working on
> Analyzer can fail when
[
https://issues.apache.org/jira/browse/SPARK-34805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Wallimann updated SPARK-34805:
Attachment: nested_columns_metadata.scala
> PySpark loses metadata in DataFrame fields whe
[
https://issues.apache.org/jira/browse/SPARK-34805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478610#comment-17478610
]
Kevin Wallimann commented on SPARK-34805:
-
The problem happens in Scala as well.
[
https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478618#comment-17478618
]
pralabhkumar commented on SPARK-24432:
--
[~dongjoon]
one quick question .
- The
Gengliang Wang created SPARK-37963:
--
Summary: Need to update Partition URI after renaming table in
InMemoryCatalog
Key: SPARK-37963
URL: https://issues.apache.org/jira/browse/SPARK-37963
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-37963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37963:
Assignee: Apache Spark (was: Gengliang Wang)
> Need to update Partition URI after renami
[
https://issues.apache.org/jira/browse/SPARK-37963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478635#comment-17478635
]
Apache Spark commented on SPARK-37963:
--
User 'gengliangwang' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-37963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37963:
Assignee: Gengliang Wang (was: Apache Spark)
> Need to update Partition URI after renami
[
https://issues.apache.org/jira/browse/SPARK-37955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andreas Chatzistergiou resolved SPARK-37955.
Resolution: Not A Bug
> PartitioningAwareFileIndex->basePath incorrectly c
[
https://issues.apache.org/jira/browse/SPARK-30661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478678#comment-17478678
]
Sean R. Owen commented on SPARK-30661:
--
How much difference does it make? I'm weigh
[
https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-32165.
-
Resolution: Not A Problem
> SessionState leaks SparkListener with multiple SparkSession
> --
[
https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478698#comment-17478698
]
Wenchen Fan commented on SPARK-32165:
-
I'm closing this as it won't happen in the re
[
https://issues.apache.org/jira/browse/SPARK-37959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huaxin Gao resolved SPARK-37959.
Fix Version/s: 3.2.1
3.3.0
Assignee: zhengruifeng (was: Apache Spark)
[
https://issues.apache.org/jira/browse/SPARK-37928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37928.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35226
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-37928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-37928:
Assignee: Yang Jie
> Add Parquet Data Page V2 bench scenario to DataSourceReadBenchmark
> ---
[
https://issues.apache.org/jira/browse/SPARK-37690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478861#comment-17478861
]
Kiran commented on SPARK-37690:
---
Got this issue with spark 3.2.0. Looking for workarounds
[
https://issues.apache.org/jira/browse/SPARK-37934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-37934:
-
Issue Type: Improvement (was: Bug)
> Upgrade Jetty version to 9.4.44
>
[
https://issues.apache.org/jira/browse/SPARK-37934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-37934.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35230
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-37934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-37934:
Assignee: Sajith A
> Upgrade Jetty version to 9.4.44
> ---
>
[
https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478907#comment-17478907
]
Dongjoon Hyun commented on SPARK-24432:
---
[~pralabhkumar]. What you are looking at
[
https://issues.apache.org/jira/browse/SPARK-37910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478934#comment-17478934
]
Dongjoon Hyun commented on SPARK-37910:
---
Hi, [~Silen].
Apache Spark JIRA issue is
[
https://issues.apache.org/jira/browse/SPARK-37910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-37910.
---
Resolution: Invalid
> Spark executor self-exiting due to driver disassociated in Kubernetes
[
https://issues.apache.org/jira/browse/SPARK-37910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-37910.
-
> Spark executor self-exiting due to driver disassociated in Kubernetes with
> client deploy-mode
>
[
https://issues.apache.org/jira/browse/SPARK-37154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478948#comment-17478948
]
Apache Spark commented on SPARK-37154:
--
User 'zero323' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-37154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37154:
Assignee: Apache Spark
> Inline type hints for python/pyspark/rdd.py
> --
[
https://issues.apache.org/jira/browse/SPARK-37154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37154:
Assignee: (was: Apache Spark)
> Inline type hints for python/pyspark/rdd.py
> ---
[
https://issues.apache.org/jira/browse/SPARK-37957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-37957.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35243
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-37957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-37957:
-
Fix Version/s: 3.2.1
> Deterministic flag is not handled for V2 functions
>
Venkata krishnan Sowrirajan created SPARK-37964:
---
Summary: Replace usages of slaveTracker to workerTracker in
MapOutputTrackerSuite
Key: SPARK-37964
URL: https://issues.apache.org/jira/browse/SPARK-3
angerszhu created SPARK-37965:
-
Summary: Remove check field name when reading existing data in
parquet
Key: SPARK-37965
URL: https://issues.apache.org/jira/browse/SPARK-37965
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-37965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-37965:
--
Description: Remove check field name when reading existing data in Orc
> Remove check field name when
[
https://issues.apache.org/jira/browse/SPARK-37965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-37965:
--
Summary: Remove check field name when reading/writing existing data in ORC
(was: Remove check field n
angerszhu created SPARK-37966:
-
Summary: Static insert should write _SUCCESS under partition path
Key: SPARK-37966
URL: https://issues.apache.org/jira/browse/SPARK-37966
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-37965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479079#comment-17479079
]
Apache Spark commented on SPARK-37965:
--
User 'AngersZh' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-37965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37965:
Assignee: Apache Spark
> Remove check field name when reading/writing existing data in OR
[
https://issues.apache.org/jira/browse/SPARK-37965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37965:
Assignee: (was: Apache Spark)
> Remove check field name when reading/writing existing
[
https://issues.apache.org/jira/browse/SPARK-37966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479082#comment-17479082
]
Apache Spark commented on SPARK-37966:
--
User 'AngersZh' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-37966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37966:
Assignee: (was: Apache Spark)
> Static insert should write _SUCCESS under partition p
[
https://issues.apache.org/jira/browse/SPARK-37966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37966:
Assignee: Apache Spark
> Static insert should write _SUCCESS under partition path
> -
[
https://issues.apache.org/jira/browse/SPARK-37839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-37839.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35130
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-37839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-37839:
---
Assignee: jiaan.geng
> DS V2 supports partial aggregate push-down AVG
> ---
[
https://issues.apache.org/jira/browse/SPARK-37954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-37954:
-
Component/s: SQL
> old columns should not be available after select or drop
> --
[
https://issues.apache.org/jira/browse/SPARK-37948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479096#comment-17479096
]
Hyukjin Kwon commented on SPARK-37948:
--
The problem is that users might intentional
angerszhu created SPARK-37967:
-
Summary: Literal support ObjectType
Key: SPARK-37967
URL: https://issues.apache.org/jira/browse/SPARK-37967
Project: Spark
Issue Type: Task
Components: S
[
https://issues.apache.org/jira/browse/SPARK-37967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-37967:
--
Summary: ConstantFolding/ Literal.create support ObjectType (was: Literal
support ObjectType)
> Cons
76 matches
Mail list logo