[
https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713412#comment-17713412
]
Hyukjin Kwon commented on SPARK-43170:
--
There'd be no more releases in Spark 3.2.X
[
https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713403#comment-17713403
]
todd commented on SPARK-43170:
--
Spark3.2.x is currently used in production, and there is no
[
https://issues.apache.org/jira/browse/SPARK-42663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713391#comment-17713391
]
Haejoon Lee edited comment on SPARK-42663 at 4/18/23 5:20 AM:
[
https://issues.apache.org/jira/browse/SPARK-42663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee resolved SPARK-42663.
-
Resolution: Fixed
Fixed from SPARK-42859
> Fix `default_session` to work properly
> ---
[
https://issues.apache.org/jira/browse/SPARK-42663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713391#comment-17713391
]
Haejoon Lee commented on SPARK-42663:
-
Sorry for the late responding, [~Wencong Liu]
[
https://issues.apache.org/jira/browse/SPARK-43078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee resolved SPARK-43078.
-
Resolution: Duplicate
> Separate test into `pyspark-conenct-pandas` and `pyspark-connect-pandas-
Cheng Pan created SPARK-43171:
-
Summary: Support dynamic changing unix user in Pod
Key: SPARK-43171
URL: https://issues.apache.org/jira/browse/SPARK-43171
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-43111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-43111:
Assignee: Bjørn Jørgensen
> Merge nested if statements into single if statements
> --
[
https://issues.apache.org/jira/browse/SPARK-43111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-43111.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40759
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-43113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-43113.
--
Fix Version/s: 3.4.1
3.5.0
Assignee: Bruce Robbins
Resolutio
[
https://issues.apache.org/jira/browse/SPARK-43112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-43112:
-
Target Version/s: (was: 3.3.3)
> Spark may use a column other than the actual specified parti
[
https://issues.apache.org/jira/browse/SPARK-43112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-43112:
-
Priority: Major (was: Critical)
> Spark may use a column other than the actual specified parti
[
https://issues.apache.org/jira/browse/SPARK-43154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713377#comment-17713377
]
Hyukjin Kwon commented on SPARK-43154:
--
Would be great if we have a self-cotained r
[
https://issues.apache.org/jira/browse/SPARK-43163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-43163.
--
Resolution: Invalid
> An exception occurred while hive table join tidb table
> ---
[
https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713373#comment-17713373
]
Hyukjin Kwon commented on SPARK-43170:
--
Spark 3.2.X is EOL. Mind trying if the same
[
https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-43170:
-
Priority: Major (was: Blocker)
> The spark sql like statement is pushed down to parquet for exe
[
https://issues.apache.org/jira/browse/SPARK-43122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43122.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40793
[https://
[
https://issues.apache.org/jira/browse/SPARK-43148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang reassigned SPARK-43148:
---
Assignee: Yikun Jiang
> Add official image dockerfile for Spark v3.4.0
> --
[
https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
todd updated SPARK-43170:
-
Description:
--DDL
CREATE TABLE `ecom_dwm`.`dwm_user_app_action_sum_all` (
`gaid` STRING COMMENT '',
`beyla
[
https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
todd updated SPARK-43170:
-
Description:
--DDL
CREATE TABLE `ecom_dwm`.`dwm_user_app_action_sum_all` (
`gaid` STRING COMMENT '',
`beyla
[
https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
todd updated SPARK-43170:
-
Attachment: image-2023-04-18-10-59-30-199.png
> The spark sql like statement is pushed down to parquet for execu
[
https://issues.apache.org/jira/browse/SPARK-43148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang resolved SPARK-43148.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 33
[https://github.
todd created SPARK-43170:
Summary: The spark sql like statement is pushed down to parquet
for execution, but the data cannot be queried
Key: SPARK-43170
URL: https://issues.apache.org/jira/browse/SPARK-43170
Yang Jie created SPARK-43169:
Summary: Update mima's previousSparkVersion to 3.4.0
Key: SPARK-43169
URL: https://issues.apache.org/jira/browse/SPARK-43169
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-43168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-43168.
---
Fix Version/s: 3.5.0
Resolution: Fixed
> Remove get PhysicalDataType method f
[
https://issues.apache.org/jira/browse/SPARK-42984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-42984.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40828
[https://
[
https://issues.apache.org/jira/browse/SPARK-42984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-42984:
-
Assignee: Takuya Ueshin
> Fix test_createDataFrame_with_single_data_type.
> ---
[
https://issues.apache.org/jira/browse/SPARK-41210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-41210.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40774
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-41210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-41210:
Assignee: Cheng Pan
> Window based executor failure tracking mechanism
>
[
https://issues.apache.org/jira/browse/SPARK-43084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-43084.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40736
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-43084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-43084:
Assignee: Peng Zhong
> Add Python state API (applyInPandasWithState) and verify UDFs
> --
[
https://issues.apache.org/jira/browse/SPARK-43146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713265#comment-17713265
]
GridGain Integration commented on SPARK-43146:
--
User 'ueshin' has created a
[
https://issues.apache.org/jira/browse/SPARK-43165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-43165:
-
Affects Version/s: 3.5.0
(was: 3.4.0)
> Move canWrite to DataTypeUtils
>
Rui Wang created SPARK-43168:
Summary: Remove get PhysicalDataType method from Datatype class
Key: SPARK-43168
URL: https://issues.apache.org/jira/browse/SPARK-43168
Project: Spark
Issue Type: Su
Wei Liu created SPARK-43167:
---
Summary: Streaming Connect console output format support
Key: SPARK-43167
URL: https://issues.apache.org/jira/browse/SPARK-43167
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-43166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713232#comment-17713232
]
Derek Brown commented on SPARK-43166:
-
I created a PR for this here:
https://github
Derek Brown created SPARK-43166:
---
Summary: Docker images are missing passwd entry for UID 185
Key: SPARK-43166
URL: https://issues.apache.org/jira/browse/SPARK-43166
Project: Spark
Issue Type:
Rui Wang created SPARK-43165:
Summary: Move canWrite to DataTypeUtils
Key: SPARK-43165
URL: https://issues.apache.org/jira/browse/SPARK-43165
Project: Spark
Issue Type: Sub-task
Compone
[
https://issues.apache.org/jira/browse/SPARK-42657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-42657.
---
Fix Version/s: 3.5.0
Assignee: Venkata Sai Akhil Gudesa
Resolution: F
[
https://issues.apache.org/jira/browse/SPARK-43164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713084#comment-17713084
]
YE commented on SPARK-43164:
hi [~vanzin], [~kabhwan] do you guys have any input for this is
YE created SPARK-43164:
--
Summary: Spark overwrites existing FILES/ARCHIVES/... settings
instead of merging them
Key: SPARK-43164
URL: https://issues.apache.org/jira/browse/SPARK-43164
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-43163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713069#comment-17713069
]
Yuming Wang commented on SPARK-43163:
-
It seems like TiSpark issue.
> An exception
[
https://issues.apache.org/jira/browse/SPARK-43152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713044#comment-17713044
]
Wojciech Indyk commented on SPARK-43152:
I raised a PR here: https://github.com/
Zhang Qi created SPARK-43163:
Summary: An exception occurred while hive table join tidb table
Key: SPARK-43163
URL: https://issues.apache.org/jira/browse/SPARK-43163
Project: Spark
Issue Type: Bu
[
https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jia Fan updated SPARK-42869:
Attachment: (was: image-2023-04-17-19-06-54-728.png)
> can not analyze window exp on sub query
> -
[
https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jia Fan updated SPARK-42869:
Attachment: image-2023-04-17-19-09-41-485.png
> can not analyze window exp on sub query
>
[
https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713029#comment-17713029
]
Jia Fan commented on SPARK-42869:
-
Can you try with master branch? I tested without any
[
https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jia Fan updated SPARK-42869:
Attachment: image-2023-04-17-19-06-54-728.png
> can not analyze window exp on sub query
>
[
https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jia Fan updated SPARK-42869:
Attachment: image-2023-04-17-19-06-28-069.png
> can not analyze window exp on sub query
>
[
https://issues.apache.org/jira/browse/SPARK-43162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-43162:
---
Description:
Currently, runtime filter only extract one filter creation side plan.
In some scene, in
[
https://issues.apache.org/jira/browse/SPARK-43162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-43162:
---
Description: Currently, Runtime filter only extract one
> Runtime filter should extracts multiple f
jiaan.geng created SPARK-43162:
--
Summary: Runtime filter should extracts multiple filter creation
side plans
Key: SPARK-43162
URL: https://issues.apache.org/jira/browse/SPARK-43162
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aimilios Tsouvelekakis updated SPARK-43160:
---
Summary: Remove typing.io namespace references as it is being removed
(was:
[
https://issues.apache.org/jira/browse/SPARK-43160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aimilios Tsouvelekakis updated SPARK-43160:
---
Description:
Python 3.11 gives a deprecation warning to the following:
{code
[
https://issues.apache.org/jira/browse/SPARK-43160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aimilios Tsouvelekakis updated SPARK-43160:
---
Description:
Python 3.11 gives a deprecation warning to the following:
{code
Jungtaek Lim created SPARK-43161:
Summary: Throw error in planning phase when the query redefines
watermark for a stream
Key: SPARK-43161
URL: https://issues.apache.org/jira/browse/SPARK-43161
Project
Aimilios Tsouvelekakis created SPARK-43160:
--
Summary: Remove typing.io references as it is being deprecated
from python 3.12
Key: SPARK-43160
URL: https://issues.apache.org/jira/browse/SPARK-43160
57 matches
Mail list logo