[
https://issues.apache.org/jira/browse/SPARK-42777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-42777.
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 40404
[
https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42340:
Assignee: Apache Spark
> Implement GroupedData.applyInPandas
>
[
https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42340:
Assignee: (was: Apache Spark)
> Implement GroupedData.applyInPandas
>
[
https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699922#comment-17699922
]
Apache Spark commented on SPARK-42340:
--
User 'xinrong-meng' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-21782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699875#comment-17699875
]
Apache Spark commented on SPARK-21782:
--
User 'megaserg' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699874#comment-17699874
]
Apache Spark commented on SPARK-21782:
--
User 'megaserg' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-42773:
-
Assignee: Allan Folting
> Minor grammatical change to "Supports Spark Connect" message
[
https://issues.apache.org/jira/browse/SPARK-42777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699872#comment-17699872
]
Apache Spark commented on SPARK-42777:
--
User 'gengliangwang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42777:
Assignee: Gengliang Wang (was: Apache Spark)
> Support converting TimestampNTZ catalog
[
https://issues.apache.org/jira/browse/SPARK-42777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699873#comment-17699873
]
Apache Spark commented on SPARK-42777:
--
User 'gengliangwang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42777:
Assignee: Apache Spark (was: Gengliang Wang)
> Support converting TimestampNTZ catalog
[
https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-42702.
-
Assignee: Wenchen Fan (was: Max Gekk)
Resolution: Fixed
> Support parameterized CTE
>
[
https://issues.apache.org/jira/browse/SPARK-42711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang Yan closed SPARK-42711.
-
> build/sbt usage error messages and shellcheck warn/error
>
[
https://issues.apache.org/jira/browse/SPARK-42711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang Yan resolved SPARK-42711.
---
Resolution: Not A Problem
The original codes are just a copy of upstream. And the changes not fix
[
https://issues.apache.org/jira/browse/SPARK-42597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-42597:
---
Assignee: Yuming Wang
> UnwrapCastInBinaryComparison support unwrap timestamp type
>
[
https://issues.apache.org/jira/browse/SPARK-42597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-42597:
Summary: Support unwrap date type to timestamp type (was:
UnwrapCastInBinaryComparison support
[
https://issues.apache.org/jira/browse/SPARK-42597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-42597.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40190
[
https://issues.apache.org/jira/browse/SPARK-42773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-42773.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 40401
[
https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699937#comment-17699937
]
Apache Spark commented on SPARK-42101:
--
User 'ulysses-you' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699924#comment-17699924
]
Apache Spark commented on SPARK-42340:
--
User 'xinrong-meng' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42771:
Assignee: (was: Apache Spark)
> Refactor HiveGenericUDF
> ---
>
[
https://issues.apache.org/jira/browse/SPARK-42771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699527#comment-17699527
]
Apache Spark commented on SPARK-42771:
--
User 'panbingkun' has created a pull request for this
jiaan.geng created SPARK-42772:
--
Summary: Adjust the default value of JDBC options about push down
to true
Key: SPARK-42772
URL: https://issues.apache.org/jira/browse/SPARK-42772
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699542#comment-17699542
]
Apache Spark commented on SPARK-42770:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42770:
Assignee: (was: Apache Spark)
> SQLImplicitsTestSuite test failed with Java 17
>
[
https://issues.apache.org/jira/browse/SPARK-42770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42770:
Assignee: Apache Spark
> SQLImplicitsTestSuite test failed with Java 17
>
[
https://issues.apache.org/jira/browse/SPARK-42769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699470#comment-17699470
]
Apache Spark commented on SPARK-42769:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang Yan updated SPARK-42711:
--
Description:
The build/sbt tool's usage information has some missing content:
{code:java}
(base)
[
https://issues.apache.org/jira/browse/SPARK-42577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-42577:
---
Assignee: Tengfei Huang
> A large stage could run indefinitely due to
[
https://issues.apache.org/jira/browse/SPARK-42577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-42577.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-42771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42771:
Assignee: Apache Spark
> Refactor HiveGenericUDF
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699571#comment-17699571
]
Apache Spark commented on SPARK-42772:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42772:
Assignee: (was: Apache Spark)
> Change the default value of JDBC options about push
[
https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42772:
Assignee: Apache Spark
> Change the default value of JDBC options about push down to
[
https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-42772:
---
Summary: Change the default value of JDBC options about push down to true
(was: Adjust the default
[
https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699595#comment-17699595
]
Apache Spark commented on SPARK-42052:
--
User 'panbingkun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-42769:
--
Summary: Add SPARK_DRIVER_POD_IP env variable to executor pods (was: Add
ENV_DRIVER_POD_IP
Dongjoon Hyun created SPARK-42769:
-
Summary: Add ENV_DRIVER_POD_IP env variable to executor pods
Key: SPARK-42769
URL: https://issues.apache.org/jira/browse/SPARK-42769
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-42766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699467#comment-17699467
]
Apache Spark commented on SPARK-42766:
--
User 'wangshengjie123' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699516#comment-17699516
]
Apache Spark commented on SPARK-40082:
--
User 'Stove-hust' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42769:
Assignee: (was: Apache Spark)
> Add ENV_DRIVER_POD_IP env variable to executor pods
[
https://issues.apache.org/jira/browse/SPARK-42769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42769:
Assignee: Apache Spark
> Add ENV_DRIVER_POD_IP env variable to executor pods
>
[
https://issues.apache.org/jira/browse/SPARK-42749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699503#comment-17699503
]
Tjomme Vergauwen commented on SPARK-42749:
--
Just checked the documentation again: the warning
[
https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699515#comment-17699515
]
Apache Spark commented on SPARK-40082:
--
User 'Stove-hust' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40082:
Assignee: Apache Spark
> DAGScheduler may not schduler new stage in condition of
[
https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40082:
Assignee: (was: Apache Spark)
> DAGScheduler may not schduler new stage in condition
[
https://issues.apache.org/jira/browse/SPARK-42764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42764:
-
Assignee: Dongjoon Hyun
> Parameterize the max number of attempts for driver props
[
https://issues.apache.org/jira/browse/SPARK-42764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42764.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40387
Yang Jie created SPARK-42770:
Summary: SQLImplicitsTestSuite test failed with Java 17
Key: SPARK-42770
URL: https://issues.apache.org/jira/browse/SPARK-42770
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-42508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-42508:
-
Assignee: Ruifeng Zheng
> Extract the common .ml classes to `mllib-common`
>
[
https://issues.apache.org/jira/browse/SPARK-42756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-42756:
-
Assignee: Ruifeng Zheng
> Helper function to convert proto literal to value in Python
[
https://issues.apache.org/jira/browse/SPARK-42756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-42756.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 40376
[
https://issues.apache.org/jira/browse/SPARK-42711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang Yan updated SPARK-42711:
--
Summary: build/sbt usage error messages and shellcheck warn/error (was:
build/sbt usage error
[
https://issues.apache.org/jira/browse/SPARK-42749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tjomme Vergauwen resolved SPARK-42749.
--
Resolution: Fixed
Additional settings required to get the intended behaviour.
BingKun Pan created SPARK-42771:
---
Summary: Refactor HiveGenericUDF
Key: SPARK-42771
URL: https://issues.apache.org/jira/browse/SPARK-42771
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-42766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42766:
Assignee: Apache Spark
> YarnAllocator should filter excluded nodes when launching
[
https://issues.apache.org/jira/browse/SPARK-42766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42766:
Assignee: (was: Apache Spark)
> YarnAllocator should filter excluded nodes when
[
https://issues.apache.org/jira/browse/SPARK-42755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-42755.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 40375
[
https://issues.apache.org/jira/browse/SPARK-42755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-42755:
-
Assignee: Ruifeng Zheng
> Factor literal value conversion out to connect-common
>
[
https://issues.apache.org/jira/browse/SPARK-42770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699490#comment-17699490
]
Yang Jie commented on SPARK-42770:
--
Maybe it can only be reproduced on Linux
>
[
https://issues.apache.org/jira/browse/SPARK-39235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-39235.
-
Fix Version/s: 3.4.0
Resolution: Fixed
> Make Catalog API be compatible with
[
https://issues.apache.org/jira/browse/SPARK-42749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699497#comment-17699497
]
Tjomme Vergauwen commented on SPARK-42749:
--
Hi,
This does indeed solve the problem. Setting
[ https://issues.apache.org/jira/browse/SPARK-42766 ]
wangshengjie deleted comment on SPARK-42766:
--
was (Author: wangshengjie):
Working on this
> YarnAllocator should filter excluded nodes when launching allocated containers
>
[
https://issues.apache.org/jira/browse/SPARK-38992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-38992:
-
Fix Version/s: (was: 3.1.3)
> Avoid using bash -c in ShellBasedGroupsMappingProvider
>
[
https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699611#comment-17699611
]
Apache Spark commented on SPARK-42101:
--
User 'cloud-fan' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699610#comment-17699610
]
Apache Spark commented on SPARK-42101:
--
User 'cloud-fan' has created a pull request for this issue:
Allan Folting created SPARK-42773:
-
Summary: Minor grammatical change to "Supports Spark Connect"
message
Key: SPARK-42773
URL: https://issues.apache.org/jira/browse/SPARK-42773
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42769:
-
Assignee: Dongjoon Hyun
> Add SPARK_DRIVER_POD_IP env variable to executor pods
>
[
https://issues.apache.org/jira/browse/SPARK-42769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42769.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40392
Micah Kornfield created SPARK-42774:
---
Summary: Expose VectorTypes API for DataSourceV2 Batch Scans
Key: SPARK-42774
URL: https://issues.apache.org/jira/browse/SPARK-42774
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Koifman updated SPARK-34637:
---
Summary: Support DPP in AQE when the broadcast exchange can be reused
(was: Support DPP in
[
https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699720#comment-17699720
]
Apache Spark commented on SPARK-41359:
--
User 'ClownXC' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41359:
Assignee: (was: Apache Spark)
> Use `PhysicalDataType` instead of DataType in
[
https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41359:
Assignee: Apache Spark
> Use `PhysicalDataType` instead of DataType in UnsafeRow
>
[
https://issues.apache.org/jira/browse/SPARK-42773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699781#comment-17699781
]
Apache Spark commented on SPARK-42773:
--
User 'allanf-db' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42773:
Assignee: (was: Apache Spark)
> Minor grammatical change to "Supports Spark Connect"
[
https://issues.apache.org/jira/browse/SPARK-42773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42773:
Assignee: Apache Spark
> Minor grammatical change to "Supports Spark Connect" message
>
[
https://issues.apache.org/jira/browse/SPARK-42754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42754:
Assignee: (was: Apache Spark)
> Spark 3.4 history server's SQL tab incorrectly
[
https://issues.apache.org/jira/browse/SPARK-42754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699852#comment-17699852
]
Apache Spark commented on SPARK-42754:
--
User 'linhongliu-db' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42754:
Assignee: Apache Spark
> Spark 3.4 history server's SQL tab incorrectly groups SQL
Gengliang Wang created SPARK-42777:
--
Summary: Support converting TimestampNTZ catalog stats to plan
stats
Key: SPARK-42777
URL: https://issues.apache.org/jira/browse/SPARK-42777
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenhao Li updated SPARK-42775:
---
Description:
In the {{approx_percentile}} expression, Spark casts decimal to double to
update the
Timothy Miller created SPARK-42776:
--
Summary: BroadcastHashJoinExec.requiredChildDistribution called
before columnar replacement rules
Key: SPARK-42776
URL: https://issues.apache.org/jira/browse/SPARK-42776
[
https://issues.apache.org/jira/browse/SPARK-42020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42020:
Assignee: Apache Spark
> createDataFrame with UDT
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-42020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699825#comment-17699825
]
Apache Spark commented on SPARK-42020:
--
User 'ueshin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42020:
Assignee: (was: Apache Spark)
> createDataFrame with UDT
>
Chenhao Li created SPARK-42775:
--
Summary: approx_percentile produces wrong results for large
decimals.
Key: SPARK-42775
URL: https://issues.apache.org/jira/browse/SPARK-42775
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenhao Li updated SPARK-42775:
---
Description:
In the {{approx_percentile}} expression, Spark casts decimal to double to
update the
88 matches
Mail list logo
