[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Description: Spark SQL today supports the TIMESTAMP data type.
> Support Decimal128 type
>
jiaan.geng created SPARK-40032:
--
Summary: Support Decimal128 type
Key: SPARK-40032
URL: https://issues.apache.org/jira/browse/SPARK-40032
Project: Spark
Issue Type: New Feature
Compone
[
https://issues.apache.org/jira/browse/SPARK-40028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577818#comment-17577818
]
Apache Spark commented on SPARK-40028:
--
User 'gengliangwang' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-40028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577817#comment-17577817
]
Apache Spark commented on SPARK-40028:
--
User 'gengliangwang' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Description:
Spark SQL today supports the Decimal data type. The implementation of Decimal
that can
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Description:
Spark SQL today supports the DECIMAL data type. The implementation of Decimal
that can
[
https://issues.apache.org/jira/browse/SPARK-40030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-40030.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37459
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-40030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-40030:
Assignee: Yang Jie
> Upgrade scala-maven-plugin to 4.7.1
> --
XiDuo You created SPARK-40033:
-
Summary: Nested schema pruning support through element_at
Key: SPARK-40033
URL: https://issues.apache.org/jira/browse/SPARK-40033
Project: Spark
Issue Type: Improv
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Description:
Spark SQL today supports the DECIMAL data type. The implementation of Decimal
that can
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Description:
Spark SQL today supports the DECIMAL data type. The implementation of Decimal
that can
[
https://issues.apache.org/jira/browse/SPARK-40033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40033:
Assignee: Apache Spark
> Nested schema pruning support through element_at
> -
[
https://issues.apache.org/jira/browse/SPARK-40033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40033:
Assignee: (was: Apache Spark)
> Nested schema pruning support through element_at
> --
[
https://issues.apache.org/jira/browse/SPARK-40033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577842#comment-17577842
]
Apache Spark commented on SPARK-40033:
--
User 'ulysses-you' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Description:
Spark SQL today supports the DECIMAL data type. The implementation of Decimal
that can
[
https://issues.apache.org/jira/browse/SPARK-40033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577844#comment-17577844
]
Apache Spark commented on SPARK-40033:
--
User 'ulysses-you' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Description:
Spark SQL today supports the DECIMAL data type. The implementation of Decimal
that can
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Description:
Spark SQL today supports the DECIMAL data type. The implementation of Decimal
that can
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Description:
Spark SQL today supports the DECIMAL data type. The implementation of Decimal
that can
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Attachment: Decimal128与Spark Decimal性能比较Benchmark.pdf
> Support Decimal128 type
> --
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Attachment: (was: Decimal128与Spark Decimal性能比较Benchmark.pdf)
> Support Decimal128 type
> ---
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Attachment: Performance comparison between decimal128 and spark decimal
benchmark.pdf
> Support Dec
[
https://issues.apache.org/jira/browse/SPARK-40008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577881#comment-17577881
]
Apache Spark commented on SPARK-40008:
--
User 'MaxGekk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Attachment: (was: Performance comparison between decimal128 and spark
decimal benchmark.pdf)
>
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40032:
---
Attachment: Performance comparison between decimal128 and spark decimal
benchmark.pdf
> Support Dec
[
https://issues.apache.org/jira/browse/SPARK-40032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577942#comment-17577942
]
jiaan.geng commented on SPARK-40032:
We are editing the design doc.
> Support Deci
[
https://issues.apache.org/jira/browse/SPARK-40029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40029:
Assignee: (was: Apache Spark)
> Make pyspark.sql.types examples self-contained
>
[
https://issues.apache.org/jira/browse/SPARK-40029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40029:
Assignee: Apache Spark
> Make pyspark.sql.types examples self-contained
> ---
[
https://issues.apache.org/jira/browse/SPARK-40029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577945#comment-17577945
]
Apache Spark commented on SPARK-40029:
--
User 'Yikun' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-40029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577946#comment-17577946
]
Apache Spark commented on SPARK-40029:
--
User 'Yikun' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-39734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-39734.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37449
[https://
[
https://issues.apache.org/jira/browse/SPARK-39734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-39734:
-
Assignee: Andrew Ray
> Add call_udf to pyspark.sql.functions
>
[
https://issues.apache.org/jira/browse/SPARK-36259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-36259.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37449
[https://
[
https://issues.apache.org/jira/browse/SPARK-39733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-39733.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37449
[https://
[
https://issues.apache.org/jira/browse/SPARK-37348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-37348.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37449
[https://
[
https://issues.apache.org/jira/browse/SPARK-37348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-37348:
-
Assignee: Ruifeng Zheng
> PySpark pmod function
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-39733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-39733:
-
Assignee: Ruifeng Zheng
> Add map_contains_key to pyspark.sql.functions
> -
[
https://issues.apache.org/jira/browse/SPARK-36259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-36259:
-
Assignee: Ruifeng Zheng
> Expose localtimestamp in pyspark.sql.functions
>
[
https://issues.apache.org/jira/browse/SPARK-39734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-39734:
-
Assignee: Ruifeng Zheng (was: Andrew Ray)
> Add call_udf to pyspark.sql.functions
> --
Steve Loughran created SPARK-40034:
--
Summary: PathOutputCommitters to work with dynamic partition
overwrite -if they support it
Key: SPARK-40034
URL: https://issues.apache.org/jira/browse/SPARK-40034
[
https://issues.apache.org/jira/browse/SPARK-40034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-40034:
---
Summary: PathOutputCommitters to work with dynamic partition overwrite
(was: PathOutputComm
[
https://issues.apache.org/jira/browse/SPARK-38910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-38910.
---
Resolution: Fixed
> Clean sparkStaging dir should before unregister()
>
[
https://issues.apache.org/jira/browse/SPARK-38910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-38910:
-
Assignee: angerszhu
> Clean sparkStaging dir should before unregister()
> -
EdisonWang created SPARK-40035:
--
Summary: Avoid apply filter twice when listing files
Key: SPARK-40035
URL: https://issues.apache.org/jira/browse/SPARK-40035
Project: Spark
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/SPARK-38910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-38910:
--
Fix Version/s: 3.4.0
> Clean sparkStaging dir should before unregister()
> ---
[
https://issues.apache.org/jira/browse/SPARK-40035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40035:
Assignee: Apache Spark
> Avoid apply filter twice when listing files
> --
[
https://issues.apache.org/jira/browse/SPARK-40035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578009#comment-17578009
]
Apache Spark commented on SPARK-40035:
--
User 'WangGuangxin' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-40035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578008#comment-17578008
]
Apache Spark commented on SPARK-40035:
--
User 'WangGuangxin' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-40035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40035:
Assignee: (was: Apache Spark)
> Avoid apply filter twice when listing files
> ---
[
https://issues.apache.org/jira/browse/SPARK-40034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578014#comment-17578014
]
Apache Spark commented on SPARK-40034:
--
User 'steveloughran' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-40034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40034:
Assignee: Apache Spark
> PathOutputCommitters to work with dynamic partition overwrite
>
[
https://issues.apache.org/jira/browse/SPARK-40034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40034:
Assignee: (was: Apache Spark)
> PathOutputCommitters to work with dynamic partition o
[
https://issues.apache.org/jira/browse/SPARK-38899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578051#comment-17578051
]
Apache Spark commented on SPARK-38899:
--
User 'chenzhx' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-38899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578052#comment-17578052
]
Apache Spark commented on SPARK-38899:
--
User 'chenzhx' has created a pull request f
Yang Jie created SPARK-40036:
Summary: LevelDB/RocksDBIterator.next should return false after
iterator or db close
Key: SPARK-40036
URL: https://issues.apache.org/jira/browse/SPARK-40036
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578066#comment-17578066
]
Apache Spark commented on SPARK-40036:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40036:
Assignee: Apache Spark
> LevelDB/RocksDBIterator.next should return false after iterator
[
https://issues.apache.org/jira/browse/SPARK-40036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40036:
Assignee: (was: Apache Spark)
> LevelDB/RocksDBIterator.next should return false afte
Bjørn Jørgensen created SPARK-40037:
---
Summary: Upgrade com.google.crypto.tink:tink from 1.6.1 to 1.7.0
Key: SPARK-40037
URL: https://issues.apache.org/jira/browse/SPARK-40037
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bjørn Jørgensen updated SPARK-40037:
Description:
[https://www.cve.org/CVERecord?id=CVE-2022-25647 | CVE-2022-25647]
[https:
[
https://issues.apache.org/jira/browse/SPARK-40037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bjørn Jørgensen updated SPARK-40037:
Description:
[https://www.cve.org/CVERecord?id=CVE-2022-25647| CVE-2022-25647]
[https:/
[
https://issues.apache.org/jira/browse/SPARK-40037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bjørn Jørgensen updated SPARK-40037:
Description:
[https://www.cve.org/CVERecord?id=CVE-2022-25647 | ]
[CVE-2022-25647|https:
[
https://issues.apache.org/jira/browse/SPARK-40037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bjørn Jørgensen updated SPARK-40037:
Description:
[CVE-2022-25647|https://www.cve.org/CVERecord?id=CVE-2022-25647]
[Info at SN
[
https://issues.apache.org/jira/browse/SPARK-38503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-38503:
-
Assignee: Yikun Jiang
> Add warn for getAdditionalPreKubernetesResources in executor si
[
https://issues.apache.org/jira/browse/SPARK-38503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-38503.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 35786
[https://
[
https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578094#comment-17578094
]
Apache Spark commented on SPARK-39887:
--
User 'peter-toth' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-39743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-39743:
-
Assignee: zhiming she
> Unable to set zstd compression level while writing parquet file
[
https://issues.apache.org/jira/browse/SPARK-39743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-39743.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37416
[https://
[
https://issues.apache.org/jira/browse/SPARK-40025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Boyang Jerry Peng updated SPARK-40025:
--
Summary: Project Lightspeed: Faster and Simpler Stream Processing with
Apache Spark (
[
https://issues.apache.org/jira/browse/SPARK-40025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Boyang Jerry Peng updated SPARK-40025:
--
Description:
Project Lightspeed is an umbrella project aimed at improving a couple of
[
https://issues.apache.org/jira/browse/SPARK-40025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Boyang Jerry Peng updated SPARK-40025:
--
Description:
Project Lightspeed is an umbrella project aimed at improving a couple of
RJ Marcus created SPARK-40038:
-
Summary: spark.sql.files.maxPartitionBytes does not observe
on-disk compression
Key: SPARK-40038
URL: https://issues.apache.org/jira/browse/SPARK-40038
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40037:
Assignee: Apache Spark
> Upgrade com.google.crypto.tink:tink from 1.6.1 to 1.7.0
> --
[
https://issues.apache.org/jira/browse/SPARK-40037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40037:
Assignee: (was: Apache Spark)
> Upgrade com.google.crypto.tink:tink from 1.6.1 to 1.7
[
https://issues.apache.org/jira/browse/SPARK-40038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
RJ Marcus updated SPARK-40038:
--
Attachment: Screenshot from 2022-08-10 16-59-56.png
Screenshot from 2022-08-10 16-50-37
[
https://issues.apache.org/jira/browse/SPARK-40037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578167#comment-17578167
]
Apache Spark commented on SPARK-40037:
--
User 'bjornjorgensen' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-40037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578168#comment-17578168
]
Apache Spark commented on SPARK-40037:
--
User 'bjornjorgensen' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-40038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578169#comment-17578169
]
RJ Marcus commented on SPARK-40038:
---
the screenshot with spillage didn't have the stag
[
https://issues.apache.org/jira/browse/SPARK-39983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-39983:
--
Assignee: Alex Balikov
> Should not cache unserialized broadcast relations on the driver
> --
[
https://issues.apache.org/jira/browse/SPARK-39983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-39983.
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37413
[https://github
[
https://issues.apache.org/jira/browse/SPARK-40039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578189#comment-17578189
]
Attila Zsolt Piros commented on SPARK-40039:
I am working on this.
> Introd
Attila Zsolt Piros created SPARK-40039:
--
Summary: Introducing checkpoint file manager based on Hadoop's
Abortable interface
Key: SPARK-40039
URL: https://issues.apache.org/jira/browse/SPARK-40039
[
https://issues.apache.org/jira/browse/SPARK-40039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-40039:
---
Summary: Introducing a streaming checkpoint file manager based on Hadoop's
Abortable
[
https://issues.apache.org/jira/browse/SPARK-40039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578192#comment-17578192
]
Apache Spark commented on SPARK-40039:
--
User 'attilapiros' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40039:
Assignee: Apache Spark (was: Attila Zsolt Piros)
> Introducing a streaming checkpoint fi
[
https://issues.apache.org/jira/browse/SPARK-40039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40039:
Assignee: Attila Zsolt Piros (was: Apache Spark)
> Introducing a streaming checkpoint fi
[
https://issues.apache.org/jira/browse/SPARK-40039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578193#comment-17578193
]
Apache Spark commented on SPARK-40039:
--
User 'attilapiros' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578195#comment-17578195
]
Jungtaek Lim commented on SPARK-40039:
--
Very interesting one to see! (Disclaimer: A
Yuming Wang created SPARK-40040:
---
Summary: Push local limit through outer join if join condition is
empty
Key: SPARK-40040
URL: https://issues.apache.org/jira/browse/SPARK-40040
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40040:
Summary: Push local limit to both sides if join condition is empty (was:
Push local limit through
[
https://issues.apache.org/jira/browse/SPARK-40040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578210#comment-17578210
]
Apache Spark commented on SPARK-40040:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578212#comment-17578212
]
Ruifeng Zheng commented on SPARK-40021:
---
Did you try to kill those Python jobs ind
[
https://issues.apache.org/jira/browse/SPARK-40040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578211#comment-17578211
]
Apache Spark commented on SPARK-40040:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-40040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40040:
Assignee: Apache Spark
> Push local limit to both sides if join condition is empty
>
[
https://issues.apache.org/jira/browse/SPARK-40040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40040:
Assignee: (was: Apache Spark)
> Push local limit to both sides if join condition is e
[
https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578212#comment-17578212
]
Ruifeng Zheng edited comment on SPARK-40021 at 8/11/22 2:08 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng updated SPARK-40021:
--
Attachment: Screen Shot 2022-08-11 at 10.07.24.png
> `Cancel workflow` can not cancel some job
[
https://issues.apache.org/jira/browse/SPARK-39708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578219#comment-17578219
]
Ruifeng Zheng commented on SPARK-39708:
---
??File /usr/local/spark/python/pyspark/ml
[
https://issues.apache.org/jira/browse/SPARK-39708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578220#comment-17578220
]
Ruifeng Zheng commented on SPARK-39708:
---
if you are using `pyspark.mllib.recommend
Qian Sun created SPARK-40041:
Summary: Add Document Parameters for pyspark.sql.window
Key: SPARK-40041
URL: https://issues.apache.org/jira/browse/SPARK-40041
Project: Spark
Issue Type: Sub-task
1 - 100 of 136 matches
Mail list logo
