Yang Jie created SPARK-44843:
Summary: flaky test: RocksDBStateStoreStreamingAggregationSuite
Key: SPARK-44843
URL: https://issues.apache.org/jira/browse/SPARK-44843
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755371#comment-17755371
]
Yang Jie commented on SPARK-44825:
--
Newly added case today：
[
https://issues.apache.org/jira/browse/SPARK-44822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-44822:
---
Assignee: Allison Wang
> Make Python UDTFs by default non-deterministic
>
[
https://issues.apache.org/jira/browse/SPARK-44822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-44822.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 42519
[
https://issues.apache.org/jira/browse/SPARK-43812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755354#comment-17755354
]
Snoot.io commented on SPARK-43812:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755355#comment-17755355
]
Snoot.io commented on SPARK-43812:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-44842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755353#comment-17755353
]
Snoot.io commented on SPARK-44842:
--
User 'itholic' has created a pull request for this issue:
Haejoon Lee created SPARK-44842:
---
Summary: Support stat functions
Key: SPARK-44842
URL: https://issues.apache.org/jira/browse/SPARK-44842
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755344#comment-17755344
]
Snoot.io commented on SPARK-44832:
--
User 'hvanhovell' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-44836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755343#comment-17755343
]
Snoot.io commented on SPARK-44836:
--
User 'ueshin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-44836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755342#comment-17755342
]
Snoot.io commented on SPARK-44836:
--
User 'ueshin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-44750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-44750:
-
Assignee: Michael Zhang (was: Ruifeng Zheng)
> SparkSession.Builder should respect
[
https://issues.apache.org/jira/browse/SPARK-44837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-44837:
-
Assignee: Michael Zhang (was: Ruifeng Zheng)
> Improve error message for ALTER TABLE
[
https://issues.apache.org/jira/browse/SPARK-44837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-44837:
-
Assignee: Ruifeng Zheng
> Improve error message for ALTER TABLE ALTER COLUMN on
[
https://issues.apache.org/jira/browse/SPARK-44750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-44750:
-
Assignee: Ruifeng Zheng (was: Michael Zhang)
> SparkSession.Builder should respect
[
https://issues.apache.org/jira/browse/SPARK-44836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-44836.
---
Fix Version/s: 3.5.0
Assignee: Takuya Ueshin
Resolution: Fixed
Issue
[
https://issues.apache.org/jira/browse/SPARK-42694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755329#comment-17755329
]
Shuaipeng Lee commented on SPARK-42694:
---
Are there any exeptions when the data-loss occur?
> Data
[
https://issues.apache.org/jira/browse/SPARK-43658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43658.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42388
[
https://issues.apache.org/jira/browse/SPARK-43658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-43658:
-
Assignee: Haejoon Lee
> Fix unexpected `SparkConnectGrpcException` from Spark Connect
[
https://issues.apache.org/jira/browse/SPARK-43618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-43618:
-
Assignee: Haejoon Lee
> Fix pyspark.sq.column._unary_op to work with Spark Connect.
>
[
https://issues.apache.org/jira/browse/SPARK-43618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43618.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42388
Haejoon Lee created SPARK-44841:
---
Summary: Support value_counts for pandas 2.0.0.
Key: SPARK-44841
URL: https://issues.apache.org/jira/browse/SPARK-44841
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-44750:
-
Assignee: Michael Zhang (was: Ruifeng Zheng)
> SparkSession.Builder should respect
Serge Rielau created SPARK-44840:
Summary: array_insert() give wrong results for ngative index
Key: SPARK-44840
URL: https://issues.apache.org/jira/browse/SPARK-44840
Project: Spark
Issue
Wei Liu created SPARK-44839:
---
Summary: Better error logging when user accesses spark session in
foreachBatch and Listener
Key: SPARK-44839
URL: https://issues.apache.org/jira/browse/SPARK-44839
Project:
[
https://issues.apache.org/jira/browse/SPARK-44784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755299#comment-17755299
]
Herman van Hövell commented on SPARK-44784:
---
Hmmm, this was supposed to be fixed by stubbing.
[
https://issues.apache.org/jira/browse/SPARK-44462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raghu Angadi updated SPARK-44462:
-
Description:
foreachBatch() in Connect uses initial session used while starting the
streaming
Serge Rielau created SPARK-44838:
Summary: Enhance raise_error() to exploit the new error framework
Key: SPARK-44838
URL: https://issues.apache.org/jira/browse/SPARK-44838
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755296#comment-17755296
]
Raghu Angadi commented on SPARK-44462:
--
I will work on this.
> Fix the session passed to
[
https://issues.apache.org/jira/browse/SPARK-42962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755295#comment-17755295
]
Raghu Angadi commented on SPARK-42962:
--
This is done. Stopped queries are accessible for an hour.
[
https://issues.apache.org/jira/browse/SPARK-43144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raghu Angadi closed SPARK-43144.
> Scala: DataStreamReader table() API
> ---
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-44460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755293#comment-17755293
]
Raghu Angadi commented on SPARK-44460:
--
[~WweiL] I think you looked into this issue. could you add
[
https://issues.apache.org/jira/browse/SPARK-44764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raghu Angadi updated SPARK-44764:
-
Summary: Streaming Python process management improvement (was: Streaming
process improvement)
[
https://issues.apache.org/jira/browse/SPARK-44837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Zhang updated SPARK-44837:
--
Affects Version/s: 3.3.2
3.2.4
3.1.3
[
https://issues.apache.org/jira/browse/SPARK-44837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Zhang updated SPARK-44837:
--
Description:
{code:java}
-- hive table
sql("create table some_table (x int, y int, z int)
[
https://issues.apache.org/jira/browse/SPARK-44837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Zhang updated SPARK-44837:
--
Description:
{code:java}
-- hive table
sql("create table some_table (x int, y int, z int)
Michael Zhang created SPARK-44837:
-
Summary: Improve error message for ALTER TABLE ALTER COLUMN on
partition columns in non-delta tables
Key: SPARK-44837
URL: https://issues.apache.org/jira/browse/SPARK-44837
Takuya Ueshin created SPARK-44836:
-
Summary: Refactor Arrow Python UDTF
Key: SPARK-44836
URL: https://issues.apache.org/jira/browse/SPARK-44836
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-43796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755232#comment-17755232
]
Herman van Hövell commented on SPARK-43796:
---
This has been fixed.
> Streaming ForeachWriter
[
https://issues.apache.org/jira/browse/SPARK-43796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-43796.
---
Fix Version/s: 3.5.0
Resolution: Fixed
> Streaming ForeachWriter can't
[
https://issues.apache.org/jira/browse/SPARK-44576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell reassigned SPARK-44576:
-
Assignee: Herman van Hövell
> Session Artifact update breaks XXWithState
[
https://issues.apache.org/jira/browse/SPARK-44829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-44829.
---
Fix Version/s: 3.5.0
Resolution: Fixed
> Expose uploadAllArtifactClasses in
[
https://issues.apache.org/jira/browse/SPARK-44824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell updated SPARK-44824:
--
Fix Version/s: 3.5.0
> There is content overlap in `ammoniteOut` used in
[
https://issues.apache.org/jira/browse/SPARK-42411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755217#comment-17755217
]
Eugene Koifman commented on SPARK-42411:
https://github.com/apache/spark/pull/40909
> Better
[
https://issues.apache.org/jira/browse/SPARK-44433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755215#comment-17755215
]
Nikita Awasthi commented on SPARK-44433:
User 'rangadi' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755180#comment-17755180
]
Ignite TC Bot commented on SPARK-42947:
---
User 'liujiayi771' has created a pull request for this
Juliusz Sompolski created SPARK-44835:
-
Summary: SparkConnect ReattachExecute could raise before
ExecutePlan even attaches.
Key: SPARK-44835
URL: https://issues.apache.org/jira/browse/SPARK-44835
Allison Wang created SPARK-44834:
Summary: Add SQL query test suites for Python UDTFs
Key: SPARK-44834
URL: https://issues.apache.org/jira/browse/SPARK-44834
Project: Spark
Issue Type:
Juliusz Sompolski created SPARK-44833:
-
Summary: Spark Connect reattach when initial ExecutePlan didn't
reach server doing too eager Reattach
Key: SPARK-44833
URL:
[
https://issues.apache.org/jira/browse/SPARK-44765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Juliusz Sompolski resolved SPARK-44765.
---
Fix Version/s: 3.5.0
Resolution: Fixed
> Make ReleaseExecute retry in
Herman van Hövell created SPARK-44832:
-
Summary: Fix connect client transitive classpath
Key: SPARK-44832
URL: https://issues.apache.org/jira/browse/SPARK-44832
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-44807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-44807.
---
Fix Version/s: 4.0.0
Resolution: Fixed
> Add Dataset.metadataColumn
>
[
https://issues.apache.org/jira/browse/SPARK-44828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-44828:
Assignee: Dongjoon Hyun
> Upgrade ORC to 1.9.1
>
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-44828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-44828.
--
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-44821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-44821.
--
Fix Version/s: 4.0.0
Target Version/s: 4.0.0
Assignee: Dongjoon Hyun
[
https://issues.apache.org/jira/browse/SPARK-44799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755057#comment-17755057
]
Ignite TC Bot commented on SPARK-44799:
---
User 'hvanhovell' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-44799.
---
Fix Version/s: 3.5.0
Resolution: Fixed
> Fix outer scopes for Ammonite
[
https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754694#comment-17754694
]
Rakesh Raushan edited comment on SPARK-44817 at 8/16/23 1:08 PM:
-
Ruifeng Zheng created SPARK-44831:
-
Summary: Refine DocString of `Union*`
Key: SPARK-44831
URL: https://issues.apache.org/jira/browse/SPARK-44831
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-44565.
---
Resolution: Not A Problem
> Example: Refine the docs for Union, UnionAll and unionByName
>
[
https://issues.apache.org/jira/browse/SPARK-44564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-44564.
---
Resolution: Not A Problem
> Refine the documents with LLM
> -
>
BingKun Pan created SPARK-44830:
---
Summary: Upgrade grpc to 1.57.2
Key: SPARK-44830
URL: https://issues.apache.org/jira/browse/SPARK-44830
Project: Spark
Issue Type: Improvement
Venkata Sai Akhil Gudesa created SPARK-44829:
Summary: Expose uploadAllArtifactClasses in ArtifactManager to
`sql` package
Key: SPARK-44829
URL: https://issues.apache.org/jira/browse/SPARK-44829
[
https://issues.apache.org/jira/browse/SPARK-44824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-44824.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42509
[
https://issues.apache.org/jira/browse/SPARK-44824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie reassigned SPARK-44824:
Assignee: Yang Jie
> There is content overlap in `ammoniteOut` used in ReplE2ESuite.
>
[
https://issues.apache.org/jira/browse/SPARK-44828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754948#comment-17754948
]
ASF GitHub Bot commented on SPARK-44828:
User 'dongjoon-hyun' has created a pull request for
Dongjoon Hyun created SPARK-44828:
-
Summary: Upgrade ORC to 1.9.1
Key: SPARK-44828
URL: https://issues.apache.org/jira/browse/SPARK-44828
Project: Spark
Issue Type: Bug
Components:
[
https://issues.apache.org/jira/browse/SPARK-44827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-44827:
Description:
https://github.com/apache/spark/actions/runs/5873530086/job/15926967006
[
https://issues.apache.org/jira/browse/SPARK-44802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754936#comment-17754936
]
ASF GitHub Bot commented on SPARK-44802:
User 'dongjoon-hyun' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-44827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-44827:
Attachment: image-2023-08-16-17-01-43-819.png
> Fix
BingKun Pan created SPARK-44827:
---
Summary: Fix test_assert_approx_equal_decimaltype_custom_rtol_pass
when SPARK_ANSI_SQL_MODE=true
Key: SPARK-44827
URL: https://issues.apache.org/jira/browse/SPARK-44827
Haejoon Lee created SPARK-44826:
---
Summary: Resolve testing timeout issue from Spark Connect
Key: SPARK-44826
URL: https://issues.apache.org/jira/browse/SPARK-44826
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754895#comment-17754895
]
Yang Jie edited comment on SPARK-44825 at 8/16/23 6:34 AM:
---
Another failure
[
https://issues.apache.org/jira/browse/SPARK-44825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754895#comment-17754895
]
Yang Jie commented on SPARK-44825:
--
Another failure case:
[
https://issues.apache.org/jira/browse/SPARK-44825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754894#comment-17754894
]
Yang Jie commented on SPARK-44825:
--
Yang Jie created SPARK-44825:
Summary: flaky pyspark tests
Key: SPARK-44825
URL: https://issues.apache.org/jira/browse/SPARK-44825
Project: Spark
Issue Type: Improvement
Components:
[
https://issues.apache.org/jira/browse/SPARK-44820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754892#comment-17754892
]
Ruifeng Zheng edited comment on SPARK-44820 at 8/16/23 6:27 AM:
update:
[
https://issues.apache.org/jira/browse/SPARK-44820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754892#comment-17754892
]
Ruifeng Zheng commented on SPARK-44820:
---
update:
this issue emerged since 3.1.1 (nit we don't
78 matches
Mail list logo
