[
https://issues.apache.org/jira/browse/SPARK-44390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-44390.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41960
[
https://issues.apache.org/jira/browse/SPARK-44390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie reassigned SPARK-44390:
Assignee: Yang Jie
> Rename SparkSerDerseUtils to SparkSerDeUtils
>
[
https://issues.apache.org/jira/browse/SPARK-44407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-44407:
-
Description:
{code:java}
[warn]
Yang Jie created SPARK-44407:
Summary: Prohibit using `enum` as a variable or function name
Key: SPARK-44407
URL: https://issues.apache.org/jira/browse/SPARK-44407
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-43964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-43964.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41867
[
https://issues.apache.org/jira/browse/SPARK-43964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-43964:
Assignee: Allison Wang
> Support arrow-optimized Python UDTFs
>
[
https://issues.apache.org/jira/browse/SPARK-44359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44359:
-
Summary: Define the computing logic through PartitionEvaluator API and use
it in
[
https://issues.apache.org/jira/browse/SPARK-44359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44359:
-
Description:
Define the computing logic through PartitionEvaluator API and use it in SQL
aggregate
[
https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44362:
-
Description:
Use PartitionEvaluator API in
AggregateInPandasExec
EvalPythonExec
[
https://issues.apache.org/jira/browse/SPARK-44362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44362:
-
Summary: Use PartitionEvaluator API in
[
https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44369:
-
Summary: Use PartitionEvaluator API in CollectMetricsExec, GenerateExec,
ExpandExec, DebugExec,
[
https://issues.apache.org/jira/browse/SPARK-44369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44369:
-
Description:
Use PartitionEvaluator API in
CollectMetricsExec
GenerateExec
ExpandExec
DebugExec
[
https://issues.apache.org/jira/browse/SPARK-44406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng updated SPARK-44406:
--
Summary: DataFrame depending on temp view fail after the view is dropped
(was: DataFrame
Ruifeng Zheng created SPARK-44406:
-
Summary: DataFrame depending on temp view fail after the view is
drop
Key: SPARK-44406
URL: https://issues.apache.org/jira/browse/SPARK-44406
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie reassigned SPARK-44387:
Assignee: Yang Jie
> The execution time of "Test encryption" is too long after SPARK-44275
>
[
https://issues.apache.org/jira/browse/SPARK-44387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-44387.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41956
[
https://issues.apache.org/jira/browse/SPARK-44393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44393.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41963
[
https://issues.apache.org/jira/browse/SPARK-44393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44393:
Assignee: Bjørn Jørgensen
> Upgrade H2 from 2.1.214 to 2.2.220
>
[
https://issues.apache.org/jira/browse/SPARK-44399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44399.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41970
[
https://issues.apache.org/jira/browse/SPARK-44399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44399:
Assignee: Xinrong Meng
> Import SparkSession in Python UDF only when useArrow is None
>
[
https://issues.apache.org/jira/browse/SPARK-44405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anton Okolnychyi updated SPARK-44405:
-
Summary: Reduce code duplication in group-based DELETE and MERGE tests
(was: Reduce
Anton Okolnychyi created SPARK-44405:
Summary: Reduce code duplication in row-level tests
Key: SPARK-44405
URL: https://issues.apache.org/jira/browse/SPARK-44405
Project: Spark
Issue
BingKun Pan created SPARK-44404:
---
Summary: Assign names to the error class
_LEGACY_ERROR_TEMP_[1009,1010,1013,1015,1016,1278]
Key: SPARK-44404
URL: https://issues.apache.org/jira/browse/SPARK-44404
[
https://issues.apache.org/jira/browse/SPARK-44397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-44397:
-
Assignee: Amanda Liu
> Expose assertDataFrameEqual in pyspark.testing.utils
>
[
https://issues.apache.org/jira/browse/SPARK-44397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-44397.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41967
Anton Okolnychyi created SPARK-44403:
Summary: Add docs for MergeRows node
Key: SPARK-44403
URL: https://issues.apache.org/jira/browse/SPARK-44403
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng updated SPARK-44401:
-
Component/s: Documentation
> Arrow Python UDF Use Guide
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-44348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44348:
Assignee: Hyukjin Kwon
> Reenable Session-based artifact test cases
>
[
https://issues.apache.org/jira/browse/SPARK-44348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44348.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41942
Anton Okolnychyi created SPARK-44402:
Summary: Add tests for schema pruning in delta-based DELETEs
Key: SPARK-44402
URL: https://issues.apache.org/jira/browse/SPARK-44402
Project: Spark
Xinrong Meng created SPARK-44401:
Summary: Arrow Python UDF Use Guide
Key: SPARK-44401
URL: https://issues.apache.org/jira/browse/SPARK-44401
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-44400:
---
Description: Improve the Listener to provide users a way to access the
Spark session and perform arbitrary
Bo Gao created SPARK-44400:
--
Summary: Improve Scala StreamingQueryListener to provide users a
way to access the Spark session for Spark Connect
Key: SPARK-44400
URL: https://issues.apache.org/jira/browse/SPARK-44400
[
https://issues.apache.org/jira/browse/SPARK-42981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-42981.
---
Fix Version/s: 3.5.0
Resolution: Fixed
> Add direct arrow serialization
>
Xinrong Meng created SPARK-44399:
Summary: Import SparkSession in Python UDF only when useArrow is
None
Key: SPARK-44399
URL: https://issues.apache.org/jira/browse/SPARK-44399
Project: Spark
Raghu Angadi created SPARK-44398:
Summary: Scala foreachBatch API in Streaming Spark Connect
Key: SPARK-44398
URL: https://issues.apache.org/jira/browse/SPARK-44398
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-44279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bjørn Jørgensen updated SPARK-44279:
Summary: Upgrade optionator to ^0.9.3 (was: Upgrade Eslint from 7.25.0 to
8.44.0)
>
Amanda Liu created SPARK-44397:
--
Summary: Expose assertDataFrameEqual in pyspark.testing.utils
Key: SPARK-44397
URL: https://issues.apache.org/jira/browse/SPARK-44397
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Priyanka Raju updated SPARK-44378:
--
Issue Type: Bug (was: Question)
> Jobs that have join & have .rdd calls get executed 2x when
Herman van Hövell created SPARK-44396:
-
Summary: Add direct Arrow deserialization
Key: SPARK-44396
URL: https://issues.apache.org/jira/browse/SPARK-44396
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-44392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44392.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41962
[
https://issues.apache.org/jira/browse/SPARK-44392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-44392:
-
Assignee: Anton Okolnychyi
> Add tests for schema pruning in delta-based UPDATEs
>
[
https://issues.apache.org/jira/browse/SPARK-44389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Volodymyr Kot updated SPARK-44389:
--
Description:
Hey, we are trying to use executor decommissioning without external shuffle
[
https://issues.apache.org/jira/browse/SPARK-44059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742499#comment-17742499
]
ci-cassandra.apache.org commented on SPARK-44059:
-
User 'learningchess2003' has created
[
https://issues.apache.org/jira/browse/SPARK-44217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742495#comment-17742495
]
ci-cassandra.apache.org commented on SPARK-44217:
-
User 'asl3' has created a pull
[
https://issues.apache.org/jira/browse/SPARK-44395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742496#comment-17742496
]
ci-cassandra.apache.org commented on SPARK-44395:
-
User 'dtenedor' has created a pull
Daniel created SPARK-44395:
--
Summary: Update table function arguments to require parentheses
around identifier after the TABLE keyword
Key: SPARK-44395
URL: https://issues.apache.org/jira/browse/SPARK-44395
Jason Li created SPARK-44394:
Summary: Add a new Spark UI page for Spark Connect
Key: SPARK-44394
URL: https://issues.apache.org/jira/browse/SPARK-44394
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-44393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bjørn Jørgensen updated SPARK-44393:
Description:
[CVE-2022-45868|https://nvd.nist.gov/vuln/detail/CVE-2022-45868]
> Upgrade
[
https://issues.apache.org/jira/browse/SPARK-44279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bjørn Jørgensen updated SPARK-44279:
Summary: Upgrade Eslint from 7.25.0 to 8.44.0 (was: Upgrade word-wrap)
> Upgrade Eslint
Bjørn Jørgensen created SPARK-44393:
---
Summary: Upgrade H2 from 2.1.214 to 2.2.220
Key: SPARK-44393
URL: https://issues.apache.org/jira/browse/SPARK-44393
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-43995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742490#comment-17742490
]
ci-cassandra.apache.org commented on SPARK-43995:
-
User 'vicennial' has created a pull
Anton Okolnychyi created SPARK-44392:
Summary: Add tests for schema pruning in delta-based UPDATEs
Key: SPARK-44392
URL: https://issues.apache.org/jira/browse/SPARK-44392
Project: Spark
Max Gekk created SPARK-44391:
Summary: `url_decode` can fail w/ an internal error
Key: SPARK-44391
URL: https://issues.apache.org/jira/browse/SPARK-44391
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-44389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742473#comment-17742473
]
Volodymyr Kot commented on SPARK-44389:
---
[~dongjoon] [~Ngone51] [~warrenzhu25] [~mridulm80]
[
https://issues.apache.org/jira/browse/SPARK-44390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-44390:
-
Component/s: (was: Connect)
> Rename SparkSerDerseUtils to SparkSerDeUtils
>
Yang Jie created SPARK-44390:
Summary: Rename SparkSerDerseUtils to SparkSerDeUtils
Key: SPARK-44390
URL: https://issues.apache.org/jira/browse/SPARK-44390
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-44389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742468#comment-17742468
]
Volodymyr Kot commented on SPARK-44389:
---
Please let me know if there any other information that
Volodymyr Kot created SPARK-44389:
-
Summary: ExecutorDeadException when using decommissioning without
external shuffle service
Key: SPARK-44389
URL: https://issues.apache.org/jira/browse/SPARK-44389
[
https://issues.apache.org/jira/browse/SPARK-44388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Venkata Sai Akhil Gudesa updated SPARK-44388:
-
Epic Link: SPARK-42554
> Using an updated instance of
Venkata Sai Akhil Gudesa created SPARK-44388:
Summary: Using an updated instance of ScalarUserDefinedFunction
causes protobuf cast failures on server
Key: SPARK-44388
URL:
Yang Jie created SPARK-44387:
Summary: The execution time of "Test encryption" is too long after
SPARK-44275
Key: SPARK-44387
URL: https://issues.apache.org/jira/browse/SPARK-44387
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742402#comment-17742402
]
Jia Fan commented on SPARK-44385:
-
I'm working on it.
> Use PartitionEvaluator API in
[
https://issues.apache.org/jira/browse/SPARK-44386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742403#comment-17742403
]
Jia Fan commented on SPARK-44386:
-
I'm working on it.
> Use PartitionEvaluator API in
Jia Fan created SPARK-44386:
---
Summary: Use PartitionEvaluator API in HashAggregateExec,
ObjectHashAggregateExec, SortAggregateExec
Key: SPARK-44386
URL: https://issues.apache.org/jira/browse/SPARK-44386
Jia Fan created SPARK-44385:
---
Summary: Use PartitionEvaluator API in MergingSessionsExec &
UpdatingSessionsExec
Key: SPARK-44385
URL: https://issues.apache.org/jira/browse/SPARK-44385
Project: Spark
BingKun Pan created SPARK-44384:
---
Summary: Use checkError() to check Exception in *View*Suite,
*Namespace*Suite, *DataSource*Suite
Key: SPARK-44384
URL: https://issues.apache.org/jira/browse/SPARK-44384
[
https://issues.apache.org/jira/browse/SPARK-43974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742352#comment-17742352
]
GridGain Integration commented on SPARK-43974:
--
User 'panbingkun' has created a pull
[
https://issues.apache.org/jira/browse/SPARK-44383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao updated SPARK-44383:
-
Fix Version/s: 3.4.1
(was: 3.4.2)
> Fix the trim logic did't handle ASCII
[
https://issues.apache.org/jira/browse/SPARK-44383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-44383.
--
Fix Version/s: 3.5.0
3.4.2
Resolution: Fixed
Issue resolved by
王俊博 created SPARK-44383:
---
Summary: Fix the trim logic did't handle ASCII control characters
correctly
Key: SPARK-44383
URL: https://issues.apache.org/jira/browse/SPARK-44383
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-42981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742334#comment-17742334
]
ASF GitHub Bot commented on SPARK-42981:
User 'hvanhovell' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742333#comment-17742333
]
ASF GitHub Bot commented on SPARK-42981:
User 'hvanhovell' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742326#comment-17742326
]
ASF GitHub Bot commented on SPARK-44375:
User 'Hisoka-X' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-43781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742325#comment-17742325
]
ASF GitHub Bot commented on SPARK-43781:
User 'Hisoka-X' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-43907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742320#comment-17742320
]
Ruifeng Zheng edited comment on SPARK-43907 at 7/12/23 8:45 AM:
I think
[
https://issues.apache.org/jira/browse/SPARK-43907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742320#comment-17742320
]
Ruifeng Zheng commented on SPARK-43907:
---
I think we have finish the work to add missing SQL
[
https://issues.apache.org/jira/browse/SPARK-44349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-44349:
-
Assignee: Ruifeng Zheng
> Add math functions to SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-44349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-44349.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41914
Yang Jie created SPARK-44382:
Summary: Upgrade protobuf-java to 3.23.4
Key: SPARK-44382
URL: https://issues.apache.org/jira/browse/SPARK-44382
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-33782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742006#comment-17742006
]
Pratik Malani edited comment on SPARK-33782 at 7/12/23 7:01 AM:
Hi
[
https://issues.apache.org/jira/browse/SPARK-44381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
qingbo jiao updated SPARK-44381:
Description:
export KRB5CCNAME=FILE:/tmp/krb5cc_1001
./bin/spark-submit -{-}master yarn
[
https://issues.apache.org/jira/browse/SPARK-44381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742293#comment-17742293
]
qingbo jiao commented on SPARK-44381:
-
[~jshao] please cc ,thanks
> How to specify parameters in
[
https://issues.apache.org/jira/browse/SPARK-44353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-44353.
---
Fix Version/s: 3.5.0
Resolution: Fixed
> Remove toAttributes from StructType
84 matches
Mail list logo