[
https://issues.apache.org/jira/browse/SPARK-44969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44969.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42660
[
https://issues.apache.org/jira/browse/SPARK-44976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759201#comment-17759201
]
YUBI LEE commented on SPARK-44976:
--
https://github.com/apache/spark/pull/42690
>
[
https://issues.apache.org/jira/browse/SPARK-41279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759197#comment-17759197
]
Hyukjin Kwon commented on SPARK-41279:
--
You can use mapInPandas as a workaround for now.
> Feature
[
https://issues.apache.org/jira/browse/SPARK-44976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YUBI LEE updated SPARK-44976:
-
Description:
SPARK-6558 changes the behavior of {{Utils.getCurrentUserName()}} to use
shortname
[
https://issues.apache.org/jira/browse/SPARK-44976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YUBI LEE updated SPARK-44976:
-
Description:
SPARK-6558 changes the behavior of {{Utils.getCurrentUserName()}} to use
shortname
[
https://issues.apache.org/jira/browse/SPARK-44976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YUBI LEE updated SPARK-44976:
-
Description:
SPARK-6558 changes the behavior of {{Utils.getCurrentUserName()}} to use
shortname
YUBI LEE created SPARK-44976:
Summary: Utils.getCurrentUserName should return the full principal
name
Key: SPARK-44976
URL: https://issues.apache.org/jira/browse/SPARK-44976
Project: Spark
Jia Fan created SPARK-44975:
---
Summary: BinaryArithmetic with useless override resolved field
Key: SPARK-44975
URL: https://issues.apache.org/jira/browse/SPARK-44975
Project: Spark
Issue Type:
Herman van Hövell created SPARK-44974:
-
Summary: Replace SparkSession/Dataset/KeyValueGroupedDataset with
null during serialization
Key: SPARK-44974
URL: https://issues.apache.org/jira/browse/SPARK-44974
Gera Shegalov created SPARK-44973:
-
Summary: CONV('-9223372036854775808', 10, -2) throws
ArrayIndexOutOfBoundsException
Key: SPARK-44973
URL: https://issues.apache.org/jira/browse/SPARK-44973
[
https://issues.apache.org/jira/browse/SPARK-44963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44963:
--
Summary: Make PySpark (pyspark-ml module) tests passing without any
optional dependency
[
https://issues.apache.org/jira/browse/SPARK-44971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-44971:
Issue Type: Bug (was: New Feature)
> [BUG Fix] PySpark StreamingQuerProgress fromJson
>
[
https://issues.apache.org/jira/browse/SPARK-44900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759130#comment-17759130
]
Yauheni Audzeichyk edited comment on SPARK-44900 at 8/25/23 6:39 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-44900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759130#comment-17759130
]
Yauheni Audzeichyk edited comment on SPARK-44900 at 8/25/23 6:38 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-44900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759130#comment-17759130
]
Yauheni Audzeichyk commented on SPARK-44900:
[~yao] we tried
Dongjoon Hyun created SPARK-44972:
-
Summary: Eagerly check if the token is valid to align with the
behavior of username/password auth
Key: SPARK-44972
URL: https://issues.apache.org/jira/browse/SPARK-44972
Wei Liu created SPARK-44971:
---
Summary: [BUG Fix] PySpark StreamingQuerProgress fromJson
Key: SPARK-44971
URL: https://issues.apache.org/jira/browse/SPARK-44971
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-44961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44961.
---
Fix Version/s: 4.0.0
Assignee: Hyukjin Kwon
Resolution: Fixed
This is
Holden Karau created SPARK-44970:
Summary: Spark History File Uploads Can Fail on S3
Key: SPARK-44970
URL: https://issues.apache.org/jira/browse/SPARK-44970
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-44966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44966.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42682
[
https://issues.apache.org/jira/browse/SPARK-44966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-44966:
-
Assignee: Yang Jie
> Change the never changed 'var' to 'val'
>
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759065#comment-17759065
]
Dipayan Dev edited comment on SPARK-44884 at 8/25/23 2:22 PM:
--
Right, the
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759065#comment-17759065
]
Dipayan Dev edited comment on SPARK-44884 at 8/25/23 2:21 PM:
--
Right, the
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759065#comment-17759065
]
Dipayan Dev edited comment on SPARK-44884 at 8/25/23 2:20 PM:
--
Right, the
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759065#comment-17759065
]
Dipayan Dev commented on SPARK-44884:
-
Right, the behaviour is same in Spark 2 and 3. However, in
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759063#comment-17759063
]
Steve Loughran commented on SPARK-44884:
so using insert overwrite. yes, what happens there is
[
https://issues.apache.org/jira/browse/SPARK-44865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-44865:
---
Assignee: Zerui Bao
> Make StreamingRelationV2 support metadata column
>
[
https://issues.apache.org/jira/browse/SPARK-44865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-44865.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42554
[
https://issues.apache.org/jira/browse/SPARK-44144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759061#comment-17759061
]
Thomas Graves commented on SPARK-44144:
---
I'm not necessarily against this but it seems odd to do
Max Gekk created SPARK-44969:
Summary: Reuse ArrayInsert in ArrayAppend
Key: SPARK-44969
URL: https://issues.apache.org/jira/browse/SPARK-44969
Project: Spark
Issue Type: Improvement
Yang Jie created SPARK-44968:
Summary: Downgrade ivy to 2.5.1
Key: SPARK-44968
URL: https://issues.apache.org/jira/browse/SPARK-44968
Project: Spark
Issue Type: Improvement
Components:
jiaan.geng created SPARK-44967:
--
Summary: Unit should be considered first before using Boolean for
TreeNodeTag
Key: SPARK-44967
URL: https://issues.apache.org/jira/browse/SPARK-44967
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-44958:
-
Assignee: Ruifeng Zheng
> Add a test to validate the parity of functions
>
[
https://issues.apache.org/jira/browse/SPARK-44958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-44958.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42671
Yang Jie created SPARK-44966:
Summary: Change the never changed 'var' to 'val'
Key: SPARK-44966
URL: https://issues.apache.org/jira/browse/SPARK-44966
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-44452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-44452.
-
> Ignore ArrowEncoderSuite for Java 21
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-44839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44839.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42594
[
https://issues.apache.org/jira/browse/SPARK-44839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44839:
Assignee: Wei Liu
> Better error logging when user accesses spark session in
Ruifeng Zheng created SPARK-44965:
-
Summary: Hide internal functions/variables from
`pyspark.sql.functions`
Key: SPARK-44965
URL: https://issues.apache.org/jira/browse/SPARK-44965
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44962.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42677
[
https://issues.apache.org/jira/browse/SPARK-44964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-44964:
-
Description: We're actually not running any doctest for it. We should
remove all other related
[
https://issues.apache.org/jira/browse/SPARK-44964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-44964:
-
Summary: Clean up pyspark.ml.connect.functions doctest (was: Make PySpark
(pyspark-ml-connect
[
https://issues.apache.org/jira/browse/SPARK-44962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-44962:
-
Assignee: Dongjoon Hyun
> Add Java 21 build to build_and_test.yml
>
[
https://issues.apache.org/jira/browse/SPARK-44962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44962:
--
Summary: Add Java 21 Maven build to build_and_test.yml (was: Add Java 21
build to
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758879#comment-17758879
]
Dipayan Dev commented on SPARK-44884:
-
I am able to narrow down the problem. This issue is happening
[
https://issues.apache.org/jira/browse/SPARK-44964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-44964:
-
Description:
{code}
./python/run-tests --python-executables=python3 --modules=pyspark-ml-connec
Hyukjin Kwon created SPARK-44964:
Summary: Make PySpark (pyspark-ml-connect module) tests passing
without any dependency
Key: SPARK-44964
URL: https://issues.apache.org/jira/browse/SPARK-44964
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dipayan Dev updated SPARK-44884:
Summary: Spark doesn't create SUCCESS file in Spark 3.3.0+ when
partitionOverwriteMode is dynamic
[
https://issues.apache.org/jira/browse/SPARK-44900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758868#comment-17758868
]
Kent Yao commented on SPARK-44900:
--
Set spark.cleaner.periodicGC.interval to a smaller value(3min)
Hyukjin Kwon created SPARK-44963:
Summary: Make PySpark (pyspark-ml module) tests passing without
any dependency
Key: SPARK-44963
URL: https://issues.apache.org/jira/browse/SPARK-44963
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dipayan Dev updated SPARK-44884:
Description:
The issue is not happening in Spark 2.x (I am using 2.4.0), but only in 3.3.0
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dipayan Dev updated SPARK-44884:
Description:
The issue is not happening in Spark 2.x (I am using 2.4.0), but only in 3.3.0
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757052#comment-17757052
]
Dipayan Dev edited comment on SPARK-44884 at 8/25/23 7:34 AM:
--
There is no
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757052#comment-17757052
]
Dipayan Dev edited comment on SPARK-44884 at 8/25/23 7:33 AM:
--
There is no
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dipayan Dev updated SPARK-44884:
Description:
The issue is not happening in Spark 2.x (I am using 2.4.0), but only in 3.3.0
Code
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dipayan Dev updated SPARK-44884:
Attachment: (was: image-2023-08-20-18-08-38-531.png)
> Spark doesn't create SUCCESS file in
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dipayan Dev updated SPARK-44884:
Attachment: image-2023-08-25-13-01-42-137.png
> Spark doesn't create SUCCESS file in Spark 3.3.0+
Dongjoon Hyun created SPARK-44962:
-
Summary: Add Java 21 build to build_and_test.yml
Key: SPARK-44962
URL: https://issues.apache.org/jira/browse/SPARK-44962
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-44957:
-
Component/s: PySpark
> Make PySpark (pyspark-sql module) tests passing without any dependency
>
Hyukjin Kwon created SPARK-44961:
Summary: Make PySpark (pyspark-connect module) tests passing
without any dependency
Key: SPARK-44961
URL: https://issues.apache.org/jira/browse/SPARK-44961
Project:
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dipayan Dev updated SPARK-44884:
Summary: Spark doesn't create SUCCESS file in Spark 3.3.0+ (was: Spark
doesn't create SUCCESS
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757550#comment-17757550
]
Dipayan Dev edited comment on SPARK-44884 at 8/25/23 7:06 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-44930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-44930.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 42629
[
https://issues.apache.org/jira/browse/SPARK-44930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-44930:
---
Assignee: Xianyang Liu
> Deterministic ApplyFunctionExpression should be foldable
>
[
https://issues.apache.org/jira/browse/SPARK-44957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44957:
Assignee: Hyukjin Kwon
> Make PySpark (pyspark-sql module) tests passing without any
[
https://issues.apache.org/jira/browse/SPARK-44957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44957.
--
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull
Kent Yao created SPARK-44960:
Summary: Unescape and consist error summary across UI pages
Key: SPARK-44960
URL: https://issues.apache.org/jira/browse/SPARK-44960
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44144:
--
Description:
Apache Spark supports spark.authenticate and spark.authenticate.secret since
[
https://issues.apache.org/jira/browse/SPARK-44144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758842#comment-17758842
]
Dongjoon Hyun commented on SPARK-44144:
---
Sure, [~tgraves].
> Enable `spark.authenticate` by
[
https://issues.apache.org/jira/browse/SPARK-44959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758840#comment-17758840
]
Nikita Awasthi commented on SPARK-44959:
User 'panbingkun' has created a pull request for this
BingKun Pan created SPARK-44959:
---
Summary: Upgrade sbt to 1.9.4
Key: SPARK-44959
URL: https://issues.apache.org/jira/browse/SPARK-44959
Project: Spark
Issue Type: Improvement
71 matches
Mail list logo
