[
https://issues.apache.org/jira/browse/SPARK-35714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466738#comment-17466738
]
Apache Spark commented on SPARK-35714:
--
User 'Ngone51' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-35714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466740#comment-17466740
]
Apache Spark commented on SPARK-35714:
--
User 'Ngone51' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466824#comment-17466824
]
jiaan.geng commented on SPARK-28516:
I'm working on.
> Data Type Formatting Functio
[
https://issues.apache.org/jira/browse/SPARK-37772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466848#comment-17466848
]
Yikun Jiang commented on SPARK-37772:
-
[https://pypi.org/project/oldest-supported-nu
[
https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-3:
---
Assignee: Wenchen Fan
> update the SQL syntax of SHOW FUNCTIONS
> -
[
https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-3.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35056
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466876#comment-17466876
]
Steve Loughran commented on SPARK-6305:
---
If anyone wants a version of a log4j 1.17
huangzhir created SPARK-37787:
-
Summary: Long running Spark Job(Spark ThriftServer) throw
HDFS_DELEGATE_TOKEN not found in cache Exception
Key: SPARK-37787
URL: https://issues.apache.org/jira/browse/SPARK-37787
[
https://issues.apache.org/jira/browse/SPARK-37785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-37785:
Assignee: Hyukjin Kwon
> Add Utils.isAtExecutor
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-37785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-37785.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35065
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-37787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
huangzhir updated SPARK-37787:
--
Remaining Estimate: 168h (was: 24h)
Original Estimate: 168h (was: 24h)
> Long running Spark Job
Daniel Davies created SPARK-37788:
-
Summary: ColumnOrName vs Column in PySpark Functions module
Key: SPARK-37788
URL: https://issues.apache.org/jira/browse/SPARK-37788
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-37788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Davies updated SPARK-37788:
--
Description:
PySpark has mainly migrated to supporting both Column input types as well as
str
Wenchen Fan created SPARK-37789:
---
Summary: Add a class to represent general aggregate functions in
DS V2
Key: SPARK-37789
URL: https://issues.apache.org/jira/browse/SPARK-37789
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-37738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maciej Szymkiewicz resolved SPARK-37738.
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35032
[
https://issues.apache.org/jira/browse/SPARK-37738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maciej Szymkiewicz reassigned SPARK-37738:
--
Assignee: Maciej Szymkiewicz
> PySpark date_add only accepts an integer as it
[
https://issues.apache.org/jira/browse/SPARK-37738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maciej Szymkiewicz reassigned SPARK-37738:
--
Assignee: (was: Maciej Szymkiewicz)
> PySpark date_add only accepts an in
[
https://issues.apache.org/jira/browse/SPARK-37738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maciej Szymkiewicz reassigned SPARK-37738:
--
Assignee: Daniel Davies
> PySpark date_add only accepts an integer as it's se
[
https://issues.apache.org/jira/browse/SPARK-37789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466912#comment-17466912
]
Apache Spark commented on SPARK-37789:
--
User 'cloud-fan' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-37789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37789:
Assignee: Wenchen Fan (was: Apache Spark)
> Add a class to represent general aggregate f
[
https://issues.apache.org/jira/browse/SPARK-37789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37789:
Assignee: Apache Spark (was: Wenchen Fan)
> Add a class to represent general aggregate f
[
https://issues.apache.org/jira/browse/SPARK-37630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466918#comment-17466918
]
Steve Loughran commented on SPARK-37630:
nobody does.
you can find a patched ja
[
https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466876#comment-17466876
]
Steve Loughran edited comment on SPARK-6305 at 12/30/21, 6:44 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466961#comment-17466961
]
Stu commented on SPARK-23599:
-
We have encountered this problem with Spark 3.1.2, resulting
[
https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466981#comment-17466981
]
Matt Sicker commented on SPARK-6305:
Note that isn't on Maven Central, either, so it
[
https://issues.apache.org/jira/browse/SPARK-37782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466982#comment-17466982
]
Rafal Wojdyla commented on SPARK-37782:
---
Duplicate of
[SPARK-37601|https://issues
[
https://issues.apache.org/jira/browse/SPARK-37782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466982#comment-17466982
]
Rafal Wojdyla edited comment on SPARK-37782 at 12/30/21, 8:05 PM:
[
https://issues.apache.org/jira/browse/SPARK-37601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maciej Szymkiewicz resolved SPARK-37601.
Fix Version/s: 3.3.0
Resolution: Fixed
> Could/should sql.DataFrame.transfo
[
https://issues.apache.org/jira/browse/SPARK-37788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466988#comment-17466988
]
Apache Spark commented on SPARK-37788:
--
User 'Daniel-Davies' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-37788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37788:
Assignee: Apache Spark
> ColumnOrName vs Column in PySpark Functions module
> ---
[
https://issues.apache.org/jira/browse/SPARK-37788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37788:
Assignee: (was: Apache Spark)
> ColumnOrName vs Column in PySpark Functions module
>
[
https://issues.apache.org/jira/browse/SPARK-37735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-37735:
-
Assignee: Yikun Jiang
> Add appId interface to KubernetesConf
> ---
[
https://issues.apache.org/jira/browse/SPARK-37735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-37735.
---
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35015
[https://
[
https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-6305:
-
Affects Version/s: 3.3.0
> Add support for log4j 2.x to Spark
> -
[
https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-6305:
-
Priority: Major (was: Minor)
> Add support for log4j 2.x to Spark
>
[
https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467004#comment-17467004
]
Dongjoon Hyun commented on SPARK-6305:
--
Thank you for the additional info, [~ste...@
[
https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467006#comment-17467006
]
Gary D. Gregory commented on SPARK-6305:
[~dongjoon]
I'm glad to hear you are m
William Hyun created SPARK-37790:
Summary: Upgrade SLF4J to 1.7.32
Key: SPARK-37790
URL: https://issues.apache.org/jira/browse/SPARK-37790
Project: Spark
Issue Type: Improvement
Com
[
https://issues.apache.org/jira/browse/SPARK-37790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467041#comment-17467041
]
Apache Spark commented on SPARK-37790:
--
User 'williamhyun' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-37790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37790:
Assignee: Apache Spark
> Upgrade SLF4J to 1.7.32
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-37790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37790:
Assignee: (was: Apache Spark)
> Upgrade SLF4J to 1.7.32
> ---
>
>
William Hyun created SPARK-37791:
Summary: Use log4j2 in examples.
Key: SPARK-37791
URL: https://issues.apache.org/jira/browse/SPARK-37791
Project: Spark
Issue Type: Improvement
Co
[
https://issues.apache.org/jira/browse/SPARK-37791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37791:
Assignee: Apache Spark
> Use log4j2 in examples.
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-37791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467043#comment-17467043
]
Apache Spark commented on SPARK-37791:
--
User 'williamhyun' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-37791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37791:
Assignee: (was: Apache Spark)
> Use log4j2 in examples.
>
>
[
https://issues.apache.org/jira/browse/SPARK-37791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467044#comment-17467044
]
Apache Spark commented on SPARK-37791:
--
User 'williamhyun' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-37719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-37719:
Assignee: Yang Jie
> Try to remove `--add-exports` compile option for Java 17
> -
[
https://issues.apache.org/jira/browse/SPARK-37719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-37719.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34991
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-37790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-37790.
---
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35072
[https://
[
https://issues.apache.org/jira/browse/SPARK-37790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-37790:
-
Assignee: William Hyun
> Upgrade SLF4J to 1.7.32
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-37772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467061#comment-17467061
]
Yikun Jiang commented on SPARK-37772:
-
For CPython(such like, python 3.8, python 3.9
Hyukjin Kwon created SPARK-37792:
Summary: Spark shell sets log level to INFO by default
Key: SPARK-37792
URL: https://issues.apache.org/jira/browse/SPARK-37792
Project: Spark
Issue Type: Imp
[
https://issues.apache.org/jira/browse/SPARK-37792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-37792:
-
Description:
{code}
./bin/spark-shell
{code}
{code}
Setting default log level to "WARN".
To adj
[
https://issues.apache.org/jira/browse/SPARK-37792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-37792:
-
Issue Type: Bug (was: Improvement)
> Spark shell sets log level to INFO by default
> --
[
https://issues.apache.org/jira/browse/SPARK-37713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-37713.
---
Assignee: qian
Resolution: Fixed
This is resolved via https://github.com/apache/spark/
[
https://issues.apache.org/jira/browse/SPARK-37791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-37791.
---
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35074
[https://
[
https://issues.apache.org/jira/browse/SPARK-37791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-37791:
-
Assignee: William Hyun
> Use log4j2 in examples.
>
>
>
Cheng Pan created SPARK-37793:
-
Summary: Invalid LocalMergedBlockData cause task hang
Key: SPARK-37793
URL: https://issues.apache.org/jira/browse/SPARK-37793
Project: Spark
Issue Type: Bug
L. C. Hsieh created SPARK-37794:
---
Summary: Remove log4j bridge api usage
Key: SPARK-37794
URL: https://issues.apache.org/jira/browse/SPARK-37794
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-37794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37794:
Assignee: Apache Spark
> Remove log4j bridge api usage
> -
>
[
https://issues.apache.org/jira/browse/SPARK-37794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467094#comment-17467094
]
Apache Spark commented on SPARK-37794:
--
User 'viirya' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-37794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37794:
Assignee: (was: Apache Spark)
> Remove log4j bridge api usage
> -
[
https://issues.apache.org/jira/browse/SPARK-37793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467095#comment-17467095
]
Apache Spark commented on SPARK-37793:
--
User 'pan3793' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-37793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37793:
Assignee: (was: Apache Spark)
> Invalid LocalMergedBlockData cause task hang
> --
[
https://issues.apache.org/jira/browse/SPARK-37793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467096#comment-17467096
]
Apache Spark commented on SPARK-37793:
--
User 'pan3793' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-37793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37793:
Assignee: Apache Spark
> Invalid LocalMergedBlockData cause task hang
> -
William Hyun created SPARK-37795:
Summary: Add a checkstyle rule to ban `org.apache.log4j`
Key: SPARK-37795
URL: https://issues.apache.org/jira/browse/SPARK-37795
Project: Spark
Issue Type: I
[
https://issues.apache.org/jira/browse/SPARK-37795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37795:
Assignee: Apache Spark
> Add a checkstyle rule to ban `org.apache.log4j`
> --
[
https://issues.apache.org/jira/browse/SPARK-37795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37795:
Assignee: (was: Apache Spark)
> Add a checkstyle rule to ban `org.apache.log4j`
> ---
[
https://issues.apache.org/jira/browse/SPARK-37795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467097#comment-17467097
]
Apache Spark commented on SPARK-37795:
--
User 'williamhyun' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-37795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467098#comment-17467098
]
Apache Spark commented on SPARK-37795:
--
User 'williamhyun' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-37795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
William Hyun updated SPARK-37795:
-
Summary: Add a scalastyle rule to ban `org.apache.log4j` (was: Add a
checkstyle rule to ban `or
XiDuo You created SPARK-37796:
-
Summary: ByteArrayMethods arrayEquals should fast skip the
checking of aligned in unaligned platform
Key: SPARK-37796
URL: https://issues.apache.org/jira/browse/SPARK-37796
[
https://issues.apache.org/jira/browse/SPARK-37796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-37796:
--
Description:
The method `arrayEquals` in `ByteArrayMethods` is critical function which is
used in `UT
[
https://issues.apache.org/jira/browse/SPARK-37796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-37796:
--
Summary: ByteArrayMethods arrayEquals should fast skip the check of
aligning with unaligned platform
[
https://issues.apache.org/jira/browse/SPARK-37796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467115#comment-17467115
]
Apache Spark commented on SPARK-37796:
--
User 'ulysses-you' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-37796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37796:
Assignee: Apache Spark
> ByteArrayMethods arrayEquals should fast skip the check of align
[
https://issues.apache.org/jira/browse/SPARK-37796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37796:
Assignee: (was: Apache Spark)
> ByteArrayMethods arrayEquals should fast skip the che
[
https://issues.apache.org/jira/browse/SPARK-37792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467117#comment-17467117
]
Hyukjin Kwon commented on SPARK-37792:
--
cc [~viirya] FYI
> Spark shell sets log le
[
https://issues.apache.org/jira/browse/SPARK-37792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467119#comment-17467119
]
L. C. Hsieh commented on SPARK-37792:
-
Thanks. I will look at it.
> Spark shell set
80 matches
Mail list logo
