[
https://issues.apache.org/jira/browse/SPARK-39723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng updated SPARK-39723:
--
Summary: Implement functionExists/getFunction in SparkR for 3L namespace
(was: Make ListFunct
[
https://issues.apache.org/jira/browse/SPARK-39719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng updated SPARK-39719:
--
Summary: Implement databaseExists/getDatabase in SparkR support 3L
namespace (was: Make datab
[
https://issues.apache.org/jira/browse/SPARK-39719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-39719.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37132
[https://
[
https://issues.apache.org/jira/browse/SPARK-39719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-39719:
-
Assignee: Ruifeng Zheng
> Make databaseExists/listTables/tables/tableNames in SparkR su
[
https://issues.apache.org/jira/browse/SPARK-35579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564797#comment-17564797
]
Prashant Singh commented on SPARK-35579:
should we bump janino to v3.1.7 conside
[
https://issues.apache.org/jira/browse/SPARK-39726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-39726.
-
Resolution: Not A Problem
> Change the default value of spark.sql.execution.topKSortFallbackThre
[
https://issues.apache.org/jira/browse/SPARK-39739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564794#comment-17564794
]
Apache Spark commented on SPARK-39739:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-39739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39739:
Assignee: (was: Apache Spark)
> Upgrade sbt to 1.7.0
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-39739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39739:
Assignee: Apache Spark
> Upgrade sbt to 1.7.0
>
>
>
Yang Jie created SPARK-39739:
Summary: Upgrade sbt to 1.7.0
Key: SPARK-39739
URL: https://issues.apache.org/jira/browse/SPARK-39739
Project: Spark
Issue Type: Improvement
Components: Bu
Eugene Shinn (Truveta) created SPARK-39738:
--
Summary: ORC uses Protobuf version vulnerable to CVE-2021-22569
Key: SPARK-39738
URL: https://issues.apache.org/jira/browse/SPARK-39738
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-39737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564788#comment-17564788
]
Apache Spark commented on SPARK-39737:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-39737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39737:
Assignee: Apache Spark
> PERCENTILE_CONT and PERCENTILE_DISC should support aggregate fil
[
https://issues.apache.org/jira/browse/SPARK-39737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564786#comment-17564786
]
Apache Spark commented on SPARK-39737:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-39737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39737:
Assignee: (was: Apache Spark)
> PERCENTILE_CONT and PERCENTILE_DISC should support ag
[
https://issues.apache.org/jira/browse/SPARK-39737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-39737:
---
Summary: PERCENTILE_CONT and PERCENTILE_DISC should support aggregate
filter (was: percentile_cont
jiaan.geng created SPARK-39737:
--
Summary: percentile_cont and percentile_disc should support
aggregate filter
Key: SPARK-39737
URL: https://issues.apache.org/jira/browse/SPARK-39737
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang updated SPARK-39735:
Description:
Since sparkr 4.2.x has [below new
change](https://github.com/r-devel/r-svn/blob/e6be
[
https://issues.apache.org/jira/browse/SPARK-39735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang updated SPARK-39735:
Summary: Enable base image build in lint job and fix sparkr env (was:
Enable base image build in
Yikun Jiang created SPARK-39736:
---
Summary: Enable base image build in SparkR job
Key: SPARK-39736
URL: https://issues.apache.org/jira/browse/SPARK-39736
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-39735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39735:
Assignee: Apache Spark
> Enable base image build in lint job
> --
[
https://issues.apache.org/jira/browse/SPARK-39735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39735:
Assignee: (was: Apache Spark)
> Enable base image build in lint job
> ---
[
https://issues.apache.org/jira/browse/SPARK-39735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564784#comment-17564784
]
Apache Spark commented on SPARK-39735:
--
User 'Yikun' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-39735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564783#comment-17564783
]
Apache Spark commented on SPARK-39735:
--
User 'Yikun' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-39720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-39720.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37133
[https://
[
https://issues.apache.org/jira/browse/SPARK-39720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-39720:
-
Assignee: Ruifeng Zheng
> Implement tableExists/getTable in SparkR for 3L namespace
> -
Yikun Jiang created SPARK-39735:
---
Summary: Enable base image build in lint job
Key: SPARK-39735
URL: https://issues.apache.org/jira/browse/SPARK-39735
Project: Spark
Issue Type: Sub-task
Andrew Ray created SPARK-39734:
--
Summary: Add call_udf to pyspark.sql.functions
Key: SPARK-39734
URL: https://issues.apache.org/jira/browse/SPARK-39734
Project: Spark
Issue Type: Improvement
Andrew Ray created SPARK-39733:
--
Summary: Add map_contains_key to pyspark.sql.functions
Key: SPARK-39733
URL: https://issues.apache.org/jira/browse/SPARK-39733
Project: Spark
Issue Type: Improve
[
https://issues.apache.org/jira/browse/SPARK-39732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564767#comment-17564767
]
Andreas Saltveit commented on SPARK-39732:
--
Introduced after 2022.07.04
> pysp
[
https://issues.apache.org/jira/browse/SPARK-39732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andreas Saltveit updated SPARK-39732:
-
Description:
import pyspark.pandas as pd
data = [\{"Category": 'A', "ID": 1, "Value": 12
Andreas Saltveit created SPARK-39732:
Summary: pyspark.pandas.DataFrame.drop drops dataframe if axis not
specified
Key: SPARK-39732
URL: https://issues.apache.org/jira/browse/SPARK-39732
Project:
[
https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-39715:
-
Target Version/s: (was: 3.2.1)
> spark UI about file size read
> -
[
https://issues.apache.org/jira/browse/SPARK-39729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564763#comment-17564763
]
Hyukjin Kwon commented on SPARK-39729:
--
Can you turn off {{spark.sql.codegen.wholeS
[
https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39731:
Assignee: (was: Apache Spark)
> Correctness issue when parsing dates with MMdd fo
[
https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564745#comment-17564745
]
Apache Spark commented on SPARK-39731:
--
User 'sadikovi' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564744#comment-17564744
]
Apache Spark commented on SPARK-39731:
--
User 'sadikovi' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39731:
Assignee: Apache Spark
> Correctness issue when parsing dates with MMdd format in CSV
[
https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39731:
-
Description:
In Spark 3.x, when reading CSV data like this:
{code:java}
name,mydate
1,2020011
2,
[
https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39731:
-
Description:
In Spark 3.x, when reading CSV data like this:
{code:java}
name,mydate
1,2020011
2,
[
https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39731:
-
Description:
In Spark 3.x, when reading CSV data like this:
{code:java}
name,mydate
1,2020011
2,
Ivan Sadikov created SPARK-39731:
Summary: Correctness issue when parsing dates with MMdd format
in CSV
Key: SPARK-39731
URL: https://issues.apache.org/jira/browse/SPARK-39731
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-39099:
--
Fix Version/s: 3.2.2
> Add dependencies to Dockerfile for building Spark releases
> --
[
https://issues.apache.org/jira/browse/SPARK-37554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37554:
--
Fix Version/s: 3.2.2
> Add PyArrow, pandas and plotly to release Docker image dependencies
> -
[
https://issues.apache.org/jira/browse/SPARK-39727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-39727.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37143
[https://
[
https://issues.apache.org/jira/browse/SPARK-39727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-39727:
-
Assignee: BingKun Pan
> Upgrade joda-time from 2.10.13 to 2.10.14
> ---
[
https://issues.apache.org/jira/browse/SPARK-39426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564735#comment-17564735
]
Pablo Langa Blanco commented on SPARK-39426:
I tested it on master and 3.3.0
Eugene Shinn (Truveta) created SPARK-39730:
--
Summary: spark-core: sonatype-2021-1215 & sonatype-2021-1216
vulnerabilities from com.twitter:chill
Key: SPARK-39730
URL: https://issues.apache.org/jira/browse
[
https://issues.apache.org/jira/browse/SPARK-37730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564734#comment-17564734
]
Apache Spark commented on SPARK-37730:
--
User 'dongjoon-hyun' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-37730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564732#comment-17564732
]
Apache Spark commented on SPARK-37730:
--
User 'dongjoon-hyun' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-39623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564730#comment-17564730
]
Pablo Langa Blanco commented on SPARK-39623:
I think the problem here is a m
[
https://issues.apache.org/jira/browse/SPARK-37730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37730:
--
Fix Version/s: 3.2.2
> plot.hist throws AttributeError on pandas=1.3.5
> -
[
https://issues.apache.org/jira/browse/SPARK-37730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564727#comment-17564727
]
Dongjoon Hyun commented on SPARK-37730:
---
This is backported to branch-3.2 for Apac
[
https://issues.apache.org/jira/browse/SPARK-39702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-39702.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37110
[https://
[
https://issues.apache.org/jira/browse/SPARK-39729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564676#comment-17564676
]
xiangxiang Shen commented on SPARK-39729:
-
CC [~tdas] [~dongjoon]
Thanks
> W
[
https://issues.apache.org/jira/browse/SPARK-39729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xiangxiang Shen updated SPARK-39729:
Environment: (was: WholeStagecodegen will have better performance in
many cases. But i
[
https://issues.apache.org/jira/browse/SPARK-39729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xiangxiang Shen updated SPARK-39729:
Description:
WholeStagecodegen will have better performance in many cases. But it should n
xiangxiang Shen created SPARK-39729:
---
Summary: Why generate WholeStagecodegen for single operator?
Key: SPARK-39729
URL: https://issues.apache.org/jira/browse/SPARK-39729
Project: Spark
Iss
58 matches
Mail list logo