[
https://issues.apache.org/jira/browse/SPARK-38770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38770:
Assignee: (was: Apache Spark)
> Simply steps to re write primary resource in k8s
[
https://issues.apache.org/jira/browse/SPARK-38770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38770:
Assignee: Apache Spark
> Simply steps to re write primary resource in k8s spark
[
https://issues.apache.org/jira/browse/SPARK-38770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516228#comment-17516228
]
Apache Spark commented on SPARK-38770:
--
User 'dcoliversun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-38770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
qian updated SPARK-38770:
-
Fix Version/s: 3.4.0
(was: 3.3.0)
> Simply steps to re write primary resource in k8s
qian created SPARK-38770:
Summary: Simply steps to re write primary resource in k8s spark
application
Key: SPARK-38770
URL: https://issues.apache.org/jira/browse/SPARK-38770
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-38769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516219#comment-17516219
]
gabrywu commented on SPARK-38769:
-
[~maxgekk]
> [SQL] behavior of schema_of_json not same with 2.4.0
>
[
https://issues.apache.org/jira/browse/SPARK-38768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516209#comment-17516209
]
Apache Spark commented on SPARK-38768:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-38768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38768:
Assignee: (was: Apache Spark)
> If limit could pushed down and Data source only have
[
https://issues.apache.org/jira/browse/SPARK-38768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38768:
Assignee: Apache Spark
> If limit could pushed down and Data source only have one
[
https://issues.apache.org/jira/browse/SPARK-38768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516210#comment-17516210
]
Apache Spark commented on SPARK-38768:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-38768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38768:
Assignee: Apache Spark
> If limit could pushed down and Data source only have one
gabrywu created SPARK-38769:
---
Summary: [SQL] behavior schema_of_json not same with 2.4.0
Key: SPARK-38769
URL: https://issues.apache.org/jira/browse/SPARK-38769
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-38769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
gabrywu updated SPARK-38769:
Summary: [SQL] behavior of schema_of_json not same with 2.4.0 (was: [SQL]
behavior schema_of_json not
jiaan.geng created SPARK-38768:
--
Summary: If limit could pushed down and Data source only have one
partition, DS V2 should not do limit again
Key: SPARK-38768
URL: https://issues.apache.org/jira/browse/SPARK-38768
[
https://issues.apache.org/jira/browse/SPARK-34863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh resolved SPARK-34863.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34659
[
https://issues.apache.org/jira/browse/SPARK-38620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-38620:
Assignee: Yang Jie
> Replace `value.formatted(formatString)` with
[
https://issues.apache.org/jira/browse/SPARK-38620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-38620.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 35930
[
https://issues.apache.org/jira/browse/SPARK-38620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-38620:
-
Priority: Trivial (was: Minor)
> Replace `value.formatted(formatString)` with
Yaohua Zhao created SPARK-38767:
---
Summary: Support ignoreCorruptFiles and ignoreMissingFiles in Data
Source options
Key: SPARK-38767
URL: https://issues.apache.org/jira/browse/SPARK-38767
Project:
[
https://issues.apache.org/jira/browse/SPARK-38763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516177#comment-17516177
]
Xinrong Meng commented on SPARK-38763:
--
I will backport the fix after approved and merged.
>
[
https://issues.apache.org/jira/browse/SPARK-38763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516176#comment-17516176
]
Apache Spark commented on SPARK-38763:
--
User 'xinrong-databricks' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-38763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516175#comment-17516175
]
Apache Spark commented on SPARK-38763:
--
User 'xinrong-databricks' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-38763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38763:
Assignee: Apache Spark
> Pandas API on spark Can`t apply lamda to columns.
>
[
https://issues.apache.org/jira/browse/SPARK-38763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38763:
Assignee: (was: Apache Spark)
> Pandas API on spark Can`t apply lamda to columns.
[
https://issues.apache.org/jira/browse/SPARK-38763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516172#comment-17516172
]
Xinrong Meng edited comment on SPARK-38763 at 4/1/22 11:56 PM:
---
Hi
[
https://issues.apache.org/jira/browse/SPARK-38766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng resolved SPARK-38766.
--
Resolution: Duplicate
> Support lambda `column` parameter of `DataFrame.rename`
>
[
https://issues.apache.org/jira/browse/SPARK-38763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516172#comment-17516172
]
Xinrong Meng commented on SPARK-38763:
--
Hi [~bjornjorgensen], thanks for raising that!
The
[
https://issues.apache.org/jira/browse/SPARK-38766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516173#comment-17516173
]
Xinrong Meng commented on SPARK-38766:
--
I am working on that.
> Support lambda `column` parameter
Xinrong Meng created SPARK-38766:
Summary: Support lambda `column` parameter of `DataFrame.rename`
Key: SPARK-38766
URL: https://issues.apache.org/jira/browse/SPARK-38766
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516087#comment-17516087
]
Bjørn Jørgensen commented on SPARK-38763:
-
This error is
[
https://issues.apache.org/jira/browse/SPARK-38765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516075#comment-17516075
]
Apache Spark commented on SPARK-38765:
--
User 'xinrong-databricks' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-38765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38765:
Assignee: Apache Spark
> Implement `inplace` parameter of `Series.clip`
>
[
https://issues.apache.org/jira/browse/SPARK-38765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38765:
Assignee: (was: Apache Spark)
> Implement `inplace` parameter of `Series.clip`
>
[
https://issues.apache.org/jira/browse/SPARK-38765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516074#comment-17516074
]
Apache Spark commented on SPARK-38765:
--
User 'xinrong-databricks' has created a pull request for
Xinrong Meng created SPARK-38765:
Summary: Implement `inplace` parameter of `Series.clip`
Key: SPARK-38765
URL: https://issues.apache.org/jira/browse/SPARK-38765
Project: Spark
Issue Type:
Ayan Ray created SPARK-38764:
Summary: spark thrift server issue: Length field is empty for
varchar fields
Key: SPARK-38764
URL: https://issues.apache.org/jira/browse/SPARK-38764
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-37903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516012#comment-17516012
]
Bjørn Jørgensen commented on SPARK-37903:
-
I do have some problems now when I use lamba on
[ https://issues.apache.org/jira/browse/SPARK-38763 ]
Bjørn Jørgensen deleted comment on SPARK-38763:
-
was (Author: bjornjorgensen):
[~XinrongM]
> Pandas API on spark Can`t apply lamda to columns.
>
[
https://issues.apache.org/jira/browse/SPARK-38763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515991#comment-17515991
]
Bjørn Jørgensen commented on SPARK-38763:
-
[~XinrongM]
> Pandas API on spark Can`t apply lamda
Bjørn Jørgensen created SPARK-38763:
---
Summary: Pandas API on spark Can`t apply lamda to columns.
Key: SPARK-38763
URL: https://issues.apache.org/jira/browse/SPARK-38763
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ZygD updated SPARK-38614:
-
Component/s: SQL
> After Spark update, df.show() shows incorrect F.percent_rank results
>
[
https://issues.apache.org/jira/browse/SPARK-38703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515907#comment-17515907
]
Cheng Pan edited comment on SPARK-38703 at 4/1/22 12:56 PM:
SPARK-34390 may
[
https://issues.apache.org/jira/browse/SPARK-38703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515907#comment-17515907
]
Cheng Pan edited comment on SPARK-38703 at 4/1/22 12:55 PM:
SPARK-34390 may
[
https://issues.apache.org/jira/browse/SPARK-38703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515907#comment-17515907
]
Cheng Pan commented on SPARK-38703:
---
SPARK-34390 may helps, our benchmark of 1T TPC-DS shows the
[
https://issues.apache.org/jira/browse/SPARK-38762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38762:
Assignee: Gengliang Wang (was: Apache Spark)
> Provide query context in Decimal
[
https://issues.apache.org/jira/browse/SPARK-38762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515890#comment-17515890
]
Apache Spark commented on SPARK-38762:
--
User 'gengliangwang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-38762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515889#comment-17515889
]
Apache Spark commented on SPARK-38762:
--
User 'gengliangwang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-38762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38762:
Assignee: Apache Spark (was: Gengliang Wang)
> Provide query context in Decimal
Gengliang Wang created SPARK-38762:
--
Summary: Provide query context in Decimal overflow errors
Key: SPARK-38762
URL: https://issues.apache.org/jira/browse/SPARK-38762
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-38758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38758:
Assignee: Apache Spark
> Web UI add heap dump
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-38758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515865#comment-17515865
]
Apache Spark commented on SPARK-38758:
--
User 'cutiechi' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-38758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38758:
Assignee: (was: Apache Spark)
> Web UI add heap dump
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-38759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38759:
Assignee: (was: Apache Spark)
> Add StreamingQueryListener support in PySpark
>
[
https://issues.apache.org/jira/browse/SPARK-38761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38761:
Assignee: Apache Spark
> DS V2 supports push down misc non-aggregate functions
>
[
https://issues.apache.org/jira/browse/SPARK-38761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515861#comment-17515861
]
Apache Spark commented on SPARK-38761:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-38759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38759:
Assignee: Apache Spark
> Add StreamingQueryListener support in PySpark
>
[
https://issues.apache.org/jira/browse/SPARK-38761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38761:
Assignee: (was: Apache Spark)
> DS V2 supports push down misc non-aggregate
[
https://issues.apache.org/jira/browse/SPARK-38759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515862#comment-17515862
]
Apache Spark commented on SPARK-38759:
--
User 'HyukjinKwon' has created a pull request for this
jiaan.geng created SPARK-38761:
--
Summary: DS V2 supports push down misc non-aggregate functions
Key: SPARK-38761
URL: https://issues.apache.org/jira/browse/SPARK-38761
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-38684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-38684:
Assignee: Jungtaek Lim
> Stream-stream outer join has a possible correctness issue due
[
https://issues.apache.org/jira/browse/SPARK-38684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-38684.
--
Fix Version/s: 3.3.0
3.2.2
Resolution: Fixed
Issue resolved by pull
Hyukjin Kwon created SPARK-38760:
Summary: Implement DataFrame.observe in PySpark
Key: SPARK-38760
URL: https://issues.apache.org/jira/browse/SPARK-38760
Project: Spark
Issue Type:
Hyukjin Kwon created SPARK-38759:
Summary: Add StreamingQueryListener support in PySpark
Key: SPARK-38759
URL: https://issues.apache.org/jira/browse/SPARK-38759
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-38358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515836#comment-17515836
]
Apache Spark commented on SPARK-38358:
--
User 'cutiechi' has created a pull request for this issue:
Jinpeng Chi created SPARK-38758:
---
Summary: Web UI add heap dump
Key: SPARK-38758
URL: https://issues.apache.org/jira/browse/SPARK-38758
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-38757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38757:
Assignee: Apache Spark
> Update the Oracle docker image version used for test and
[
https://issues.apache.org/jira/browse/SPARK-38757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515807#comment-17515807
]
Apache Spark commented on SPARK-38757:
--
User 'LucaCanali' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-38757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38757:
Assignee: (was: Apache Spark)
> Update the Oracle docker image version used for test
[
https://issues.apache.org/jira/browse/SPARK-38757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luca Canali updated SPARK-38757:
Summary: Update the Oracle docker image version used for test and
integration (was: Update the
Luca Canali created SPARK-38757:
---
Summary: Update the Oracle docker image
Key: SPARK-38757
URL: https://issues.apache.org/jira/browse/SPARK-38757
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-37528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-37528:
--
Affects Version/s: 3.4.0
(was: 3.3.0)
> Schedule Tasks By Input Size
>
[
https://issues.apache.org/jira/browse/SPARK-38756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38756:
Assignee: (was: Apache Spark)
> Clean up useless security configs in `TransportConf`
[
https://issues.apache.org/jira/browse/SPARK-38756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38756:
Assignee: Apache Spark
> Clean up useless security configs in `TransportConf`
>
Yang Jie created SPARK-38756:
Summary: Clean up useless security configs in `TransportConf`
Key: SPARK-38756
URL: https://issues.apache.org/jira/browse/SPARK-38756
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-37528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-37528:
--
Summary: Schedule Tasks By Input Size (was: Support reorder tasks during
scheduling by shuffle
[
https://issues.apache.org/jira/browse/SPARK-37528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-37528:
--
Description:
In general, the larger input data size means longer running time. So ideally,
we can
76 matches
Mail list logo