Cheng Pan created SPARK-43248:
-
Summary: Unnecessary serialize/deserialize of Path on parallel
gather partition stats
Key: SPARK-43248
URL: https://issues.apache.org/jira/browse/SPARK-43248
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng updated SPARK-43229:
--
Summary: Introduce Barrier Python UDF (was: Support Barrier Python UDF)
> Introduce Barrier P
Martin Grund created SPARK-43249:
Summary: df.sql() should send metrics back()
Key: SPARK-43249
URL: https://issues.apache.org/jira/browse/SPARK-43249
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-42317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-42317.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40810
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-42317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-42317:
Assignee: Koray Beyaz
> Assign name to _LEGACY_ERROR_TEMP_2247
>
[
https://issues.apache.org/jira/browse/SPARK-43249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-43249:
-
Assignee: Martin Grund
> df.sql() should send metrics back()
>
[
https://issues.apache.org/jira/browse/SPARK-43249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43249.
---
Fix Version/s: 3.5.0
3.4.1
Resolution: Fixed
Issue resolved by pul
[
https://issues.apache.org/jira/browse/SPARK-43250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-43250:
-
Description:
Choose a proper name for the error class *_LEGACY_ERROR_TEMP_2014* defined in
{*}core/src/
Max Gekk created SPARK-43250:
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2014
Key: SPARK-43250
URL: https://issues.apache.org/jira/browse/SPARK-43250
Project: Spark
Issue Type:
Max Gekk created SPARK-43252:
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2016
Key: SPARK-43252
URL: https://issues.apache.org/jira/browse/SPARK-43252
Project: Spark
Issue Type:
Max Gekk created SPARK-43251:
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2015
Key: SPARK-43251
URL: https://issues.apache.org/jira/browse/SPARK-43251
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-43252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-43252:
-
Description:
Choose a proper name for the error class *_LEGACY_ERROR_TEMP_2016* defined in
{*}core/src/
[
https://issues.apache.org/jira/browse/SPARK-43251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-43251:
-
Description:
Choose a proper name for the error class *_LEGACY_ERROR_TEMP_2015* defined in
{*}core/src/
[
https://issues.apache.org/jira/browse/SPARK-43254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-43254:
-
Description:
Choose a proper name for the error class *_LEGACY_ERROR_TEMP_2018* defined in
{*}core/src/
Max Gekk created SPARK-43254:
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2018
Key: SPARK-43254
URL: https://issues.apache.org/jira/browse/SPARK-43254
Project: Spark
Issue Type:
Max Gekk created SPARK-43253:
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2017
Key: SPARK-43253
URL: https://issues.apache.org/jira/browse/SPARK-43253
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-43253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-43253:
-
Description:
Choose a proper name for the error class *_LEGACY_ERROR_TEMP_2017* defined in
{*}core/src/
Max Gekk created SPARK-43256:
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2021
Key: SPARK-43256
URL: https://issues.apache.org/jira/browse/SPARK-43256
Project: Spark
Issue Type:
Max Gekk created SPARK-43255:
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2020
Key: SPARK-43255
URL: https://issues.apache.org/jira/browse/SPARK-43255
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-43255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-43255:
-
Description:
Choose a proper name for the error class *_LEGACY_ERROR_TEMP_2020* defined in
{*}core/src/
[
https://issues.apache.org/jira/browse/SPARK-43256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-43256:
-
Description:
Choose a proper name for the error class *_LEGACY_ERROR_TEMP_2021* defined in
{*}core/src/
Max Gekk created SPARK-43258:
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2023
Key: SPARK-43258
URL: https://issues.apache.org/jira/browse/SPARK-43258
Project: Spark
Issue Type:
Max Gekk created SPARK-43257:
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2022
Key: SPARK-43257
URL: https://issues.apache.org/jira/browse/SPARK-43257
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-43257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-43257:
-
Description:
Choose a proper name for the error class *_LEGACY_ERROR_TEMP_2022* defined in
{*}core/src/
[
https://issues.apache.org/jira/browse/SPARK-43258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-43258:
-
Description:
Choose a proper name for the error class *_LEGACY_ERROR_TEMP_2023* defined in
{*}core/src/
Max Gekk created SPARK-43259:
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2024
Key: SPARK-43259
URL: https://issues.apache.org/jira/browse/SPARK-43259
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-43259:
-
Description:
Choose a proper name for the error class *_LEGACY_ERROR_TEMP_2024* defined in
{*}core/src/
[
https://issues.apache.org/jira/browse/SPARK-43178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-43178:
-
Assignee: Haejoon Lee
> Migrate UDF errors into error class
> -
[
https://issues.apache.org/jira/browse/SPARK-43178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43178.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40866
[https://
[
https://issues.apache.org/jira/browse/SPARK-43214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-43214.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40875
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-43214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-43214:
---
Assignee: Fu Chen
> Post driver-side metrics for LocalTableScanExec/CommandResultExec
> ---
Haejoon Lee created SPARK-43260:
---
Summary: Migrate the Spark SQL pandas arrow type errors into error
class.
Key: SPARK-43260
URL: https://issues.apache.org/jira/browse/SPARK-43260
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17715748#comment-17715748
]
Nikita Awasthi commented on SPARK-43246:
User 'LuciferYang' has created a pull r
[
https://issues.apache.org/jira/browse/SPARK-43246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17715746#comment-17715746
]
Nikita Awasthi commented on SPARK-43246:
User 'LuciferYang' has created a pull r
Haejoon Lee created SPARK-43261:
---
Summary: Migrate `TypeError` from Spark SQL types into error class
Key: SPARK-43261
URL: https://issues.apache.org/jira/browse/SPARK-43261
Project: Spark
Issue
Haejoon Lee created SPARK-43262:
---
Summary: Migrate Spark Connect Structured Streaming errors into
error class
Key: SPARK-43262
URL: https://issues.apache.org/jira/browse/SPARK-43262
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17715796#comment-17715796
]
karthik kadiyam commented on SPARK-43201:
-
+1
Will appreciate if someone can t
Bjørn Jørgensen created SPARK-43263:
---
Summary: Upgrade FasterXML / jackson-dataformats-text to 2.15.0
Key: SPARK-43263
URL: https://issues.apache.org/jira/browse/SPARK-43263
Project: Spark
Zamil Majdy created SPARK-43264:
---
Summary: Avoid allocation of unwritten ColumnVector in
VectorizedReader
Key: SPARK-43264
URL: https://issues.apache.org/jira/browse/SPARK-43264
Project: Spark
Rui Wang created SPARK-43265:
Summary: Move Error framework to a common utils module
Key: SPARK-43265
URL: https://issues.apache.org/jira/browse/SPARK-43265
Project: Spark
Issue Type: Task
Peter Toth created SPARK-43266:
--
Summary: Move MergeScalarSubqueries to spark-sql
Key: SPARK-43266
URL: https://issues.apache.org/jira/browse/SPARK-43266
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-43217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-43217:
---
Assignee: Johan Lasperas
> Correctly recurse into maps of maps and arrays of arrays in
> S
[
https://issues.apache.org/jira/browse/SPARK-43217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-43217.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40879
[https://gith
Sifan Huang created SPARK-43267:
---
Summary: Support creating data frame from a Postgres table that
contains user-defined array column
Key: SPARK-43267
URL: https://issues.apache.org/jira/browse/SPARK-43267
Anton Okolnychyi created SPARK-43268:
Summary: Use proper error classes when exceptions are constructed
with a message
Key: SPARK-43268
URL: https://issues.apache.org/jira/browse/SPARK-43268
Proje
Neil Jonkers created SPARK-43269:
Summary: Adding support for MissingFiles when
spark.sql.parquet.mergeSchema=true
Key: SPARK-43269
URL: https://issues.apache.org/jira/browse/SPARK-43269
Project: Spar
[
https://issues.apache.org/jira/browse/SPARK-43269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neil Jonkers updated SPARK-43269:
-
Description:
Hello,
With`spark.sql.files.ignoreMissingFiles=true` we notice
[readParquetFooter
[
https://issues.apache.org/jira/browse/SPARK-43269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neil Jonkers updated SPARK-43269:
-
Description:
Hello,
{{With *spark.sql.files.ignoreMissingFiles=true* we notice
[readParquetFoo
[
https://issues.apache.org/jira/browse/SPARK-43269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neil Jonkers updated SPARK-43269:
-
Description:
Hello,
{{With }}*spark.sql.files.ignoreMissingFiles=true*{{ we notice
[readParque
[
https://issues.apache.org/jira/browse/SPARK-43269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neil Jonkers updated SPARK-43269:
-
Description:
Hello,
{{With *spark.sql.files.ignoreMissingFiles=true* we notice [link
title|htt
[
https://issues.apache.org/jira/browse/SPARK-43269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neil Jonkers updated SPARK-43269:
-
Description:
Hello,
{{With *spark.sql.files.ignoreMissingFiles=true* we notice
[readParquetFoo
[
https://issues.apache.org/jira/browse/SPARK-43269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neil Jonkers updated SPARK-43269:
-
Description:
Hello,
{{With `spark.sql.files.ignoreMissingFiles=true` we notice
[readParquetFoo
[
https://issues.apache.org/jira/browse/SPARK-43269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neil Jonkers updated SPARK-43269:
-
Description:
Hello,
{{With *spark.sql.files.ignoreMissingFiles=true* we notice
[readParquetFoo
[
https://issues.apache.org/jira/browse/SPARK-43269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neil Jonkers updated SPARK-43269:
-
Description:
Hello,
{{With spark.sql.files.ignoreMissingFiles=true we notice
[readParquetFoote
[
https://issues.apache.org/jira/browse/SPARK-43269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neil Jonkers updated SPARK-43269:
-
Description:
Hello,
{{With {{spark.sql.files.ignoreMissingFiles=true}} we notice
[readParquetF
[
https://issues.apache.org/jira/browse/SPARK-43269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neil Jonkers updated SPARK-43269:
-
Description:
Hello,
{{With spark.sql.files.ignoreMissingFiles=true we notice
[readParquetFoote
[
https://issues.apache.org/jira/browse/SPARK-43263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bjørn Jørgensen updated SPARK-43263:
Summary: Upgrade FasterXML jackson to 2.15.0 (was: Upgrade FasterXML /
jackson-dataformat
[
https://issues.apache.org/jira/browse/SPARK-43263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17715949#comment-17715949
]
PJ Fanning commented on SPARK-43263:
This is a duplicate of SPARK-42854 and it is no
[
https://issues.apache.org/jira/browse/SPARK-43269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neil Jonkers updated SPARK-43269:
-
Issue Type: Improvement (was: Bug)
> Adding support for MissingFiles when spark.sql.parquet.mer
Beishao Cao created SPARK-43270:
---
Summary: Implement __dir__() in pyspark.sql.dataframe.DataFrame to
include columns
Key: SPARK-43270
URL: https://issues.apache.org/jira/browse/SPARK-43270
Project: Spar
[
https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beishao Cao updated SPARK-43270:
Attachment: Screenshot 2023-04-23 at 6.48.46 PM-1.png
> Implement __dir__() in pyspark.sql.datafra
[
https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beishao Cao updated SPARK-43270:
Attachment: (was: Screenshot 2023-04-23 at 6.48.46 PM-1.png)
> Implement __dir__() in pyspark.
[
https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beishao Cao updated SPARK-43270:
Description:
Currently, {{df.|}} will only suggest the method of dataframe(see attached
Screensho
[
https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beishao Cao updated SPARK-43270:
Description:
Currently, {{df.|}} will only suggest the method of dataframe(see attached
photo of
[
https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beishao Cao updated SPARK-43270:
Attachment: Screenshot 2023-04-23 at 6.48.46 PM.png
> Implement __dir__() in pyspark.sql.dataframe
[
https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beishao Cao updated SPARK-43270:
Description:
Currently, {{df.|}} will only suggest the method of dataframe(see attached
Screensho
[
https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beishao Cao updated SPARK-43270:
Description:
Currently, Given {{df.|}} , the databricks notebook will only suggest the
method of
[
https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beishao Cao updated SPARK-43270:
Description:
Currently, Given {{df.|}} , the databricks notebook will only suggest the
method of
[
https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beishao Cao updated SPARK-43270:
Description:
Currently, Given {{df.|}} , the databricks notebook will only suggest the
method of
[
https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beishao Cao updated SPARK-43270:
Description:
Currently, Given {{df.|}} , the databricks notebook will only suggest the
method of
[
https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beishao Cao updated SPARK-43270:
Description:
Currently, Given {{df.|}} , the databricks notebook will only suggest the
method of
[
https://issues.apache.org/jira/browse/SPARK-43250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17716006#comment-17716006
]
Atour Mousavi Gourabi commented on SPARK-43250:
---
I'd like to take this one
[
https://issues.apache.org/jira/browse/SPARK-43268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-43268.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40934
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-43268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-43268:
Assignee: Anton Okolnychyi
> Use proper error classes when exceptions are constructed with a mess
[
https://issues.apache.org/jira/browse/SPARK-43233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-43233.
--
Fix Version/s: 3.5.0
Assignee: Siying Dong
Resolution: Fixed
Issue resolved vi
[
https://issues.apache.org/jira/browse/SPARK-43262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43262.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40928
[https://
[
https://issues.apache.org/jira/browse/SPARK-43262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-43262:
-
Assignee: Haejoon Lee
> Migrate Spark Connect Structured Streaming errors into error cl
Haejoon Lee created SPARK-43271:
---
Summary: Fix test DataFrameTests.test_reindex with specifying
`index`.
Key: SPARK-43271
URL: https://issues.apache.org/jira/browse/SPARK-43271
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-43271:
Summary: Match behavior with DataFrame.reindex with specifying `index`.
(was: Fix test DataFrameT
[
https://issues.apache.org/jira/browse/SPARK-42419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17716071#comment-17716071
]
Snoot.io commented on SPARK-42419:
--
User 'itholic' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17716072#comment-17716072
]
Snoot.io commented on SPARK-43270:
--
User 'alexanderwu-db' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-43144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43144.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40887
[https://
[
https://issues.apache.org/jira/browse/SPARK-43260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-43260:
-
Assignee: Haejoon Lee
> Migrate the Spark SQL pandas arrow type errors into error class
[
https://issues.apache.org/jira/browse/SPARK-43260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43260.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40924
[https://
Yang Jie created SPARK-43272:
Summary: Replace reflection w/ direct calling for
`SparkHadoopUtil#createFile`
Key: SPARK-43272
URL: https://issues.apache.org/jira/browse/SPARK-43272
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17716118#comment-17716118
]
Max Gekk commented on SPARK-43250:
--
[~amousavigourabi] Sure, go ahead.
> Assign a name
86 matches
Mail list logo
