[jira] [Updated] (SPARK-45714) Spark UI throws 500 error when StructuredStreaming query filter is selected

2023-10-27 Thread Satyam Raj (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satyam Raj updated SPARK-45714: --- Description: h2.   When I'm trying to do the following inside the listener class, and go to the UI

[jira] [Updated] (SPARK-45714) Spark UI throws 500 error when StructuredStreaming query filter is selected

2023-10-27 Thread Satyam Raj (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satyam Raj updated SPARK-45714: --- Description: h2. HTTP ERROR 500 java.lang.NullPointerException ||URI:|/StreamingQuery/active|

[jira] [Created] (SPARK-45714) Spark UI throws 500 error when StructuredStreaming query filter is selected

2023-10-27 Thread Satyam Raj (Jira)
Satyam Raj created SPARK-45714: -- Summary: Spark UI throws 500 error when StructuredStreaming query filter is selected Key: SPARK-45714 URL: https://issues.apache.org/jira/browse/SPARK-45714 Project:

[jira] [Updated] (SPARK-45678) Cover BufferReleasingInputStream.available under tryOrFetchFailedException

2023-10-27 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-45678: Fix Version/s: 3.4.2 3.5.1 > Cover BufferReleasingInputStream.available under

[jira] [Updated] (SPARK-45678) Cover BufferReleasingInputStream.available under tryOrFetchFailedException

2023-10-27 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-45678: Issue Type: Bug (was: Improvement) > Cover BufferReleasingInputStream.available under

[jira] [Updated] (SPARK-45678) Cover BufferReleasingInputStream.available under tryOrFetchFailedException

2023-10-27 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-45678: Affects Version/s: 3.5.0 3.4.1 > Cover

[jira] [Assigned] (SPARK-45678) Cover BufferReleasingInputStream.available under tryOrFetchFailedException

2023-10-27 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-45678: Assignee: L. C. Hsieh > Cover BufferReleasingInputStream.available under

[jira] [Resolved] (SPARK-45678) Cover BufferReleasingInputStream.available under tryOrFetchFailedException

2023-10-27 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-45678. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43543

[jira] [Resolved] (SPARK-45705) Fix flaky test: Status of a failed DDL/DML with no jobs should be FAILED

2023-10-27 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You resolved SPARK-45705. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43554

[jira] [Updated] (SPARK-45713) Support registering Python data sources

2023-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45713: --- Labels: pull-request-available (was: ) > Support registering Python data sources >

[jira] [Updated] (SPARK-45713) Support registering Python data sources

2023-10-27 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-45713: - Description: Support registering Python data sources. Users can register a Python data source

[jira] [Updated] (SPARK-45713) Support registering Python data sources

2023-10-27 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-45713: - Description: Support registering Python data sources. Users can register a Python data source

[jira] [Created] (SPARK-45713) Support registering Python data sources

2023-10-27 Thread Allison Wang (Jira)
Allison Wang created SPARK-45713: Summary: Support registering Python data sources Key: SPARK-45713 URL: https://issues.apache.org/jira/browse/SPARK-45713 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45639) Support loading Python data sources in DataFrameReader

2023-10-27 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-45639: - Description: Allow users to read from a Python data source using

[jira] [Updated] (SPARK-45639) Support loading Python data sources in DataFrameReader

2023-10-27 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-45639: - Summary: Support loading Python data sources in DataFrameReader (was: Support Python data

[jira] [Created] (SPARK-45712) Provide a command line flag to override the log4j properties file

2023-10-27 Thread Holden Karau (Jira)
Holden Karau created SPARK-45712: Summary: Provide a command line flag to override the log4j properties file Key: SPARK-45712 URL: https://issues.apache.org/jira/browse/SPARK-45712 Project: Spark

[jira] [Updated] (SPARK-45684) Clean up the deprecated API usage related to `SeqOps`

2023-10-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45684: - Description: * method transform in trait SeqOps is deprecated (since 2.13.0) * method reverseMap in

[jira] [Updated] (SPARK-45685) Use `LazyList` instead of `Stream`

2023-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45685: --- Labels: pull-request-available (was: ) > Use `LazyList` instead of `Stream` >

[jira] [Resolved] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

2023-10-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45649. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43507

[jira] [Updated] (SPARK-45711) Introduce a mapper for avro compression codecs

2023-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45711: --- Labels: pull-request-available (was: ) > Introduce a mapper for avro compression codecs >

[jira] [Updated] (SPARK-45711) Introduce a mapper for avro compression codecs

2023-10-27 Thread Jiaan Geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-45711: --- Description: Currently, Spark supported all the avro compression codecs, but the avro supported

[jira] [Updated] (SPARK-45711) Introduce a mapper for avro compression codecs

2023-10-27 Thread Jiaan Geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-45711: --- Description: Currently, Spark supported all the avro compression codecs, but the avro supported

[jira] [Updated] (SPARK-45711) Introduce a mapper for avro compression codecs

2023-10-27 Thread Jiaan Geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-45711: --- Description: Currently, Spark supported all the orc compression codecs, but the orc supported

[jira] [Resolved] (SPARK-45706) Makes entire Binder build fails fast during setting up

2023-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45706. -- Fix Version/s: 4.0.0 3.5.1 Assignee: Hyukjin Kwon

[jira] [Updated] (SPARK-45710) Assign name to _LEGACY_ERROR_TEMP_21[59,60,61,62]

2023-10-27 Thread Deng Ziming (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deng Ziming updated SPARK-45710: Description: Choose a proper name for the error class

[jira] [Created] (SPARK-45710) Assign name to _LEGACY_ERROR_TEMP__LEGACY_ERROR_TEMP_21[59,60,61,62]

2023-10-27 Thread Deng Ziming (Jira)
Deng Ziming created SPARK-45710: --- Summary: Assign name to _LEGACY_ERROR_TEMP__LEGACY_ERROR_TEMP_21[59,60,61,62] Key: SPARK-45710 URL: https://issues.apache.org/jira/browse/SPARK-45710 Project: Spark

[jira] [Updated] (SPARK-45710) Assign name to _LEGACY_ERROR_TEMP_21[59,60,61,62]

2023-10-27 Thread Deng Ziming (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deng Ziming updated SPARK-45710: Summary: Assign name to _LEGACY_ERROR_TEMP_21[59,60,61,62] (was: Assign name to

[jira] [Updated] (SPARK-45708) Retry mvn deploy failures

2023-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45708: --- Labels: pull-request-available (was: ) > Retry mvn deploy failures >

[jira] [Created] (SPARK-45708) Retry mvn deploy failures

2023-10-27 Thread Enrico Minack (Jira)
Enrico Minack created SPARK-45708: - Summary: Retry mvn deploy failures Key: SPARK-45708 URL: https://issues.apache.org/jira/browse/SPARK-45708 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-45707) Simplify `DataFrameStatFunctions. countMinSketch` with `CountMinSketchAgg `

2023-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45707: --- Labels: pull-request-available (was: ) > Simplify `DataFrameStatFunctions. countMinSketch`

[jira] [Created] (SPARK-45707) Simplify `DataFrameStatFunctions. countMinSketch` with `CountMinSketchAgg `

2023-10-27 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-45707: - Summary: Simplify `DataFrameStatFunctions. countMinSketch` with `CountMinSketchAgg ` Key: SPARK-45707 URL: https://issues.apache.org/jira/browse/SPARK-45707

[jira] [Updated] (SPARK-45696) Fix `method tryCompleteWith in trait Promise is deprecated`

2023-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45696: --- Labels: pull-request-available (was: ) > Fix `method tryCompleteWith in trait Promise is

[jira] [Resolved] (SPARK-45698) Clean up the deprecated API usage related to `Buffer`

2023-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45698. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43551

[jira] [Assigned] (SPARK-45698) Clean up the deprecated API usage related to `Buffer`

2023-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-45698: Assignee: Yang Jie > Clean up the deprecated API usage related to `Buffer` >

[jira] [Assigned] (SPARK-45651) Snapshots of some packages are not published any more

2023-10-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45651: Assignee: Enrico Minack > Snapshots of some packages are not published any more >

[jira] [Resolved] (SPARK-45651) Snapshots of some packages are not published any more

2023-10-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45651. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43555

[jira] [Updated] (SPARK-45705) Fix flaky test: Status of a failed DDL/DML with no jobs should be FAILED

2023-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45705: --- Labels: pull-request-available (was: ) > Fix flaky test: Status of a failed DDL/DML with

[jira] [Updated] (SPARK-45706) Makes entire Binder build fails fast during setting up

2023-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45706: --- Labels: pull-request-available (was: ) > Makes entire Binder build fails fast during

[jira] [Created] (SPARK-45706) Makes entire Binder build fails fast during setting up

2023-10-27 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45706: Summary: Makes entire Binder build fails fast during setting up Key: SPARK-45706 URL: https://issues.apache.org/jira/browse/SPARK-45706 Project: Spark Issue

[jira] [Created] (SPARK-45705) Fix flaky test: Status of a failed DDL/DML with no jobs should be FAILED

2023-10-27 Thread Kent Yao (Jira)
Kent Yao created SPARK-45705: Summary: Fix flaky test: Status of a failed DDL/DML with no jobs should be FAILED Key: SPARK-45705 URL: https://issues.apache.org/jira/browse/SPARK-45705 Project: Spark

[jira] [Updated] (SPARK-45701) Clean up the deprecated API usage related to `SetOps`

2023-10-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45701: - Description: * method - in trait SetOps is deprecated (since 2.13.0) * method – in trait SetOps is

[jira] [Resolved] (SPARK-45614) Assign name to _LEGACY_ERROR_TEMP_215[6,7,8]

2023-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45614. -- Resolution: Fixed Issue resolved by pull request 43481 [https://github.com/apache/spark/pull/43481]

[jira] [Assigned] (SPARK-40820) Creating StructType from Json

2023-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40820: Assignee: Anthony Wainer Cachay Guivin > Creating StructType from Json >

[jira] [Resolved] (SPARK-40820) Creating StructType from Json

2023-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40820. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43474

[jira] [Updated] (SPARK-45670) SparkSubmit does not support --total-executor-cores when deploying on K8s

2023-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45670: - Fix Version/s: 3.4.2 3.5.1 > SparkSubmit does not support

[jira] [Resolved] (SPARK-45670) SparkSubmit does not support --total-executor-cores when deploying on K8s

2023-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45670. -- Fix Version/s: 3.3.4 Resolution: Fixed Issue resolved by pull request 43548

[jira] [Assigned] (SPARK-45670) SparkSubmit does not support --total-executor-cores when deploying on K8s

2023-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45670: Assignee: Cheng Pan > SparkSubmit does not support --total-executor-cores when deploying

[jira] [Updated] (SPARK-45637) Time window aggregation in separate streams followed by stream-stream join not returning results

2023-10-27 Thread Wei Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Liu updated SPARK-45637: Description: According to documentation update (SPARK-42591) resulting from SPARK-42376, Spark 3.5.0