[jira] [Assigned] (SPARK-46641) Add maxBytesPerTrigger threshold option

[ https://issues.apache.org/jira/browse/SPARK-46641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46641: - Assignee: Maksim Konstantinov > Add maxBytesPerTrigger threshold option >

[jira] [Resolved] (SPARK-46641) Add maxBytesPerTrigger threshold option

[ https://issues.apache.org/jira/browse/SPARK-46641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46641. --- Resolution: Fixed Issue resolved by pull request 44636

[jira] [Updated] (SPARK-35303) Enable pinned thread mode by default

[ https://issues.apache.org/jira/browse/SPARK-35303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-35303: --- Labels: pull-request-available (was: ) > Enable pinned thread mode by default >

[jira] [Updated] (SPARK-35946) Respect Py4J server if InheritableThread API

[ https://issues.apache.org/jira/browse/SPARK-35946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-35946: --- Labels: pull-request-available (was: ) > Respect Py4J server if InheritableThread API >

[jira] [Commented] (SPARK-47014) Implement methods dumpPerfProfiles and dumpMemoryProfiles of SparkSession

[ https://issues.apache.org/jira/browse/SPARK-47014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815891#comment-17815891 ] Hudson commented on SPARK-47014: User 'xinrong-meng' has created a pull request for this issue:

[jira] [Created] (SPARK-47014) Implement methods dumpPerfProfiles and dumpMemoryProfiles of SparkSession

Xinrong Meng created SPARK-47014: Summary: Implement methods dumpPerfProfiles and dumpMemoryProfiles of SparkSession Key: SPARK-47014 URL: https://issues.apache.org/jira/browse/SPARK-47014 Project:

[jira] [Updated] (SPARK-47013) Document the config spark.sql.streaming.minBatchesToRetain

[ https://issues.apache.org/jira/browse/SPARK-47013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingeshwaran Radhakrishnan updated SPARK-47013: --- Summary: Document the config spark.sql.streaming.minBatchesToRetain

[jira] [Updated] (SPARK-47013) Document the config spark.sql.streaming.minBatchesToRetain

[ https://issues.apache.org/jira/browse/SPARK-47013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingeshwaran Radhakrishnan updated SPARK-47013: --- Priority: Minor (was: Major) > Document the config

[jira] [Created] (SPARK-47013) Add the config spark.sql.streaming.minBatchesToRetain to the docs

Lingeshwaran Radhakrishnan created SPARK-47013: -- Summary: Add the config spark.sql.streaming.minBatchesToRetain to the docs Key: SPARK-47013 URL: https://issues.apache.org/jira/browse/SPARK-47013

[jira] [Created] (SPARK-47012) Built-in SQL Function Support - Collate

Aleksandar Tomic created SPARK-47012: Summary: Built-in SQL Function Support - Collate Key: SPARK-47012 URL: https://issues.apache.org/jira/browse/SPARK-47012 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47002) Enforce that 'AnalyzeResult' 'orderBy' field is a list of pyspark.sql.functions.OrderingColumn

[ https://issues.apache.org/jira/browse/SPARK-47002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-47002. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45062

[jira] [Assigned] (SPARK-47002) Enforce that 'AnalyzeResult' 'orderBy' field is a list of pyspark.sql.functions.OrderingColumn

[ https://issues.apache.org/jira/browse/SPARK-47002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-47002: - Assignee: Daniel > Enforce that 'AnalyzeResult' 'orderBy' field is a list of >

[jira] [Assigned] (SPARK-47011) Remove deprecated `BinaryClassificationMetrics.scoreLabelsWeight`

[ https://issues.apache.org/jira/browse/SPARK-47011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47011: - Assignee: Dongjoon Hyun > Remove deprecated

[jira] [Resolved] (SPARK-47011) Remove deprecated `BinaryClassificationMetrics.scoreLabelsWeight`

[ https://issues.apache.org/jira/browse/SPARK-47011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47011. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45070

[jira] [Assigned] (SPARK-46690) Support profiling on FlatMapCoGroupsInBatchExec

[ https://issues.apache.org/jira/browse/SPARK-46690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-46690: Assignee: Xinrong Meng > Support profiling on FlatMapCoGroupsInBatchExec >

[jira] [Resolved] (SPARK-46690) Support profiling on FlatMapCoGroupsInBatchExec

[ https://issues.apache.org/jira/browse/SPARK-46690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-46690. -- Resolution: Done Resolved by https://github.com/apache/spark/pull/45050 > Support profiling

[jira] [Resolved] (SPARK-46689) Support profiling on FlatMapGroupsInBatchExec

[ https://issues.apache.org/jira/browse/SPARK-46689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-46689. -- Resolution: Done Resolved by https://github.com/apache/spark/pull/45050 > Support profiling

[jira] [Assigned] (SPARK-46689) Support profiling on FlatMapGroupsInBatchExec

[ https://issues.apache.org/jira/browse/SPARK-46689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-46689: Assignee: Xinrong Meng > Support profiling on FlatMapGroupsInBatchExec >

[jira] [Updated] (SPARK-47011) Remove deprecated `BinaryClassificationMetrics.scoreLabelsWeight`

[ https://issues.apache.org/jira/browse/SPARK-47011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47011: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Remove deprecated

[jira] [Created] (SPARK-47011) Remove deprecated `BinaryClassificationMetrics.scoreLabelsWeight`

Dongjoon Hyun created SPARK-47011: - Summary: Remove deprecated `BinaryClassificationMetrics.scoreLabelsWeight` Key: SPARK-47011 URL: https://issues.apache.org/jira/browse/SPARK-47011 Project: Spark

[jira] [Updated] (SPARK-47011) Remove deprecated `BinaryClassificationMetrics.scoreLabelsWeight`

[ https://issues.apache.org/jira/browse/SPARK-47011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47011: --- Labels: pull-request-available (was: ) > Remove deprecated

[jira] [Created] (SPARK-47010) Kubernetes: support csi driver for volume type

Oleg Frenkel created SPARK-47010: Summary: Kubernetes: support csi driver for volume type Key: SPARK-47010 URL: https://issues.apache.org/jira/browse/SPARK-47010 Project: Spark Issue Type:

[jira] [Created] (SPARK-47009) Create table with collation

Stefan Kandic created SPARK-47009: - Summary: Create table with collation Key: SPARK-47009 URL: https://issues.apache.org/jira/browse/SPARK-47009 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47008) Spark to support S3 Express One Zone Storage

Steve Loughran created SPARK-47008: -- Summary: Spark to support S3 Express One Zone Storage Key: SPARK-47008 URL: https://issues.apache.org/jira/browse/SPARK-47008 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47007) Add SortMap function

[ https://issues.apache.org/jira/browse/SPARK-47007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47007: --- Labels: pull-request-available (was: ) > Add SortMap function > > >

[jira] [Assigned] (SPARK-39910) DataFrameReader API cannot read files from hadoop archives (.har)

[ https://issues.apache.org/jira/browse/SPARK-39910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39910: --- Assignee: Christophe Préaud > DataFrameReader API cannot read files from hadoop archives

[jira] [Resolved] (SPARK-39910) DataFrameReader API cannot read files from hadoop archives (.har)

[ https://issues.apache.org/jira/browse/SPARK-39910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39910. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-47007) Add SortMap function

Stefan Kandic created SPARK-47007: - Summary: Add SortMap function Key: SPARK-47007 URL: https://issues.apache.org/jira/browse/SPARK-47007 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46999) ExpressionWithUnresolvedIdentifier should include other expressions in the expression tree

[ https://issues.apache.org/jira/browse/SPARK-46999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46999. - Fix Version/s: 4.0.0 Assignee: Wenchen Fan Resolution: Fixed >

[jira] [Resolved] (SPARK-46993) Allow session variables in more places such as from_json for schema

[ https://issues.apache.org/jira/browse/SPARK-46993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46993. - Fix Version/s: 4.0.0 Assignee: Serge Rielau Resolution: Fixed > Allow session

[jira] [Updated] (SPARK-47006) Refactor refill() method to isExhausted() in NioBufferedFileInputStream

[ https://issues.apache.org/jira/browse/SPARK-47006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-47006: - Description: Currently, in NioBufferedFileInputStream, the refill() method is always invoked in a

[jira] [Created] (SPARK-47006) Refactor refill() method to isExhausted() in NioBufferedFileInputStream

Yang Jie created SPARK-47006: Summary: Refactor refill() method to isExhausted() in NioBufferedFileInputStream Key: SPARK-47006 URL: https://issues.apache.org/jira/browse/SPARK-47006 Project: Spark