[jira] [Commented] (SPARK-39301) Levearge LocalRelation in createDataFrame with Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-39301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542364#comment-17542364 ] Apache Spark commented on SPARK-39301: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-39301) Levearge LocalRelation in createDataFrame with Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-39301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39301: Assignee: Apache Spark > Levearge LocalRelation in createDataFrame with Arrow

[jira] [Commented] (SPARK-39301) Levearge LocalRelation in createDataFrame with Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-39301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542363#comment-17542363 ] Apache Spark commented on SPARK-39301: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-39301) Levearge LocalRelation in createDataFrame with Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-39301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39301: Assignee: (was: Apache Spark) > Levearge LocalRelation in createDataFrame with Arrow

[jira] [Created] (SPARK-39301) Levearge LocalRelation in createDataFrame with Arrow optimization

Hyukjin Kwon created SPARK-39301: Summary: Levearge LocalRelation in createDataFrame with Arrow optimization Key: SPARK-39301 URL: https://issues.apache.org/jira/browse/SPARK-39301 Project: Spark

[jira] [Assigned] (SPARK-39300) Move pandasSkewness and pandasKurtosis into pandas.spark.functions

[ https://issues.apache.org/jira/browse/SPARK-39300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39300: Assignee: Apache Spark > Move pandasSkewness and pandasKurtosis into

[jira] [Assigned] (SPARK-39300) Move pandasSkewness and pandasKurtosis into pandas.spark.functions

[ https://issues.apache.org/jira/browse/SPARK-39300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39300: Assignee: (was: Apache Spark) > Move pandasSkewness and pandasKurtosis into

[jira] [Commented] (SPARK-39300) Move pandasSkewness and pandasKurtosis into pandas.spark.functions

[ https://issues.apache.org/jira/browse/SPARK-39300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542342#comment-17542342 ] Apache Spark commented on SPARK-39300: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-39300) Move pandasSkewness and pandasKurtosis into pandas.spark.functions

zhengruifeng created SPARK-39300: Summary: Move pandasSkewness and pandasKurtosis into pandas.spark.functions Key: SPARK-39300 URL: https://issues.apache.org/jira/browse/SPARK-39300 Project: Spark

[jira] [Assigned] (SPARK-39277) Make Optimizer extends SQLConfHelper

[ https://issues.apache.org/jira/browse/SPARK-39277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39277: --- Assignee: Yuming Wang > Make Optimizer extends SQLConfHelper >

[jira] [Resolved] (SPARK-39277) Make Optimizer extends SQLConfHelper

[ https://issues.apache.org/jira/browse/SPARK-39277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39277. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36657

[jira] [Assigned] (SPARK-39299) Series.autocorr use SQL.corr to avoid conversion to vector

[ https://issues.apache.org/jira/browse/SPARK-39299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39299: Assignee: Apache Spark > Series.autocorr use SQL.corr to avoid conversion to vector >

[jira] [Assigned] (SPARK-39299) Series.autocorr use SQL.corr to avoid conversion to vector

[ https://issues.apache.org/jira/browse/SPARK-39299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39299: Assignee: (was: Apache Spark) > Series.autocorr use SQL.corr to avoid conversion to

[jira] [Commented] (SPARK-39299) Series.autocorr use SQL.corr to avoid conversion to vector

[ https://issues.apache.org/jira/browse/SPARK-39299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542335#comment-17542335 ] Apache Spark commented on SPARK-39299: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-39299) Series.autocorr use SQL.corr to avoid conversion to vector

zhengruifeng created SPARK-39299: Summary: Series.autocorr use SQL.corr to avoid conversion to vector Key: SPARK-39299 URL: https://issues.apache.org/jira/browse/SPARK-39299 Project: Spark

[jira] [Assigned] (SPARK-39283) Spark tasks stuck forever due to deadlock between TaskMemoryManager and UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-39283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39283: Assignee: (was: Apache Spark) > Spark tasks stuck forever due to deadlock between

[jira] [Assigned] (SPARK-39283) Spark tasks stuck forever due to deadlock between TaskMemoryManager and UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-39283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39283: Assignee: Apache Spark > Spark tasks stuck forever due to deadlock between

[jira] [Commented] (SPARK-39283) Spark tasks stuck forever due to deadlock between TaskMemoryManager and UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-39283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542333#comment-17542333 ] Apache Spark commented on SPARK-39283: -- User 'sandeepvinayak' has created a pull request for this

[jira] [Commented] (SPARK-39298) Change to use `seq.indices` constructing ranges

[ https://issues.apache.org/jira/browse/SPARK-39298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542331#comment-17542331 ] Apache Spark commented on SPARK-39298: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-39298) Change to use `seq.indices` constructing ranges

[ https://issues.apache.org/jira/browse/SPARK-39298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542330#comment-17542330 ] Apache Spark commented on SPARK-39298: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39298) Change to use `seq.indices` constructing ranges

[ https://issues.apache.org/jira/browse/SPARK-39298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39298: Assignee: (was: Apache Spark) > Change to use `seq.indices` constructing ranges >

[jira] [Assigned] (SPARK-39298) Change to use `seq.indices` constructing ranges

[ https://issues.apache.org/jira/browse/SPARK-39298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39298: Assignee: Apache Spark > Change to use `seq.indices` constructing ranges >

[jira] [Commented] (SPARK-39297) ui error if spark.ui.proxyBase contains "proxy" or "history"

[ https://issues.apache.org/jira/browse/SPARK-39297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542328#comment-17542328 ] Apache Spark commented on SPARK-39297: -- User 'cswangzheng' has created a pull request for this

[jira] [Assigned] (SPARK-39297) ui error if spark.ui.proxyBase contains "proxy" or "history"

[ https://issues.apache.org/jira/browse/SPARK-39297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39297: Assignee: Apache Spark > ui error if spark.ui.proxyBase contains "proxy" or "history" >

[jira] [Assigned] (SPARK-39297) ui error if spark.ui.proxyBase contains "proxy" or "history"

[ https://issues.apache.org/jira/browse/SPARK-39297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39297: Assignee: (was: Apache Spark) > ui error if spark.ui.proxyBase contains "proxy" or

[jira] [Commented] (SPARK-39297) ui error if spark.ui.proxyBase contains "proxy" or "history"

[ https://issues.apache.org/jira/browse/SPARK-39297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542327#comment-17542327 ] Apache Spark commented on SPARK-39297: -- User 'cswangzheng' has created a pull request for this

[jira] [Created] (SPARK-39298) Change to use `seq.indices` constructing ranges

Yang Jie created SPARK-39298: Summary: Change to use `seq.indices` constructing ranges Key: SPARK-39298 URL: https://issues.apache.org/jira/browse/SPARK-39298 Project: Spark Issue Type:

[jira] [Created] (SPARK-39297) ui error if spark.ui.proxyBase contains "proxy" or "history"

zheng created SPARK-39297: - Summary: ui error if spark.ui.proxyBase contains "proxy" or "history" Key: SPARK-39297 URL: https://issues.apache.org/jira/browse/SPARK-39297 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-39296) Replcace `Array.toString` with `Array.mkString`

[ https://issues.apache.org/jira/browse/SPARK-39296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39296: Assignee: (was: Apache Spark) > Replcace `Array.toString` with `Array.mkString` >

[jira] [Commented] (SPARK-39296) Replcace `Array.toString` with `Array.mkString`

[ https://issues.apache.org/jira/browse/SPARK-39296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542315#comment-17542315 ] Apache Spark commented on SPARK-39296: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39296) Replcace `Array.toString` with `Array.mkString`

[ https://issues.apache.org/jira/browse/SPARK-39296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39296: Assignee: Apache Spark > Replcace `Array.toString` with `Array.mkString` >

[jira] [Created] (SPARK-39296) Replcace `Array.toString` with `Array.mkString`

Yang Jie created SPARK-39296: Summary: Replcace `Array.toString` with `Array.mkString` Key: SPARK-39296 URL: https://issues.apache.org/jira/browse/SPARK-39296 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

[ https://issues.apache.org/jira/browse/SPARK-39290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542308#comment-17542308 ] Hyukjin Kwon commented on SPARK-39290: -- It creates partitions per the groups. For questions, let's

[jira] [Resolved] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

[ https://issues.apache.org/jira/browse/SPARK-39290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39290. -- Resolution: Invalid > Question of job division in "df.groupBy().applyInPandas" >

[jira] [Updated] (SPARK-39295) Improve documentation of pandas API support list.

[ https://issues.apache.org/jira/browse/SPARK-39295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39295: - Parent: (was: SPARK-38961) Issue Type: Improvement (was: Sub-task) > Improve

[jira] [Resolved] (SPARK-39253) Improve PySpark API reference to be more readable

[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39253. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36647

[jira] [Assigned] (SPARK-39253) Improve PySpark API reference to be more readable

[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39253: Assignee: Haejoon Lee > Improve PySpark API reference to be more readable >

[jira] [Assigned] (SPARK-39293) The accumulator of ArrayAggregate should copy the intermediate result if string, struct, array, or map

[ https://issues.apache.org/jira/browse/SPARK-39293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39293: Assignee: Takuya Ueshin > The accumulator of ArrayAggregate should copy the intermediate

[jira] [Resolved] (SPARK-39293) The accumulator of ArrayAggregate should copy the intermediate result if string, struct, array, or map

[ https://issues.apache.org/jira/browse/SPARK-39293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39293. -- Resolution: Fixed > The accumulator of ArrayAggregate should copy the intermediate result if

[jira] [Commented] (SPARK-39293) The accumulator of ArrayAggregate should copy the intermediate result if string, struct, array, or map

[ https://issues.apache.org/jira/browse/SPARK-39293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542304#comment-17542304 ] Hyukjin Kwon commented on SPARK-39293: -- Fixed in https://github.com/apache/spark/pull/36674 > The

[jira] [Updated] (SPARK-39293) The accumulator of ArrayAggregate should copy the intermediate result if string, struct, array, or map

[ https://issues.apache.org/jira/browse/SPARK-39293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39293: - Fix Version/s: 3.1.3 3.0.4 3.2.2 3.3.1

[jira] [Commented] (SPARK-38700) Use error classes in the execution errors of save mode

[ https://issues.apache.org/jira/browse/SPARK-38700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542293#comment-17542293 ] Apache Spark commented on SPARK-38700: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-39294) Support Orc file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542288#comment-17542288 ] Apache Spark commented on SPARK-39294: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Commented] (SPARK-39294) Support Orc file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542287#comment-17542287 ] Apache Spark commented on SPARK-39294: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Updated] (SPARK-39288) Keep the Spark SQL API reference URL as same as before.

[ https://issues.apache.org/jira/browse/SPARK-39288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-39288: Description: After https://github.com/apache/spark/pull/36647 is merged, the PySpark SQL API

[jira] [Commented] (SPARK-39295) Improve documentation of pandas API support list.

[ https://issues.apache.org/jira/browse/SPARK-39295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542285#comment-17542285 ] Hyunwoo Park commented on SPARK-39295: -- I am working on it. > Improve documentation of pandas API

[jira] [Commented] (SPARK-39295) Improve documentation of pandas API support list.

[ https://issues.apache.org/jira/browse/SPARK-39295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542284#comment-17542284 ] Hyunwoo Park commented on SPARK-39295: -- Related:

[jira] [Created] (SPARK-39295) Improve documentation of pandas API support list.

Hyunwoo Park created SPARK-39295: Summary: Improve documentation of pandas API support list. Key: SPARK-39295 URL: https://issues.apache.org/jira/browse/SPARK-39295 Project: Spark Issue

[jira] [Commented] (SPARK-39293) The accumulator of ArrayAggregate should copy the intermediate result if string, struct, array, or map

[ https://issues.apache.org/jira/browse/SPARK-39293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542259#comment-17542259 ] Apache Spark commented on SPARK-39293: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39293) The accumulator of ArrayAggregate should copy the intermediate result if string, struct, array, or map

[ https://issues.apache.org/jira/browse/SPARK-39293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39293: Assignee: Apache Spark > The accumulator of ArrayAggregate should copy the intermediate

[jira] [Assigned] (SPARK-39294) Support Orc file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39294: Assignee: Apache Spark > Support Orc file scans with DEFAULT values >

[jira] [Assigned] (SPARK-39293) The accumulator of ArrayAggregate should copy the intermediate result if string, struct, array, or map

[ https://issues.apache.org/jira/browse/SPARK-39293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39293: Assignee: (was: Apache Spark) > The accumulator of ArrayAggregate should copy the

[jira] [Assigned] (SPARK-39294) Support Orc file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39294: Assignee: (was: Apache Spark) > Support Orc file scans with DEFAULT values >

[jira] [Commented] (SPARK-39293) The accumulator of ArrayAggregate should copy the intermediate result if string, struct, array, or map

[ https://issues.apache.org/jira/browse/SPARK-39293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542258#comment-17542258 ] Apache Spark commented on SPARK-39293: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-39294) Support Orc file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542257#comment-17542257 ] Apache Spark commented on SPARK-39294: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Created] (SPARK-39294) Support Orc file scans with DEFAULT values

Daniel created SPARK-39294: -- Summary: Support Orc file scans with DEFAULT values Key: SPARK-39294 URL: https://issues.apache.org/jira/browse/SPARK-39294 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-39293) The accumulator of ArrayAggregate should copy the intermediate result if string, struct, array, or map

Takuya Ueshin created SPARK-39293: - Summary: The accumulator of ArrayAggregate should copy the intermediate result if string, struct, array, or map Key: SPARK-39293 URL:

[jira] [Commented] (SPARK-39265) Support Parquet file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542254#comment-17542254 ] Apache Spark commented on SPARK-39265: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Commented] (SPARK-39265) Support Parquet file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542253#comment-17542253 ] Apache Spark commented on SPARK-39265: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Commented] (SPARK-37888) Unify v1 and v2 DESCRIBE TABLE tests

[ https://issues.apache.org/jira/browse/SPARK-37888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542199#comment-17542199 ] Apache Spark commented on SPARK-37888: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-39283) Spark tasks stuck forever due to deadlock between TaskMemoryManager and UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-39283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542113#comment-17542113 ] Sandeep Pal commented on SPARK-39283: - [~cloud_fan] This seems to occur frequently on spark 3.1.2,

[jira] [Updated] (SPARK-39255) Improve error messages

[ https://issues.apache.org/jira/browse/SPARK-39255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39255: - Fix Version/s: 3.3.1 > Improve error messages > -- > > Key:

[jira] [Commented] (SPARK-38648) SPIP: Simplified API for DL Inferencing

[ https://issues.apache.org/jira/browse/SPARK-38648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542107#comment-17542107 ] Lee Yang commented on SPARK-38648: -- [~mengxr] I think that could work.  FWIW, I looked into how the

[jira] [Commented] (SPARK-39234) Code clean up in SparkThrowableHelper.getMessage

[ https://issues.apache.org/jira/browse/SPARK-39234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542077#comment-17542077 ] Apache Spark commented on SPARK-39234: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-39261) Improve newline formatting for error messages

[ https://issues.apache.org/jira/browse/SPARK-39261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39261: -- Assignee: Karen Feng > Improve newline formatting for error messages >

[jira] [Resolved] (SPARK-39261) Improve newline formatting for error messages

[ https://issues.apache.org/jira/browse/SPARK-39261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39261. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36639

[jira] [Created] (SPARK-39292) Make Dataset.melt work with struct fields

Enrico Minack created SPARK-39292: - Summary: Make Dataset.melt work with struct fields Key: SPARK-39292 URL: https://issues.apache.org/jira/browse/SPARK-39292 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39291) Fetch blocks and open stream should not respond a closed channel

[ https://issues.apache.org/jira/browse/SPARK-39291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542056#comment-17542056 ] Apache Spark commented on SPARK-39291: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-39291) Fetch blocks and open stream should not respond a closed channel

[ https://issues.apache.org/jira/browse/SPARK-39291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39291: Assignee: (was: Apache Spark) > Fetch blocks and open stream should not respond a

[jira] [Commented] (SPARK-39291) Fetch blocks and open stream should not respond a closed channel

[ https://issues.apache.org/jira/browse/SPARK-39291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542055#comment-17542055 ] Apache Spark commented on SPARK-39291: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-39291) Fetch blocks and open stream should not respond a closed channel

[ https://issues.apache.org/jira/browse/SPARK-39291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39291: Assignee: Apache Spark > Fetch blocks and open stream should not respond a closed

[jira] [Commented] (SPARK-38700) Use error classes in the execution errors of save mode

[ https://issues.apache.org/jira/browse/SPARK-38700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542053#comment-17542053 ] Apache Spark commented on SPARK-38700: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-39289) Replace map.getOrElse(false/true) with exists/forall

[ https://issues.apache.org/jira/browse/SPARK-39289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39289: Assignee: Apache Spark > Replace map.getOrElse(false/true) with exists/forall >

[jira] [Commented] (SPARK-39289) Replace map.getOrElse(false/true) with exists/forall

[ https://issues.apache.org/jira/browse/SPARK-39289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542054#comment-17542054 ] Apache Spark commented on SPARK-39289: -- User 'dcoliversun' has created a pull request for this

[jira] [Commented] (SPARK-39289) Replace map.getOrElse(false/true) with exists/forall

[ https://issues.apache.org/jira/browse/SPARK-39289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542052#comment-17542052 ] Apache Spark commented on SPARK-39289: -- User 'dcoliversun' has created a pull request for this

[jira] [Assigned] (SPARK-39289) Replace map.getOrElse(false/true) with exists/forall

[ https://issues.apache.org/jira/browse/SPARK-39289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39289: Assignee: (was: Apache Spark) > Replace map.getOrElse(false/true) with exists/forall

[jira] [Updated] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

[ https://issues.apache.org/jira/browse/SPARK-39290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-39290: --- Description: My program runs in spark on Yarn environment and has four nodes in total. My num

[jira] [Updated] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

[ https://issues.apache.org/jira/browse/SPARK-39290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-39290: --- Attachment: DAG.png > Question of job division in "df.groupBy().applyInPandas" >

[jira] [Updated] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

[ https://issues.apache.org/jira/browse/SPARK-39290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-39290: --- Attachment: job1.png > Question of job division in "df.groupBy().applyInPandas" >

[jira] [Updated] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

[ https://issues.apache.org/jira/browse/SPARK-39290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-39290: --- Attachment: job2.png > Question of job division in "df.groupBy().applyInPandas" >

[jira] [Updated] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

[ https://issues.apache.org/jira/browse/SPARK-39290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-39290: --- Description: My program runs in spark on Yarn environment and has four nodes in total. My num

[jira] [Updated] (SPARK-39291) Fetch blocks and open stream should not respond a closed channel

[ https://issues.apache.org/jira/browse/SPARK-39291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-39291: -- Description: If user cancel and interrupt a reduce task who is fetching shuffle blocks, the channel

[jira] [Updated] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

[ https://issues.apache.org/jira/browse/SPARK-39290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-39290: --- Description: My program runs in spark on Yarn environment and has four nodes in total. My num

[jira] [Updated] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

[ https://issues.apache.org/jira/browse/SPARK-39290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-39290: --- Description: My program runs in spark on Yarn environment and has four nodes in total. My num

[jira] [Updated] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

[ https://issues.apache.org/jira/browse/SPARK-39290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-39290: --- Attachment: 2022-05-25 21-17-10 的屏幕截图.png > Question of job division in

[jira] [Updated] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

[ https://issues.apache.org/jira/browse/SPARK-39290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-39290: --- Attachment: WebUI.png > Question of job division in "df.groupBy().applyInPandas" >

[jira] [Created] (SPARK-39291) Fetch blocks and open stream should not respond a closed channel

XiDuo You created SPARK-39291: - Summary: Fetch blocks and open stream should not respond a closed channel Key: SPARK-39291 URL: https://issues.apache.org/jira/browse/SPARK-39291 Project: Spark

[jira] [Updated] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

[ https://issues.apache.org/jira/browse/SPARK-39290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-39290: --- Attachment: (was: 2022-05-25 21-17-10 的屏幕截图.png) > Question of job division in

[jira] [Created] (SPARK-39290) Question of job division in "df.groupBy().applyInPandas"

YuNing Liu created SPARK-39290: -- Summary: Question of job division in "df.groupBy().applyInPandas" Key: SPARK-39290 URL: https://issues.apache.org/jira/browse/SPARK-39290 Project: Spark Issue

[jira] [Created] (SPARK-39289) Replace map.getOrElse(false/true) with exists/forall

qian created SPARK-39289: Summary: Replace map.getOrElse(false/true) with exists/forall Key: SPARK-39289 URL: https://issues.apache.org/jira/browse/SPARK-39289 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-39288) Keep the Spark SQL API reference URL as same as before.

[ https://issues.apache.org/jira/browse/SPARK-39288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542033#comment-17542033 ] Haejoon Lee commented on SPARK-39288: - I'm working on this > Keep the Spark SQL API reference URL

[jira] [Created] (SPARK-39288) Keep the Spark SQL API reference URL as same as before.

Haejoon Lee created SPARK-39288: --- Summary: Keep the Spark SQL API reference URL as same as before. Key: SPARK-39288 URL: https://issues.apache.org/jira/browse/SPARK-39288 Project: Spark Issue

[jira] [Commented] (SPARK-39287) TaskSchedulerImpl should quickly ignore task finished event if its task was finished state

[ https://issues.apache.org/jira/browse/SPARK-39287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542010#comment-17542010 ] Apache Spark commented on SPARK-39287: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39287) TaskSchedulerImpl should quickly ignore task finished event if its task was finished state

[ https://issues.apache.org/jira/browse/SPARK-39287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39287: Assignee: (was: Apache Spark) > TaskSchedulerImpl should quickly ignore task

[jira] [Commented] (SPARK-39287) TaskSchedulerImpl should quickly ignore task finished event if its task was finished state

[ https://issues.apache.org/jira/browse/SPARK-39287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542009#comment-17542009 ] Apache Spark commented on SPARK-39287: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39287) TaskSchedulerImpl should quickly ignore task finished event if its task was finished state

[ https://issues.apache.org/jira/browse/SPARK-39287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39287: Assignee: Apache Spark > TaskSchedulerImpl should quickly ignore task finished event if

[jira] [Commented] (SPARK-38700) Use error classes in the execution errors of save mode

[ https://issues.apache.org/jira/browse/SPARK-38700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542005#comment-17542005 ] Apache Spark commented on SPARK-38700: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-38700) Use error classes in the execution errors of save mode

[ https://issues.apache.org/jira/browse/SPARK-38700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542007#comment-17542007 ] Apache Spark commented on SPARK-38700: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-38982) test_categories_setter failed due to pandas bug

[ https://issues.apache.org/jira/browse/SPARK-38982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38982: Assignee: Yikun Jiang > test_categories_setter failed due to pandas bug >

[jira] [Resolved] (SPARK-38982) test_categories_setter failed due to pandas bug

[ https://issues.apache.org/jira/browse/SPARK-38982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38982. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36355

  1   2   >