[jira] [Resolved] (SPARK-35001) Use ps as the short name instead of pp

[ https://issues.apache.org/jira/browse/SPARK-35001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35001. -- Resolution: Duplicate > Use ps as the short name instead of pp >

[jira] [Commented] (SPARK-35015) Add type hints of pyspark.sql.column.* and pyspark.sql.types.*

[ https://issues.apache.org/jira/browse/SPARK-35015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318417#comment-17318417 ] Apache Spark commented on SPARK-35015: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-35015) Add type hints of pyspark.sql.column.* and pyspark.sql.types.*

[ https://issues.apache.org/jira/browse/SPARK-35015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318416#comment-17318416 ] Apache Spark commented on SPARK-35015: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35015) Add type hints of pyspark.sql.column.* and pyspark.sql.types.*

[ https://issues.apache.org/jira/browse/SPARK-35015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35015: Assignee: (was: Apache Spark) > Add type hints of pyspark.sql.column.* and

[jira] [Assigned] (SPARK-35015) Add type hints of pyspark.sql.column.* and pyspark.sql.types.*

[ https://issues.apache.org/jira/browse/SPARK-35015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35015: Assignee: Apache Spark > Add type hints of pyspark.sql.column.* and pyspark.sql.types.*

[jira] [Updated] (SPARK-35015) Add type hints of pyspark.sql.column.* and pyspark.sql.types.*

[ https://issues.apache.org/jira/browse/SPARK-35015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-35015: Description: python/pyspark/pandas/spark/functions.py:22: error: Module 'pyspark.sql.column' has

[jira] [Updated] (SPARK-35015) Add type hints of pyspark.sql.column.* and pyspark.sql.types.*

[ https://issues.apache.org/jira/browse/SPARK-35015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-35015: Description: python/pyspark/pandas/spark/functions.py:22: error: Module 'pyspark.sql.column' has

[jira] [Created] (SPARK-35015) Add type hints of pyspark.sql.column.* and pyspark.sql.types.*

Yikun Jiang created SPARK-35015: --- Summary: Add type hints of pyspark.sql.column.* and pyspark.sql.types.* Key: SPARK-35015 URL: https://issues.apache.org/jira/browse/SPARK-35015 Project: Spark

[jira] [Assigned] (SPARK-34996) Port Koalas Series related unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34996: Assignee: Apache Spark > Port Koalas Series related unit tests into PySpark >

[jira] [Assigned] (SPARK-34996) Port Koalas Series related unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34996: Assignee: (was: Apache Spark) > Port Koalas Series related unit tests into PySpark >

[jira] [Commented] (SPARK-34996) Port Koalas Series related unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318407#comment-17318407 ] Apache Spark commented on SPARK-34996: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-34996) Port Koalas Series related unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318406#comment-17318406 ] Apache Spark commented on SPARK-34996: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-34972) Make doctests work in Spark.

[ https://issues.apache.org/jira/browse/SPARK-34972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318397#comment-17318397 ] Apache Spark commented on SPARK-34972: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-34972) Make doctests work in Spark.

[ https://issues.apache.org/jira/browse/SPARK-34972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318396#comment-17318396 ] Apache Spark commented on SPARK-34972: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-35010) nestedSchemaPruning causes issue when reading hive generated Orc files

[ https://issues.apache.org/jira/browse/SPARK-35010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318347#comment-17318347 ] Yuming Wang commented on SPARK-35010: - Yes. It is an issue:

[jira] [Commented] (SPARK-35014) A foldable expression could not be replaced by an AttributeReference

[ https://issues.apache.org/jira/browse/SPARK-35014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318234#comment-17318234 ] Apache Spark commented on SPARK-35014: -- User 'sigmod' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35014) A foldable expression could not be replaced by an AttributeReference

[ https://issues.apache.org/jira/browse/SPARK-35014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35014: Assignee: Apache Spark > A foldable expression could not be replaced by an

[jira] [Assigned] (SPARK-35014) A foldable expression could not be replaced by an AttributeReference

[ https://issues.apache.org/jira/browse/SPARK-35014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35014: Assignee: (was: Apache Spark) > A foldable expression could not be replaced by an

[jira] [Commented] (SPARK-35014) A foldable expression could not be replaced by an AttributeReference

[ https://issues.apache.org/jira/browse/SPARK-35014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318233#comment-17318233 ] Apache Spark commented on SPARK-35014: -- User 'sigmod' has created a pull request for this issue:

[jira] [Commented] (SPARK-34963) Nested column pruning fails to extract case-insensitive struct field from array

[ https://issues.apache.org/jira/browse/SPARK-34963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318229#comment-17318229 ] Apache Spark commented on SPARK-34963: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-35014) A foldable expression could not be replaced by an AttributeReference

Yingyi Bu created SPARK-35014: - Summary: A foldable expression could not be replaced by an AttributeReference Key: SPARK-35014 URL: https://issues.apache.org/jira/browse/SPARK-35014 Project: Spark

[jira] [Commented] (SPARK-34963) Nested column pruning fails to extract case-insensitive struct field from array

[ https://issues.apache.org/jira/browse/SPARK-34963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318228#comment-17318228 ] Apache Spark commented on SPARK-34963: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-34963) Nested column pruning fails to extract case-insensitive struct field from array

[ https://issues.apache.org/jira/browse/SPARK-34963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34963: Issue Type: Bug (was: Improvement) > Nested column pruning fails to extract case-insensitive

[jira] [Resolved] (SPARK-34963) Nested column pruning fails to extract case-insensitive struct field from array

[ https://issues.apache.org/jira/browse/SPARK-34963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34963. - Resolution: Fixed > Nested column pruning fails to extract case-insensitive struct field from

[jira] [Updated] (SPARK-34963) Nested column pruning fails to extract case-insensitive struct field from array

[ https://issues.apache.org/jira/browse/SPARK-34963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34963: Fix Version/s: 3.0.3 3.1.2 3.2.0 > Nested column pruning

[jira] [Updated] (SPARK-35013) Spark allows to set spark.driver.cores to 0

[ https://issues.apache.org/jira/browse/SPARK-35013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleg Lypkan updated SPARK-35013: Description: I found an inconsistency in [validation logic of Spark submit arguments

[jira] [Updated] (SPARK-35013) Spark allows to set spark.driver.cores=0

[ https://issues.apache.org/jira/browse/SPARK-35013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleg Lypkan updated SPARK-35013: Summary: Spark allows to set spark.driver.cores=0 (was: Spark allows to set spark.driver.cores

[jira] [Updated] (SPARK-35013) Spark allows to set spark.driver.cores to 0

[ https://issues.apache.org/jira/browse/SPARK-35013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleg Lypkan updated SPARK-35013: Description: I found an inconsistency in validation logic of Spark submit arguments that allows 

[jira] [Created] (SPARK-35013) Spark allows to set spark.driver.cores to 0

Oleg Lypkan created SPARK-35013: --- Summary: Spark allows to set spark.driver.cores to 0 Key: SPARK-35013 URL: https://issues.apache.org/jira/browse/SPARK-35013 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-28379) Correlated scalar subqueries must be aggregated

[ https://issues.apache.org/jira/browse/SPARK-28379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28379: Assignee: Apache Spark > Correlated scalar subqueries must be aggregated >

[jira] [Assigned] (SPARK-28379) Correlated scalar subqueries must be aggregated

[ https://issues.apache.org/jira/browse/SPARK-28379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28379: Assignee: (was: Apache Spark) > Correlated scalar subqueries must be aggregated >

[jira] [Commented] (SPARK-28379) Correlated scalar subqueries must be aggregated

[ https://issues.apache.org/jira/browse/SPARK-28379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318194#comment-17318194 ] Apache Spark commented on SPARK-28379: -- User 'allisonwang-db' has created a pull request for this

[jira] [Created] (SPARK-35012) Port Koalas DataFrame related unit tests into PySpark

Xinrong Meng created SPARK-35012: Summary: Port Koalas DataFrame related unit tests into PySpark Key: SPARK-35012 URL: https://issues.apache.org/jira/browse/SPARK-35012 Project: Spark Issue

[jira] [Comment Edited] (SPARK-34941) Enable mypy for pandas-on-Spark

[ https://issues.apache.org/jira/browse/SPARK-34941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317846#comment-17317846 ] Yikun Jiang edited comment on SPARK-34941 at 4/9/21, 6:03 PM: -- It seems no

[jira] [Updated] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumeet updated SPARK-35011: --- Description: *Note:* This is a follow-up on SPARK-34949, even after the heartbeat fix, driver reports dead

[jira] [Commented] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318174#comment-17318174 ] Sumeet commented on SPARK-35011: I am working on this. > Avoid Block Manager registerations when

[jira] [Created] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

Sumeet created SPARK-35011: -- Summary: Avoid Block Manager registerations when StopExecutor msg is in-flight. Key: SPARK-35011 URL: https://issues.apache.org/jira/browse/SPARK-35011 Project: Spark

[jira] [Commented] (SPARK-27335) cannot collect() from Correlation.corr

[ https://issues.apache.org/jira/browse/SPARK-27335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318171#comment-17318171 ] Samantha Zeitlin commented on SPARK-27335: --  I'm seeing this on spark 3.0.1 and I'm not using

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318132#comment-17318132 ] Shane Knapp commented on SPARK-34738: - i would LOVE to just use the docker driver for minikube. 

[jira] [Created] (SPARK-35010) nestedSchemaPruning causes issue when reading hive generated Orc files

Baohe Zhang created SPARK-35010: --- Summary: nestedSchemaPruning causes issue when reading hive generated Orc files Key: SPARK-35010 URL: https://issues.apache.org/jira/browse/SPARK-35010 Project: Spark

[jira] [Commented] (SPARK-35009) Avoid creating multiple Monitor threads for reused python workers for the same TaskContext

[ https://issues.apache.org/jira/browse/SPARK-35009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318097#comment-17318097 ] Attila Zsolt Piros commented on SPARK-35009: I am working on this > Avoid creating multiple

[jira] [Created] (SPARK-35009) Avoid creating multiple Monitor threads for reused python workers for the same TaskContext

Attila Zsolt Piros created SPARK-35009: -- Summary: Avoid creating multiple Monitor threads for reused python workers for the same TaskContext Key: SPARK-35009 URL:

[jira] [Commented] (SPARK-34630) Add type hints of pyspark.__version__ and pyspark.sql.Column.contains

[ https://issues.apache.org/jira/browse/SPARK-34630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318080#comment-17318080 ] Apache Spark commented on SPARK-34630: -- User 'Yikun' has created a pull request for this issue:

[jira] [Resolved] (SPARK-35003) Improve performance for reading smallint in vectorized Parquet reader

[ https://issues.apache.org/jira/browse/SPARK-35003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35003. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32104

[jira] [Assigned] (SPARK-35003) Improve performance for reading smallint in vectorized Parquet reader

[ https://issues.apache.org/jira/browse/SPARK-35003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35003: - Assignee: Chao Sun > Improve performance for reading smallint in vectorized Parquet

[jira] [Updated] (SPARK-35004) Fix Incorrect assertion of "master/worker web ui available behind front-end reverseProxy" in MasterSuite

[ https://issues.apache.org/jira/browse/SPARK-35004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35004: --- Affects Version/s: 3.1.1 > Fix Incorrect assertion of "master/worker web ui available

[jira] [Assigned] (SPARK-35004) Fix Incorrect assertion of "master/worker web ui available behind front-end reverseProxy" in MasterSuite

[ https://issues.apache.org/jira/browse/SPARK-35004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35004: -- Assignee: Yang Jie > Fix Incorrect assertion of "master/worker web ui available

[jira] [Resolved] (SPARK-35004) Fix Incorrect assertion of "master/worker web ui available behind front-end reverseProxy" in MasterSuite

[ https://issues.apache.org/jira/browse/SPARK-35004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35004. Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by

[jira] [Created] (SPARK-35008) Spark hangs after on doing multiple unions

Arthur created SPARK-35008: -- Summary: Spark hangs after on doing multiple unions Key: SPARK-35008 URL: https://issues.apache.org/jira/browse/SPARK-35008 Project: Spark Issue Type: Question

[jira] [Resolved] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-34989. --- Fix Version/s: 3.2.0 Assignee: Ali Afroozeh Resolution: Fixed >

[jira] [Updated] (SPARK-35007) Spark 2.4.x version does not support numeric

[ https://issues.apache.org/jira/browse/SPARK-35007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun BiaoBiao updated SPARK-35007: - Summary: Spark 2.4.x version does not support numeric (was: Spark 2.4 version does not support

[jira] [Updated] (SPARK-35007) Spark 2.4.x version does not support numeric

[ https://issues.apache.org/jira/browse/SPARK-35007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun BiaoBiao updated SPARK-35007: - Description: as said in this pr:  [https://github.com/apache/spark/pull/31891] ,    So seems

[jira] [Assigned] (SPARK-35007) Spark 2.4 version does not support numeric

[ https://issues.apache.org/jira/browse/SPARK-35007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35007: Assignee: Apache Spark > Spark 2.4 version does not support numeric >

[jira] [Commented] (SPARK-35007) Spark 2.4 version does not support numeric

[ https://issues.apache.org/jira/browse/SPARK-35007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317918#comment-17317918 ] Apache Spark commented on SPARK-35007: -- User 'zheniantoushipashi' has created a pull request for

[jira] [Assigned] (SPARK-35007) Spark 2.4 version does not support numeric

[ https://issues.apache.org/jira/browse/SPARK-35007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35007: Assignee: (was: Apache Spark) > Spark 2.4 version does not support numeric >

[jira] [Commented] (SPARK-34716) Support ANSI SQL intervals by the aggregate function `sum`

[ https://issues.apache.org/jira/browse/SPARK-34716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317914#comment-17317914 ] Apache Spark commented on SPARK-34716: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34716) Support ANSI SQL intervals by the aggregate function `sum`

[ https://issues.apache.org/jira/browse/SPARK-34716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34716: Assignee: (was: Apache Spark) > Support ANSI SQL intervals by the aggregate function

[jira] [Commented] (SPARK-34716) Support ANSI SQL intervals by the aggregate function `sum`

[ https://issues.apache.org/jira/browse/SPARK-34716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317913#comment-17317913 ] Apache Spark commented on SPARK-34716: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34716) Support ANSI SQL intervals by the aggregate function `sum`

[ https://issues.apache.org/jira/browse/SPARK-34716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34716: Assignee: Apache Spark > Support ANSI SQL intervals by the aggregate function `sum` >

[jira] [Assigned] (SPARK-34983) Renaming the package alias from pp to ps

[ https://issues.apache.org/jira/browse/SPARK-34983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34983: Assignee: (was: Apache Spark) > Renaming the package alias from pp to ps >

[jira] [Assigned] (SPARK-34983) Renaming the package alias from pp to ps

[ https://issues.apache.org/jira/browse/SPARK-34983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34983: Assignee: Apache Spark > Renaming the package alias from pp to ps >

[jira] [Commented] (SPARK-34983) Renaming the package alias from pp to ps

[ https://issues.apache.org/jira/browse/SPARK-34983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317912#comment-17317912 ] Apache Spark commented on SPARK-34983: -- User 'LSturtew' has created a pull request for this issue:

[jira] [Commented] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317874#comment-17317874 ] Nick Hryhoriev commented on SPARK-31427: thx [~kabhwan], yes my only concern read data twice.

[jira] [Created] (SPARK-35007) Spark 2.4 version does not support numeric

Sun BiaoBiao created SPARK-35007: Summary: Spark 2.4 version does not support numeric Key: SPARK-35007 URL: https://issues.apache.org/jira/browse/SPARK-35007 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-35005) Improve error msg if UTF8String concatWs length overflow

[ https://issues.apache.org/jira/browse/SPARK-35005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35005: Assignee: (was: Apache Spark) > Improve error msg if UTF8String concatWs length

[jira] [Assigned] (SPARK-35005) Improve error msg if UTF8String concatWs length overflow

[ https://issues.apache.org/jira/browse/SPARK-35005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35005: Assignee: Apache Spark > Improve error msg if UTF8String concatWs length overflow >

[jira] [Commented] (SPARK-35005) Improve error msg if UTF8String concatWs length overflow

[ https://issues.apache.org/jira/browse/SPARK-35005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317855#comment-17317855 ] Apache Spark commented on SPARK-35005: -- User 'ulysses-you' has created a pull request for this

[jira] [Comment Edited] (SPARK-34941) Enable mypy for pandas-on-Spark

[ https://issues.apache.org/jira/browse/SPARK-34941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317846#comment-17317846 ] Yikun Jiang edited comment on SPARK-34941 at 4/9/21, 10:12 AM: --- It seems

[jira] [Commented] (SPARK-34941) Enable mypy for pandas-on-Spark

[ https://issues.apache.org/jira/browse/SPARK-34941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317846#comment-17317846 ] Yikun Jiang commented on SPARK-34941: - It seems no one take this task yet, I can help some on it.

[jira] [Commented] (SPARK-35006) Spark driver mistakenly classifies OOM error of executor (on K8s pod) as framework error

[ https://issues.apache.org/jira/browse/SPARK-35006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317843#comment-17317843 ] Huy commented on SPARK-35006: - I tried to set the configuration

[jira] [Updated] (SPARK-35006) Spark driver mistakenly classifies OOM error of executor (on K8s pod) as framework error

[ https://issues.apache.org/jira/browse/SPARK-35006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huy updated SPARK-35006: Description: *Issue Description* I'm having a Spark application with 1 driver (on bare metal) + 1 executor (on

[jira] [Updated] (SPARK-35006) Spark driver mistakenly classifies OOM error of executor (on K8s pod) as framework error

[ https://issues.apache.org/jira/browse/SPARK-35006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huy updated SPARK-35006: Description: *Issue Description* I'm having a Spark application with 1 driver (on bare metal) + 1 executor (on

[jira] [Created] (SPARK-35006) Spark driver mistakenly classifies OOM error of executor (on K8s pod) as framework error

Huy created SPARK-35006: --- Summary: Spark driver mistakenly classifies OOM error of executor (on K8s pod) as framework error Key: SPARK-35006 URL: https://issues.apache.org/jira/browse/SPARK-35006 Project:

[jira] [Updated] (SPARK-35005) Improve error msg if UTF8String concatWs length overflow

[ https://issues.apache.org/jira/browse/SPARK-35005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-35005: Summary: Improve error msg if UTF8String concatWs length overflow (was: Improve error msg if

[jira] [Created] (SPARK-35005) Improve error msg if UTF8String concatWs over int length

ulysses you created SPARK-35005: --- Summary: Improve error msg if UTF8String concatWs over int length Key: SPARK-35005 URL: https://issues.apache.org/jira/browse/SPARK-35005 Project: Spark Issue

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317779#comment-17317779 ] Attila Zsolt Piros commented on SPARK-34738: For sure `withValues` is needed. This is

[jira] [Assigned] (SPARK-35004) Fix Incorrect assertion of "master/worker web ui available behind front-end reverseProxy" in MasterSuite

[ https://issues.apache.org/jira/browse/SPARK-35004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35004: Assignee: Apache Spark > Fix Incorrect assertion of "master/worker web ui available

[jira] [Assigned] (SPARK-35004) Fix Incorrect assertion of "master/worker web ui available behind front-end reverseProxy" in MasterSuite

[ https://issues.apache.org/jira/browse/SPARK-35004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35004: Assignee: (was: Apache Spark) > Fix Incorrect assertion of "master/worker web ui

[jira] [Commented] (SPARK-35004) Fix Incorrect assertion of "master/worker web ui available behind front-end reverseProxy" in MasterSuite

[ https://issues.apache.org/jira/browse/SPARK-35004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317769#comment-17317769 ] Apache Spark commented on SPARK-35004: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-35003) Improve performance for reading smallint in vectorized Parquet reader

[ https://issues.apache.org/jira/browse/SPARK-35003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35003: Assignee: (was: Apache Spark) > Improve performance for reading smallint in

[jira] [Assigned] (SPARK-35003) Improve performance for reading smallint in vectorized Parquet reader

[ https://issues.apache.org/jira/browse/SPARK-35003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35003: Assignee: Apache Spark > Improve performance for reading smallint in vectorized Parquet

[jira] [Commented] (SPARK-35003) Improve performance for reading smallint in vectorized Parquet reader

[ https://issues.apache.org/jira/browse/SPARK-35003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317763#comment-17317763 ] Apache Spark commented on SPARK-35003: -- User 'sunchao' has created a pull request for this issue:

[jira] [Created] (SPARK-35004) Fix Incorrect assertion of "master/worker web ui available behind front-end reverseProxy" in MasterSuite

Yang Jie created SPARK-35004: Summary: Fix Incorrect assertion of "master/worker web ui available behind front-end reverseProxy" in MasterSuite Key: SPARK-35004 URL: https://issues.apache.org/jira/browse/SPARK-35004

[jira] [Created] (SPARK-35003) Improve performance for reading smallint in vectorized Parquet reader

Chao Sun created SPARK-35003: Summary: Improve performance for reading smallint in vectorized Parquet reader Key: SPARK-35003 URL: https://issues.apache.org/jira/browse/SPARK-35003 Project: Spark

[jira] [Commented] (SPARK-35001) Use ps as the short name instead of pp

[ https://issues.apache.org/jira/browse/SPARK-35001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317731#comment-17317731 ] Apache Spark commented on SPARK-35001: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-35001) Use ps as the short name instead of pp

[ https://issues.apache.org/jira/browse/SPARK-35001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35001: Assignee: (was: Apache Spark) > Use ps as the short name instead of pp >

[jira] [Commented] (SPARK-35001) Use ps as the short name instead of pp

[ https://issues.apache.org/jira/browse/SPARK-35001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317729#comment-17317729 ] Apache Spark commented on SPARK-35001: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-35001) Use ps as the short name instead of pp

[ https://issues.apache.org/jira/browse/SPARK-35001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35001: Assignee: Apache Spark > Use ps as the short name instead of pp >

[jira] [Resolved] (SPARK-34886) Port/integrate Koalas DataFrame unit test into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34886. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32083

[jira] [Assigned] (SPARK-34886) Port/integrate Koalas DataFrame unit test into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34886: Assignee: Xinrong Meng > Port/integrate Koalas DataFrame unit test into PySpark >

[jira] [Commented] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317700#comment-17317700 ] Apache Spark commented on SPARK-35002: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35002. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32096

[jira] [Assigned] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35002: - Assignee: Yuming Wang > Fix the java.net.BindException when testing with Github Action