[
https://issues.apache.org/jira/browse/SPARK-35001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35001:
Assignee: Apache Spark
> Use ps as the short name instead of pp
> ---
[
https://issues.apache.org/jira/browse/SPARK-35001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35001:
Assignee: (was: Apache Spark)
> Use ps as the short name instead of pp
>
[
https://issues.apache.org/jira/browse/SPARK-35001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317729#comment-17317729
]
Apache Spark commented on SPARK-35001:
--
User 'HyukjinKwon' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-35001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317731#comment-17317731
]
Apache Spark commented on SPARK-35001:
--
User 'HyukjinKwon' has created a pull reque
Chao Sun created SPARK-35003:
Summary: Improve performance for reading smallint in vectorized
Parquet reader
Key: SPARK-35003
URL: https://issues.apache.org/jira/browse/SPARK-35003
Project: Spark
Yang Jie created SPARK-35004:
Summary: Fix Incorrect assertion of "master/worker web ui
available behind front-end reverseProxy" in MasterSuite
Key: SPARK-35004
URL: https://issues.apache.org/jira/browse/SPARK-35004
[
https://issues.apache.org/jira/browse/SPARK-35003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35003:
Assignee: Apache Spark
> Improve performance for reading smallint in vectorized Parquet r
[
https://issues.apache.org/jira/browse/SPARK-35003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317763#comment-17317763
]
Apache Spark commented on SPARK-35003:
--
User 'sunchao' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-35003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35003:
Assignee: (was: Apache Spark)
> Improve performance for reading smallint in vectorize
[
https://issues.apache.org/jira/browse/SPARK-35004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317769#comment-17317769
]
Apache Spark commented on SPARK-35004:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-35004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35004:
Assignee: Apache Spark
> Fix Incorrect assertion of "master/worker web ui available behin
[
https://issues.apache.org/jira/browse/SPARK-35004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35004:
Assignee: (was: Apache Spark)
> Fix Incorrect assertion of "master/worker web ui avai
[
https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317779#comment-17317779
]
Attila Zsolt Piros commented on SPARK-34738:
For sure `withValues` is needed
ulysses you created SPARK-35005:
---
Summary: Improve error msg if UTF8String concatWs over int length
Key: SPARK-35005
URL: https://issues.apache.org/jira/browse/SPARK-35005
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-35005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ulysses you updated SPARK-35005:
Summary: Improve error msg if UTF8String concatWs length overflow (was:
Improve error msg if UTF8
Huy created SPARK-35006:
---
Summary: Spark driver mistakenly classifies OOM error of executor
(on K8s pod) as framework error
Key: SPARK-35006
URL: https://issues.apache.org/jira/browse/SPARK-35006
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-35006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huy updated SPARK-35006:
Description:
*Issue Description*
I'm having a Spark application with 1 driver (on bare metal) + 1 executor (on
K
[
https://issues.apache.org/jira/browse/SPARK-35006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huy updated SPARK-35006:
Description:
*Issue Description*
I'm having a Spark application with 1 driver (on bare metal) + 1 executor (on
K
[
https://issues.apache.org/jira/browse/SPARK-35006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317843#comment-17317843
]
Huy commented on SPARK-35006:
-
I tried to set the configuration
`spark.kubernetes.executor.
[
https://issues.apache.org/jira/browse/SPARK-34941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317846#comment-17317846
]
Yikun Jiang commented on SPARK-34941:
-
It seems no one take this task yet, I can hel
[
https://issues.apache.org/jira/browse/SPARK-34941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317846#comment-17317846
]
Yikun Jiang edited comment on SPARK-34941 at 4/9/21, 10:12 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-35005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317855#comment-17317855
]
Apache Spark commented on SPARK-35005:
--
User 'ulysses-you' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-35005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35005:
Assignee: Apache Spark
> Improve error msg if UTF8String concatWs length overflow
> -
[
https://issues.apache.org/jira/browse/SPARK-35005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35005:
Assignee: (was: Apache Spark)
> Improve error msg if UTF8String concatWs length overf
Sun BiaoBiao created SPARK-35007:
Summary: Spark 2.4 version does not support numeric
Key: SPARK-35007
URL: https://issues.apache.org/jira/browse/SPARK-35007
Project: Spark
Issue Type: Improv
[
https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317874#comment-17317874
]
Nick Hryhoriev commented on SPARK-31427:
thx [~kabhwan], yes my only concern rea
[
https://issues.apache.org/jira/browse/SPARK-34983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34983:
Assignee: Apache Spark
> Renaming the package alias from pp to ps
> -
[
https://issues.apache.org/jira/browse/SPARK-34983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317912#comment-17317912
]
Apache Spark commented on SPARK-34983:
--
User 'LSturtew' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-34716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34716:
Assignee: Apache Spark
> Support ANSI SQL intervals by the aggregate function `sum`
> ---
[
https://issues.apache.org/jira/browse/SPARK-34983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34983:
Assignee: (was: Apache Spark)
> Renaming the package alias from pp to ps
> --
[
https://issues.apache.org/jira/browse/SPARK-34716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317913#comment-17317913
]
Apache Spark commented on SPARK-34716:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-34716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34716:
Assignee: (was: Apache Spark)
> Support ANSI SQL intervals by the aggregate function
[
https://issues.apache.org/jira/browse/SPARK-34716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317914#comment-17317914
]
Apache Spark commented on SPARK-34716:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-35007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35007:
Assignee: Apache Spark
> Spark 2.4 version does not support numeric
> ---
[
https://issues.apache.org/jira/browse/SPARK-35007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317918#comment-17317918
]
Apache Spark commented on SPARK-35007:
--
User 'zheniantoushipashi' has created a pul
[
https://issues.apache.org/jira/browse/SPARK-35007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35007:
Assignee: (was: Apache Spark)
> Spark 2.4 version does not support numeric
>
[
https://issues.apache.org/jira/browse/SPARK-35007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sun BiaoBiao updated SPARK-35007:
-
Description:
as said in this pr: [https://github.com/apache/spark/pull/31891] ,
So seems t
[
https://issues.apache.org/jira/browse/SPARK-35007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sun BiaoBiao updated SPARK-35007:
-
Summary: Spark 2.4.x version does not support numeric (was: Spark 2.4
version does not support
[
https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-34989.
---
Fix Version/s: 3.2.0
Assignee: Ali Afroozeh
Resolution: Fixed
> Impr
Arthur created SPARK-35008:
--
Summary: Spark hangs after on doing multiple unions
Key: SPARK-35008
URL: https://issues.apache.org/jira/browse/SPARK-35008
Project: Spark
Issue Type: Question
[
https://issues.apache.org/jira/browse/SPARK-35004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-35004.
Fix Version/s: 3.1.2
3.2.0
Resolution: Fixed
Issue resolved by p
[
https://issues.apache.org/jira/browse/SPARK-35004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang reassigned SPARK-35004:
--
Assignee: Yang Jie
> Fix Incorrect assertion of "master/worker web ui available behin
[
https://issues.apache.org/jira/browse/SPARK-35004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-35004:
---
Affects Version/s: 3.1.1
> Fix Incorrect assertion of "master/worker web ui available behind
[
https://issues.apache.org/jira/browse/SPARK-35003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-35003:
-
Assignee: Chao Sun
> Improve performance for reading smallint in vectorized Parquet rea
[
https://issues.apache.org/jira/browse/SPARK-35003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-35003.
---
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 32104
[https://
[
https://issues.apache.org/jira/browse/SPARK-34630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318080#comment-17318080
]
Apache Spark commented on SPARK-34630:
--
User 'Yikun' has created a pull request for
Attila Zsolt Piros created SPARK-35009:
--
Summary: Avoid creating multiple Monitor threads for reused python
workers for the same TaskContext
Key: SPARK-35009
URL: https://issues.apache.org/jira/browse/SPARK-3
[
https://issues.apache.org/jira/browse/SPARK-35009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318097#comment-17318097
]
Attila Zsolt Piros commented on SPARK-35009:
I am working on this
> Avoid c
Baohe Zhang created SPARK-35010:
---
Summary: nestedSchemaPruning causes issue when reading hive
generated Orc files
Key: SPARK-35010
URL: https://issues.apache.org/jira/browse/SPARK-35010
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318132#comment-17318132
]
Shane Knapp commented on SPARK-34738:
-
i would LOVE to just use the docker driver fo
[
https://issues.apache.org/jira/browse/SPARK-27335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318171#comment-17318171
]
Samantha Zeitlin commented on SPARK-27335:
--
I'm seeing this on spark 3.0.1 and
Sumeet created SPARK-35011:
--
Summary: Avoid Block Manager registerations when StopExecutor msg
is in-flight.
Key: SPARK-35011
URL: https://issues.apache.org/jira/browse/SPARK-35011
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318174#comment-17318174
]
Sumeet commented on SPARK-35011:
I am working on this.
> Avoid Block Manager registerat
[
https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sumeet updated SPARK-35011:
---
Description:
*Note:* This is a follow-up on SPARK-34949, even after the heartbeat fix,
driver reports dead
[
https://issues.apache.org/jira/browse/SPARK-34941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317846#comment-17317846
]
Yikun Jiang edited comment on SPARK-34941 at 4/9/21, 6:03 PM:
Xinrong Meng created SPARK-35012:
Summary: Port Koalas DataFrame related unit tests into PySpark
Key: SPARK-35012
URL: https://issues.apache.org/jira/browse/SPARK-35012
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-28379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318194#comment-17318194
]
Apache Spark commented on SPARK-28379:
--
User 'allisonwang-db' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-28379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28379:
Assignee: (was: Apache Spark)
> Correlated scalar subqueries must be aggregated
> ---
[
https://issues.apache.org/jira/browse/SPARK-28379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28379:
Assignee: Apache Spark
> Correlated scalar subqueries must be aggregated
> --
Oleg Lypkan created SPARK-35013:
---
Summary: Spark allows to set spark.driver.cores to 0
Key: SPARK-35013
URL: https://issues.apache.org/jira/browse/SPARK-35013
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-35013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Oleg Lypkan updated SPARK-35013:
Description:
I found an inconsistency in validation logic of Spark submit arguments that
allows *
[
https://issues.apache.org/jira/browse/SPARK-35013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Oleg Lypkan updated SPARK-35013:
Summary: Spark allows to set spark.driver.cores=0 (was: Spark allows to
set spark.driver.cores to
[
https://issues.apache.org/jira/browse/SPARK-35013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Oleg Lypkan updated SPARK-35013:
Description:
I found an inconsistency in [validation logic of Spark submit arguments
|https://git
[
https://issues.apache.org/jira/browse/SPARK-34963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh updated SPARK-34963:
Fix Version/s: 3.0.3
3.1.2
3.2.0
> Nested column pruning fai
[
https://issues.apache.org/jira/browse/SPARK-34963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh resolved SPARK-34963.
-
Resolution: Fixed
> Nested column pruning fails to extract case-insensitive struct field from
>
[
https://issues.apache.org/jira/browse/SPARK-34963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh updated SPARK-34963:
Issue Type: Bug (was: Improvement)
> Nested column pruning fails to extract case-insensitive stru
[
https://issues.apache.org/jira/browse/SPARK-34963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318228#comment-17318228
]
Apache Spark commented on SPARK-34963:
--
User 'viirya' has created a pull request fo
Yingyi Bu created SPARK-35014:
-
Summary: A foldable expression could not be replaced by an
AttributeReference
Key: SPARK-35014
URL: https://issues.apache.org/jira/browse/SPARK-35014
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318229#comment-17318229
]
Apache Spark commented on SPARK-34963:
--
User 'viirya' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-35014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318233#comment-17318233
]
Apache Spark commented on SPARK-35014:
--
User 'sigmod' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-35014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35014:
Assignee: Apache Spark
> A foldable expression could not be replaced by an AttributeRefer
[
https://issues.apache.org/jira/browse/SPARK-35014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35014:
Assignee: (was: Apache Spark)
> A foldable expression could not be replaced by an Att
[
https://issues.apache.org/jira/browse/SPARK-35014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318234#comment-17318234
]
Apache Spark commented on SPARK-35014:
--
User 'sigmod' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-35010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318347#comment-17318347
]
Yuming Wang commented on SPARK-35010:
-
Yes. It is an issue:
https://github.com/apach
[
https://issues.apache.org/jira/browse/SPARK-34972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318396#comment-17318396
]
Apache Spark commented on SPARK-34972:
--
User 'ueshin' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-34972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318397#comment-17318397
]
Apache Spark commented on SPARK-34972:
--
User 'ueshin' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-34996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318406#comment-17318406
]
Apache Spark commented on SPARK-34996:
--
User 'xinrong-databricks' has created a pul
[
https://issues.apache.org/jira/browse/SPARK-34996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318407#comment-17318407
]
Apache Spark commented on SPARK-34996:
--
User 'xinrong-databricks' has created a pul
[
https://issues.apache.org/jira/browse/SPARK-34996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34996:
Assignee: Apache Spark
> Port Koalas Series related unit tests into PySpark
> ---
[
https://issues.apache.org/jira/browse/SPARK-34996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34996:
Assignee: (was: Apache Spark)
> Port Koalas Series related unit tests into PySpark
>
Yikun Jiang created SPARK-35015:
---
Summary: Add type hints of pyspark.sql.column.* and
pyspark.sql.types.*
Key: SPARK-35015
URL: https://issues.apache.org/jira/browse/SPARK-35015
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-35015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang updated SPARK-35015:
Description:
python/pyspark/pandas/spark/functions.py:22: error: Module 'pyspark.sql.column'
has
[
https://issues.apache.org/jira/browse/SPARK-35015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang updated SPARK-35015:
Description:
python/pyspark/pandas/spark/functions.py:22: error: Module 'pyspark.sql.column'
has
[
https://issues.apache.org/jira/browse/SPARK-35015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35015:
Assignee: (was: Apache Spark)
> Add type hints of pyspark.sql.column.* and pyspark.sq
[
https://issues.apache.org/jira/browse/SPARK-35015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35015:
Assignee: Apache Spark
> Add type hints of pyspark.sql.column.* and pyspark.sql.types.*
>
[
https://issues.apache.org/jira/browse/SPARK-35015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318416#comment-17318416
]
Apache Spark commented on SPARK-35015:
--
User 'Yikun' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-35015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318417#comment-17318417
]
Apache Spark commented on SPARK-35015:
--
User 'Yikun' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-35001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-35001.
--
Resolution: Duplicate
> Use ps as the short name instead of pp
> -
88 matches
Mail list logo