[
https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204424#comment-17204424
]
Apache Spark commented on SPARK-33022:
--
User 'duanmeng' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33022:
Assignee: Apache Spark
> partition length is wrong after merge partition segments in
> B
[
https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33022:
Assignee: (was: Apache Spark)
> partition length is wrong after merge partition segme
[
https://issues.apache.org/jira/browse/SPARK-13704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-13704:
Description:
In some cases, TaskSchedulerImpl.createTaskSetManager can be expensive. For
example,
[
https://issues.apache.org/jira/browse/SPARK-33032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-33032.
-
Resolution: Not A Bug
It is not a bug after increase driver memory to 20GB.
> Should throw Spa
Yuming Wang created SPARK-33032:
---
Summary: Should throw SparkException if broadcast large table
Key: SPARK-33032
URL: https://issues.apache.org/jira/browse/SPARK-33032
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-32947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-32947:
Target Version/s: (was: 3.0.1)
> Support top-N sort for Spark SQL window function
>
[
https://issues.apache.org/jira/browse/SPARK-32947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204325#comment-17204325
]
Andrew K Long commented on SPARK-32947:
---
Has anyone started working on this?
> Su
[
https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204312#comment-17204312
]
Apache Spark commented on SPARK-32037:
--
User 'tgravescs' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204311#comment-17204311
]
Apache Spark commented on SPARK-32037:
--
User 'tgravescs' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32037:
Assignee: Apache Spark
> Rename blacklisting feature to avoid language with racist connot
[
https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32037:
Assignee: (was: Apache Spark)
> Rename blacklisting feature to avoid language with ra
[
https://issues.apache.org/jira/browse/SPARK-33030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33030:
Assignee: Apache Spark
> Add nth_value in SparkR API
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-33030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33030:
Assignee: (was: Apache Spark)
> Add nth_value in SparkR API
> ---
[
https://issues.apache.org/jira/browse/SPARK-33030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204291#comment-17204291
]
Apache Spark commented on SPARK-33030:
--
User 'zero323' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-33030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204292#comment-17204292
]
Apache Spark commented on SPARK-33030:
--
User 'zero323' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204265#comment-17204265
]
Thomas Graves commented on SPARK-33031:
---
I tried this again on yarn and now it see
[
https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-33031:
--
Description:
I was running a test with blacklisting standalone mode and all the executors
we
[
https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-33031:
--
Description:
I was running a test with blacklisting on yarn (and standalone mode) and all
the
[
https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-33031:
--
Affects Version/s: 3.0.0
> scheduler with blacklisting doesn't appear to pick up new executor
[
https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-33031:
--
Affects Version/s: (was: 3.0.0)
3.1.0
> scheduler with blacklisting
[
https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204259#comment-17204259
]
Thomas Graves commented on SPARK-33029:
---
NOte I filed https://issues.apache.org/ji
Thomas Graves created SPARK-33031:
-
Summary: scheduler with blacklisting doesn't appear to pick up new
executor added
Key: SPARK-33031
URL: https://issues.apache.org/jira/browse/SPARK-33031
Project: S
[
https://issues.apache.org/jira/browse/SPARK-33019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-33019:
-
Assignee: Dongjoon Hyun
> Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.vers
[
https://issues.apache.org/jira/browse/SPARK-33019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-33019.
---
Fix Version/s: 3.0.2
3.1.0
Resolution: Fixed
Issue resolved by pul
Maciej Szymkiewicz created SPARK-33030:
--
Summary: Add nth_value in SparkR API
Key: SPARK-33030
URL: https://issues.apache.org/jira/browse/SPARK-33030
Project: Spark
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-33029:
--
Description:
I am running a spark shell on a 1 node standalone cluster. I noticed that the
e
[
https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-33029:
--
Attachment: Screen Shot 2020-09-29 at 1.53.37 PM.png
> Standalone mode blacklist executors pag
[
https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-33029:
--
Attachment: Screen Shot 2020-09-29 at 1.52.09 PM.png
> Standalone mode blacklist executors pag
Thomas Graves created SPARK-33029:
-
Summary: Standalone mode blacklist executors page UI marks driver
as blacklisted
Key: SPARK-33029
URL: https://issues.apache.org/jira/browse/SPARK-33029
Project: Sp
Ahmed Metwally created SPARK-33028:
--
Summary: Fix ScalaReflection issue for Case Classes with complex
type aliased data
Key: SPARK-33028
URL: https://issues.apache.org/jira/browse/SPARK-33028
Project
Cheng Su created SPARK-33027:
Summary: Add DisableUnnecessaryBucketedScan rule to AQE
queryStagePreparationRules
Key: SPARK-33027
URL: https://issues.apache.org/jira/browse/SPARK-33027
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-33018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-33018:
---
Assignee: Yuming Wang
> Fix compute statistics issue
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-33018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-33018.
-
Fix Version/s: 3.0.2
3.1.0
Resolution: Fixed
Issue resolved by pull re
[
https://issues.apache.org/jira/browse/SPARK-33026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204108#comment-17204108
]
Apache Spark commented on SPARK-33026:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-33026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204105#comment-17204105
]
Apache Spark commented on SPARK-33026:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-33026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33026:
Assignee: Apache Spark
> Add numRows to metric of BroadcastExchangeExec
> ---
[
https://issues.apache.org/jira/browse/SPARK-33026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33026:
Assignee: (was: Apache Spark)
> Add numRows to metric of BroadcastExchangeExec
>
Yuming Wang created SPARK-33026:
---
Summary: Add numRows to metric of BroadcastExchangeExec
Key: SPARK-33026
URL: https://issues.apache.org/jira/browse/SPARK-33026
Project: Spark
Issue Type: Impr
Evgenii Samusenko created SPARK-33025:
-
Summary: Empty file for the first partition
Key: SPARK-33025
URL: https://issues.apache.org/jira/browse/SPARK-33025
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-33024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203951#comment-17203951
]
Apache Spark commented on SPARK-33024:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-33024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33024:
Assignee: (was: Apache Spark)
> Fix CodeGen fallback issue of UDFSuite in Scala 2.13
[
https://issues.apache.org/jira/browse/SPARK-33024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33024:
Assignee: Apache Spark
> Fix CodeGen fallback issue of UDFSuite in Scala 2.13
> -
[
https://issues.apache.org/jira/browse/SPARK-33024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203950#comment-17203950
]
Apache Spark commented on SPARK-33024:
--
User 'LuciferYang' has created a pull reque
Yang Jie created SPARK-33024:
Summary: Fix CodeGen fallback issue of UDFSuite in Scala 2.13
Key: SPARK-33024
URL: https://issues.apache.org/jira/browse/SPARK-33024
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-32723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203909#comment-17203909
]
Apache Spark commented on SPARK-32723:
--
User 'peter-toth' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-32723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32723:
Assignee: (was: Apache Spark)
> Security Vulnerability due to JQuery version in Spark
[
https://issues.apache.org/jira/browse/SPARK-32723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32723:
Assignee: Apache Spark
> Security Vulnerability due to JQuery version in Spark Master/Wor
[
https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
duanmeng updated SPARK-33022:
-
Description:
The segment file may be empty even after writer committing caused by
disk/kernel in heavy
angerszhu created SPARK-33023:
-
Summary: addJar use `Utils.isWindow` to judge windows system
Key: SPARK-33023
URL: https://issues.apache.org/jira/browse/SPARK-33023
Project: Spark
Issue Type: Imp
[
https://issues.apache.org/jira/browse/SPARK-32901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-32901.
---
Fix Version/s: 3.1.0
3.0.2
Assignee: Tom van Bussel
[
https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-30789:
---
Summary: Support (IGNORE | RESPECT) NULLS for
LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE (was: Suppo
[
https://issues.apache.org/jira/browse/SPARK-31617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203806#comment-17203806
]
jiaan.geng edited comment on SPARK-31617 at 9/29/20, 9:23 AM:
[
https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
duanmeng updated SPARK-33022:
-
Description:
A data file might be empty even after DiskBlockObjectWriter committing it in
BypassMergeS
[
https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
duanmeng updated SPARK-33022:
-
Description:
A data file might be empty even after DiskBlockObjectWriter committing it in
BypassMergeS
[
https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
duanmeng updated SPARK-33022:
-
Description:
A data file might be empty even after DiskBlockObjectWriter committing it in
BypassMergeS
[
https://issues.apache.org/jira/browse/SPARK-31617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203806#comment-17203806
]
jiaan.geng commented on SPARK-31617:
It seems deleting custom functions is a rare op
[
https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
duanmeng updated SPARK-33022:
-
Description:
A data file might be empty even after DiskBlockObjectWriter committing it in
BypassMergeS
duanmeng created SPARK-33022:
Summary: partition length is wrong after merge partition segments
in BypassMergeSortShuffleWriter
Key: SPARK-33022
URL: https://issues.apache.org/jira/browse/SPARK-33022
Proj
[
https://issues.apache.org/jira/browse/SPARK-26862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203786#comment-17203786
]
Rahul Jaiswal edited comment on SPARK-26862 at 9/29/20, 8:31 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-26862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203786#comment-17203786
]
Rahul Jaiswal commented on SPARK-26862:
---
is it resolved?
I am facing the same iss
[
https://issues.apache.org/jira/browse/SPARK-18496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203785#comment-17203785
]
Rahul Jaiswal commented on SPARK-18496:
---
I am facing the same issue, have we found
[
https://issues.apache.org/jira/browse/SPARK-32970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-32970:
Assignee: Tanel Kiis
> Reduce the runtime of unit test for SPARK-32019
>
[
https://issues.apache.org/jira/browse/SPARK-32970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-32970.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29842
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-33015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203760#comment-17203760
]
Apache Spark commented on SPARK-33015:
--
User 'MaxGekk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-33021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-33021:
-
Fix Version/s: 3.0.2
> Move functions related test cases into test_functions.py
> --
[
https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203753#comment-17203753
]
Dustin Smith commented on SPARK-32046:
--
[~planga82] this works every time without i
[
https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203733#comment-17203733
]
Pablo Langa Blanco commented on SPARK-32046:
When you cache a Dataframe, you
68 matches
Mail list logo