Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/23121
OK, thanks for the reminder.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user jerryshao closed the pull request at:
https://github.com/apache/spark/pull/23121
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
GitHub user jerryshao opened a pull request:
https://github.com/apache/spark/pull/23121
[SPARK-24553][UI][FOLLOWUP][2.4 Backport] Fix unnecessary UI redirect
## What changes were proposed in this pull request?
This is a backport PR of #23116 .
This PR is a follow
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/23116
@dongjoon-hyun , this should also be backported to branch 2.4, let me
create a backport PR.
---
-
To unsubscribe, e-mail
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/23116
Jenkins, retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
GitHub user jerryshao opened a pull request:
https://github.com/apache/spark/pull/23116
[SPARK-24553][UI][FOLLOWUP] Fix unnecessary UI redirect
## What changes were proposed in this pull request?
This PR is a follow-up PR of #21600 to fix the unnecessary UI redirect
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22441
Is it possible to test this on Jenkins?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22434
@cloud-fan @vanzin , please help to review, thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
GitHub user jerryshao opened a pull request:
https://github.com/apache/spark/pull/22434
[SPARK-24685][BUILD][FOLLOWUP] Fix the nonexist profile name in release
script
## What changes were proposed in this pull request?
`without-hadoop` profile doesn't exist in Maven
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22372
Btw, I don't think we can run current Spark with Hadoop 3.1 without any
change.
---
-
To unsubscribe, e-mail: reviews
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22372
Do we officially support hadoop3 in branch 2.4? If branch 2.4 doesn't
target to support Hadoop3 and this fix is only for Hadoop3, then I don't think
it is meaningful to have this fix
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22372
Jackson version below 2.9.5 has CVE issues, I would suggest to upgrade to
2.9.6 as #21596 did.
---
-
To unsubscribe, e-mail
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/18142
I see. Thanks for the note.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21756
I think the use case here is quite specific, I'm not sure if it is a good
idea to make `SparkHadoopUtil` ServiceLoader-able to support your requirement.
Typically I don't think user has
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22299
Seems there's another similar PR #22296 .
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22186
Merging to master branch.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22213#discussion_r214244665
--- Diff:
core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala ---
@@ -1144,6 +1144,46 @@ class SparkSubmitSuite
conf1.get
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22186
Jenkins, retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22186
I see. Thanks for the explain, I checked the code again, yes you're right.
Let me retrigger the test again, will merge it if everything is fine
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22279#discussion_r214234325
--- Diff: core/src/main/scala/org/apache/spark/metrics/MetricsSystem.scala
---
@@ -103,6 +103,14 @@ private[spark] class MetricsSystem private
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22279
Hi @LucaCanali do you have an output current AM metrics? I would like to
know what kind of metrics will be output for now
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22289#discussion_r214233802
--- Diff:
launcher/src/main/java/org/apache/spark/launcher/AbstractCommandBuilder.java ---
@@ -200,6 +200,7 @@ void addOptionString(List cmd, String
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22213#discussion_r214231103
--- Diff:
core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala ---
@@ -1144,6 +1144,46 @@ class SparkSubmitSuite
conf1.get
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22186
The fix itself LGTM, but I don't think this could solve the STS shutdown
hook conflict problem with Hadoop
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22164
Thanks @vanzin .
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22164#discussion_r213168025
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnRMClient.scala
---
@@ -126,4 +136,21 @@ private[spark] class
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22213#discussion_r213160007
--- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala ---
@@ -2062,8 +2062,10 @@ private[spark] object Utils extends Logging {
try
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22213#discussion_r212889779
--- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala ---
@@ -2062,8 +2062,10 @@ private[spark] object Utils extends Logging {
try
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22164
I think it should be related to this JIRA
(https://issues.apache.org/jira/browse/YARN-7269). Seems like a Hadoop 2.9/3.0+
issue
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22186
My local maven build also failed.
I think the problem is that`ShutdownHookManager` is implemented in Scala,
the complied method signature may be different when invoked from Java, I'm
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22199
ok to test.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22213#discussion_r212530383
--- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala ---
@@ -2062,8 +2062,10 @@ private[spark] object Utils extends Logging {
try
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22164
Gently ping again @vanzin @tgravescs . Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22164
@vanzin @tgravescs would you please help to review, thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
GitHub user jerryshao opened a pull request:
https://github.com/apache/spark/pull/22164
[SPARK-23679][YARN] Fix AmIpFilter cannot work in RM HA scenario
## What changes were proposed in this pull request?
YARN `AmIpFilter` adds a new parameter "RM_HA_URLS" to sup
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22117
Jenkins, retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22084
I'm totally on the user's standpoint, compared to ship these slim jars, it
would be better to ship the assembly jars, as those jars can be used directly
by adding to Spark's runtime
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22084
From user's point, I don't think it is useful compared to pulling from
maven repo, the provided jar alone is of no use. But if there's an Apache
policy to release all the binaries, then I'm OK
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22005
I believe such kind of PR requires SPIP and community discussion first.
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22077
This is already merged, @LantaoJin please close this PR, thanksï¼
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22084#discussion_r209481255
--- Diff: dev/make-distribution.sh ---
@@ -188,6 +190,23 @@ if [ -f
"$SPARK_HOME"/common/network-yarn/target/scala*/spark-*-yarn-shuffle.jar
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22084#discussion_r209480817
--- Diff: dev/make-distribution.sh ---
@@ -188,6 +190,23 @@ if [ -f
"$SPARK_HOME"/common/network-yarn/target/scala*/spark-*-yarn-shuffle.jar
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22084#discussion_r209480628
--- Diff: dev/make-distribution.sh ---
@@ -188,6 +190,23 @@ if [ -f
"$SPARK_HOME"/common/network-yarn/target/scala*/spark-*-yarn-shuffle.jar
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22066
@cloud-fan , yeah, I will include it in 2.3.2.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22067
ok to test.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22055
Yes @dongjoon-hyun , I will prepare the new RC, nothing is blocked AFAIK.
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21977
What about R, do we also need a similar setting for R? I was thinking that
with project hydrogen, more and more external processes will be run inside the
Spark's executor (MPP), all
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22034#discussion_r208786793
--- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala ---
@@ -169,6 +171,19 @@ private[spark] class Executor
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22034#discussion_r208552871
--- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala ---
@@ -169,6 +171,19 @@ private[spark] class Executor
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22022
Merged to branch 2.2, please close this PR @mgaido91
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22022
Jenkins, retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22022
Sorry, let me test again to see everything is ok.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22021
@mgaido91 already merged to branch 2.3, please close this PR.
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22021
merging to branch-2.3.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/22021
Please change the title to add branch 2.3 backport tag.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21596
Jenkins, retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21596
Are we still waiting for the 2.4 code freeze @gatorsmile @Fokko ?
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21895
This should also be backported to branch 2.2 and 2.3 @mridulm , this is a
regression.
@mgaido91 would you please create backport PRs for the separate branches
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21895
Hi @mgaido91 would you please check it is auto-mergeable to branch 2.2/2.3,
if not please also repare the fix for the related branch once this is merged
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21895
Ping @mridulm , would you please also take a review, thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21953
Jenkins, retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21953
I see, thanks for explaining.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21895
Jenkins, retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21895#discussion_r207419217
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -80,8 +80,8 @@ import org.apache.spark.util.kvstore
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21895#discussion_r207140685
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -973,6 +985,38 @@ private[history] object FsHistoryProvider
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21953
What kind of behavior did you see? This local dir is only used to store
some temporary files, which is not IO intensive, so I don't think the problem
here is severe
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21895
@mridulm would you please also take a review. Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21895#discussion_r207133206
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -973,6 +985,38 @@ private[history] object FsHistoryProvider
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21895#discussion_r207131160
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -461,32 +462,37 @@ private[history] class FsHistoryProvider
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21895#discussion_r207128637
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -80,8 +80,8 @@ import org.apache.spark.util.kvstore
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21895
I don't think the problem you mentioned is a big problem.
1. For the blacklist mechanism, we can have a time-based reviving mechanism
to check if permission is changed, compared to check
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21895
My current thinking is to revert SPARK-20172 and improve the logging when
exception is met during the actual read
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21895#discussion_r206726059
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -973,6 +978,42 @@ private[history] object FsHistoryProvider
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21895#discussion_r206725814
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -973,6 +978,42 @@ private[history] object FsHistoryProvider
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21867#discussion_r205312971
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -731,7 +731,14 @@ private[spark] class BlockManager
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21474
Hi @squito , would you please also update the changes in the doc, thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21635#discussion_r204265925
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/config.scala
---
@@ -152,6 +152,11 @@ package object config
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21758
I see, thanks for explaining. Maybe it is worth to mark as a TODO.
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21758
I mean rddC's partitions are derived from rddA and rddB, here assuming
partitions in rddA requires barrier, but not required in rddB. So rddC's
partitions are the half barrier and half
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21474#discussion_r204021872
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -429,7 +429,11 @@ package object config {
"ext
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21758
Hi @jiangxb1987 one question about barrier task.
For example, `rddA` is marked as barrier, and `rddB` is a normal RDD, if
`rddC = rddA.union(rddB)`, seems it contains both normal task
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21474
I will take a look at this sometime day, but don't block on me if it is
urgent.
---
-
To unsubscribe, e-mail: reviews
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21533
Merging to master branch. Thanks all!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21440#discussion_r203914040
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -659,6 +659,11 @@ private[spark] class BlockManager(
* Get block
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21440#discussion_r203581903
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -659,6 +659,11 @@ private[spark] class BlockManager(
* Get block
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21635#discussion_r203580155
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMasterSource.scala
---
@@ -0,0 +1,49 @@
+/*
+ * Licensed
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21440#discussion_r203251175
--- Diff:
core/src/main/scala/org/apache/spark/util/io/ChunkedByteBufferFileRegion.scala
---
@@ -0,0 +1,86 @@
+/*
+ * Licensed to the Apache
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21440#discussion_r203250619
--- Diff:
core/src/main/scala/org/apache/spark/util/io/ChunkedByteBuffer.scala ---
@@ -166,6 +170,34 @@ private[spark] class ChunkedByteBuffer(var chunks
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21440#discussion_r203237484
--- Diff:
core/src/main/scala/org/apache/spark/util/io/ChunkedByteBufferFileRegion.scala
---
@@ -0,0 +1,86 @@
+/*
+ * Licensed to the Apache
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21440#discussion_r203236014
--- Diff:
core/src/main/scala/org/apache/spark/util/io/ChunkedByteBuffer.scala ---
@@ -166,6 +170,34 @@ private[spark] class ChunkedByteBuffer(var chunks
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21440#discussion_r203235292
--- Diff:
core/src/main/scala/org/apache/spark/util/io/ChunkedByteBuffer.scala ---
@@ -17,17 +17,21 @@
package org.apache.spark.util.io
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21635#discussion_r203232034
--- Diff: docs/monitoring.md ---
@@ -435,6 +435,7 @@ set of sinks to which metrics are reported. The
following instances are currentl
* `executor
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21635#discussion_r203228423
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMasterSource.scala
---
@@ -0,0 +1,49 @@
+/*
+ * Licensed
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21784#discussion_r202929476
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnClientSchedulerBackend.scala
---
@@ -111,7 +111,7 @@ private
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21756
Would you please explain the scenarios of such usage? This
`SparkHadoopUtil` is highly hadoop/yarn dependent, I'm not sure how other
customized cluster manager use
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21635#discussion_r202886551
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMasterSource.scala
---
@@ -0,0 +1,49 @@
+/*
+ * Licensed
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21635#discussion_r202886077
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala
---
@@ -309,6 +312,16 @@ private[spark] class
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21635#discussion_r202015739
--- Diff: docs/monitoring.md ---
@@ -435,6 +435,7 @@ set of sinks to which metrics are reported. The
following instances are currentl
* `executor
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21664
You already got an uncaught exception, there's no need to add warning log.
Besides, this is a fatal error, how will let the job continue with such error
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21664
The issue is not introduced by Spark itself, it is introduced by user code,
is it better to fix in the user side rather than in Spark? Besides, I'm not so
sure that Spark should take
1 - 100 of 2740 matches
Mail list logo
