Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22805#discussion_r229399189
--- Diff:
resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/IntegrationTestBackend.scala
Github user rvesse commented on a diff in the pull request:
https://github.com/apache/spark/pull/22805#discussion_r229395036
--- Diff:
resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/IntegrationTestBackend.scala
---
Github user ifilonenko commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229394011
--- Diff:
resource-managers/kubernetes/integration-tests/kerberos-yml/data-populator-deployment.yml
---
@@ -0,0 +1,49 @@
+#
+# Licensed to the
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/22849
It may happen that a busy executor is marked as lost and later it
re-register to the driver, in that case currently we call `makeOffers()` and
that will add the executor into
Github user ifilonenko commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229391389
--- Diff: bin/docker-image-tool.sh ---
@@ -53,7 +53,7 @@ function build {
# contain a lot of duplicated jars with the main Spark directory. In a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4632/
---
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229389845
--- Diff:
resource-managers/kubernetes/integration-tests/kerberos-yml/data-populator-deployment.yml
---
@@ -0,0 +1,49 @@
+#
+# Licensed to the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98273/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #98273 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98273/testReport)**
for PR 22146 at commit
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/22849
What do you mean by "better performance" ? If that means we can spend less
time on `TaskSchedulerImpl.resourceOffers()` then I agree it's true, but AFAIK
it's never reported this can be a
Github user ifilonenko commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229386227
--- Diff:
resource-managers/kubernetes/integration-tests/kerberos-yml/data-populator-deployment.yml
---
@@ -0,0 +1,49 @@
+#
+# Licensed to the
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4632/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #98273 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98273/testReport)**
for PR 22146 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22845
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22845
Thank you, @heary-cao . Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22895
**[Test build #98272 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98272/testReport)**
for PR 22895 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22895
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22895
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22844
Since this is JSON benchmark, could you merge this, @HyukjinKwon ? :)
---
-
To unsubscribe, e-mail:
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22844#discussion_r229376327
--- Diff: sql/core/benchmarks/JSONBenchmarks-results.txt ---
@@ -0,0 +1,33 @@
GitHub user gengliangwang opened a pull request:
https://github.com/apache/spark/pull/22895
[SPARK-25886][SQL] Improve error message of `FailureSafeParser` and
`from_avro` in FAILFAST mode
## What changes were proposed in this pull request?
Currently in `FailureSafeParser`
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229373938
--- Diff:
resource-managers/kubernetes/integration-tests/kerberos-yml/nn-deployment.yml
---
@@ -0,0 +1,54 @@
+#
+# Licensed to the Apache
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229372458
--- Diff:
resource-managers/kubernetes/integration-tests/kerberos-yml/data-populator-service.yml
---
@@ -0,0 +1,33 @@
+#
+# Licensed to the
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229373845
--- Diff:
resource-managers/kubernetes/integration-tests/kerberos-yml/kerberos-test.yml
---
@@ -0,0 +1,43 @@
+#
+# Licensed to the Apache
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229372327
--- Diff:
resource-managers/kubernetes/integration-tests/kerberos-yml/data-populator-deployment.yml
---
@@ -0,0 +1,49 @@
+#
+# Licensed to the
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229370867
--- Diff: dev/make-distribution.sh ---
@@ -191,7 +191,8 @@ fi
# Only create and copy the dockerfiles directory if the kubernetes
artifacts were
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229371556
--- Diff:
resource-managers/kubernetes/docker/src/test/scripts/populate-data.sh ---
@@ -0,0 +1,42 @@
+#!/usr/bin/env bash
+#
+# Licensed to
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229370525
--- Diff: bin/docker-image-tool.sh ---
@@ -53,7 +53,7 @@ function build {
# contain a lot of duplicated jars with the main Spark directory. In a
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229373633
--- Diff:
resource-managers/kubernetes/integration-tests/kerberos-yml/kerberos-deployment.yml
---
@@ -0,0 +1,49 @@
+#
+# Licensed to the Apache
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r229373205
--- Diff:
resource-managers/kubernetes/integration-tests/kerberos-yml/dn1-deployment.yml
---
@@ -0,0 +1,49 @@
+#
+# Licensed to the Apache
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22881
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22881
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22881
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22884
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22881
**[Test build #98271 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98271/testReport)**
for PR 22881 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22881
**[Test build #98271 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98271/testReport)**
for PR 22881 at commit
Github user squito commented on the issue:
https://github.com/apache/spark/pull/22884
merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/22146#discussion_r229367166
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Constants.scala
---
@@ -74,8 +74,16 @@ private[spark] object
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/22146#discussion_r229367415
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesDriverBuilder.scala
---
@@ -16,11 +16,17 @@
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22881
**[Test build #4398 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4398/testReport)**
for PR 22881 at commit
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22805#discussion_r229366533
--- Diff:
resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/cloud/KubeConfigBackend.scala
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22805#discussion_r229367224
--- Diff:
resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/IntegrationTestBackend.scala
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22881
**[Test build #4398 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4398/testReport)**
for PR 22881 at commit
Github user dilipbiswal commented on the issue:
https://github.com/apache/spark/pull/17520
@gatorsmile Sure Sean.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/21688#discussion_r229363078
--- Diff: core/src/main/resources/org/apache/spark/ui/static/stagepage.js
---
@@ -0,0 +1,959 @@
+/*
+ * Licensed to the Apache Software
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/17520
@dilipbiswal Could you take this over?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dilipbiswal commented on a diff in the pull request:
https://github.com/apache/spark/pull/22778#discussion_r229362181
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -171,10 +171,13 @@ abstract class
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/22778#discussion_r229361802
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -171,10 +171,13 @@ abstract class
Github user squito commented on the issue:
https://github.com/apache/spark/pull/22624
any more comments @ifilonenko @skonto ?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user maryannxue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22778#discussion_r229356678
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -171,10 +171,13 @@ abstract class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22788
**[Test build #98270 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98270/testReport)**
for PR 22788 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22788
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22788
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user huaxingao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22788#discussion_r229354247
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala
---
@@ -2856,6 +2856,21 @@ class SQLQuerySuite extends QueryTest with
Github user squito commented on the issue:
https://github.com/apache/spark/pull/22881
jenkins, retest this please
known flaky: https://issues.apache.org/jira/browse/SPARK-24285
---
-
To unsubscribe, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22844
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22892
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98266/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22892
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22852
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98269/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22852
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22852
**[Test build #98269 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98269/testReport)**
for PR 22852 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22892
**[Test build #98266 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98266/testReport)**
for PR 22892 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22844
Lgtm
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user bdrillard commented on a diff in the pull request:
https://github.com/apache/spark/pull/22878#discussion_r229328064
--- Diff:
external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ---
@@ -1374,4 +1377,182 @@ class AvroSuite extends QueryTest with
Github user bdrillard commented on a diff in the pull request:
https://github.com/apache/spark/pull/22878#discussion_r229329920
--- Diff:
external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ---
@@ -1374,4 +1377,182 @@ class AvroSuite extends QueryTest with
Github user bdrillard commented on a diff in the pull request:
https://github.com/apache/spark/pull/22878#discussion_r229326520
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroEncoder.scala ---
@@ -0,0 +1,534 @@
+/*
+ * Licensed to the Apache Software
Github user bdrillard commented on a diff in the pull request:
https://github.com/apache/spark/pull/22878#discussion_r229332500
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala
---
@@ -1617,6 +1617,58 @@ case class
Github user bdrillard commented on a diff in the pull request:
https://github.com/apache/spark/pull/22878#discussion_r229323278
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroEncoder.scala ---
@@ -0,0 +1,534 @@
+/*
+ * Licensed to the Apache Software
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22852
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22852
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/22852
added sections to the resource manager sections.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22852
**[Test build #98269 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98269/testReport)**
for PR 22852 at commit
Github user heary-cao commented on the issue:
https://github.com/apache/spark/pull/22755
thanks @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user shahidki31 commented on the issue:
https://github.com/apache/spark/pull/22784
Thanks a lot @srowen
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22713
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22713
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/22852
I can add a note here for deployments here and then we can do version
specific ones after
---
-
To unsubscribe, e-mail:
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22852
I think these are good changes. In a separate PR for the versions-specific
docs, we could add a similar note to
https://spark.apache.org/docs/latest/spark-standalone.html as much of the
security
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22713
**[Test build #98268 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98268/testReport)**
for PR 22713 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22852
**[Test build #98267 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98267/testReport)**
for PR 22852 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22852
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98267/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22852
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22852
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22852
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/22852
Updated to have a section on security in the quickstart and overview, let
me know what you think and if wording needs updated. If this ok I can followup
with something on the website
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22852
**[Test build #98267 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98267/testReport)**
for PR 22852 at commit
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22713
@cloud-fan I would answer yes. At least, I haven't found a real case when
this can cause a bug visible to end users, but I am not 100% that there is no
weird case where someone could hit it.
---
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/22713#discussion_r229313621
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/AnalysisSuite.scala
---
@@ -604,4 +606,28 @@ class AnalysisSuite extends
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/22713
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22784
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22784
Merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22713
LGTM. To confirm, this is a potential bug, currently end-users can't hit
it, right?
---
-
To unsubscribe, e-mail:
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22713#discussion_r229307114
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/AnalysisSuite.scala
---
@@ -604,4 +606,28 @@ class AnalysisSuite extends
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
Install Spark I mentioned above.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/22891
Thank you for your contribution.
Could you please write appropriate title and descriptions based on
http://spark.apache.org/contributing.html ?
---
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22885
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22894
Practically, though, it generates a whole copy of the map at every update,
so for 10 items, the implementation in the PR generates 9 copies of 1, 2, 3,
... elements, while the current one
201 - 300 of 486 matches
Mail list logo
