Github user yaooqinn commented on the pull request:
https://github.com/apache/spark/pull/3438#issuecomment-208769628
Is there any progress about this mechanism study?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/3438#issuecomment-136918372
@jerryshao unfortunately the shuffle code has changed significantly since
this patch was last updated and it will unlikely be merged. Would you mind
closing this
Github user jerryshao commented on the pull request:
https://github.com/apache/spark/pull/3438#issuecomment-136939951
OK, thanks a lot.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user jerryshao closed the pull request at:
https://github.com/apache/spark/pull/3438
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user jeanlyn commented on a diff in the pull request:
https://github.com/apache/spark/pull/3438#discussion_r30295775
--- Diff:
core/src/main/scala/org/apache/spark/shuffle/sort/SortShuffleReader.scala ---
@@ -0,0 +1,337 @@
+/*
+ * Licensed to the Apache Software
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/3438#issuecomment-92231768
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/3438#discussion_r28222570
--- Diff: core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala ---
@@ -726,8 +725,8 @@ class RDDSuite extends FunSuite with SharedSparkContext
{
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3438#issuecomment-92231763
[Test build #30143 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30143/consoleFull)
for PR 3438 at commit
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/3438#discussion_r28221127
--- Diff: core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala ---
@@ -726,8 +725,8 @@ class RDDSuite extends FunSuite with SharedSparkContext
{
Github user chenghao-intel commented on a diff in the pull request:
https://github.com/apache/spark/pull/3438#discussion_r28223056
--- Diff: core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala ---
@@ -726,8 +725,8 @@ class RDDSuite extends FunSuite with SharedSparkContext
{
Github user adrian-wang commented on a diff in the pull request:
https://github.com/apache/spark/pull/3438#discussion_r28220021
--- Diff: core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala ---
@@ -726,8 +725,8 @@ class RDDSuite extends FunSuite with SharedSparkContext
{
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/3438#discussion_r28223321
--- Diff: core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala ---
@@ -726,8 +725,8 @@ class RDDSuite extends FunSuite with SharedSparkContext
{
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/3438#discussion_r28210241
--- Diff:
core/src/main/scala/org/apache/spark/shuffle/sort/SortShuffleManager.scala ---
@@ -48,7 +47,7 @@ private[spark] class SortShuffleManager(conf:
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3438#issuecomment-92214906
[Test build #30143 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30143/consoleFull)
for PR 3438 at commit
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/3438#discussion_r28210315
--- Diff:
core/src/main/scala/org/apache/spark/util/collection/TieredDiskMerger.scala ---
@@ -0,0 +1,232 @@
+/*
+ * Licensed to the Apache Software
Github user lianhuiwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/3438#discussion_r28191449
--- Diff:
core/src/main/scala/org/apache/spark/util/collection/TieredDiskMerger.scala ---
@@ -0,0 +1,232 @@
+/*
+ * Licensed to the Apache
Github user lianhuiwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/3438#discussion_r28191464
--- Diff:
core/src/main/scala/org/apache/spark/util/collection/TieredDiskMerger.scala ---
@@ -0,0 +1,232 @@
+/*
+ * Licensed to the Apache
Github user jerryshao commented on the pull request:
https://github.com/apache/spark/pull/3438#issuecomment-75448758
Hi @andrewor14 , I've rebased this code against the latest master, would
you please help to review this code, thanks a lot.
---
If your project is set up for it, you
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3438#issuecomment-75421923
[Test build #27831 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27831/consoleFull)
for PR 3438 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3438#issuecomment-75423996
[Test build #27831 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27831/consoleFull)
for PR 3438 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/3438#issuecomment-75423999
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
21 matches
Mail list logo