Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/6968
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enab
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-118110554
Merging into master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have thi
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-118104014
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-118103794
[Test build #36405 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36405/console)
for PR 6968 at commit
[`4ef8263`](https://github.
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-118068102
[Test build #36405 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36405/consoleFull)
for PR 6968 at commit
[`4ef8263`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-118066768
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-118066733
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-118065257
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-117946376
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-117946307
[Test build #36348 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36348/console)
for PR 6968 at commit
[`4ef8263`](https://github.
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-117916000
[Test build #36348 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36348/consoleFull)
for PR 6968 at commit
[`4ef8263`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-117913542
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-117913432
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-117911709
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-117876952
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-117876925
[Test build #36318 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36318/console)
for PR 6968 at commit
[`4ef8263`](https://github.
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-117868504
LGTM. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33740640
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -194,7 +194,7 @@ abstract class RDD[T: ClassTag](
@transient private var partitions_ :
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-117866830
[Test build #36318 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36318/consoleFull)
for PR 6968 at commit
[`4ef8263`](https://gith
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33740255
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -194,7 +194,7 @@ abstract class RDD[T: ClassTag](
@transient private var partitions_
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-117866559
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-117866547
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33740162
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -194,7 +194,7 @@ abstract class RDD[T: ClassTag](
@transient private var partitio
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33740116
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -194,7 +194,7 @@ abstract class RDD[T: ClassTag](
@transient private var partitio
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33739984
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -194,7 +194,7 @@ abstract class RDD[T: ClassTag](
@transient private var partitions_ :
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33739791
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDDCheckpointData.scala
---
@@ -46,37 +45,35 @@ private[spark] class RDDCheckpointData[T:
ClassTag](@tr
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33739769
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -194,7 +194,7 @@ abstract class RDD[T: ClassTag](
@transient private var partitio
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33628298
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDDCheckpointData.scala
---
@@ -46,37 +45,35 @@ private[spark] class RDDCheckpointData[T:
ClassTag](@transien
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33627973
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDDCheckpointData.scala
---
@@ -46,37 +45,35 @@ private[spark] class RDDCheckpointData[T:
ClassTag](@transien
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33621236
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -194,7 +194,7 @@ abstract class RDD[T: ClassTag](
@transient private var partitions_ :
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33620712
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -194,7 +194,7 @@ abstract class RDD[T: ClassTag](
@transient private var partitions_ :
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33620460
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1897,6 +1897,16 @@ class SparkContext(config: SparkConf) extends
Logging with ExecutorA
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-116821437
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-116821037
[Test build #36006 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36006/console)
for PR 6968 at commit
[`b1437ad`](https://github.
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-116770263
[Test build #36006 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36006/consoleFull)
for PR 6968 at commit
[`b1437ad`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-116769664
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-116769691
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-116769050
@tdas can you review?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have th
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-116769034
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-115015336
[Test build #35713 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35713/console)
for PR 6968 at commit
[`b1437ad`](https://github.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-115015416
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-115000904
[Test build #35704 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35704/console)
for PR 6968 at commit
[`7fb4af5`](https://github.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-115000940
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114977232
[Test build #35713 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35713/consoleFull)
for PR 6968 at commit
[`b1437ad`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114976377
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114976345
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114973791
[Test build #35704 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35704/consoleFull)
for PR 6968 at commit
[`7fb4af5`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114973025
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114972992
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114971960
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114972145
Hm that seems hard to detect. Maybe we should just do away with the check.
---
If your project is set up for it, you can reply to this email and have your
reply appea
Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114732755
What if I have an NFS filesystem that's mounted in a way that it appears as
a local disk? I wonder if we should have a flag to bypass the non-local check
for those ra
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114717053
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114717038
[Test build #35623 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35623/console)
for PR 6968 at commit
[`7fb4af5`](https://github.
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114695679
[Test build #35623 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35623/consoleFull)
for PR 6968 at commit
[`7fb4af5`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114695673
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114695651
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114695572
retest this please??
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have thi
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114695457
[Test build #35621 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35621/console)
for PR 6968 at commit
[`7fb4af5`](https://github.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114695461
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114695441
[Test build #35621 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35621/consoleFull)
for PR 6968 at commit
[`7fb4af5`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114694757
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114694725
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33110878
--- Diff: core/src/main/scala/org/apache/spark/rdd/CheckpointRDD.scala ---
@@ -59,9 +61,6 @@ class CheckpointRDD[T: ClassTag](sc: SparkContext, val
checkpo
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/6968#discussion_r33110886
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1897,6 +1897,13 @@ class SparkContext(config: SparkConf) extends
Logging with Exe
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/6968#issuecomment-114694501
@tdas PTAL
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/6968
[SPARK-8581][SPARK-8584] Simplify checkpointing code + better error message
This patch rewrites the old checkpointing code in a way that is easier to
understand. It also adds a guard against an i
67 matches
Mail list logo
