Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/2735
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enab
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-62450003
Tested this manually, works perfectly. Merging this. Thanks for this!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/2735#discussion_r20109983
--- Diff:
examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala
---
@@ -114,7 +115,7 @@ object RecoverableNetworkWordCou
Github user comcmipi commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-62448101
@tdas Thanks for clarifying it.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-62442543
@comcmipi Yes, in the current version, if you quit the streaming
application (aka driver) quits, then the data received by receivers but not yet
processed gets lost. Thats w
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/2735#discussion_r20106873
--- Diff:
examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala
---
@@ -114,7 +115,7 @@ object RecoverableNetworkWordCou
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2735#discussion_r20057909
--- Diff:
examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala
---
@@ -114,7 +115,7 @@ object RecoverableNetworkWordC
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-62254523
[Test build #23097 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23097/consoleFull)
for PR 2735 at commit
[`b6d8001`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-62254525
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23
Github user comcmipi commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-62252538
There is one more issue in this example. It could be the lack of my
understanding, or maybe a problem.
When the checkpoint exists and you send some lines to nc w
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-62252431
[Test build #23097 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23097/consoleFull)
for PR 2735 at commit
[`b6d8001`](https://githu
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-62231450
I made this change in https://github.com/apache/spark/pull/2564 too. You
could kinda think of this as part of the SPARK-2548 JIRA as well as it includes
some touch-ups to
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-62221302
Also, please make a JIRA and update the title with the JIRA (see other pull
requests)
---
If your project is set up for it, you can reply to this email and have your
reply
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-62221232
Thank you for catching this. The example is almost useless without that! I
had one comment, please address that. Other than I tested the change manually
(since unit tests do
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/2735#discussion_r20040175
--- Diff:
examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala
---
@@ -116,6 +116,7 @@ object RecoverableNetworkWordCou
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-60324055
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-60324050
[QA tests have
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22089/consoleFull)
for PR 2735 at commit
[`96fe274`](https://github.com/a
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-60316955
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22089/consoleFull)
for PR 2735 at commit
[`96fe274`](https://github.com/ap
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-60316389
Jenkins, this is ok to test.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have th
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-59119147
@tdas
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabl
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-58572767
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your pro
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2735#issuecomment-58522723
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your pro
GitHub user comcmipi opened a pull request:
https://github.com/apache/spark/pull/2735
Update RecoverableNetworkWordCount.scala
Trying this example, I missed the moment when the checkpoint was iniciated
You can merge this pull request into a Git repository by running:
$ git pull
23 matches
Mail list logo