[GitHub] spark pull request: Augmented updateStateByKey API

2014-09-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2267#issuecomment-55365085 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20210/consoleFull) for PR 2267 at commit [`db54919`](https://github.com/ap

[GitHub] spark pull request: Augmented updateStateByKey API

2014-09-11 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/2267#issuecomment-55364912 @conviva @xiliu82 Could you create a JIRA and add the JIRA number to the PR title, similar to the other PRs? --- If your project is set up for it, you can reply to this em

[GitHub] spark pull request: Augmented updateStateByKey API

2014-09-11 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/2267#issuecomment-55364870 Jenkins, this is ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: Augmented updateStateByKey API

2014-09-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2267#issuecomment-54694323 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] spark pull request: Augmented updateStateByKey API

2014-09-04 Thread xiliu82
Github user xiliu82 commented on a diff in the pull request: https://github.com/apache/spark/pull/2267#discussion_r17147160 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala --- @@ -396,6 +396,26 @@ class PairDStreamFunctions[K, V](se

[GitHub] spark pull request: Augmented updateStateByKey API

2014-09-04 Thread xiliu82
Github user xiliu82 commented on a diff in the pull request: https://github.com/apache/spark/pull/2267#discussion_r17133551 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala --- @@ -396,6 +396,26 @@ class PairDStreamFunctions[K, V](se

[GitHub] spark pull request: Augmented updateStateByKey API

2014-09-04 Thread xiliu82
Github user xiliu82 commented on a diff in the pull request: https://github.com/apache/spark/pull/2267#discussion_r17131871 --- Diff: spark2 --- @@ -0,0 +1 @@ +Some changes --- End diff -- Yep, this was from the fork, should be removed. --- If your project is set

[GitHub] spark pull request: Augmented updateStateByKey API

2014-09-04 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/2267#discussion_r17101578 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala --- @@ -396,6 +396,26 @@ class PairDStreamFunctions[K, V](sel

[GitHub] spark pull request: Augmented updateStateByKey API

2014-09-04 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/2267#discussion_r17101501 --- Diff: spark2 --- @@ -0,0 +1 @@ +Some changes --- End diff -- What is this file? accidentally added? --- If your project is set up for it,

[GitHub] spark pull request: Augmented updateStateByKey API

2014-09-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2267#issuecomment-5447 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: Augmented updateStateByKey API

2014-09-03 Thread xiliu82
GitHub user xiliu82 opened a pull request: https://github.com/apache/spark/pull/2267 Augmented updateStateByKey API Augment updateStateByKey API by exposing both key and current batch timestamp to applications. You can merge this pull request into a Git repository by running: