[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-05-01 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29544962 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala --- @@ -188,25 +188,26 @@ private[streaming] class Str

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-05-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5680 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-05-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29543066 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala --- @@ -188,25 +188,26 @@ private[streaming] class Streamin

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-05-01 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98271294 LGTM. Merging this. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-05-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29540303 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala --- @@ -188,25 +188,26 @@ private[streaming] class Streamin

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98073621 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98073613 [Test build #31527 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31527/consoleFull) for PR 5680 at commit [`339f854`](https://gith

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98073622 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/315

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98058405 [Test build #31527 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31527/consoleFull) for PR 5680 at commit [`339f854`](https://githu

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98058377 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98058370 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29491091 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/scheduler/InputInfoTrackerSuite.scala --- @@ -0,0 +1,104 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29490701 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/scheduler/InputInfoTrackerSuite.scala --- @@ -0,0 +1,104 @@ +/* + * Licensed to the A

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29490484 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,63 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98040664 [Test build #738 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/738/consoleFull) for PR 5680 at commit [`abd0036`](https://github

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98038855 OK, I will try to get it done, thanks a lot for your comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98038682 I made some more comments. Would be great if you can get it done today and I can merge it in tomorrow. That will unblock #5533. --- If your project is set up for it, you ca

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29488679 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/scheduler/InputInfoTrackerSuite.scala --- @@ -0,0 +1,104 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29488326 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,63 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29488325 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/scheduler/InputInfoTrackerSuite.scala --- @@ -0,0 +1,104 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29488250 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,63 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29488194 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/scheduler/InputInfoTrackerSuite.scala --- @@ -0,0 +1,104 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29488188 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/scheduler/InputInfoTrackerSuite.scala --- @@ -0,0 +1,104 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98035178 The approach is good! I am still looking at the details. There are some details that are going to to be changed singificantly in #5533 by @zsxwing . So I will look for gener

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98032608 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98032610 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/314

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98032571 [Test build #31492 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31492/consoleFull) for PR 5680 at commit [`727264e`](https://gith

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29487898 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,63 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98031757 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98031749 [Test build #31499 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31499/consoleFull) for PR 5680 at commit [`abd0036`](https://gith

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98031758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/314

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29487553 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala --- @@ -101,6 +101,7 @@ private[streaming] class Strea

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29487167 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,63 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29487150 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DirectKafkaInputDStream.scala --- @@ -17,7 +17,6 @@ package org.apache.spark

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29487117 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala --- @@ -101,6 +101,7 @@ private[streaming] class StreamingJ

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98029172 [Test build #31499 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31499/consoleFull) for PR 5680 at commit [`abd0036`](https://githu

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98029146 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98029131 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29486738 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29485616 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98020414 Any comment for the current implementation ? @tdas --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98019794 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98019776 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-98019962 [Test build #31492 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31492/consoleFull) for PR 5680 at commit [`727264e`](https://githu

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29485228 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,69 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29453720 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala --- @@ -70,9 +70,8 @@ private[streaming] class StreamingJob

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29448422 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,69 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97822058 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/314

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97822008 [Test build #31417 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31417/consoleFull) for PR 5680 at commit [`6682bef`](https://gith

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97822054 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29427122 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala --- @@ -188,25 +189,26 @@ private[streaming] class Str

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29427075 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala --- @@ -101,6 +101,7 @@ private[streaming] class Strea

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97763562 [Test build #31417 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31417/consoleFull) for PR 5680 at commit [`6682bef`](https://githu

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97762965 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97762940 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97725344 [Test build #31411 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31411/consoleFull) for PR 5680 at commit [`8325787`](https://gith

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97725352 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97725353 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/314

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97725327 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/314

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97725321 [Test build #31408 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31408/consoleFull) for PR 5680 at commit [`8325787`](https://gith

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97725326 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97712927 [Test build #31411 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31411/consoleFull) for PR 5680 at commit [`8325787`](https://githu

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97712628 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97712611 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97711812 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97709911 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97709914 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/314

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97709908 [Test build #31407 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31407/consoleFull) for PR 5680 at commit [`17fa251`](https://gith

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97709002 [Test build #31408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31408/consoleFull) for PR 5680 at commit [`8325787`](https://githu

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97708818 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97708865 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97708542 Hi @zsxwing, you also changed a lot on this part, would you please take a look at this, thanks a lot. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97707535 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97707496 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29411380 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29410424 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala --- @@ -95,7 +95,7 @@ private[ui] class StreamingPage(parent: Streaming

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29410293 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala --- @@ -70,9 +70,8 @@ private[streaming] class Streami

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29410045 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala --- @@ -135,28 +132,25 @@ private[streaming] class Str

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97697526 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97697528 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/313

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97697502 [Test build #31397 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31397/consoleFull) for PR 5680 at commit [`3ad00d9`](https://gith

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29409167 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29409159 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala --- @@ -135,28 +132,25 @@ private[streaming] class Streamin

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29409065 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala --- @@ -70,9 +70,8 @@ private[streaming] class StreamingJob

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29408973 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/BatchInfo.scala --- @@ -32,7 +33,7 @@ import org.apache.spark.streaming.Time @Devel

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29408882 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobScheduler.scala --- @@ -50,6 +50,8 @@ class JobScheduler(val ssc: StreamingContext) e

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29408816 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29408797 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5680#discussion_r29408785 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala --- @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97695062 Yes, I will do this, please take take a look at the whole design, thanks a lot :) --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97694754 There are merge conflicts! Please merge master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: [SPARK-7112][Streaming][WIP] Add a InputInfoTr...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-97692345 [Test build #31397 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31397/consoleFull) for PR 5680 at commit [`3ad00d9`](https://githu