Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57120571
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20962/consoleFull)
for PR 2538 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57129237
**[Tests timed
out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20962/consoleFull)**
after a configured wait of `120m`.
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57129245
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user giwa commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18148393
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala
---
@@ -549,6 +549,10 @@ class JavaStreamingContext(val ssc:
Github user giwa commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57148324
@davies
Python API for Streaming becomes much nicer. You are awesome! Tests have
been failed so far. But it looks like other issue, I think.
Thanks to you,
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57203546
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57203903
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20981/consoleFull)
for PR 2538 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57204099
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57204096
[QA tests have
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20981/consoleFull)
for PR 2538 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57224244
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20995/consoleFull)
for PR 2538 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57226638
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20997/consoleFull)
for PR 2538 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57077576
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20932/consoleFull)
for PR 2538 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57079953
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57079950
**[Tests timed
out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20932/consoleFull)**
after a configured wait of `120m`.
---
If your project
Github user giwa commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18132327
--- Diff: python/pyspark/streaming/dstream.py ---
@@ -0,0 +1,632 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+#
Github user giwa commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18132355
--- Diff: examples/src/main/python/streaming/wordcount.py ---
@@ -0,0 +1,21 @@
+import sys
+
+from pyspark import SparkContext
+from
Github user giwa commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18132354
--- Diff: examples/src/main/python/streaming/network_wordcount.py ---
@@ -0,0 +1,20 @@
+import sys
+
+from pyspark import SparkContext
+from
Github user giwa commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18132833
--- Diff: python/pyspark/streaming/tests.py ---
@@ -0,0 +1,385 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+#
Github user giwa commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18133131
--- Diff: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala
---
@@ -288,7 +293,7 @@ private class PythonException(msg: String, cause:
Exception)
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57044911
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20909/consoleFull)
for PR 2538 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57045108
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20910/consoleFull)
for PR 2538 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57045191
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20911/consoleFull)
for PR 2538 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57045280
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20912/consoleFull)
for PR 2538 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57045714
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57047298
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57047297
**[Tests timed
out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20909/consoleFull)**
after a configured wait of `120m`.
---
If your project
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57047499
**[Tests timed
out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20910/consoleFull)**
after a configured wait of `120m`.
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57047501
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57047595
**[Tests timed
out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20911/consoleFull)**
after a configured wait of `120m`.
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57047597
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57047693
**[Tests timed
out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20912/consoleFull)**
after a configured wait of `120m`.
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57047695
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56926658
**[Tests timed
out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20843/consoleFull)**
after a configured wait of `120m`.
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-5692
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56928665
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user giwa commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18077695
--- Diff: python/pyspark/streaming/jtime.py ---
@@ -0,0 +1,135 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+#
Github user giwa commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18078083
--- Diff: examples/src/main/python/streaming/network_wordcount.py ---
@@ -0,0 +1,20 @@
+import sys
+
+from pyspark.streaming.context import
Github user giwa commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18078104
--- Diff: examples/src/main/python/streaming/wordcount.py ---
@@ -0,0 +1,21 @@
+import sys
+
+from pyspark.streaming.context import StreamingContext
Github user giwa commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18079362
--- Diff: python/pyspark/streaming/tests.py ---
@@ -0,0 +1,321 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+#
Github user giwa commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18079928
--- Diff: python/pyspark/streaming/dstream.py ---
@@ -0,0 +1,400 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+#
Github user giwa commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18080721
--- Diff: python/pyspark/streaming/tests.py ---
@@ -0,0 +1,321 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+#
Github user giwa commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56942157
@davies @JoshRosen
Is there any idea about how to kill callback server after an error is
happened?
I tried signal and atexit to call
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18095580
--- Diff: examples/src/main/python/streaming/wordcount.py ---
@@ -0,0 +1,21 @@
+import sys
+
+from pyspark.streaming.context import
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18095572
--- Diff: examples/src/main/python/streaming/network_wordcount.py ---
@@ -0,0 +1,20 @@
+import sys
+
+from pyspark.streaming.context import
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56978708
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20859/consoleFull)
for PR 2538 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56994578
**[Tests timed
out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20859/consoleFull)**
after a configured wait of `120m`.
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56994595
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57019919
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20876/consoleFull)
for PR 2538 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57020046
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57020039
[QA tests have
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20876/consoleFull)
for PR 2538 at commit
Github user davies commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-57020408
@giwa @JoshRosen It support window functions and updateStateByKey now,
should be function complete as Java API, I'd move on to add more docs and tests.
We did not
GitHub user davies opened a pull request:
https://github.com/apache/spark/pull/2538
[WIP] [SPARK-2377] Python API for Streaming
This patch bring Python API for Streaming, WIP.
TODO:
updateStateByKey()
windowXXX()
This patch is based on work from @giwa
You
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56903104
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20829/consoleFull)
for PR 2538 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56903179
[QA tests have
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20829/consoleFull)
for PR 2538 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56903180
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56906051
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20833/consoleFull)
for PR 2538 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56906115
[QA tests have
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20833/consoleFull)
for PR 2538 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56906120
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18070136
--- Diff: python/pyspark/streaming/jtime.py ---
@@ -0,0 +1,135 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+#
Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18070171
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/api/python/PythonDStream.scala
---
@@ -0,0 +1,141 @@
+/*
+ * Licensed to the Apache
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2538#issuecomment-56919790
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/20843/consoleFull)
for PR 2538 at commit
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18073938
--- Diff: python/pyspark/streaming/jtime.py ---
@@ -0,0 +1,135 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+#
Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2538#discussion_r18074580
--- Diff: python/pyspark/streaming/jtime.py ---
@@ -0,0 +1,135 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+#
63 matches
Mail list logo
