GitHub user prabeesh opened a pull request:
https://github.com/apache/spark/pull/13554
[Documentation] Fixed JAR path
## What changes were proposed in this pull request?
Spark-2.0.0 uses Scala-2.11
## How was this patch tested?
n/a
You can merge this
Github user prabeesh closed the pull request at:
https://github.com/apache/spark/pull/4229
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-127619915
I am not going to update this PR again. Can I close this PR or it
automatically closes after #7833 merge ?
---
If your project is set up for it, you can reply to
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-127608284
welcome @zsxwing thanks for your great help
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-127370989
@tdas please have a look.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/7833#issuecomment-126802941
@zsxwing instead of start broker service. we can use some public broker
services like `iot.eclipse.org:1883`.
Otherwise just install light a weight MQTT server
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-125455405
@tdas Please have a look.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/4229#discussion_r35490561
--- Diff: examples/src/main/python/streaming/mqtt_wordcount.py ---
@@ -0,0 +1,57 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-124957667
@zsxwing, we can add MQTT docs. Also now MQTT handling only strings, we can
extend it to also, what is your thoughts about it ?
---
If your project is set up for it
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-124957090
@zsxwing sure.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-124950088
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-124866461
@tdas Please have a look.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-124846814
Got assertion error. Timeout waiting for receiver to start. @zsxwing how
to we can fix this issue?
---
If your project is set up for it, you can reply to this email
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-124820093
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-124795267
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-124336489
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-124212301
@zsxwing tested successfully in local.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-123978543
@tdas and @zsxwing. Sorry for the delay. I can start work on this as soon
as possible. I will update you soon.
---
If your project is set up for it, you can reply
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/4229#discussion_r34997807
--- Diff:
external/mqtt/src/main/scala/org/apache/spark/streaming/mqtt/MQTTTestUtils.scala
---
@@ -0,0 +1,124 @@
+/*
+ * Licensed to the Apache
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/4229#discussion_r34997634
--- Diff:
external/mqtt/src/main/scala/org/apache/spark/streaming/mqtt/MQTTUtils.scala ---
@@ -74,3 +75,24 @@ object MQTTUtils {
createStream
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/4229#discussion_r34997530
--- Diff: external/mqtt/pom.xml ---
@@ -72,7 +72,6 @@
org.apache.activemq
activemq-core
5.7.0
- test
--- End
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-120254773
@tdas I am working on it. Will update you soon
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-118951780
@zsxwing thanks. Now I am working on it.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-117550718
Sure. I think I can add test. But help to implement MQTTUtilsPythonHelper
---
If your project is set up for it, you can reply to this email and have your
reply appear
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-117530565
@tdas I think we should add test for this and MQTTUtilsPythonHelper.
---
If your project is set up for it, you can reply to this email and have your
reply appear on
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-107834133
@tdas please take a look
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-96364287
@tdas please review this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-95576304
@tdas
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
GitHub user prabeesh reopened a pull request:
https://github.com/apache/spark/pull/5653
[minor][streaming]fixed scala string interpolation error
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/prabeesh/spark fix
Alternatively
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/5653#issuecomment-95479634
@srowen
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user prabeesh closed the pull request at:
https://github.com/apache/spark/pull/5653
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user prabeesh opened a pull request:
https://github.com/apache/spark/pull/5653
[minor][streaming]fixed scala string interpolation error
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/prabeesh/spark fix
Alternatively you
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4178#issuecomment-75968545
@dragos no need of withdraw the comment.
Ultimately my aim to deliver good code to Spark users.
---
If your project is set up for it, you can reply to this email
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4178#issuecomment-75948873
@srowen I think so I addressed the @dragos comments. Should we need more
updates for that comments ?, If so could you please explain in detail ?
---
If your project
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4178#issuecomment-75947077
@srowen warning that what is occurring.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4229#issuecomment-75288357
@tdas please review this
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4178#issuecomment-74553655
@srowen is there any more updates here?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/4178#discussion_r24433999
--- Diff:
external/mqtt/src/main/scala/org/apache/spark/streaming/mqtt/MQTTInputDStream.scala
---
@@ -17,23 +17,23 @@
package
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/4178#discussion_r24431522
--- Diff:
examples/src/main/scala/org/apache/spark/examples/streaming/MQTTWordCount.scala
---
@@ -42,25 +40,33 @@ object MQTTPublisher
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/4178#discussion_r24353169
--- Diff:
examples/src/main/scala/org/apache/spark/examples/streaming/MQTTWordCount.scala
---
@@ -42,25 +40,33 @@ object MQTTPublisher
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/4178#discussion_r24352985
--- Diff:
examples/src/main/scala/org/apache/spark/examples/streaming/MQTTWordCount.scala
---
@@ -42,25 +40,33 @@ object MQTTPublisher
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/4229#discussion_r24106831
--- Diff: examples/src/main/python/streaming/mqtt_wordcount.py ---
@@ -0,0 +1,58 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/4229#discussion_r24106237
--- Diff: python/pyspark/streaming/mqtt.py ---
@@ -0,0 +1,57 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/4229#discussion_r24106102
--- Diff: examples/src/main/python/streaming/mqtt_wordcount.py ---
@@ -0,0 +1,58 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/4270#discussion_r23827773
--- Diff:
external/mqtt/src/test/scala/org/apache/spark/streaming/mqtt/MQTTStreamSuite.scala
---
@@ -121,8 +130,18 @@ class MQTTStreamSuite extends
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/3715#discussion_r23637548
--- Diff: examples/src/main/python/streaming/kafka_wordcount.py ---
@@ -0,0 +1,57 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/3715#discussion_r23636136
--- Diff: examples/src/main/python/streaming/kafka_wordcount.py ---
@@ -0,0 +1,57 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
GitHub user prabeesh opened a pull request:
https://github.com/apache/spark/pull/4229
[SPARK-5155] [PySpark] [Streaming] Mqtt streaming support in Python
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/prabeesh/spark mqtt_python
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/4178#issuecomment-71182609
Jenkins, retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
GitHub user prabeesh opened a pull request:
https://github.com/apache/spark/pull/4178
[Minor][streaming][MQTT streaming] some trivial fixes
modified to adhere to accepted coding standards as pointed by @tdas in PR
#3844
You can merge this pull request into a Git repository by
Github user prabeesh closed the pull request at:
https://github.com/apache/spark/pull/3947
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user prabeesh commented on a diff in the pull request:
https://github.com/apache/spark/pull/3947#discussion_r22707793
--- Diff:
examples/src/main/scala/org/apache/spark/examples/streaming/MQTTWordCount.scala
---
@@ -42,25 +41,34 @@ object MQTTPublisher
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/3947#issuecomment-69298331
@rxin please review this
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/3947#issuecomment-69172360
@srowen made it as local variable.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/3947#issuecomment-69165253
- the hard code '\tmp' may be creating garbage. so created temp directory
using internal methods and deleting after the use.
- revert to _
- added t
GitHub user prabeesh opened a pull request:
https://github.com/apache/spark/pull/3947
some trivial fixes
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/prabeesh/spark master
Alternatively you can review and apply these changes
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/3844#issuecomment-68355645
@tdas verify this patch
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/3715#issuecomment-67308682
LGTM for mqtt
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/3487#issuecomment-64777115
@tdas they updated the
[repo](https://repo.eclipse.org/content/repositories/paho-releases/org/eclipse/paho/mqtt-client/0.4.0/)
---
If your project is set up for it
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/3485#issuecomment-64776951
@srowen they updated the
[repo](https://repo.eclipse.org/content/repositories/paho-releases/org/eclipse/paho/mqtt-client/0.4.0/)
---
If your project is set up for it
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/3492#issuecomment-64776782
@srowen they update the [repo](
https://repo.eclipse.org/content/repositories/paho-releases/org/eclipse/paho/mqtt-client/0.4.0/)
---
If your project is set up for it
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/3495#issuecomment-64771442
@tdas paho updated the
[repo](https://repo.eclipse.org/content/repositories/paho-releases/org/eclipse/paho/mqtt-client/0.4.0/).
Now the older one works fine.
---
If
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/3495#issuecomment-64760018
@tdas please see the last update date of the
[repo](https://repo.eclipse.org/content/repositories/paho/org/eclipse/paho/mqtt-client/)
---
If your project is set up for
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/3495#issuecomment-64758946
@srowen please review this
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user prabeesh closed the pull request at:
https://github.com/apache/spark/pull/3492
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user prabeesh commented on the pull request:
https://github.com/apache/spark/pull/3492#issuecomment-64758536
refer #3495
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
GitHub user prabeesh opened a pull request:
https://github.com/apache/spark/pull/3495
[SPARK-4632] version update
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/prabeesh/spark master
Alternatively you can review and apply
Github user prabeesh closed the pull request at:
https://github.com/apache/spark/pull/3493
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user prabeesh closed the pull request at:
https://github.com/apache/spark/pull/3494
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user prabeesh opened a pull request:
https://github.com/apache/spark/pull/3492
[SPARK-4632] changed resolver paho-releases -> paho
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/prabeesh/spark patch-4
Alternatively
GitHub user prabeesh opened a pull request:
https://github.com/apache/spark/pull/3493
[SPARK-4632] changed resolver paho-releases -> paho
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/prabeesh/spark patch-5
Alternatively
GitHub user prabeesh opened a pull request:
https://github.com/apache/spark/pull/3494
[SPARK-4632] version update
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/prabeesh/spark patch-6
Alternatively you can review and apply
GitHub user prabeesh opened a pull request:
https://github.com/apache/spark/pull/331
small fix ( proogram -> program )
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/prabeesh/spark patch-3
Alternatively you can review
73 matches
Mail list logo
