[
https://issues.apache.org/jira/browse/BAHIR-104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282855#comment-16282855
]
ASF GitHub Bot commented on BAHIR-104:
--------------------------------------
Github user ckadner commented on the issue:
https://github.com/apache/bahir/pull/55
We still have failing tests in `sql-cloudant` but all other modules were
built and tested successfully.
```
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Bahir - Parent POM .......................... SUCCESS [
4.356 s]
[INFO] Apache Bahir - Spark SQL Cloudant DataSource ....... FAILURE [03:13
min]
[INFO] Apache Bahir - Spark Streaming Akka ................ SUCCESS [
27.906 s]
[INFO] Apache Bahir - Spark SQL Streaming Akka ............ SUCCESS [03:49
min]
[INFO] Apache Bahir - Spark Streaming MQTT ................ SUCCESS [01:53
min]
[INFO] Apache Bahir - Spark SQL Streaming MQTT ............ SUCCESS [02:05
min]
[INFO] Apache Bahir - Spark Streaming Twitter ............. SUCCESS [
25.999 s]
[INFO] Apache Bahir - Spark Streaming ZeroMQ .............. SUCCESS [
18.989 s]
[INFO] Apache Bahir - Spark Streaming Google PubSub ....... SUCCESS [
53.220 s]
[INFO] Apache Bahir - Spark Extensions Distribution ....... SUCCESS [
3.500 s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 13:16 min
[INFO] Finished at: 2017-12-07T17:02:57-08:00
[INFO] Final Memory: 183M/6960M
[INFO]
------------------------------------------------------------------------
```
> MQTT Dstream returned by the new multi topic support API is not a pairRDD
> -------------------------------------------------------------------------
>
> Key: BAHIR-104
> URL: https://issues.apache.org/jira/browse/BAHIR-104
> Project: Bahir
> Issue Type: Bug
> Components: Spark Streaming Connectors
> Affects Versions: Spark-2.1.0
> Reporter: Francesco Beneventi
> Labels: MQTT, SPARK
>
> The new multi topic support API added with [BAHIR-89], when used in pyspark,
> does not return a Dstream of <topic,message> tuples.
> Example:
> In pyspark, when creating a Dstream using the new API ( mqttstream =
> MQTTUtils.createPairedStream(ssc, brokerUrl, topics) ) the expected contents
> of mqttstream should be a collections of tuples:
> (topic,message) , (topic,message) , (topic,message) , ...
> Instead, the current content is a flattened list:
> topic, message, topic, message, topic, message, ...
> that is hard to use.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
