Jussi-Pekka Partanen created BAHIR-164:
------------------------------------------
Summary: Spark Streaming with MQTT fails with Spark 2.3.0
Key: BAHIR-164
URL: https://issues.apache.org/jira/browse/BAHIR-164
Project: Bahir
Issue Type: Bug
Components: Spark Streaming Connectors
Affects Versions: Spark-2.2.0
Reporter: Jussi-Pekka Partanen
Currently I’m not able to use latest Spark 2.3.0 release together with Bahir,
but getting the following error:
_java.lang.AssertionError: assertion failed: DataFrame returned by getBatch
from org.apache.bahir.sql.streaming.mqtt.MQTTTextStreamSource@66847d45 did not
have isStreaming=true_
org/apache/bahir/sql/streaming/mqtt/MQTTStreamSource.scala line 164 seems to be
causing the issue, i.e. it’s returning a normal dataframe instead of streaming
dataframe.
There seems to be discussion about the same topic, but on stream source for
Kafka:
https://lists.apache.org/thread.html/015f2fbe9fbeafb86214a969a2d883a4898621189a86f21a4c6fbb75@%3Cdev.spark.apache.org%3E
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
