[
https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14295316#comment-14295316
]
Iulian Dragos commented on SPARK-4631:
--------------------------------------
This test exhibits a race condition.
MQTTStreamSuite fails both on my machine and on an EC2 instance with the
message below (but passes if I add a `Thread.sleep(50)` inside `publishData`).
See my [comment on the
PR|https://github.com/apache/spark/pull/3844#issuecomment-71852913].
{code}
[info] - mqtt input stream *** FAILED *** (552 milliseconds)
[info] org.eclipse.paho.client.mqttv3.MqttException: Too many publishes in
progress
{code}
The issue comes from the hard-coded limit of 10 in-flight messages in the MQTT
client. This test produces too much data too fast on some machines.
> Add real unit test for MQTT
> ----------------------------
>
> Key: SPARK-4631
> URL: https://issues.apache.org/jira/browse/SPARK-4631
> Project: Spark
> Issue Type: Test
> Components: Streaming
> Reporter: Tathagata Das
> Priority: Critical
> Fix For: 1.3.0, 1.2.1
>
>
> A real unit test that actually transfers data to ensure that the MQTTUtil is
> functional
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
