Would love to hear if you try it out. I was also considering that. I recently changed to using the file based streaming input. I made another Go script <https://github.com/saulshanabrook/ici.recorder/blob/fd8110e490691cc9e98dce1fefbddba973c29deb/server/main.go> that let's me connect over TCP and writes each newline it receives to a new file in a folder. Then Spark can read them from that folder.
On Sat, May 6, 2017 at 2:38 PM tencas [via Apache Spark User List] < ml+s1001560n2865...@n3.nabble.com> wrote: > Thanks @saulshanabrook, I'll have a look at it. > > I think apache kafka could be an alternative solution, but I haven't > checked it yet. > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/Join-streams-Apache-Spark-tp28603p28656.html > To unsubscribe from Join streams Apache Spark, click here > <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=28603&code=cy5zaGFuYWJyb29rQGdtYWlsLmNvbXwyODYwM3wtMTIyOTI1NzM1Ng==> > . > NAML > <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Join-streams-Apache-Spark-tp28603p28657.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
