Carlo Quinonez created BAHIR-227:
------------------------------------
Summary: Support Structured Streaming for CouchDB/Cloudant
Key: BAHIR-227
URL: https://issues.apache.org/jira/browse/BAHIR-227
Project: Bahir
Issue Type: Wish
Components: Spark Structured Streaming Connectors
Reporter: Carlo Quinonez
The Cloudant connector only supports DStreams/SparkStreaming. We write service
tools for our field service engineers to calibrate/validate/test our
instruments when they are at customer sites. The service tools sync the results
into our couchdb instance. We have a daily job running in databricks using the
cloudant connector to pull the data, aggregate it with other enterprise data
and push it to BI dashboards.
Currently, we're pull down all of the results every night, but our goal is to
make service data available near-real time.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)