Jose Torres created SPARK-24234:
-----------------------------------
Summary: Write RDD with row buffer
Key: SPARK-24234
URL: https://issues.apache.org/jira/browse/SPARK-24234
Project: Spark
Issue Type: Sub-task
Components: Structured Streaming
Affects Versions: 2.4.0
Reporter: Jose Torres
[https://docs.google.com/document/d/1IL4kJoKrZWeyIhklKUJqsW-yEN7V7aL05MmM65AYOfE/edit#heading=h.8t3ci57f7uii]
This probably ought to be an abstraction of ContinuousDataSourceRDD and
ContinuousQueuedDataReader. These classes do pretty much exactly what's needed,
except the buffer is filled from the remote data source instead of a remote
Spark task.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
