GitHub user jose-torres opened a pull request:
https://github.com/apache/spark/pull/20369
[SPARK-23196] Unify continuous and microbatch V2 sinks
## What changes were proposed in this pull request?
Replace streaming V2 sinks with a unified StreamWriteSupport interface,
with a shim to use it with microbatch execution.
Add a new SQL config to use for disabling V2 sinks, falling back to the V1
sink implementation.
## How was this patch tested?
Existing tests, which in the case of Kafka (the only existing continuous V2
sink) now use V2 for microbatch.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jose-torres/spark streaming-sink
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20369.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20369
----
commit 94c06a5f9a9d88810a43ac66722f58ffa45709f0
Author: Jose Torres <jose@...>
Date: 2018-01-23T20:47:44Z
change sink
commit ee773f4cc7d6cfbb14b40c2e7961386ea2742612
Author: Jose Torres <jose@...>
Date: 2018-01-23T21:12:20Z
add config
commit d722bbf2f253dff0b7da0111b4e75529dc591813
Author: Jose Torres <jose@...>
Date: 2018-01-23T22:07:11Z
fix internal row
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
