Johan Lasperas created SPARK-48526:
--------------------------------------
Summary: Allow passing custom sink to StreamTest::testStream
Key: SPARK-48526
URL: https://issues.apache.org/jira/browse/SPARK-48526
Project: Spark
Issue Type: Test
Components: Structured Streaming
Affects Versions: 4.0.0
Reporter: Johan Lasperas
The testing helpers for streaming don't allow providing a custom sink, this is
limiting in (at least) two ways:
* A sink can't be reused across multiple calls to `testStream`, e.g. when
canceling and resuming streaming
* A custom sink implementation other than `MemorySink` can't be provided. A
use case here is for example to test the Delta streaming sink by wrapping it in
a MemorySink interface and passing it to the test framework.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
