Ismaël Mejía created BEAM-9282: ---------------------------------- Summary: Create new module for Spark 3 runner Key: BEAM-9282 URL: https://issues.apache.org/jira/browse/BEAM-9282 Project: Beam Issue Type: Sub-task Components: runner-spark Reporter: Ismaël Mejía Assignee: Ismaël Mejía
GIven the big amount of different dependencies and some code incompatibilities introduced by the Spark Structured Streaming runner reliance on the unsable Spark Source V2 API it is a good idea to provide independent modules for the Spark 3 runner. Notice that the idea is still that the users can provide their Spark dependencies. We should probably rely on a structure similar to the one the Flink runner uses to support their multiple versions. -- This message was sent by Atlassian Jira (v8.3.4#803005)