Ismaël Mejía created BEAM-9282:
----------------------------------

             Summary: Create new module for Spark 3 runner
                 Key: BEAM-9282
                 URL: https://issues.apache.org/jira/browse/BEAM-9282
             Project: Beam
          Issue Type: Sub-task
          Components: runner-spark
            Reporter: Ismaël Mejía
            Assignee: Ismaël Mejía


GIven the big amount of different dependencies and some code incompatibilities 
introduced by the Spark Structured Streaming runner reliance on the unsable 
Spark Source V2 API it is a good idea to provide independent modules for the 
Spark 3 runner.

Notice that the idea is still that the users can provide their Spark 
dependencies.

We should probably rely on a structure similar to the one the Flink runner uses 
to support their multiple versions.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to