Muktha9491 opened a new pull request, #10670:
URL: https://github.com/apache/seatunnel/pull/10670

   ### Purpose of this pull request
   
   This PR adds multi-table sink support for the Pulsar connector.
   
   The Pulsar sink can now route records dynamically to different Pulsar topics
   based on `SeaTunnelRow.getTableId()`. Each topic maintains a dedicated Pulsar
   producer in a producer map, allowing the connector to support multiple tables
   in a single pipeline.
   
   This change implements `SupportMultiTableSink` for the Pulsar connector and
   adds `SupportMultiTableSinkWriter<Void>` support in the writer.
   
   Closes #10426
   
   ### Does this PR introduce _any_ user-facing change?
   
   Yes.
   
   Previously, the Pulsar sink only supported writing records to a single topic.
   
   With this change:
   - the sink supports multi-table pipelines by routing records with 
`SeaTunnelRow.getTableId()` to different Pulsar topics
   - the `topic` option remains supported for single-table pipelines
   - `topic` is now optional for multi-table pipelines when rows already 
contain table ids
   - `partition_key_fields` support is preserved
   
   The English connector documentation was also updated to describe the new 
multi-table behavior.
   
   ### How was this patch tested?
   
   Tested locally with:
   
   ```bash
   mvn -pl seatunnel-connectors-v2/connector-pulsar -am spotless:apply
   mvn -pl seatunnel-connectors-v2/connector-pulsar -am -q -DskipTests verify
   mvn -pl seatunnel-connectors-v2/connector-pulsar -Dtest=PulsarSinkWriterTest 
test
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to