liunaijie commented on issue #6573:
URL: https://github.com/apache/seatunnel/issues/6573#issuecomment-2024786466
> > @Leeeee16 hi, have you solve this issue?
>
> thanks for reply.
>
> I have another question: if I want to simultaneously synchronize multiple
tables across multiple databases, should I write the job config by individually
configuring the source and sink for each one, as shown below?
>
> ```yaml
> env {
> execution.parallelism = 10
> job.mode = "STREAMING"
> checkpoint.interval = 60000
> #execution.checkpoint.interval = 10000
> #execution.checkpoint.data-uri = "hdfs://localhost:9000/checkpoint"
> }
>
> source {
> MySQL-CDC {
> # db.table1
> # xxx...
> }
> MySQL-CDC {
> # db2.table2
> # xxx...
> }
> }
>
> sink {
> jdbc {
> # db.table1
> #...
> }
> jdbc {
> # db.table1
> #...
> }
> }
> ```
In my opinion, it's better to split to multiple jobs, it won't impact other
job if one sub job has issue.
But from other side, it will generate more pipelines need to manager. it
need trade off by yourself.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
