Kevy123 opened a new issue, #9767:
URL: https://github.com/apache/seatunnel/issues/9767

   ### Search before asking
   
   - [x] I had searched in the 
[feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22)
 and found no similar feature requirement.
   
   
   ### Description
   
   ```
   env {
     parallelism = 2
     job.mode = "STREAMING"
     checkpoint.interval = 10000
     # 控制读取速度
     read_limit.bytes_per_second=7000000
     read_limit.rows_per_second=400
   }
   
   source {
       MySQL-CDC {
       base-url = "jdbc:mysql://192.168.999.161:3306/test"
       username = "root"
       password = "SQaL2008sa%aaa"
       # 监听的表(支持多个)
       table-names = ["test.base_meter_info"]
       startup.mode = "initial"
   
       plugin_output = "data1"
     }
   
      MySQL-CDC {
       base-url = "jdbc:mysql://192.168.999.60:3306/test"
       username = "root"
       password = "SQaL2008sa%aaa"
       # 监听的表(支持多个)
       table-names = ["test.base_meter_info"]
       startup.mode = "initial"
   
       plugin_output = "data2"
     }
   }
   
   transform {
   
    # TableMerge 是一个数据库实例下,多个表结构相同可以合并,多个Source是不支持的
    # transform多表操作也是暂不支持,必须是表名,但是这里表名又是相同的
   
    Filter {
       plugin_input = "data1"
       plugin_output = "data1-2"
       include_fields = [meter_id, consumer_id, company_id, address_2nd]
     }
   
     FieldMapper {
       plugin_input = "data1-2"
       plugin_output = "data1-3"
       field_mapper = {
           meter_id = meterId
           consumer_id = consumerId
           company_id = companyId
           address_2nd = address2nd
       }
     }
   
     Filter {
       plugin_input = "data2"
       plugin_output = "data2-2"
       include_fields = [meter_id, consumer_id, company_id, address_2nd]
     }
   
     FieldMapper {
       plugin_input = "data2-2"
       plugin_output = "data2-3"
       field_mapper = {
           meter_id = meterId
           consumer_id = consumerId
           company_id = companyId
           address_2nd = address2nd
       }
     }
   }
   
   sink {
       Redis {
          plugin_input = "data1-3"
   
         host = 192.168.0.105
         port = 16379
         key = "meter:{address2nd}"
         auth = "admin"
         support_custom_key = true
         data_type = key
         format = "json"
       }
   
       Redis {
          plugin_input = "data2-3"
   
         host = 192.168.0.105
         port = 16379
         key = "meter:{address2nd}"
         auth = "admin"
         support_custom_key = true
         data_type = key
         format = "json"
       }
   }
   ```
   
   2.3.11中,实现多个数据库实例表名相同结构相同,合并数据到同一redis中,除了再复制一遍,还有别的方法吗
   
   ### Usage Scenario
   
   分库不分表
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to