tchivs opened a new pull request, #4216:
URL: https://github.com/apache/flink-cdc/pull/4216

   ## Summary
   
   Add `partition.tables` configuration option to support PostgreSQL partition 
table routing, significantly improving performance for databases with many 
partitions.
   
   ## Performance Improvements
   
   ### Before (Problems)
   - **Frequent schema refresh**: Schema was refreshed on every table access
   - **Full schema load**: Even when requesting single table schema, all tables 
were loaded
   - **Excessive CreateTableEvents**: Hundreds of partition tables generated 
massive CreateTableEvent storms
   - **High memory/DB pressure**: Loading schema for each partition table 
caused memory bloat and database load
   
   ### After (Optimizations)
   - **Lazy schema loading**: Schema loaded only when needed
   - **Single table fetch**: `readSchema()` now fetches only the requested table
   - **Event consolidation**: Child partition events routed to parent table, 
eliminating duplicate CreateTableEvents
   - **Reduced DB queries**: Parent table schema cached and reused for all 
child partitions


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to