pabloem commented on pull request #15848: URL: https://github.com/apache/beam/pull/15848#issuecomment-1023901471
@mosche would you take a look at this change and let me know what you think? I suggest you look at the new integration tests in `JdbcIOAutoPartitioningIT`, you can see the intended usage: A user would pass the type of the partition column, and we automatically generate partition ranges. Some follow up changes are: - Automatically infer the upper and lower bound at pipeline runtime via `select min(col), max(col) from table`, so the user won't have to provide them. - Dynamic rebalancing: change ReadFn to work as a splittable DoFn that can sub-partition a range if it's going slow -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
