[
https://issues.apache.org/jira/browse/BEAM-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17549974#comment-17549974
]
Danny McCormick commented on BEAM-14161:
----------------------------------------
This issue has been migrated to https://github.com/apache/beam/issues/21544
> Add dynamic splitting to JdbcIO.readWithPartitions
> --------------------------------------------------
>
> Key: BEAM-14161
> URL: https://issues.apache.org/jira/browse/BEAM-14161
> Project: Beam
> Issue Type: Improvement
> Components: io-java-jdbc
> Reporter: Pablo Estrada
> Assignee: Jean-Baptiste Onofré
> Priority: P2
> Labels: stale-assigned
> Fix For: Not applicable
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> Now, the JDBC IO is basically a {{DoFn}} executed with a {{{}ParDo{}}}. So,
> it means that parallelism is "limited" and executed on one executor.
> ReadWithPartitions does some preliminary partitioning of the data, but any
> skew in data range or workload will create an unbalanced workload.
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
