[ https://issues.apache.org/jira/browse/BEAM-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17033429#comment-17033429 ]
Ismaël Mejía commented on BEAM-4735: ------------------------------------ [~lcwik] is there any Jira tracking Dynamic Work Rebalancing on Google Dataflow for SplittableDoFn? > Make HBaseIO.read() based on SDF by default > ------------------------------------------- > > Key: BEAM-4735 > URL: https://issues.apache.org/jira/browse/BEAM-4735 > Project: Beam > Issue Type: Improvement > Components: io-java-hbase > Reporter: Ismaël Mejía > Priority: Minor > > BEAM-4020 introduces HBaseIO reads based on SDF. So far the read() method > still uses the Source based API because SDF does not support Dynamic Work > Rebalancing (DWR) but the Source API of HBase does, so changing it means > losing some functionality. > Since DWR is only supported by Dataflow once Dataflow supports SDF + DWR we > can move the main read() function to use the SDF API and remove the Source > based implementation. The rest of the runners already support Bounded based > Reads (like HBase based on SDF does) via a default translation without DWR. -- This message was sent by Atlassian Jira (v8.3.4#803005)