Solomon Duskis created BEAM-3246: ------------------------------------ Summary: BigtableIO should merge splits if they exceed 15K Key: BEAM-3246 URL: https://issues.apache.org/jira/browse/BEAM-3246 Project: Beam Issue Type: Bug Components: sdk-java-gcp Reporter: Solomon Duskis Assignee: Solomon Duskis
A customer hit a problem with a large number of splits. CloudBitableIO fixes that here https://github.com/GoogleCloudPlatform/cloud-bigtable-client/blob/master/bigtable-dataflow-parent/bigtable-hbase-beam/src/main/java/com/google/cloud/bigtable/beam/CloudBigtableIO.java#L241 BigtableIO should have similar logic. -- This message was sent by Atlassian JIRA (v6.4.14#64029)