Daniel Halperin created BEAM-206: ------------------------------------ Summary: GcsIOChannelFactory does serial renames Key: BEAM-206 URL: https://issues.apache.org/jira/browse/BEAM-206 Project: Beam Issue Type: Bug Components: sdk-java-gcp Reporter: Daniel Halperin Priority: Critical
This code can be the bottleneck if there are many small files. Should be parallelized when possible. https://github.com/apache/incubator-beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/FileBasedSink.java#L633 -- This message was sent by Atlassian JIRA (v6.3.4#6332)