[ https://issues.apache.org/jira/browse/BEAM-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kenneth Knowles updated BEAM-8495: ---------------------------------- Description: Consider change the estimated byte size for file based sources for better initial autoscaling (on runners which support it; currently only Dataflow). Currently the estimate is based on total size, for compressed file we could add a factor multiplier (~5) for compressed files in a blob go produce a better estimate. (was: Consider change the estimated byte size for file based sources for better initial autoscaling. Currently the estimate is based on total size, for compressed file we could add a factor multiplier (~5) for compressed files in a blob go produce a better estimate.) > Change byte size estimate for compressed files for FileBasedSources > ------------------------------------------------------------------- > > Key: BEAM-8495 > URL: https://issues.apache.org/jira/browse/BEAM-8495 > Project: Beam > Issue Type: Bug > Components: io-java-files, io-py-files > Reporter: Ahmet Altay > Assignee: Chamikara Madhusanka Jayalath > Priority: Major > > Consider change the estimated byte size for file based sources for better > initial autoscaling (on runners which support it; currently only Dataflow). > Currently the estimate is based on total size, for compressed file we could > add a factor multiplier (~5) for compressed files in a blob go produce a > better estimate. -- This message was sent by Atlassian Jira (v8.3.4#803005)