[ https://issues.apache.org/jira/browse/BEAM-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kenneth Knowles updated BEAM-8495: ---------------------------------- Status: Open (was: Triage Needed) > Change byte size estimate for compressed files for FileBasedSources > ------------------------------------------------------------------- > > Key: BEAM-8495 > URL: https://issues.apache.org/jira/browse/BEAM-8495 > Project: Beam > Issue Type: Bug > Components: io-java-files, io-py-files > Reporter: Ahmet Altay > Assignee: Chamikara Madhusanka Jayalath > Priority: Major > > Consider change the estimated byte size for file based sources for better > initial autoscaling (on runners which support it; currently only Dataflow). > Currently the estimate is based on total size, for compressed file we could > add a factor multiplier (~5) for compressed files in a blob go produce a > better estimate. -- This message was sent by Atlassian Jira (v8.3.4#803005)