[ https://issues.apache.org/jira/browse/BEAM-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sourabh Bajaj updated BEAM-1079: -------------------------------- Description: Filebased source during validation at pipeline creation does a full glob when it only needs to validate atleast one file. So create a limit parameter to make this faster. > Validation speed for really large number of files > ------------------------------------------------- > > Key: BEAM-1079 > URL: https://issues.apache.org/jira/browse/BEAM-1079 > Project: Beam > Issue Type: Improvement > Components: sdk-py > Reporter: Sourabh Bajaj > Assignee: Sourabh Bajaj > Priority: Trivial > > Filebased source during validation at pipeline creation does a full glob when > it only needs to validate atleast one file. So create a limit parameter to > make this faster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)