Luke Cwik created BEAM-9578: ------------------------------- Summary: Enumerating artifacts is too expensive in Java Key: BEAM-9578 URL: https://issues.apache.org/jira/browse/BEAM-9578 Project: Beam Issue Type: Bug Components: sdk-java-core Reporter: Luke Cwik Assignee: Heejong Lee Fix For: 2.21.0
There are a lot of places (e.g. **ParDoTranslation#getParDoPayload**) which effectively call **Environments#createOrGetDefaultEnvironment** which causes [artifacts to be computed|https://github.com/apache/beam/blob/fc6cef9972780ca6b7525d4aadd65a8344221f1b/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/Environments.java#L114]. This leads to zipping directories for non-jar dependencies. Similar problems may exist for Python/Go. -- This message was sent by Atlassian Jira (v8.3.4#803005)