[ https://issues.apache.org/jira/browse/BEAM-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17548326#comment-17548326 ]
Danny McCormick commented on BEAM-8900: --------------------------------------- This issue has been migrated to https://github.com/apache/beam/issues/19968 > Python SDK should stage only up-to-date versions of pipeline dependencies > defined by requirements file. > ------------------------------------------------------------------------------------------------------- > > Key: BEAM-8900 > URL: https://issues.apache.org/jira/browse/BEAM-8900 > Project: Beam > Issue Type: Bug > Components: sdk-py-core > Reporter: Valentyn Tymofieiev > Priority: P3 > Labels: starter > > When staging pipeline dependencies specified in requirements.txt file and > transitive deps, we stage entire content of requirements-cache directory on > user's machine, which may include dependencies that were cached a while ago > and are no longer needed. See [1] for discussion and some ideas how we can > avoid staging packages we don't need. > [1] > https://lists.apache.org/thread.html/f99820489026a46160505ea9a4c8c4a0eabe8649143c1ee22b7088aa%40%3Cdev.beam.apache.org%3E -- This message was sent by Atlassian Jira (v8.20.7#820007)