[
https://issues.apache.org/jira/browse/BEAM-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kenneth Knowles updated BEAM-12655:
-----------------------------------
Description:
I have a pipeline for GCP Dataflow.
In this pipeline I install dependencies from requirements.txt not only using
PyPI but also using links to github. Example link below:
{code}
git+https://${GITHUB_TOKEN}@github.com/my-org/my-repo.git@commit_sha#egg=egg_name
{code}
It was working flawlessly in apache-beam==2.16.0 but after upgrading to 2.31
(also checked 2.30) I get following error in worker logs:
{code}
ERROR: Error [Errno 2] No such file or directory: 'git': 'git' while executing
command git clone -q 'https://****@github.com/my-org/my-repo.git'
/tmp/pip-install-kwjqgr99/my-repo_87c34d2507fe456b892269fd4429a76b
{code}
was:
I have a pipeline for GCP Dataflow.
In this pipeline I install dependencies from requirements.txt not only using
PyPI but also using links to github. Example link below:
git+https://${GITHUB_TOKEN}@github.com/my-org/my-repo.git@commit_sha#egg=egg_name
It was working flawlessly in apache-beam==2.16.0 but after upgrading to 2.31
(also checked 2.30) I get following error in worker logs:
ERROR: Error [Errno 2] No such file or directory: 'git': 'git' while executing
command git clone -q 'https://****@github.com/my-org/my-repo.git'
/tmp/pip-install-kwjqgr99/my-repo_87c34d2507fe456b892269fd4429a76b
> Pip cannot install from git
> ---------------------------
>
> Key: BEAM-12655
> URL: https://issues.apache.org/jira/browse/BEAM-12655
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Affects Versions: 2.30.0, 2.31.0
> Environment: Dataflow
> Reporter: Piotr M
> Priority: P2
> Labels: dataflow, python
>
> I have a pipeline for GCP Dataflow.
> In this pipeline I install dependencies from requirements.txt not only using
> PyPI but also using links to github. Example link below:
> {code}
> git+https://${GITHUB_TOKEN}@github.com/my-org/my-repo.git@commit_sha#egg=egg_name
> {code}
> It was working flawlessly in apache-beam==2.16.0 but after upgrading to 2.31
> (also checked 2.30) I get following error in worker logs:
> {code}
> ERROR: Error [Errno 2] No such file or directory: 'git': 'git' while
> executing command git clone -q 'https://****@github.com/my-org/my-repo.git'
> /tmp/pip-install-kwjqgr99/my-repo_87c34d2507fe456b892269fd4429a76b
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
