mohamedawnallah commented on PR #35686:
URL: https://github.com/apache/beam/pull/35686#issuecomment-3205113128
> My local machine fails with memory issues and `grpcio` dependency errors.
Hi @Anush008, have you tried to run them one by one sequentially? It mostly
appear to me the issue is that those generating python docker requirements for
different python versions in parallel. That is why it cause memory issues
I remember once in a while I had come across this issue and I solved by this
script:
```bash
dev@dev:~/beam$ cat ./run_python_requirements.sh
#!/bin/bash
# Array of Python versions to process
versions=(39 310 311 312 313)
# Loop through each version
for version in "${versions[@]}"; do
log_file="python_${version}_docker_requirements.log"
echo "Starting sequential Python requirements generation..." >>
"${log_file}"
echo "$(date): Starting process for Python ${version}..." >> "${log_file}"
# Run the command, redirecting output to the log file.
./gradlew :sdks:python:container:py${version}:generatePythonRequirements
>> "${log_file}" 2>&1
# Check if the command was successful
if [ $? -eq 0 ]; then
echo "$(date): Completed process for Python ${version} successfully" >>
"${log_file}"
else
echo "$(date): Process for Python ${version} failed with exit code $?"
>> "${log_file}"
fi
done
echo "$(date): All processes completed" >> "${log_file}"
```
I am willing to move this PR forward in terms of review work 🙏
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
