Re: [ansible-project] Memory error when downloading 3.4GB file

2019-03-28 Thread Brian Coca
fetch will automatically use slurp if become is true, fetch itself should not have issues with large files, but slurp uses RAM > x2 the file size due to copying the full file into memory and then base64 encoding it. -- -- Brian Coca -- You received this message because you are subscrib

Re: [ansible-project] Memory error when downloading 3.4GB file

2019-03-28 Thread Sindhuja Koneru
I found that it’s a big in the Ansible module. Module fetch cannot download larger files , instead we need to try synchronize module with mode set to pull and it is working. -- You received this message because you are subscribed to the Google Groups "Ansible Project" group. To unsubscribe from

Re: [ansible-project] Memory error when downloading 3.4GB file

2019-03-28 Thread Sindhuja Koneru
To download, ansible is using fetch module. fetch: dest: ' ' fail_on_missing: yes flat: yes src: ' ' On Thursday, March 28, 2019 at 8:26:15 PM UTC-4, Sindhuja Koneru wrote: > > Thanks for the reply Sebastian. > > It(backup.yml) is a inbuilt module provided in the ansible bundle. It i

Re: [ansible-project] Memory error when downloading 3.4GB file

2019-03-28 Thread Sindhuja Koneru
Thanks for the reply Sebastian. It(backup.yml) is a inbuilt module provided in the ansible bundle. It is also running fetch.py during the download File "/usr/lib/python2.7/site-packages/ansible/plugins/action/fetch.py", line 95, in run slurpres = self._execute_module(module_name='slurp',

Re: [ansible-project] Memory error when downloading 3.4GB file

2019-03-28 Thread Jonathan Lozada De La Matta
I think you might not have enough space to do this. You should contact red hat support and get them to help you. On Thu, Mar 28, 2019 at 8:15 PM Sebastian Meyer wrote: > Hi, > > On 29.03.19 00:55, Sindhuja Koneru wrote: > > '"'"'/usr/bin/python > > /root/.ansible/tmp/ansible-tmp-1553783711.94-90

Re: [ansible-project] Memory error when downloading 3.4GB file

2019-03-28 Thread Sebastian Meyer
Hi, On 29.03.19 00:55, Sindhuja Koneru wrote: > '"'"'/usr/bin/python > /root/.ansible/tmp/ansible-tmp-1553783711.94-90505061625143/slurp.py && > sleep 0'"'"'' Any reason you are using slurp and not fetch? slurp reads the whole file into memory, afterwards it does base64 encoding still in memor

Re: [ansible-project] Memory error when downloading 3.4GB file

2019-03-28 Thread Sindhuja Koneru
It's Linux system with 64 bit (x86_64) Running on 2 cpu x 8 memory, there are no other processes running except ansible. Im running the setup.sh as root user. I can see enough disk space and available memory, no clue why it throws memory error? Is it trying to load the entire file to some cache

Re: [ansible-project] Memory error when downloading 3.4GB file

2019-03-28 Thread Stephen John Smoogen
What architectures are you using? 3.4 gb is a common failure size for 32 bit processors On Thu, Mar 28, 2019, 19:55 Sindhuja Koneru wrote: > > Hello, > > Has anyone come across this Memory error? It occurs when running > backup.yml script which is to backup DB and SECRET KEY. > Script is complet

[ansible-project] Memory error when downloading 3.4GB file

2019-03-28 Thread Sindhuja Koneru
Hello, Has anyone come across this Memory error? It occurs when running backup.yml script which is to backup DB and SECRET KEY. Script is completely successful, until it reaches to a point when it needs to download a common.tar.gz file which is 3.4GB --Fails with an unpredictable memory error.