Re: Paramiko EOFErrors start to occur after a while

2012-05-08 Thread Kurtis Mullins
Hey, I'd take a look at these options if you want to stick with Django-Storages ( http://django-storages.readthedocs.org/en/latest/index.html listed on the top of the page). Otherwise, I wonder if you could use the hadoop fileystem or some other, similar distributed file system built for high pe

Re: Paramiko EOFErrors start to occur after a while

2012-05-08 Thread Phang Mulianto
Hi, i also have the script to sftp using python...run with cron every 30 mins, and suddently since last week, the eol errors come out.. i think this problem bcoz the sftp server.. are you trying rsync to transfer between host ? On Tue, May 8, 2012 at 6:31 AM, Tino de Bruijn wrote: > Hi, > > U

Re: Paramiko EOFErrors start to occur after a while

2012-05-07 Thread Tino de Bruijn
Hi, Unfortunatly we can't move to Amazon S3. So what other file system or transfer method would you recommend? We had an NFS in place, but getting it to play nice with permissions was quite a hassle. How do other people do this? Tino On Wednesday, May 2, 2012 1:25:52 AM UTC+2, Kurtis wrote: >

Re: Paramiko EOFErrors start to occur after a while

2012-05-01 Thread Kurtis Mullins
I messed with the SFTP implementatoin a while back. I noticed it was pretty tough and, if I'm not mistaken, a bit out-dated. We ended up moving to Amazon S3 so it wasn't a big deal. Anyways, maybe you could try using another file system? SSH isn't really an ideal solution for this sort of a proble

Paramiko EOFErrors start to occur after a while

2012-05-01 Thread Tino de Bruijn
Hi, My setup is the following: I have two webservers that serve all dynamic request. I have a seperate static file server (that also has some celery queue workers running). When images are uploaded by users, those images are uploaded to the webservers, and processed async by a queue. In the job