Re: Is it madness to process uploaded tars and zips completely in memory?

2010-11-02 Thread wawa wawawa
On 2 November 2010 14:03, Cal Leeming [Simplicity Media Ltd] wrote: > All depends on whether; > > you have enough memory > you are going to enforce the file size > you have appropriate resource limitations in place on the server > you are going to enforce the maximum number of processing requests

Re: Is it madness to process uploaded tars and zips completely in memory?

2010-11-02 Thread Cal Leeming [Simplicity Media Ltd]
All depends on whether; - you have enough memory - you are going to enforce the file size - you have appropriate resource limitations in place on the server - you are going to enforce the maximum number of processing requests etc etc... Personally, if all those conditions were met,

Is it madness to process uploaded tars and zips completely in memory?

2010-11-02 Thread wawa wawawa
Hi, I am writing an app to "apply some rainbows and unicorns" to a bunch of uploaded XML files (which can be uploaded as a compressed tar or zip file). Celery and rabbitmq will be used for the asynchronous tasks with jQuery (maybe with dajaxproject) to get updates on progress to the browser. I'm