Re: stream (large) files from the back-end via Django to the user?

2010-08-24 Thread Markus
On Tue, Aug 24, 2010 at 2:16 AM, Eric Chamberlain wrote: > > Yes. The problem is that currently our CDN is based on Hadoop which serves > us really well for internal purpose. We can't make it accessible from the > outside because at the moment Hadoop is missing some crucial security > features. S

Re: stream (large) files from the back-end via Django to the user?

2010-08-24 Thread Markus
On Tue, Aug 24, 2010 at 1:28 AM, Steve Holden wrote: > Consider using Apache or Nginx to deliver this content much as you would > deliver static content from disk. You don't want Django-users in that loop > if you are interested in maximum throughput. > > But the question is how to get the conten

Re: stream (large) files from the back-end via Django to the user?

2010-08-23 Thread Eric Chamberlain
On Aug 23, 2010, at 4:25 PM, Markus wrote: > > Surely the whole point of a content delivery network is to act as a > proxy for the data source. Buffering it through Django means it's no > longer a CDN, it's just a data store. > > Yes. The problem is that currently our CDN is based on Hadoop whi

Re: stream (large) files from the back-end via Django to the user?

2010-08-23 Thread Markus
> Surely the whole point of a content delivery network is to act as a > proxy for the data source. Buffering it through Django means it's no > longer a CDN, it's just a data store. > Yes. The problem is that currently our CDN is based on Hadoop which serves us really well for internal purpose. We

Re: stream (large) files from the back-end via Django to the user?

2010-08-23 Thread Steve Holden
On 8/23/2010 6:44 PM, Markus wrote: > Hi, > > sorry for the delay of my answer. > > On Thu, Aug 12, 2010 at 5:21 PM, vjimw > wrote: > > When we upload files to the CDN, we store that path with the object. > Then we override the widget for the file so w

Re: stream (large) files from the back-end via Django to the user?

2010-08-23 Thread Markus
Hi, sorry for the delay of my answer. On Thu, Aug 12, 2010 at 5:21 PM, vjimw wrote: > When we upload files to the CDN, we store that path with the object. > Then we override the widget for the file so we can server the file > directly from the CDN using that field. Would that work for you? > I

Re: stream (large) files from the back-end via Django to the user?

2010-08-12 Thread shi shaozhong
We have problems with programmatically retrieve very large datasets from an online source. It takes about 20 minutes. Therefore, efficient solutions are required. Regards. David On 12 August 2010 16:21, vjimw wrote: > When we upload files to the CDN, we store that path with the object. > Then

Re: stream (large) files from the back-end via Django to the user?

2010-08-12 Thread vjimw
When we upload files to the CDN, we store that path with the object. Then we override the widget for the file so we can server the file directly from the CDN using that field. Would that work for you? On Aug 12, 7:54 am, shi shaozhong wrote: > Dear Markus, > > This is a very interesting topic. >

Re: stream (large) files from the back-end via Django to the user?

2010-08-12 Thread shi shaozhong
Dear Markus, This is a very interesting topic. Please keep me informed of answers. Regards. David On 11 August 2010 15:26, Markus wrote: > Hi, > > it was hard to find the right subject. Let me explain what I want to > do. > > I write a web application with Django. I have some forms to upload

stream (large) files from the back-end via Django to the user?

2010-08-11 Thread Markus
Hi, it was hard to find the right subject. Let me explain what I want to do. I write a web application with Django. I have some forms to upload content and some forms to download content. Sometimes the content is just a string (than it will be stored in a database) but sometimes the content is a