[google-appengine] Re: simultaneous dynamic requests, max blob size, multi-blob?
Thanks Nick! On Wed, Jul 22, 2009 at 3:56 AM, Nick Johnson (Google) wrote: > > Hi Jeff, > > When I said 10MB, I was referring to the 10MB request size limit, and > pointing out that the forthcoming blob API will allow storing blobs > larger than that size also. You can currently store anything up to > 10MB by splitting the blob into multiple datastore entities, but it's > impossible to accept an upload greater than 10MB at all. > > -Nick Johnson > > On Tue, Jul 21, 2009 at 9:26 AM, Jeff Enderwick > wrote: >> >> Yeah, just trying to get clarification. Nick's email stated 10MB, >> Wikipedia says 1MB with a 10MB response limit. If Wikipedia is right >> and I can get 10MB in/out the door, I can always fragment (or wait, or >> if Nick says it is now 10MB ... :-). >> >> http://en.wikipedia.org/wiki/Google_App_Engine#Hard_limits >> >> On Mon, Jul 20, 2009 at 4:00 PM, Wooble wrote: >>> >>> >>> >>> On Jul 18, 8:29 pm, Jeff Enderwick wrote: Is 10MB the current limit, or is it 1MB? I was under the impression that the max blob size was 1MB, and max HTTP response size was 10MB. Do I have it right? >>> >>> API calls are limited to 1MB unless that's been changed without an >>> announcement fairly recently; you couldn't get more than 1MB into an >>> entity even if the blob itself could hold it. >>> > >>> >> >> > >> > > > > -- > Nick Johnson, App Engine Developer Programs Engineer > Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration > Number: 368047 > > > > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: simultaneous dynamic requests, max blob size, multi-blob?
Hi Jeff, When I said 10MB, I was referring to the 10MB request size limit, and pointing out that the forthcoming blob API will allow storing blobs larger than that size also. You can currently store anything up to 10MB by splitting the blob into multiple datastore entities, but it's impossible to accept an upload greater than 10MB at all. -Nick Johnson On Tue, Jul 21, 2009 at 9:26 AM, Jeff Enderwick wrote: > > Yeah, just trying to get clarification. Nick's email stated 10MB, > Wikipedia says 1MB with a 10MB response limit. If Wikipedia is right > and I can get 10MB in/out the door, I can always fragment (or wait, or > if Nick says it is now 10MB ... :-). > > http://en.wikipedia.org/wiki/Google_App_Engine#Hard_limits > > On Mon, Jul 20, 2009 at 4:00 PM, Wooble wrote: >> >> >> >> On Jul 18, 8:29 pm, Jeff Enderwick wrote: >>> Is 10MB the current limit, or is it 1MB? I was under the impression >>> that the max blob size was 1MB, and max HTTP response size was 10MB. >>> Do I have it right? >> >> API calls are limited to 1MB unless that's been changed without an >> announcement fairly recently; you couldn't get more than 1MB into an >> entity even if the blob itself could hold it. >> > >> > > > > -- Nick Johnson, App Engine Developer Programs Engineer Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: simultaneous dynamic requests, max blob size, multi-blob?
> 3) Along those lines, has anyone implemented something like multi-blob > fragmentation/reassembly for storing & serving things greater than > 1MB? > I have implemented a basic app. You can check from: http://simpleupdown.appspot.com/ and the codes are here: http://code.google.com/p/appenginelargefileupload/downloads/list --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: simultaneous dynamic requests, max blob size, multi-blob?
> 3) Along those lines, has anyone implemented something like multi-blob > fragmentation/reassembly for storing & serving things greater than > 1MB? I have implemented a basic app for this. http://simpleupdown.appspot.com/ allows file upload until 10MB. You can check codes here: http://code.google.com/p/appenginelargefileupload/downloads/list --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: simultaneous dynamic requests, max blob size, multi-blob?
Yeah, just trying to get clarification. Nick's email stated 10MB, Wikipedia says 1MB with a 10MB response limit. If Wikipedia is right and I can get 10MB in/out the door, I can always fragment (or wait, or if Nick says it is now 10MB ... :-). http://en.wikipedia.org/wiki/Google_App_Engine#Hard_limits On Mon, Jul 20, 2009 at 4:00 PM, Wooble wrote: > > > > On Jul 18, 8:29 pm, Jeff Enderwick wrote: >> Is 10MB the current limit, or is it 1MB? I was under the impression >> that the max blob size was 1MB, and max HTTP response size was 10MB. >> Do I have it right? > > API calls are limited to 1MB unless that's been changed without an > announcement fairly recently; you couldn't get more than 1MB into an > entity even if the blob itself could hold it. > > > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: simultaneous dynamic requests, max blob size, multi-blob?
On Jul 18, 8:29 pm, Jeff Enderwick wrote: > Is 10MB the current limit, or is it 1MB? I was under the impression > that the max blob size was 1MB, and max HTTP response size was 10MB. > Do I have it right? API calls are limited to 1MB unless that's been changed without an announcement fairly recently; you couldn't get more than 1MB into an entity even if the blob itself could hold it. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: simultaneous dynamic requests, max blob size, multi-blob?
Is 10MB the current limit, or is it 1MB? I was under the impression that the max blob size was 1MB, and max HTTP response size was 10MB. Do I have it right? On Thu, Jul 16, 2009 at 2:15 AM, Nick Johnson (Google) wrote: > > Hi Jeff, > > On Thu, Jul 16, 2009 at 3:33 AM, Jeff Enderwick > wrote: >> >> 1) I saw that 30 was listed somewhere as the max simultaneous dynamic >> requests for an app. Is this really true? Even if I am paying, and I >> have a very popular app? I see the math indicating that one can retire >> 400/sec with 75ms latency, but I am sure that GOOG-internal apps >> aren't held to this limit of 30. Is this really a hard limit? > > It's not a hard limit, no. If your app scales large enough, this will > be increased. 400 QPS is a very busy app, though. > >> >> 2) Great to see that "Service for storing and serving large files" is >> on deck. Can y'all give any indication whether this will be >> accomplished by making blobs bigger (or adding some sort of uberblob)? >> Any indications on new max size would be great. > > It will definitely be capable of storing blobs larger than the current > 10MB limit. For more details, you'll have to wait for the service to > be released. > > -Nick Johnson > >> >> 3) Along those lines, has anyone implemented something like multi-blob >> fragmentation/reassembly for storing & serving things greater than >> 1MB? >> >> Thanks! >> Jeff >> >> > >> > > > > -- > Nick Johnson, App Engine Developer Programs Engineer > Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration > Number: 368047 > > > > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: simultaneous dynamic requests, max blob size, multi-blob?
Hi Jeff, On Thu, Jul 16, 2009 at 3:33 AM, Jeff Enderwick wrote: > > 1) I saw that 30 was listed somewhere as the max simultaneous dynamic > requests for an app. Is this really true? Even if I am paying, and I > have a very popular app? I see the math indicating that one can retire > 400/sec with 75ms latency, but I am sure that GOOG-internal apps > aren't held to this limit of 30. Is this really a hard limit? It's not a hard limit, no. If your app scales large enough, this will be increased. 400 QPS is a very busy app, though. > > 2) Great to see that "Service for storing and serving large files" is > on deck. Can y'all give any indication whether this will be > accomplished by making blobs bigger (or adding some sort of uberblob)? > Any indications on new max size would be great. It will definitely be capable of storing blobs larger than the current 10MB limit. For more details, you'll have to wait for the service to be released. -Nick Johnson > > 3) Along those lines, has anyone implemented something like multi-blob > fragmentation/reassembly for storing & serving things greater than > 1MB? > > Thanks! > Jeff > > > > -- Nick Johnson, App Engine Developer Programs Engineer Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: simultaneous dynamic requests, max blob size, multi-blob?
I'm pretty sure #1 is correct. Of course, it's not a hard limit in the sense that the 31st request is dropped, rather it's queued, but yes it's unfortunate. On Jul 15, 10:33 pm, Jeff Enderwick wrote: > 1) I saw that 30 was listed somewhere as the max simultaneous dynamic > requests for an app. Is this really true? Even if I am paying, and I > have a very popular app? I see the math indicating that one can retire > 400/sec with 75ms latency, but I am sure that GOOG-internal apps > aren't held to this limit of 30. Is this really a hard limit? > > 2) Great to see that "Service for storing and serving large files" is > on deck. Can y'all give any indication whether this will be > accomplished by making blobs bigger (or adding some sort of uberblob)? > Any indications on new max size would be great. > > 3) Along those lines, has anyone implemented something like multi-blob > fragmentation/reassembly for storing & serving things greater than > 1MB? > > Thanks! > Jeff --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
