[appengine-java] Re: 1MB URL Fetch limit
I've been able to upload large images around 10MB posting from GAE. I usually will have it spawn a task and do it so I don't hit 30s limit. This is one way I do it: http://code.google.com/p/gwt-examples/wiki/DemoGAEMultiFileBlobUpload?ts=1304783389&updated=DemoGAEMultiFileBlobUpload#Upload_By_Servlet Brandon Donnelson http://gwt-examples.googlecode.com -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: 1MB URL Fetch limit
Hi Brandon, Is there a way to do this to Google Document List API to store into Google Docs? Ravi -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: 1MB URL Fetch limit
That api has an upload option. I haven't used it yet. I do use the spreadsheet api and sync with it and it works great. I use oauth to set the authorization up. There doc apis are quite nice. You wouldn't have to use URL fetch to send the document over if you use the java api. http://code.google.com/apis/documents/docs/3.0/developers_guide_java.html Brandon Donnelson http://gwt-examples.googlecode.com -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: 1MB URL Fetch limit
Thank you for reply, Your idea is clear but In Google document list API upload option we need to use file object,and InputStream object is restricted class in App engine. And moreover enduser send document data in request body only. Thanks Mahesh.B -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: 1MB URL Fetch limit
I haven't used this api yet, although, the java api is a wrapping up the parameters into a post to the docs service in xml. In this case, what I might do is sniff the http post out and get the config. Usually I can figure out the api's intentions and get it to work for me. In this case I can see some classes are restricted, and a sniff of the post, copy and configure it to your liking would do the job. You can stream the bytes ouf of the blob into a post request to the doc api. Brandon http://gwt-examples.googlecode.com -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: 1MB URL Fetch limit and blobstore service
Humm, Im not sure this would work but maybe you could use a transfer or send redirect to do the upload since the blob store upload URL is within your app. On Sep 13, 3:08 pm, Lucian Baciu wrote: > What I meant is actually send POST requests using the URL Fetch API to the > blobstore. I've done a test and the request limit does apply :( so I can't > send files larger then 1MB in size. > My app has a dropbox servlet (i.e. users send emails to the app with > attachments) and my app saves these attachments to the blobstore, this is > the reason why I need to call the blobstore service from a servlet. > So it would be so great if you would remove this limit at least for requests > send to the blobstore or offer some other way to archive this. > > Thank you, > Lucian > > On Mon, Sep 13, 2010 at 9:58 PM, Ikai Lan (Google) > > > > > > wrote: > > No. You will be able to upload large files to the blobstore. > > > On Mon, Sep 13, 2010 at 6:54 AM, Lucian Baciu wrote: > > >> Does the 1MB request limit listed here: > >>http://code.google.com/appengine/docs/java/urlfetch/overview.html > >> apply to upload requests send to the blobstore as well? > > >> Thanks, > >> Lucian > > >> -- > >> You received this message because you are subscribed to the Google Groups > >> "Google App Engine for Java" group. > >> To post to this group, send email to > >> google-appengine-j...@googlegroups.com. > >> To unsubscribe from this group, send email to > >> google-appengine-java+unsubscr...@googlegroups.com >> unsubscr...@googlegroups.com> > >> . > >> For more options, visit this group at > >>http://groups.google.com/group/google-appengine-java?hl=en. > > > -- > > You received this message because you are subscribed to the Google Groups > > "Google App Engine for Java" group. > > To post to this group, send email to > > google-appengine-j...@googlegroups.com. > > To unsubscribe from this group, send email to > > google-appengine-java+unsubscr...@googlegroups.com > unsubscr...@googlegroups.com> > > . > > For more options, visit this group at > >http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: 1MB URL Fetch limit and blobstore service
It worked! GREAT suggestion! Thank you, Lucian On Sep 14, 1:14 am, Robert Lancer wrote: > Humm, Im not sure this would work but maybe you could use a transfer > or send redirect to do the upload since the blob store upload URL is > within your app. > > On Sep 13, 3:08 pm, Lucian Baciu wrote: > > > > > > > > > What I meant is actually send POST requests using the URL Fetch API to the > > blobstore. I've done a test and the request limit does apply :( so I can't > > send files larger then 1MB in size. > > My app has a dropbox servlet (i.e. users send emails to the app with > > attachments) and my app saves these attachments to the blobstore, this is > > the reason why I need to call the blobstore service from a servlet. > > So it would be so great if you would remove this limit at least for requests > > send to the blobstore or offer some other way to archive this. > > > Thank you, > > Lucian > > > On Mon, Sep 13, 2010 at 9:58 PM, Ikai Lan (Google) > > > > > > wrote: > > > No. You will be able to upload large files to the blobstore. > > > > On Mon, Sep 13, 2010 at 6:54 AM, Lucian Baciu > > > wrote: > > > >> Does the 1MB request limit listed here: > > >>http://code.google.com/appengine/docs/java/urlfetch/overview.html > > >> apply to upload requests send to the blobstore as well? > > > >> Thanks, > > >> Lucian > > > >> -- > > >> You received this message because you are subscribed to the Google Groups > > >> "Google App Engine for Java" group. > > >> To post to this group, send email to > > >> google-appengine-j...@googlegroups.com. > > >> To unsubscribe from this group, send email to > > >> google-appengine-java+unsubscr...@googlegroups.com > >> unsubscr...@googlegroups.com> > > >> . > > >> For more options, visit this group at > > >>http://groups.google.com/group/google-appengine-java?hl=en. > > > > -- > > > You received this message because you are subscribed to the Google Groups > > > "Google App Engine for Java" group. > > > To post to this group, send email to > > > google-appengine-j...@googlegroups.com. > > > To unsubscribe from this group, send email to > > > google-appengine-java+unsubscr...@googlegroups.com > > unsubscr...@googlegroups.com> > > > . > > > For more options, visit this group at > > >http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: 1MB URL Fetch limit and blobstore service
Hi Lucian Can you give some more details on how you worked around this issue. Did you use a RequestDispatcher.forward to redirect your dropbox request server side to the blob upload url. Presumably you had to rewrite the request data? Was your original request in mulitpart/form-data or did you have to construct that server side too? Or some other mechanism? Our app is also going to be affected by this issue. Our app has some tasks managed on the task queue that will need to write files > 1MB to the blobstore. Really wish Google would sort out this issue. There is a BlobstoreInputStream interface for reading from the Blobstore serverside, so why not a BlobstoreOutputStream for writing to the Blobstore from our apps. Seems crazy that the only way we can serve large files is directly from the blobstore, but our apps cannot get the files in there easily. Thanks for any info you can give. Martin -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: 1MB URL Fetch limit and blobstore service
Hi Martin, Yes, I used RequestDispatcher.forward to redirect to the blobstore URL. Yes, I had to rewrite the request using HttpServletRequestWrapper to set the "Content-Type" header to multipart-form-data and set the body data. Unfortunately, this only worked on the development server, when deployed I ran into this issue: http://code.google.com/p/googleappengine/issues/detail?id=3241 Now, I got it working by sending a new request to the blobstore URL using the URL Fetch API. Sadly, the 1MB limit now applies to these requests. Lucian On Wed, Sep 29, 2010 at 6:25 PM, Martin Bayly wrote: > Hi Lucian > > Can you give some more details on how you worked around this issue. Did > you use a RequestDispatcher.forward to redirect your dropbox request server > side to the blob upload url. Presumably you had to rewrite the request data? > Was your original request in mulitpart/form-data or did you have to > construct that server side too? Or some other mechanism? > > Our app is also going to be affected by this issue. Our app has some tasks > managed on the task queue that will need to write files > 1MB to the > blobstore. > > > Really wish Google would sort out this issue. > There is a BlobstoreInputStream interface for reading from the Blobstore > serverside, so why not a BlobstoreOutputStream for writing to the Blobstore > from our apps. Seems crazy that the only way we can serve large files is > directly from the blobstore, but our apps cannot get the files in there > easily. > > Thanks for any info you can give. > Martin > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine for Java" group. > To post to this group, send email to > google-appengine-j...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine-java+unsubscr...@googlegroups.com > . > For more options, visit this group at > http://groups.google.com/group/google-appengine-java?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
