I was testing my splitting library. I had a 2GB file accessible in my test environment. From that I created a 2GB blob and set it as a property of my Entity. My library then split that property into entities around 1MB each, and then did multiput 500 of those 4 times and then whatever was left on the 5th try. So I didn't run into the limitation, but it was a unit test using test setup. You can see the library here: http://code.google.com/p/mindash-datastore/
One note, I haven't gotten around to posting version 0.8 yet, so 0.7 breaks for sure. But it's minor bugs, the general methodology is there. If you do go in depth on it I would love to get some feedback. Cheers On May 18, 12:45 am, Mouseclicker <jens.h...@googlemail.com> wrote: > This means you make one put() call containing 500 entities summing up > to 2GB, means sending one 2GB RPC internally? > > I would love to see this code... I will try to strip down mine to a > test case and post here for further comments in another reply to this > thread > > On May 18, 12:31 am, Tristan <tristan.slomin...@gmail.com> wrote: > > > > > > > I've been able to multiput 2GB split into 500 entity batches on the > > dev server before. If it's breaking then this would be new. > > > On May 17, 2:12 pm, Mouseclicker <jens.h...@googlemail.com> wrote: > > > > Hi, > > > > it seems that the put() in the datastore call with the Iterable > > > parameter does not work as documented: > > > > From what I read in the documentation it should be possible to store > > > at most 500 entities in one put()-call and each entity having a max. > > > size of 1MB. > > > > But it seems to be implemented in a way that the sum of all entities > > > passed in the put call must not exceed 1MB. Is that intended? > > > > I split large files in chunks of almost 1 MB and for efficiency > > > reasons I want to store multiple Blobs in one put call. But this even > > > fails for two of them with a RequestTooLargeException. > > > > (done on local dev server) > > > > Can someone confirm this behavior? > > > > -- > > > You received this message because you are subscribed to the Google Groups > > > "Google App Engine for Java" group. > > > To post to this group, send email to > > > google-appengine-j...@googlegroups.com. > > > To unsubscribe from this group, send email to > > > google-appengine-java+unsubscr...@googlegroups.com. > > > For more options, visit this group > > > athttp://groups.google.com/group/google-appengine-java?hl=en. > > > -- > > You received this message because you are subscribed to the Google Groups > > "Google App Engine for Java" group. > > To post to this group, send email to google-appengine-j...@googlegroups.com. > > To unsubscribe from this group, send email to > > google-appengine-java+unsubscr...@googlegroups.com. > > For more options, visit this group > > athttp://groups.google.com/group/google-appengine-java?hl=en. > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine for Java" group. > To post to this group, send email to google-appengine-j...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine-java+unsubscr...@googlegroups.com. > For more options, visit this group > athttp://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
