Glad it could be of help! I need to free up some time to write some more articles. I've got all these ideas in mind ...
-- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Fri, Dec 17, 2010 at 12:56 AM, Toby <toby.ro...@gmail.com> wrote: > Hi, > > I found this great tutorial from Ikai. it explains how to use the > Mapper API to import large CSV files from the blob store to the > datastore. > So it is essentially what I was looking for. > Here the link for those who might have the same need: > > http://ikaisays.com/2010/08/11/using-the-app-engine-mapper-for-bulk-data-import > > Cheers, > Toby > > On Dec 2, 6:53 pm, Didier Durand <durand.did...@gmail.com> wrote: > > Hi, > > > > you have to distinguish between a Blob stored in Datastore whose limit > > is 1 Mbyte and a blob stored in the blobstore whose limit is 2 Gbytes > > > > For the blob in the blobstore you access it by chunks via the api: see > > the byte range inhttp:// > code.google.com/appengine/docs/java/blobstore/overview.html#Se... > > > > To read those chunks, you have to use the BlobstoreInputStream and its > > read() method. > Seehttp://code.googlecom/appengine/docs/java/javadoc/com/google/appengin... > > > > regards > > didier > > > > On Dec 2, 6:23 pm, Toby <toby.ro...@gmail.com> wrote: > > > > > Hi, > > > > > I am trying to figure out how to programatically process a file from > > > the BlobStore. It is a CSV file of about 100MB. I read that the limit > > > is 1MB but I have seen in Pyton that it can be read partially (they > > > call it BlobReader). > > > Is this a feature currently not available in Java? Or is there a way I > > > can process this data step by step using the task-queue? > > > > > Thank you, > > > Toby > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine for Java" group. > To post to this group, send email to > google-appengine-j...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine-java+unsubscr...@googlegroups.com<google-appengine-java%2bunsubscr...@googlegroups.com> > . > For more options, visit this group at > http://groups.google.com/group/google-appengine-java?hl=en. > > -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
