Have you looked into using the Remote API https://developers.google.com/appengine/docs/python/tools/remoteapi https://developers.google.com/appengine/articles/remote_api
You use your local machine to parse the file [no memory problems], create the needed objects, and put them in the datastore in batches. You can use a modified class Mapper to do the batch write as found in https://developers.google.com/appengine/articles/deferred -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
