Hi I am trying to download all of the datastore objects in my application with the bulkloader and then upload them into a different application.
I use this command to download: bulkloader.py --dump --app_id=jsm277 --url=http://bulkmove.latest.jsm277.appspot.com/remote_api --filename=test_download_data and I get this output: /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py:64: DeprecationWarning: the sha module is deprecated; use the hashlib module instead import sha /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/dev_appserver_login.py:33: DeprecationWarning: the md5 module is deprecated; use hashlib instead import md5 [INFO ] Logging to bulkloader-log-20100313.160710 [INFO ] Throttling transfers: [INFO ] Bandwidth: 250000 bytes/second [INFO ] HTTP connections: 8/second [INFO ] Entities inserted/fetched/modified: 20/second [INFO ] Opening database: bulkloader-progress-20100313.160710.sql3 [INFO ] Opening database: bulkloader-results-20100313.160710.sql3 [INFO ] Connecting to bulkmove.latest.jsm277.appspot.com/remote_api [INFO ] Downloading kinds: [u'Blogs', u'Posts', u'Blog', u'Person', u'Post', u'_ah_SESSION'] ......[INFO ] _ah_SESSION: No descending index on __key__, performing serial download .................................................................................................................................................................................................................... [INFO ] Have 21307 entities, 0 previously transferred [INFO ] 21307 entities (7414423 bytes) transferred in 1063.4 seconds Then I use this command to upload to my new application: bulkloader.py --restore --url=http://bulkmove.latest.railsturbinetest.appspot.com/ --filename=test_download_data --app_id=railsturbinetest And this is the output that I am getting: Josh-Moores-MacBook:datadownload joshmoore$ bulkloader.py --restore --url=http://bulkmove.latest.railsturbinetest.appspot.com/ --filename=test_download_data --app_id=railsturbinetest ~/Documents/code/new_rails_turbine/ /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py:64: DeprecationWarning: the sha module is deprecated; use the hashlib module instead import sha /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/dev_appserver_login.py:33: DeprecationWarning: the md5 module is deprecated; use hashlib instead import md5 [INFO ] Logging to bulkloader-log-20100313.164108 [INFO ] Throttling transfers: [INFO ] Bandwidth: 250000 bytes/second [INFO ] HTTP connections: 8/second [INFO ] Entities inserted/fetched/modified: 20/second [INFO ] Opening database: bulkloader-progress-20100313.164108.sql3 [INFO ] Connecting to bulkmove.latest.railsturbinetest.appspot.com/ Traceback (most recent call last): File "/usr/local/bin/bulkloader.py", line 68, in <module> run_file(__file__, globals()) File "/usr/local/bin/bulkloader.py", line 64, in run_file execfile(script_path, globals_) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 4031, in <module> sys.exit(main(sys.argv)) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 4027, in main return _PerformBulkload(arg_dict) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 3880, in _PerformBulkload return_code = app.Run() File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 3170, in Run kinds = self.RunPostAuthentication() File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 3278, in RunPostAuthentication self.request_manager.IncrementId(list(ancestor_path), kind, high_id) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 1215, in IncrementId start, end = datastore.AllocateIds(model_key, 1) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/datastore.py", line 1481, in AllocateIds datastore_pb.AllocateIdsResponse(), rpc) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/datastore.py", line 177, in _MakeSyncCall rpc.check_success() File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/apiproxy_stub_map.py", line 474, in check_success self.__rpc.CheckSuccess() File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/apiproxy_rpc.py", line 149, in _WaitImpl self.request, self.response) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py", line 226, in MakeSyncCall response) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py", line 155, in MakeSyncCall self._MakeRealSyncCall(service, call, request, response) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py", line 168, in _MakeRealSyncCall response_pb.ParseFromString(encoded_response) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/net/proto/ProtocolBuffer.py", line 58, in ParseFromString self.MergeFromString(s) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/net/proto/ProtocolBuffer.py", line 71, in MergeFromString self.Merge(d) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/net/proto/ProtocolBuffer.py", line 175, in Merge self.TryMerge(d) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_pb.py", line 473, in TryMerge d.skipData(tt) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/net/proto/ProtocolBuffer.py", line 414, in skipData raise ProtocolBufferDecodeError, "corrupted" google.net.proto.ProtocolBuffer.ProtocolBufferDecodeError: corrupted I am using the Java SDK, but I am not sure if that makes a difference. I have completed the download twice and get the same message about corruption each time when I try to restore it. Can anybody point me in the write direction to figure out this problem? Thanks, Josh -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
