Yeah, I got it working. I guess --dry_run didn't work so I just went all out and took it right to production, things don't seem to be broken.
On Mon, Mar 15, 2010 at 5:57 PM, Eli Jones <eli.jo...@gmail.com> wrote: > oh.. here's a question for you. > > Are you running the bulkloader.py from the main google_appengine folder? > > For me.. I always make sure I am in the google_appengine/ folder before > running bulkloader. > > Otherwise, you may need to fiddle with your path. > > Also, this is all assuming that the remote_api is correctly set up and > deployed for your app. > > > On Mon, Mar 15, 2010 at 8:40 PM, Patrick Twohig <patr...@namazustudios.com > > wrote: > >> Still having that issue :( I'm gonna grok the docs a little more. >> >> >> On Mon, Mar 15, 2010 at 5:06 PM, Eli Jones <eli.jo...@gmail.com> wrote: >> >>> to be sure.. you should probably run it using python2.5 to run the >>> bulkloader. >>> >>> on my machine which came with 2.6 automatically installed, i just did: >>> >>> apt-get install python2.5 >>> >>> and then I run --dumps like so: >>> >>> # python2.5 bulkloader.py --dump --url= >>> http://myapp.appspot.com/remote_api --filename=myapp.dump >>> --batch_size=100 >>> >>> On Mon, Mar 15, 2010 at 7:57 PM, Patrick Twohig < >>> patr...@namazustudios.com> wrote: >>> >>>> I'm trying to bulkload data from my app, but it fails on this call. I >>>> browsed through the archives and found a post by Nick Johnson earlier and >>>> he >>>> suggested changing the fetch limit per request, but that didn't seem to see >>>> much. Any suggestions? I'm thinking that I just forgot to set some >>>> environment variable or something. >>>> >>>> Thanks, >>>> Pat. >>>> >>>> Full trace: >>>> patr...@gentoo ~/test/test_gae_bulkload $ bulkloader.py --batch_size=2 >>>> --dry_run --filename=backup.csv --dump --url= >>>> http://1.latest.myapp.appspot.com/remote_api >>>> /home/patrick/gae/google_appengine-1.3.1/google/appengine/ext/remote_api/remote_api_stub.py:64: >>>> DeprecationWarning: the sha module is deprecated; use the hashlib module >>>> instead >>>> import sha >>>> /home/patrick/gae/google_appengine-1.3.1/google/appengine/tools/dev_appserver_login.py:33: >>>> DeprecationWarning: the md5 module is deprecated; use hashlib instead >>>> import md5 >>>> [INFO ] Logging to bulkloader-log-20100315.162913 >>>> [INFO ] Throttling transfers: >>>> [INFO ] Bandwidth: 250000 bytes/second >>>> [INFO ] HTTP connections: 8/second >>>> [INFO ] Entities inserted/fetched/modified: 20/second >>>> [INFO ] Opening database: bulkloader-progress-20100315.162913.sql3 >>>> [INFO ] Opening database: bulkloader-results-20100315.162913.sql3 >>>> [INFO ] Running in dry run mode, skipping remote_api setup >>>> [INFO ] Connecting to 1.latest.myapp.appspot.com/remote_api >>>> Traceback (most recent call last): >>>> File "/home/patrick/gae/current/bulkloader.py", line 68, in <module> >>>> run_file(__file__, globals()) >>>> File "/home/patrick/gae/current/bulkloader.py", line 64, in run_file >>>> execfile(script_path, globals_) >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/tools/bulkloader.py", >>>> line 4031, in <module> >>>> sys.exit(main(sys.argv)) >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/tools/bulkloader.py", >>>> line 4027, in main >>>> return _PerformBulkload(arg_dict) >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/tools/bulkloader.py", >>>> line 3913, in _PerformBulkload >>>> return_code = app.Run() >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/tools/bulkloader.py", >>>> line 3170, in Run >>>> kinds = self.RunPostAuthentication() >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/tools/bulkloader.py", >>>> line 3314, in RunPostAuthentication >>>> return self.request_manager.GetSchemaKinds() >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/tools/bulkloader.py", >>>> line 1222, in GetSchemaKinds >>>> global_stat = stats.GlobalStat.all().get() >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/ext/db/__init__.py", >>>> line 1564, in get >>>> results = self.fetch(1, rpc=rpc) >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/ext/db/__init__.py", >>>> line 1616, in fetch >>>> raw = raw_query.Get(limit, offset, rpc=rpc) >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/api/datastore.py", >>>> line 1183, in Get >>>> limit=limit, offset=offset, prefetch_count=limit, >>>> **kwargs)._Get(limit) >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/api/datastore.py", >>>> line 1110, in _Run >>>> datastore_pb.QueryResult(), rpc) >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/api/datastore.py", >>>> line 173, in _MakeSyncCall >>>> rpc = CreateRPC(service) >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/api/datastore.py", >>>> line 192, in CreateRPC >>>> return DatastoreRPC(service, deadline, callback) >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/api/apiproxy_stub_map.py", >>>> line 345, in __init__ >>>> self.__rpc = CreateRPC(service) >>>> File >>>> "/home/patrick/gae/google_appengine-1.3.1/google/appengine/api/apiproxy_stub_map.py", >>>> line 54, in CreateRPC >>>> assert stub, 'No api proxy found for service "%s"' % service >>>> AssertionError: No api proxy found for service "datastore_v3" >>>> >>>> >>>> -- >>>> Patrick H. Twohig. >>>> >>>> Namazu Studios >>>> P.O. Box 34161 >>>> San Diego, CA 92163-4161 >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "Google App Engine" group. >>>> To post to this group, send email to google-appeng...@googlegroups.com. >>>> To unsubscribe from this group, send email to >>>> google-appengine+unsubscr...@googlegroups.com<google-appengine%2bunsubscr...@googlegroups.com> >>>> . >>>> For more options, visit this group at >>>> http://groups.google.com/group/google-appengine?hl=en. >>>> >>> >>> -- >>> You received this message because you are subscribed to the Google Groups >>> "Google App Engine" group. >>> To post to this group, send email to google-appeng...@googlegroups.com. >>> To unsubscribe from this group, send email to >>> google-appengine+unsubscr...@googlegroups.com<google-appengine%2bunsubscr...@googlegroups.com> >>> . >>> For more options, visit this group at >>> http://groups.google.com/group/google-appengine?hl=en. >>> >> >> >> >> -- >> Patrick H. Twohig. >> >> Namazu Studios >> P.O. Box 34161 >> San Diego, CA 92163-4161 >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appeng...@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com<google-appengine%2bunsubscr...@googlegroups.com> >> . >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com<google-appengine%2bunsubscr...@googlegroups.com> > . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- Patrick H. Twohig. Namazu Studios P.O. Box 34161 San Diego, CA 92163-4161 -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.