in case it affects anyone else, one line fixes it: Index: google/appengine/tools/bulkloader.py =================================================================== --- google/appengine/tools/bulkloader.py (revision 142) +++ google/appengine/tools/bulkloader.py (working copy) @@ -698,6 +698,8 @@ transfer_time) sys.stdout.write('.') sys.stdout.flush() + # Since we had at least one successful transfer, we could assume DNS errors are transient + non_fatal_error_codes.add(-2) status = adaptive_thread_pool.WorkItem.SUCCESS if transfer_time <= MAXIMUM_INCREASE_DURATION: instruction = adaptive_thread_pool.ThreadGate.INCREASE
BTW, is there a nice constant for this kind of error? Adding a -2 to the set seems dirty, to say the least. 2011/1/22 Ricardo Bánffy <rban...@gmail.com>: > Hi. > > I have been, for the past couple days, to download data from the live > app to my local development copy. Every time, sometimes a couple hours > and gigabytes into the download, I get a > > .................[INFO ] An error occurred. Shutting down... > ..[ERROR ] Error in Thread-8: <urlopen error (-2, 'Name or service > not known')> > > [INFO ] Have 210 entities, 0 previously transferred > [INFO ] 210 entities (2145028 bytes) transferred in 54.4 seconds > > message. > > I assume a try/except with a couple retries around it would fix the > problem - as it looks like a transient DNS failure - and I'll dig > deeper into appcfg.py's code tomorrow in order to fix this, but, > before I do, has anyone fixed this before? > > BTW, I'm running 1.4.1 on Ubuntu 10.10 with a built-from-sources > Python 2.5.5 (Ubuntu doesn't package it anymore). -- Ricardo Bánffy http://www.dieblinkenlights.com http://twitter.com/rbanffy -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.