[google-appengine] Re: download_data performance?
~970MB right now. On Jun 5, 11:33 am, Barry Hunter wrote: > How big is the data you have already downloaded? > > You should be able to see the size of the file being written to. > > (or find the temporally file its been written to) -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: download_data performance?
How big is the data you have already downloaded? You should be able to see the size of the file being written to. (or find the temporally file its been written to) -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: download_data performance?
Wait, hang on. 2GB of entities. Default bandwidth limit of 250,000 bytes/sec. So, assuming we exactly saturate that limit, it should take ~2 hours 43 minutes. Now, we'll never saturate, so maybe estimate a 2x or even 3x multiple of that time? That's still far less than the 14+ hours my download job has been running. -Dave On Jun 5, 11:03 am, Dave Peck wrote: > I'm not sure how I missed that! Thanks. > > -Dave > > On Jun 5, 10:53 am, c h wrote: > > > > > > > > > by default download_data is throttled. read the docs for appcfg.py to see > > the settings and change them. > > > On Tuesday, June 5, 2012 10:40:55 AM UTC-7, Dave Peck wrote: > > > > I want to download the full database for one of my apps. Entities > > > consume a relatively modest 2GB. (Indexes all told consume 19GB, but > > > my impression is that download_data won't download these?) > > > > appcfg.py download_data has been running now for 12+ hours on a very > > > fast downstream connection. > > > > Is there a faster way to download all data from a GAE app? Some > > > settings I can tweak that might help move things along? > > > > Thanks, > > > Dave -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: download_data performance?
I'm not sure how I missed that! Thanks. -Dave On Jun 5, 10:53 am, c h wrote: > by default download_data is throttled. read the docs for appcfg.py to see > the settings and change them. > > > > > > > > On Tuesday, June 5, 2012 10:40:55 AM UTC-7, Dave Peck wrote: > > > I want to download the full database for one of my apps. Entities > > consume a relatively modest 2GB. (Indexes all told consume 19GB, but > > my impression is that download_data won't download these?) > > > appcfg.py download_data has been running now for 12+ hours on a very > > fast downstream connection. > > > Is there a faster way to download all data from a GAE app? Some > > settings I can tweak that might help move things along? > > > Thanks, > > Dave -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: download_data performance?
by default download_data is throttled. read the docs for appcfg.py to see the settings and change them. On Tuesday, June 5, 2012 10:40:55 AM UTC-7, Dave Peck wrote: > > I want to download the full database for one of my apps. Entities > consume a relatively modest 2GB. (Indexes all told consume 19GB, but > my impression is that download_data won't download these?) > > appcfg.py download_data has been running now for 12+ hours on a very > fast downstream connection. > > Is there a faster way to download all data from a GAE app? Some > settings I can tweak that might help move things along? > > Thanks, > Dave > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/GEu7C0GegeQJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
