I agree, that's totally a problem. I can cope with that though, if only I could restore my backups!
On 16 May 2013 22:05, troberti <tij...@firigames.com> wrote: > A similar problem (or the same problem) is when you edit (ie. save) a > entity with a compressed property in the Datastore viewer. The compressed > property cannot be loaded afterwards. I have filed an issue on the ndb > issue tracker: > http://code.google.com/p/appengine-ndb-experiment/issues/detail?id=202but it > does not seem to be high priority. > > On Thursday, May 16, 2013 1:38:25 PM UTC+2, Emlyn wrote: >> >> Hi, >> >> Python 2.7, ndb. This probably requires someone from the appengine team. >> >> I'm getting inconsistent failures when restoring instances of this object >> from backup: >> >> class Event(ndb.Model): >> dtStored = ndb.DateTimeProperty(auto_now_**add = True) >> strType = ndb.StringProperty() >> keyClient = ndb.KeyProperty() >> keyAssertingPrincipal = ndb.KeyProperty() >> txtData = ndb.TextProperty(compressed = True) >> keysRelated = ndb.StringProperty(repeated = True) >> version = ndb.IntegerProperty() >> >> It's the only type that causes problems. >> >> When I restore it, the mapreduce tasks fail (see below). I do get a >> handful of objects (less than 20, when there are a couple of thousand). >> >> Of the objects that do load, there's another issue; the blobs don't know >> they're compressed, and load incorrectly. The issue is detailed here: >> https://code.google.com/**p/googleappengine/issues/**detail?id=8599<https://code.google.com/p/googleappengine/issues/detail?id=8599> >> >> I've actually got a workaround for that, so the only real problem is that >> all the objects don't load. >> >> datastore_backup_restore_**datastore_backup_2013_05_16Job >> #15811165735318781AA47 >> Processed items per shard >> Overview >> >> - Failed >> - Elapsed time: 00:03:25 >> - Start time: 16/5/2013 20:54:09 >> - files: ["/blobstore/**AMIfv97SZ99dXOQM_** >> mnRvAM0zq46DVrNbtTIgHNldiWKhvZ**m_Gya_**gaAaaH8FmUO44MyCgd7uWIlE4zjC3N >> **nLuw0w3v8aU2GZxOellbwnMjPoy4Ld**yKhI_TAL9xFFi60UGLfYXIILT-** >> g0PHyfs6HvbqOslDqxNf7eKRGyg-**KZTJZnbLrZ6AV46Y","/blobstore/** >> AMIfv95f1-**rDfkt9mU8tpjDSZFItFygt0T8wudsK** >> bQzZGyZJZXOGLQTQylONwc9hpQJioJ**X3OIV8OJ2XmPLrP4I23BXefgTVyt6F** >> tc7Hnk2kmnFIVXcDaFwBsYwvjGKhwv**Y2aYicSM6W7MuED1XuXZFEIEUq378d** >> 7I50Nqa7wyADoS7ZTvxJvvA","/**blobstore/AMIfv95J9-** >> gr38xASdG532e6PRzVbRzgCpcofSM9**bkHBUjJp4LlpfdbeUavUxBcd8gNxNj** >> a6is5H5QNNWpD3NgU_AYIP1-0zC4-**fLcGq2_mBS-fKg_** >> owihzibI8p35RW5yQK8s6XHS4MGGyx**Yw9IKZcLvknqJ6ZTLcW2ZqqhaXL_** >> 5dH8l1nrrvI","/blobstore/**AMIfv94yitrEvcVwe0qUNegoTxu3_**IRqknWnvy_** >> iEieoaMVgjA1jbMoU31hMS4zcN8Rfb**6-**nehAhrL1A02d9HIz2v6O76Az9w98-** >> iXW2tIc4DU8HX5Yw-59T2-**IVF3kdK60UQM7nebsboVZMKzFZ5Bub**NGXEATlN0EV_** >> jYc6Mx3fXiN3MOcaXrg","/**blobstore/**AMIfv95igj5MqPIMPYte9O_** >> yyRvlWFApsDquW-**XKXYKtbB36PCcnoJdG1fkefapX6ijn**SMoSTaF_** >> NnEVqcZF7dNuTQNoUnbAOOHzDwDuZp**X1pNIrPzPXP3IGBChjEvknB6SfTQXA** >> G8MhU5CSpj4qztyYeGQRpAAaF0UyGN**OGj0QO3IYh0hXWgQ8","/**blobstore/** >> AMIfv96E9ULQbP0LocTy9gcPyRcS3R**6kSlcmeWsCbFSLd_Gmyqq-1tX-** >> IyBZL_TKYYsqNSe9_**T9usaVsGAHVj9BpCd76SLiDG3vrebq** >> mfiFQt91sizGRQKUoIqjDvB6jBX5cn**2wMwAzgaj19hOyhU9mKW7ooLIZkbNb** >> Op2Udf4hueV8mbvBCwJY","/**blobstore/**AMIfv96ruBqhkI3QHpegsd-** >> SM2kM1RM9xOpyVggJRJHNJe5guB7F9**Yzz9DkfADvX4JqrbJl8TwXuRtZZP2O**_** >> 27oHSSVu2zdErd7D2pUBuZod5ivm7G**l7jg7FdiSdgaaKQw6PZSTj_** >> CGVZ55PMdCgy7hrtjaqQLBbqmoVCcs**5u1mo-diZ3QDYyZY","/blobstore/** >> AMIfv9432ZpwBD6v_**0LqKKtDmoShp0XndRJSl-R_** >> DUHUleVp12EbIR0cxPGUsnZcnEGRFD**sDd0PsfvDiWjUsYKZUY_LPko_** >> gcKdIvEEKDOHbLm8jp3ESTdSUAosFI**ja-3-JJWJnqgaumeGbw9_** >> >> Kmv6wCB27os1i203v61d1PCNL5jYVP**iqYTcno"]Collapse<https://ah-builtin-python-bundle-dot-tes-test-eca.appspot.com/_ah/mapreduce/detail?mapreduce_id=15811165735318781AA47> >> - kind_filter: ["Event"] >> - namespace: null >> - original_app: null >> >> Counters >> >> - io-read-bytes: 28696 (139.98/**sec avg.) >> - io-read-msec: 410 (2/sec avg.) >> - mapper-calls: 29 (0.14/sec avg.) >> >> Mapper status ShardStatusDescriptionLast work itemTime elapsed 0 >> failed[u'/blobstore/ >> **AMIfv97SZ99dXOQM_**mnRvAM0zq46DVrNbtTIgHNldiWKhvZ**m_Gya_** >> gaAaaH8FmUO44MyCgd7uWIlE4zjC3N**nLuw0w3v8aU2GZxOellbwnMjPoy4Ld** >> yKhI_TAL9xFFi60UGLfYXIILT-**g0PHyfs6HvbqOslDqxNf7eKRGyg-** >> KZTJZnbLrZ6AV46Y']:0 'jXj\x0es~tes-test-ecarF\x0b\** >> x12\teventtype"\x08assessor\**x0c\x0b\x12\x05Event"$** >> 870ad402-6e77-4f49-80 00:03:00 1 failed [u'/blobstore/AMIfv95f1-** >> rDfkt9mU8tpjDSZFItFygt0T8wudsK**bQzZGyZJZXOGLQTQylONwc9hpQJioJ** >> X3OIV8OJ2XmPLrP4I23BXefgTVyt6F**tc7Hnk2kmnFIVXcDaFwBsYwvjGKhwv** >> Y2aYicSM6W7MuED1XuXZFEIEUq378d**7I50Nqa7wyADoS7ZTvxJvvA']:0'jXj\x0es~tes-test-ecarF\x0b\ >> **x12\teventtype"\x08assessor\**x0c\x0b\x12\x05Event"$** >> 0492ea38-82d4-4554-86 00:03:00 2 failed [u'/blobstore/AMIfv95J9-** >> gr38xASdG532e6PRzVbRzgCpcofSM9**bkHBUjJp4LlpfdbeUavUxBcd8gNxNj** >> a6is5H5QNNWpD3NgU_AYIP1-0zC4-**fLcGq2_mBS-fKg_** >> owihzibI8p35RW5yQK8s6XHS4MGGyx**Yw9IKZcLvknqJ6ZTLcW2ZqqhaXL_** >> 5dH8l1nrrvI']:0 'jXj\x0es~tes-test-ecarF\x0b\** >> x12\teventtype"\x08assessor\**x0c\x0b\x12\x05Event"$** >> bd85aa67-7dce-4661-a6 00:03:01 3 failed [u'/blobstore/** >> AMIfv94yitrEvcVwe0qUNegoTxu3_**IRqknWnvy_**iEieoaMVgjA1jbMoU31hMS4zcN8Rfb >> **6-**nehAhrL1A02d9HIz2v6O76Az9w98-**iXW2tIc4DU8HX5Yw-59T2-** >> IVF3kdK60UQM7nebsboVZMKzFZ5Bub**NGXEATlN0EV_**jYc6Mx3fXiN3MOcaXrg']:0'jXj\x0es~tes-test-ecarF\x0b\ >> **x12\teventtype"\x08assessor\**x0c\x0b\x12\x05Event"$** >> a78573d4-a20a-4fcd-80 00:03:00 4 failed [u'/blobstore/** >> AMIfv95igj5MqPIMPYte9O_**yyRvlWFApsDquW-**XKXYKtbB36PCcnoJdG1fkefapX6ijn* >> *SMoSTaF_**NnEVqcZF7dNuTQNoUnbAOOHzDwDuZp**X1pNIrPzPXP3IGBChjEvknB6SfTQXA >> **G8MhU5CSpj4qztyYeGQRpAAaF0UyGN**OGj0QO3IYh0hXWgQ8']:0'jAj\x0es~tes-test-ecar/\x0b\ >> **x12\x05Event"$af4f00c3-388e-**4d2a-b6ea-ae9ab1df11cc\x0cr\** >> x19\x08\x07\x1a 00:03:00 5 failed [u'/blobstore/** >> AMIfv96E9ULQbP0LocTy9gcPyRcS3R**6kSlcmeWsCbFSLd_Gmyqq-1tX-** >> IyBZL_TKYYsqNSe9_**T9usaVsGAHVj9BpCd76SLiDG3vrebq** >> mfiFQt91sizGRQKUoIqjDvB6jBX5cn**2wMwAzgaj19hOyhU9mKW7ooLIZkbNb** >> Op2Udf4hueV8mbvBCwJY']:0 'jXj\x0es~tes-test-ecarF\x0b\** >> x12\teventtype"\x08assessor\**x0c\x0b\x12\x05Event"$** >> 52b0c2a9-0006-488d-95 00:03:01 6 failed [u'/blobstore/** >> AMIfv96ruBqhkI3QHpegsd-**SM2kM1RM9xOpyVggJRJHNJe5guB7F9** >> Yzz9DkfADvX4JqrbJl8TwXuRtZZP2O**_**27oHSSVu2zdErd7D2pUBuZod5ivm7G** >> l7jg7FdiSdgaaKQw6PZSTj_**CGVZ55PMdCgy7hrtjaqQLBbqmoVCcs** >> 5u1mo-diZ3QDYyZY']:0 'jTj\x0es~tes-test-ecarB\x0b\** >> x12\teventtype"\x04user\x0c\**x0b\x12\x05Event"$5585675a-** >> 11a9-4fb9-9834-3 00:03:01 7 failed [u'/blobstore/**AMIfv9432ZpwBD6v_** >> 0LqKKtDmoShp0XndRJSl-R_**DUHUleVp12EbIR0cxPGUsnZcnEGRFD** >> sDd0PsfvDiWjUsYKZUY_LPko_**gcKdIvEEKDOHbLm8jp3ESTdSUAosFI** >> ja-3-JJWJnqgaumeGbw9_**Kmv6wCB27os1i203v61d1PCNL5jYVP**iqYTcno']:0 >> >> >> -- >> Emlyn >> >> http://point7.wordpress.com - My blog >> https://plus.google.com/u/0/**100281903174934656260<https://plus.google.com/u/0/100281903174934656260>- >> Google+ >> > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to google-appengine+unsubscr...@googlegroups.com. > To post to this group, send email to google-appengine@googlegroups.com. > Visit this group at http://groups.google.com/group/google-appengine?hl=en. > For more options, visit https://groups.google.com/groups/opt_out. > > > -- Emlyn http://point7.wordpress.com - My blog https://plus.google.com/u/0/100281903174934656260 - Google+ -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
