[google-appengine] A few entities disappeared for no apparent reason

2012-08-30 Thread Scott

At 5:31PM PST last Saturday, August 25th, our app, write-way, started 
generating a bunch of errors as the system stopped being able to find a 
handful of our most commonly accessed entities. These sorts of entities are 
never deleted, and I checked through the code (though I can't guarantee 
there isn't some bug in the code) and couldn't find any instances of these 
entities being deleted. Also these entities have been used for going on 
four years now and we've never seen this happen before. Luckily we were 
able to restore most the data that was missing, but since then there have 
no more such losses, and we still can't find a reason for this data going 
missing, and we're worried now that some other entities that are less 
visible are also gone.

Are there any instances of entities just going missing? There's no 
particular connection between the seven of them that we were able to 
identify were missing, except that they seem to have gone at about the same 
exact time, and we can pinpoint that time. And it was only a handful as far 
as we know. We'll keep looking for a reason, tighten up our security, and 
work on having better backup systems, but basically was wondering if 
there's anything Google-side that might help explain this, or if anyone 
else has experienced something like this.

If it's any help, here are the keys:

[datastore_types.Key.from_path(u'VocabListInfo', 47892865, 
_app=u's~write-way'),
 datastore_types.Key.from_path(u'VocabListInfo', 37347661, 
_app=u's~write-way'),
 datastore_types.Key.from_path(u'VocabListInfo', 108027294, 
_app=u's~write-way'),
 datastore_types.Key.from_path(u'VocabListInfo', 47828570, 
_app=u's~write-way'),
 datastore_types.Key.from_path(u'VocabListInfo', 99447023, 
_app=u's~write-way'),
 datastore_types.Key.from_path(u'VocabListInfo', 47846448, 
_app=u's~write-way'),
 datastore_types.Key.from_path(u'VocabListInfo', 89472006, 
_app=u's~write-way')]

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/5AGALmBQoRQJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] A few entities disappeared for no apparent reason

2012-08-30 Thread Takashi Matsuo
Hi Scott,

Are you accessing those entities by getting by keys, or by queries?

-- Takashi


On Fri, Aug 31, 2012 at 12:08 AM, Scott  wrote:

>
> At 5:31PM PST last Saturday, August 25th, our app, write-way, started
> generating a bunch of errors as the system stopped being able to find a
> handful of our most commonly accessed entities. These sorts of entities are
> never deleted, and I checked through the code (though I can't guarantee
> there isn't some bug in the code) and couldn't find any instances of these
> entities being deleted. Also these entities have been used for going on
> four years now and we've never seen this happen before. Luckily we were
> able to restore most the data that was missing, but since then there have
> no more such losses, and we still can't find a reason for this data going
> missing, and we're worried now that some other entities that are less
> visible are also gone.
>
> Are there any instances of entities just going missing? There's no
> particular connection between the seven of them that we were able to
> identify were missing, except that they seem to have gone at about the same
> exact time, and we can pinpoint that time. And it was only a handful as far
> as we know. We'll keep looking for a reason, tighten up our security, and
> work on having better backup systems, but basically was wondering if
> there's anything Google-side that might help explain this, or if anyone
> else has experienced something like this.
>
> If it's any help, here are the keys:
>
> [datastore_types.Key.from_path(u'VocabListInfo', 47892865,
> _app=u's~write-way'),
>  datastore_types.Key.from_path(u'VocabListInfo', 37347661,
> _app=u's~write-way'),
>  datastore_types.Key.from_path(u'VocabListInfo', 108027294,
> _app=u's~write-way'),
>  datastore_types.Key.from_path(u'VocabListInfo', 47828570,
> _app=u's~write-way'),
>  datastore_types.Key.from_path(u'VocabListInfo', 99447023,
> _app=u's~write-way'),
>  datastore_types.Key.from_path(u'VocabListInfo', 47846448,
> _app=u's~write-way'),
>  datastore_types.Key.from_path(u'VocabListInfo', 89472006,
> _app=u's~write-way')]
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/5AGALmBQoRQJ.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>



-- 
Takashi Matsuo | Developers Advocate | tmat...@google.com

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.