Thanks John. It worked.
Is there other way to re-create index then re-insert 5 million entities each time we detect problem? We may add more indexes later. Should we re-insert everything again? Here is BeanShell script that re-inserts 500 record (5 second) per request import java.util.Iterator; import java.util.List; import com.google.appengine.api.datastore.DatastoreService; import com.google.appengine.api.datastore.DatastoreServiceFactory; import com.google.appengine.api.datastore.Entity; import com.google.appengine.api.datastore.FetchOptions; import com.google.appengine.api.datastore.Key; import com.google.appengine.api.datastore.KeyFactory; import com.google.appengine.api.datastore.PreparedQuery; import com.google.appengine.api.datastore.Query; DatastoreService ds = DatastoreServiceFactory.getDatastoreService(); Key key = KeyFactory.createKey("Table1", "92417102:2345"); Entity entity1 = ds.get(key); Query query = new Query("Table1"); query.addFilter("cid", Query.FilterOperator.EQUAL, 2345l); query.addFilter("__key__", Query.FilterOperator.GREATER_THAN_OR_EQUAL, key ); FetchOptions options = FetchOptions.Builder.withLimit(500); PreparedQuery p1 = ds.prepare(query); Iterable it = p1.asIterable(options); ds.put(it); On Jan 19, 3:35 pm, John Patterson <jdpatter...@gmail.com> wrote: > Is it possible that some of your entities in Table1 were stored when > cid was declared unindexed? If so you will need to re-store them so > they get indexed in the implicit cid index and also in the custom > index on cid-ctime. > > Whether or not this was the cause of some entities not being included > in the custom index, you should try to re-store those entities that > are missing from your query. > > On 19 Jan 2010, at 20:01, Max wrote: > > > How do we to contact support? > > If we pay money then there must be at least email address where I can > > send email? > > > Basic query does not return every second line that it should return. > > > May be something wrong with index. > > > Please, help > > > On Jan 17, 3:59 pm, Max <max.seven....@gmail.com> wrote: > >> I can't find way to report serious problem. > >> We have uploaded real customer data and there is bug in datastore > >> results. > > >> But I can't find way to send screenshots and queries that will not be > >> seem by everyone. > >> I can't show customer emails or IDs. > > >> In short problem is that when I do following query (I have changed > >> IDs > >> and table names) > > >> SELECT * FROM Table1 WHERE ctime >= DATETIME('2009-12-01 00:00:00') > >> ORDER BY ctime > > >> key - is key > >> cid - is indexed long > >> ctime - is indexed date > > >> first 2 lines are > >> cid:1234 cid:2009-12-01 00:00:37 > >> cid:2345 ctime:2009-12-01 00:01:11 > > >> when I filter it to show cis=2345 only > > >> SELECT * FROM Table1 WHERE cid= 2345 and ctime >= > >> DATETIME('2009-12-01 > >> 00:00:00') ORDER BY ctime > > >> first 2 lines are > >> cid:2345 ctime:2009-12-01 00:03:26 > >> cid:2345 ctime:2009-12-01 00:15:09 > > >> ---- > > >> I expected to see "cid:2345 ctime:2009-12-01 00:01:11 " as > >> first line > >> in second query. > >> But it is missing. > > >> We have uploaded 5,426,307 entities (9 GBytes) data to datastore and > >> our report for December 2009 till now showed that > >> countMissing = 28253 > >> countExists = 17555 > > >> ---- > > >> How can I contact you privately? This data is stored on paid account. > > >> Thanks, Max > > -- > > You received this message because you are subscribed to the Google > > Groups "Google App Engine for Java" group. > > To post to this group, send email to google-appengine-java@googlegroups.com > > . > > To unsubscribe from this group, send email to > > google-appengine-java+unsubscr...@googlegroups.com > > . > > For more options, visit this group > > athttp://groups.google.com/group/google-appengine-java?hl=en > > . > >
-- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.