This issue is being discussed on " PreparedQuery.countEntities() clarifications" http://groups.google.com/group/google-appengine-java/browse_thread/thread/f97bdd5bdf91c114/486958d3b4da1310#486958d3b4da1310
On Oct 30, 1:31 pm, Pion <onlee2...@gmail.com> wrote: > I went to Admin Console -> DataStore -> Statistics. It shows that I > have stored more than 1,000 entities. It confirms that the method > below stores entities correctly. > > I need to look at the code that retrieves the entity why it is saying > that it is only 1,000. I just found out this > dochttp://code.google.com/appengine/docs/java/datastore/stats.html > > On Oct 30, 11:58 am, Pion <onlee2...@gmail.com> wrote: > > > I can store a few thousands of entities incrementally in Development > > Server environment using the method below. > > > public void add(List<String> iriList, List<String> nameList, > > List<String> imageList) { > > int counter = 0; > > ArrayList<Entity> eList = new ArrayList<Entity>(); > > for (int index=0; index<iriList.size(); index++) { > > Entity e = createEntity(iriList.get(index), > > nameList.get(index), > > imageList.get(index)); // e should be less than 1,000 bytes each > > eList.add(e); > > > counter++; // Break down the storing to DS_LIMIT > > each due to > > Google limitation/quotas > > if ((counter % CUtility.DS_LIMIT) == 0) { // > > DS_LIMIT = 200 > > logger.info("Storing " + > > Integer.toString(counter) + " IRIs."); > > datastore.put(eList); // Store in > > batch > > eList = new ArrayList<Entity>(); // Reset > > the array > > } // if > > > } // for > > > if (eList.size() > 0) > > datastore.put(eList); // Store in batch > > > logger.info("Storing " + Integer.toString(counter) + " > > IRIs."); > > > } > > > But when using it in deployed environment, it can only store 1,000 > > entities. It never adds beyond it. It does not hit the 30-second > > limitation because I call it incrementally. After having 1,000 > > entities, I tried to add more. Below is the log from the deployed > > server and verified it stored additional 225 entities without throwing > > any exception. > > > I 10-30 11:38AM 02.852 com.col.server.tool.DsWriter writeIri: Writing > > 225 to MDsIri > > I 10-30 11:38AM 02.867 com.col.server.MDsIri add: Storing 200 IRIs. > > I 10-30 11:38AM 04.551 com.col.server.MDsIri add: Storing 225 IRIs. > > I 10-30 11:38AM 04.551 com.col.server.tool.DsWriter writeIri: > > Done **************************************** > > > Do I have to do something differently in deployed environment? Any > > configuration changes or something? What did I do wrong? I know some > > people have stored millions of entities successfully. > > > Thanks in advance for your help. --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-java@googlegroups.com To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en -~----------~----~----~----~------~----~------~--~---
