[google-appengine] Limitation on “Exceeded maximum allocated IDs”
*Issue 9110:* Application ID : gochild2009.appspot.com My app is running fine for months. Today it starts to give error on Exceeded maximum allocated IDs with datastore put. Is this something new with appengine quota and limitation? What is the quota for allocated IDs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Limitation on “Exceeded maximum allocated IDs”
*This might be a JDO limitation. Is there a setting to increase maximum allocation IDs?* java.lang.IllegalArgumentException: Exceeded maximum allocated IDs at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:488) at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:736) at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:756) On Thursday, April 4, 2013 3:37:36 PM UTC+8, GoSharp Lite wrote: *Issue 9110:* Application ID : gochild2009.appspot.com My app is running fine for months. Today it starts to give error on Exceeded maximum allocated IDs with datastore put. Is this something new with appengine quota and limitation? What is the quota for allocated IDs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Resident instance not serving the traffic
- New instance is created That is expected. Its there to serve the new traffic. - the request is served by the new instance Are you absolutely sure of this? What evidence do you have? Unless you can provide real verifiable evidence, there is probably little Google can do. They need something to investigate. What is the purpose of Resident instance? To accept the first hit, while a new dynamic instance is being spun up. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Limitation on “Exceeded maximum allocated IDs”
What is the relevant code (and values) that experience this exception? On Apr 4, 10:13 am, GoSharp Lite gosharpl...@gmail.com wrote: *This might be a JDO limitation. Is there a setting to increase maximum allocation IDs?* java.lang.IllegalArgumentException: Exceeded maximum allocated IDs at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:488) at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:736) at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:756) On Thursday, April 4, 2013 3:37:36 PM UTC+8, GoSharp Lite wrote: *Issue 9110:* Application ID : gochild2009.appspot.com My app is running fine for months. Today it starts to give error on Exceeded maximum allocated IDs with datastore put. Is this something new with appengine quota and limitation? What is the quota for allocated IDs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Limitation on “Exceeded maximum allocated IDs”
The code is a simple datastore.put(entity). I'm getting close to find the problem. The kind which gives Exceeded maximum allocated IDs only has 1483 entities, but the last entity id=9223259787550119662. This is almost 2^63, which is the limit. I have been using this kind since 2010, it seems the ID generator might be root cause of this error. On Thursday, April 4, 2013 8:14:49 PM UTC+8, Ian Marshall wrote: What is the relevant code (and values) that experience this exception? On Apr 4, 10:13 am, GoSharp Lite gosharpl...@gmail.com wrote: *This might be a JDO limitation. Is there a setting to increase maximum allocation IDs?* java.lang.IllegalArgumentException: Exceeded maximum allocated IDs at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:488) at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:736) at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:756) On Thursday, April 4, 2013 3:37:36 PM UTC+8, GoSharp Lite wrote: *Issue 9110:* Application ID : gochild2009.appspot.com My app is running fine for months. Today it starts to give error on Exceeded maximum allocated IDs with datastore put. Is this something new with appengine quota and limitation? What is the quota for allocated IDs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Limitation on “Exceeded maximum allocated IDs”
I found another kind which gives Exceeded maximum allocated IDs. This kind only has 2545 entities. Looking at the id sequence, at around 1223 entity id=6070550, the next entity id=9223259787545785651 and increasing. The id generator is behaving strangely. On Thursday, April 4, 2013 8:40:28 PM UTC+8, GoSharp Lite wrote: The code is a simple datastore.put(entity). I'm getting close to find the problem. The kind which gives Exceeded maximum allocated IDs only has 1483 entities, but the last entity id=9223259787550119662. This is almost 2^63, which is the limit. I have been using this kind since 2010, it seems the ID generator might be root cause of this error. On Thursday, April 4, 2013 8:14:49 PM UTC+8, Ian Marshall wrote: What is the relevant code (and values) that experience this exception? On Apr 4, 10:13 am, GoSharp Lite gosharpl...@gmail.com wrote: *This might be a JDO limitation. Is there a setting to increase maximum allocation IDs?* java.lang.IllegalArgumentException: Exceeded maximum allocated IDs at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:488) at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:736) at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:756) On Thursday, April 4, 2013 3:37:36 PM UTC+8, GoSharp Lite wrote: *Issue 9110:* Application ID : gochild2009.appspot.com My app is running fine for months. Today it starts to give error on Exceeded maximum allocated IDs with datastore put. Is this something new with appengine quota and limitation? What is the quota for allocated IDs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Limitation on “Exceeded maximum allocated IDs”
I have a kind which shows the time of id jump as shown below. id=6045690, 2011-11-17 03:24:34.576000 id=9223259787545788651, 2011-11-18 16:09:36.499000 On Thursday, April 4, 2013 9:13:27 PM UTC+8, GoSharp Lite wrote: I found another kind which gives Exceeded maximum allocated IDs. This kind only has 2545 entities. Looking at the id sequence, at around 1223 entity id=6070550, the next entity id=9223259787545785651 and increasing. The id generator is behaving strangely. On Thursday, April 4, 2013 8:40:28 PM UTC+8, GoSharp Lite wrote: The code is a simple datastore.put(entity). I'm getting close to find the problem. The kind which gives Exceeded maximum allocated IDs only has 1483 entities, but the last entity id=9223259787550119662. This is almost 2^63, which is the limit. I have been using this kind since 2010, it seems the ID generator might be root cause of this error. On Thursday, April 4, 2013 8:14:49 PM UTC+8, Ian Marshall wrote: What is the relevant code (and values) that experience this exception? On Apr 4, 10:13 am, GoSharp Lite gosharpl...@gmail.com wrote: *This might be a JDO limitation. Is there a setting to increase maximum allocation IDs?* java.lang.IllegalArgumentException: Exceeded maximum allocated IDs at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:488) at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:736) at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:756) On Thursday, April 4, 2013 3:37:36 PM UTC+8, GoSharp Lite wrote: *Issue 9110:* Application ID : gochild2009.appspot.com My app is running fine for months. Today it starts to give error on Exceeded maximum allocated IDs with datastore put. Is this something new with appengine quota and limitation? What is the quota for allocated IDs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Limitation on “Exceeded maximum allocated IDs”
Another kind shows the id jump at about the same time. id=6071550, 2011-11-18 06:00:31.469000 id=9223259787545787652, 2011-11-18 15:51:32.743000 On Thursday, April 4, 2013 9:21:05 PM UTC+8, GoSharp Lite wrote: I have a kind which shows the time of id jump as shown below. id=6045690, 2011-11-17 03:24:34.576000 id=9223259787545788651, 2011-11-18 16:09:36.499000 On Thursday, April 4, 2013 9:13:27 PM UTC+8, GoSharp Lite wrote: I found another kind which gives Exceeded maximum allocated IDs. This kind only has 2545 entities. Looking at the id sequence, at around 1223 entity id=6070550, the next entity id=9223259787545785651 and increasing. The id generator is behaving strangely. On Thursday, April 4, 2013 8:40:28 PM UTC+8, GoSharp Lite wrote: The code is a simple datastore.put(entity). I'm getting close to find the problem. The kind which gives Exceeded maximum allocated IDs only has 1483 entities, but the last entity id=9223259787550119662. This is almost 2^63, which is the limit. I have been using this kind since 2010, it seems the ID generator might be root cause of this error. On Thursday, April 4, 2013 8:14:49 PM UTC+8, Ian Marshall wrote: What is the relevant code (and values) that experience this exception? On Apr 4, 10:13 am, GoSharp Lite gosharpl...@gmail.com wrote: *This might be a JDO limitation. Is there a setting to increase maximum allocation IDs?* java.lang.IllegalArgumentException: Exceeded maximum allocated IDs at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:488) at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:736) at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:756) On Thursday, April 4, 2013 3:37:36 PM UTC+8, GoSharp Lite wrote: *Issue 9110:* Application ID : gochild2009.appspot.com My app is running fine for months. Today it starts to give error on Exceeded maximum allocated IDs with datastore put. Is this something new with appengine quota and limitation? What is the quota for allocated IDs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: Limitation on “Exceeded maximum allocated IDs”
This thread https://groups.google.com/forum/?fromgroups=#!topic/google-appengine/r7L2mH3VzLw mentions they where going to change the id allocation online. Maybe that is now causing issue? On Thu, Apr 4, 2013 at 2:26 PM, GoSharp Lite gosharpl...@gmail.com wrote: Another kind shows the id jump at about the same time. id=6071550, 2011-11-18 06:00:31.469000 id=9223259787545787652, 2011-11-18 15:51:32.743000 On Thursday, April 4, 2013 9:21:05 PM UTC+8, GoSharp Lite wrote: I have a kind which shows the time of id jump as shown below. id=6045690, 2011-11-17 03:24:34.576000 id=9223259787545788651, 2011-11-18 16:09:36.499000 On Thursday, April 4, 2013 9:13:27 PM UTC+8, GoSharp Lite wrote: I found another kind which gives Exceeded maximum allocated IDs. This kind only has 2545 entities. Looking at the id sequence, at around 1223 entity id=6070550, the next entity id=9223259787545785651 and increasing. The id generator is behaving strangely. On Thursday, April 4, 2013 8:40:28 PM UTC+8, GoSharp Lite wrote: The code is a simple datastore.put(entity). I'm getting close to find the problem. The kind which gives Exceeded maximum allocated IDs only has 1483 entities, but the last entity id=9223259787550119662. This is almost 2^63, which is the limit. I have been using this kind since 2010, it seems the ID generator might be root cause of this error. On Thursday, April 4, 2013 8:14:49 PM UTC+8, Ian Marshall wrote: What is the relevant code (and values) that experience this exception? On Apr 4, 10:13 am, GoSharp Lite gosharpl...@gmail.com wrote: *This might be a JDO limitation. Is there a setting to increase maximum allocation IDs?* java.lang.**IllegalArgumentException: Exceeded maximum allocated IDs at org.datanucleus.api.jdo.**NucleusJDOHelper.** getJDOExceptionForNucleusExcep**tion(NucleusJDOHelper.java:**488) at org.datanucleus.api.jdo.**JDOPersistenceManager.**jdoMakePersistent( **JDOPersistenceManager.java:**736) at org.datanucleus.api.jdo.**JDOPersistenceManager.**makePersistent(** JDOPersistenceManager.java:**756) On Thursday, April 4, 2013 3:37:36 PM UTC+8, GoSharp Lite wrote: *Issue 9110:* Application ID : gochild2009.appspot.com My app is running fine for months. Today it starts to give error on Exceeded maximum allocated IDs with datastore put. Is this something new with appengine quota and limitation? What is the quota for allocated IDs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: Limitation on “Exceeded maximum allocated IDs”
Kinds in my app with key generated by myself still function well. Kinds which I let datastore generate key automatically all has Exceeded maximum allocated IDs problem now. On Thursday, April 4, 2013 9:43:15 PM UTC+8, barryhunter wrote: This thread https://groups.google.com/forum/?fromgroups=#!topic/google-appengine/r7L2mH3VzLw mentions they where going to change the id allocation online. Maybe that is now causing issue? On Thu, Apr 4, 2013 at 2:26 PM, GoSharp Lite gosha...@gmail.comjavascript: wrote: Another kind shows the id jump at about the same time. id=6071550, 2011-11-18 06:00:31.469000 id=9223259787545787652, 2011-11-18 15:51:32.743000 On Thursday, April 4, 2013 9:21:05 PM UTC+8, GoSharp Lite wrote: I have a kind which shows the time of id jump as shown below. id=6045690, 2011-11-17 03:24:34.576000 id=9223259787545788651, 2011-11-18 16:09:36.499000 On Thursday, April 4, 2013 9:13:27 PM UTC+8, GoSharp Lite wrote: I found another kind which gives Exceeded maximum allocated IDs. This kind only has 2545 entities. Looking at the id sequence, at around 1223 entity id=6070550, the next entity id=9223259787545785651 and increasing. The id generator is behaving strangely. On Thursday, April 4, 2013 8:40:28 PM UTC+8, GoSharp Lite wrote: The code is a simple datastore.put(entity). I'm getting close to find the problem. The kind which gives Exceeded maximum allocated IDs only has 1483 entities, but the last entity id=9223259787550119662. This is almost 2^63, which is the limit. I have been using this kind since 2010, it seems the ID generator might be root cause of this error. On Thursday, April 4, 2013 8:14:49 PM UTC+8, Ian Marshall wrote: What is the relevant code (and values) that experience this exception? On Apr 4, 10:13 am, GoSharp Lite gosharpl...@gmail.com wrote: *This might be a JDO limitation. Is there a setting to increase maximum allocation IDs?* java.lang.**IllegalArgumentException: Exceeded maximum allocated IDs at org.datanucleus.api.jdo.**NucleusJDOHelper.** getJDOExceptionForNucleusExcep**tion(NucleusJDOHelper.java:**488) at org.datanucleus.api.jdo.**JDOPersistenceManager.** jdoMakePersistent(**JDOPersistenceManager.java:**736) at org.datanucleus.api.jdo.**JDOPersistenceManager.**makePersistent(** JDOPersistenceManager.java:**756) On Thursday, April 4, 2013 3:37:36 PM UTC+8, GoSharp Lite wrote: *Issue 9110:* Application ID : gochild2009.appspot.com My app is running fine for months. Today it starts to give error on Exceeded maximum allocated IDs with datastore put. Is this something new with appengine quota and limitation? What is the quota for allocated IDs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com javascript:. To post to this group, send email to google-a...@googlegroups.comjavascript: . Visit this group at http://groups.google.com/group/google-appengine?hl=en . For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: too many error over last 3 days
Could you post the error you were getting? Il giorno mercoledì 3 aprile 2013 10:30:07 UTC+2, Sudip Mukherjee ha scritto: I have shifted my application out of appengine . Thanks Regards Sudip On Monday 01 April 2013 03:08 PM, John V Denley wrote: Yup, still having the same problem myself: 2013-03-25 12:55:21 Charge Cleared ($25.74) $0.00 2013-03-18 16:11:03 Charge Cleared ($19.67) $0.00 2013-03-11 13:01:14 Charge Cleared ($6.85) $0.00 2013-03-04 13:58:43 Charge Cleared ($6.94) $0.00 2013-02-25 13:01:18 Charge Cleared ($13.16) $0.00 2013-02-18 13:00:10 Charge Cleared ($9.06) $0.00 2013-02-11 13:02:06 Charge Cleared ($20.42) $0.00 2013-02-04 12:49:39 Charge Cleared ($2.30) $0.00 2013-01-28 12:48:57 Charge Cleared ($2.10) $0.00 2013-01-21 12:52:44 Charge Cleared ($2.10) $0.00 2013-01-14 12:48:24 Charge Cleared ($2.10) $0.00 2013-01-07 12:50:48 Charge Cleared ($2.10) $0.00 2012-12-31 12:59:44 Charge Cleared ($2.10) $0.00 2012-12-24 13:02:54 Charge Cleared ($2.10) $0.00 2012-12-17 13:05:47 Charge Cleared ($2.10) $0.00 2012-12-10 13:01:34 Charge Cleared ($2.10) $0.00 2012-12-03 15:09:00 Charge Cleared ($2.64) $0.00 2012-11-26 12:59:38 Charge Cleared ($2.10) $0.00 2012-11-19 13:08:04 Charge Cleared ($2.10) $0.00 2012-11-12 13:01:26 Charge Cleared ($2.10) $0.00 On Monday, 11 February 2013 07:23:50 UTC, Sudip Mukherjee wrote: Hi My application vectortracking.appspot.com which has been running for last few years as a paid application and running without any issues , suddenly started having having too many errors since 09/02 . The only way to stop the error temporarily is to redeploy it. And strangely the error is coming at almost fixed time daily. I am redeploying and it is again running with few errors till next day. And again surprisingly , from 09/02 onwards my *Frontend Instance Hours*is crossing the free limit , which has almost never crossed the limit in last 2 years. Can anyone please have a look into the issue. Thanks Regards Sudip -- You received this message because you are subscribed to a topic in the Google Groups Google App Engine group. To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/yADVt6P1mLI/unsubscribe?hl=en . To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com javascript:. To post to this group, send email to google-a...@googlegroups.comjavascript: . Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Test and Upgrade your App Engine Java Application to a Java 7 runtime...now.
Hi, It's coming! Are you ready? Google App Engine Java SDK 1.7.7 (shipping very soon) will deploy all Java applications to the new Java 7 runtime. Did you do a sanity test with your current Java applications? Many of you have done it already: Thank you! So far, no migration issues have been reported. In general, Java 7 runtime is backwards compatible with Java 6, and will run all pre-existing Java applications that did not rely on implementation-specific functionality. Please refer to the Oracle white paper on Java 7 and Java 6http://www.oracle.com/technetwork/java/javase/compatibility-417013.html compatibility for additional details. It is still time to try deploying a new version of your application with the --use_java7 flag with the appcfg tool and and see that your application is behaving as before. Remenber that this flag will be on by default going forward in GAE 1.7.7. In the near future all App Engine Java applications will run a the new Java 7 runtime. Cheers. On Thursday, March 14, 2013 6:56:32 PM UTC-7, Ludovic Champenois wrote: Hi, A quick status on the Java 7 migration: No news is good news right? Applications (very large and small) having tried or even completely upgraded to the Java 7 runtime have not discovered runtime issue: this is great news! More applications every single day, and counting... If you have not started testing your application with the new Java 7 runtime, this is the right time now to do it either with the current 1.7.5 release, or the coming 1.7.6 release (we push a preview SDK earlier this week). Cheers. On Wednesday, February 27, 2013 10:37:01 AM UTC-8, Ludovic Champenois wrote: Hi, As part of Google App Engine 1.7.5 release on February 13, 2013, we introduced Preview support of App Engine Java 7 runtime. In early April, Google will commence upgrading our internal applications from Java 6 to Java 7. In conjunction with this effort, we highly recommend that all of our App Engine customers begin testing and eventually migrate their applications to Java 7 runtime within the next couple of months. Please find below some additional technical information to assist with testing and migrating your application to Java 7 environment: *Java 6 and Java 7 Compatibility* In general, Java 7 runtime is backwards compatible with Java 6, and will run all pre-existing Java applications that did not rely on implementation-specific functionality. Please refer to the Oracle white paper on Java 7 and Java 6http://www.oracle.com/technetwork/java/javase/compatibility-417013.htmlcompatibility for additional details. *Procedure for Testing* For all your Java App Engine applications, here are the steps for testing in the new Java 7 environment. 1. App Engine can support multiple live versions of a given application. It is best to create a new version of your app and deploy it to a Java 7 runtime. 2. You can deploy to a new Java 7 runtime with one of the following steps: a) Recompile your Java Application with a full JDK 7 compiler. You can test it with the GAE 1.7.5 SDK, and when ready, use the regular appcfg SDK tool that will detect that the Java byte code is Java 7 compliant and will use a Java7 runtime for this application version. b) If you are still compiling your Java application with a JDK 6 compiler, you can deploy to the Java 7 runtime by adding the *--use_java7 * flag to the appcfg SDK tool. Please review the Google Java 7 Considerationshttps://developers.google.com/appengine/docs/java/java7paper for additional information on configuring Java 7. 3. Assuming you have your default application version still running with a Java 6 runtime and a new version running in Java 7, you can use the Google App Engine Traffic Splitting feature to slowly ramp up traffic on the new Java 7 runtime. Consider starting with 5%, then increase gradually to 10%, 20%, and so on as your app is behaving as expected. See our Traffic Splitting documenthttps://developers.google.com/appengine/docs/adminconsole/trafficsplittingfor more information about this tool. Thanks for spending the time to make sure your application is Java 7 ready now. Only a very few incompatible behaviors may have to be fixed in your applications. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Backend shutdown/restart broken
I am seeing the following across multiple apps written in Python: 1) Backend running a background thread (via: start_new_background_thread()) gets shutdown. 2) Backend gets restarted AN HOUR later (almost to the minute). This behavior started this week. I used the backends to rotate game boards on Android massive multiplayer games. This means 1 hour in each 24 the game is effectively down giving an effective uptime of 96%. I have tried reaching out to people at Google, but my emails have been ignored. Please investigate and fix appid's: sven-anagramhero, sven-wordhero -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Resident instance not serving the traffic
The resident is there to absorb *spikes* in traffic, not to handle standard traffic operations. In an *ideal* world, what should be happening is that you start out with resident instances. Traffic comes in, then the scheduler kicks up a dynamic instance while simultaneously directing some traffic to resident instances to process. Once the dynamics are up, then the requests go to the dynamic instances while residents return to idle. It doesn't always work that way, but that's the general idea. Can you double check your logs, and specifically look at the instance id that is recorded on each log? Sometimes it can look like the dynamic instance is handling the request, when in reality the resident is handling the request; the simultaneous processes can sometimes confuse people. - -Vinny P Technology Media Advisor Chicago, IL @GOV on AppDotNet: https://alpha.app.net/gov On Wednesday, April 3, 2013 11:07:03 PM UTC-5, aswath wrote: Hello, I have the appid Application settings Idle instances: 1 - Automatic My app is idle, and I can see the logs, that there is no traffic There is one Resident instance. Now, I issue a servlet request from my browser - New instance is created - the request is served by the new instance What is the purpose of Resident instance? Google team, please suggest for the appropriate settings to avoid this situation -Aswath -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: App Engine (Java) application - Browse and search Google Spreadsheets content
On Tuesday, April 2, 2013 9:07:50 AM UTC-5, in...@fajneveci.cz wrote:
is there anyone who can help me? I can pay for it - I need solution
quickly.
Hi David,
I had some free time last night, so I knocked together a sample app based
on this documentation:
https://developers.google.com/google-apps/spreadsheets/#working_with_list-based_feeds
To set up this example, I placed this spreadsheet file into my Google Docs:
http://i.imgur.com/xp1XO0M.png The below code generated this results file:
http://i.imgur.com/gEwVFz4.png
Just so you understand what's going on, the program searched for the phrase
GOOG which matched twice, once on the first cell of row 3 and secondly on
the second cell of row 3 (it matched the first part of GOOGle inc). You
place the word you want to find into the variable find_word. You can extend
this code by taking the row_index variable and linking it to whatever you
need the row data for. It searches every spreadsheet file saved in your
Google Docs, but only the first worksheet (you can change that in the code).
Now, a word of notice: I'm using ClientLogin authorization for this
example. ClientLogin is deprecated and is being removed from production in
April 2015. If you move this code into a production service, you need to
implement OAuth. There are plenty of other examples of OAuth based
authentication out there, just Google it. If you're just doing this for a
school project or personal, for-your-own-use service, then ClientLogin is
fine.
@Takashi, Euphrosine, Ikai, other Google people: Can you call up the Google
Spreadsheets people and tell them they have an error in their
documentation? Go to
https://developers.google.com/google-apps/spreadsheets/#retrieving_a_list-based_feed
and
click on the Java example code tab. Where it says* for (ListEntry row :
feed.getEntries()) {* that needs to be changed to *for (ListEntry row :
listFeed.getEntries()) {*. (There's no *feed* variable, it's supposed to be
the feed from the cells, which is *listFeed*). There are a couple of other
Java errors in the other documentation samples. I fixed it in the below
code.
package com.example.gaegroupsexample;
import java.io.IOException;
import java.net.URI;
import java.net.URL;
import java.util.Iterator;
import java.util.List;
import com.google.gdata.client.spreadsheet.*;
import com.google.gdata.data.spreadsheet.*;
import com.google.gdata.util.*;
import javax.servlet.http.*;
@SuppressWarnings(serial)
public class GAEGroupsExampleServlet extends HttpServlet {
public void doGet(HttpServletRequest req, HttpServletResponse resp)
throws IOException {
resp.setContentType(text/html);
resp.getWriter().println(pre);
try {
String USERNAME = username;
String PASSWORD = password;
String find_word = GOOG;
find_word = find_word.toLowerCase();
SpreadsheetService service = new SpreadsheetService(
GAEGROUPSEXAMPLENOPROD);
service.setUserCredentials(USERNAME, PASSWORD);
URL SPREADSHEET_FEED_URL = new URL(
https://spreadsheets.google.com/feeds/spreadsheets/private/full;);
// Make a request to the API and get all spreadsheets.
SpreadsheetFeed feed = service.getFeed(SPREADSHEET_FEED_URL,
SpreadsheetFeed.class);
ListSpreadsheetEntry spreadsheets = feed.getEntries();
if (spreadsheets.size() == 0) {
resp.getWriter().println(There are no spreadsheets to inspect!);
}
//Retrieve an iterator over all spreadsheets contained in
//this user's Google Drive
IteratorSpreadsheetEntry spreadsheet_iterator =
spreadsheets.iterator();
while (spreadsheet_iterator.hasNext()) {
SpreadsheetEntry spreadsheet = spreadsheet_iterator.next();
String spreadsheet_name = spreadsheet.getTitle().getPlainText();
resp.getWriter().println(Currently searching spreadsheet +
spreadsheet_name);
//Search only the first worksheet of the spreadsheet.
WorksheetFeed worksheetFeed = service.getFeed(
spreadsheet.getWorksheetFeedUrl(), WorksheetFeed.class);
ListWorksheetEntry worksheets = worksheetFeed.getEntries();
WorksheetEntry worksheet = worksheets.get(0);
// Fetch the cell feed of the worksheet.
URL cellFeedUrl = worksheet.getCellFeedUrl();
CellFeed cellFeed = service.getFeed(cellFeedUrl, CellFeed.class);
for (CellEntry cell : cellFeed.getEntries()) {
//Retrieve the contents of each cell.
String cell_contents = cell.getCell().getInputValue().toLowerCase();
//Match the word with the cell contents. Ignoring case.
if (cell_contents.indexOf(find_word) != -1) {
//Found the word.
resp.getWriter().println(Cell with contents + cell_contents +
matches your phrase!);
// Find the row
Integer row_index = new Integer(cell.getCell().getRow());
resp.getWriter().println(
bRow + row_index.toString() + /b in
+ spreadsheet_name
+ matches your query.);
String rowCollect = ;
// Print row
[google-appengine] Google Cloud Support Pricing w/ App Engine
With the new support pricing for Google Cloud (e.g. Gold Standard..$400/ month), how does this work with App Engine premier pricing? If I want gold support, do I now have to pay $400 + $500 = $900 / month? Or do I get premier access with just $400 / month? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Google Compute Engine w/ App Engine
Question for the App Engine team: I really like that compute engine is becoming available for us to build more flexible services, but I'm curious how it plays with App Engine. Is there going to be another way to communicate with Compute Engine instances that is more flexible than URL Fetch? Does using URL Fetch make round trips on the Internet or is it smart enough to route directly within Google datacenters? KP -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Does deleting a backup also delete the files in Cloud Storage?
I think it should work if you provide the folder as part of the gs_bucket_name value (e.g. 'bucket/folder/'). Also, gsutil does support wildcard (and delete with wildcard) and the gs online browser supports deleting multiple files and/or folders. On Wednesday, April 3, 2013 3:13:09 PM UTC-7, Jason Collins wrote: Thanks for the response Arie. Once I get access to the Cloud Storage JSON API, I will have developed my own backup scrubber. Using a folder per backup can help with maintenance. I agree this would help (though the current tooling doesn't allow easy deletion of an entire folder), but the cron-based backup tool does not allow for dynamically-specified folder names. In my opinion, the backup tool should automatically create date-named subfolders when creating backups. j On Wednesday, 3 April 2013 14:26:54 UTC-6, Arie Ozarov wrote: Right. Deleting a backup does not delete the associated Google Cloud Storage files (but does delete the associated blobstore files). We may provide an option to delete the associated Google Cloud Storage files in the future (and the default would be False). Using a folder per backup can help with maintenance. Arie. On Tuesday, April 2, 2013 12:04:56 PM UTC-7, Bryce Cutt wrote: IIRC it does not. Works fine on blobstore though. On Monday, April 1, 2013 4:46:47 PM UTC-7, Jason Collins wrote: We use the Datastore Admin backup tool (fired by a cron) to backup our data into Cloud Storage nightly. Our storage costs have crept up and I'd like to delete the old backups. Aside: if you think, like I do, that you should be able to automate backup deletion, please star https://code.google.com/p/googleappengine/issues/detail?id=7412 or possible even https://code.google.com/p/googleappengine/issues/detail?id=7428 Datastore Admin has a feature that allows me to delete old backups. However, I don't think that it actually deletes the Cloud Storage files themselves. Here is the code I'm looking at from google.appengine.ext.datastore_admin.backup_handler: def delete_backup_files(filesystem, backup_files): if backup_files: if filesystem == files.BLOBSTORE_FILESYSTEM: blob_keys = [] for fname in backup_files: blob_key = files.blobstore.get_blob_key(fname) if blob_key: blob_keys.append(blob_key) if len(blob_keys) == MAX_BLOBS_PER_DELETE: blobstore_api.delete(blob_keys) blob_keys = [] if blob_keys: blobstore_api.delete(blob_keys) I'm guessing that blank line that has been redacted says TODO: implement Google Storage file deletion. Can anyone confirm or deny? How do people manage their backups today? Is my only option to write some kind of custom tool to dump old files on Cloud Storage? Thanks, j -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Google Compute Engine w/ App Engine
This is very informative (read session presentation if you don't want to watch the video). https://developers.google.com/events/io/2012/sessions/gooio2012/308/ -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: Very large entity ids on 1.7.6 dev server
Quick question -- just for my clarity, and I am sorry if this was already
clear. Once this change is implemented in production (this is not an SDK
question), if prior to writing an new entity, I get one entity id value
using allocate_ids(), is this going to be an integer value of reasonable
size consistent with today's automatically generated IDs? Or will
allocate_ids('mymodel', 1) yield one of the new bigint scattered number
IDs? TIA -stevep
On Tuesday, March 26, 2013 6:11:38 PM UTC-7, Jeff Schnitzer wrote:
Will there be any problems intermingling allocated and automatic ids?
Right now I can switch back and forth between explicitly allocated and
automatically generated ids. Will this continue to be the case?
Will there be an allocator method to generate a scattered id?
Jeff
On Tue, Mar 26, 2013 at 7:33 PM, Jesse Rohwer
roh...@google.comjavascript:
wrote:
Hi all,
To address the questions on this thread in order:
1. While we will be moving to scattered ids in production soon, we're
going
to limit the size of ids to the max integer that a 64-bit float can
represent exactly, which will address the problem with floating-point
representations. This will also be changed in the 1.7.7 SDKs.
The motivation for scattered ids is that sequential ids cause hot spots
in
bigtable and GAE MR, which leads to significant performance limitations.
More info on scattered ids:
Scattered auto ids in 1.7.5 SDK
See the section Specifying the automatic id allocation policy:
https://developers.google.com/appengine/docs/Python/tools/devserver#Using_the_Datastore
https://developers.google.com/appengine/docs/java/tools/devserver#Using_the_Datastore
2. The current allocate_ids() functions will continue to allocate
sequential
ids. So, manually allocated sequential ids will still be available.
3. We're sorry for the inconvenience this caused with the 1.7.6 dev
appserver, but we're glad we caught this early!
4. If you need small ids, you won't be able to rely on automatic ids for
this. One option would be to use the allocate_ids() functions to
manually
allocate ids.
Thanks for your feedback!
On Monday, March 25, 2013 12:13:52 PM UTC-7, Mahron wrote:
Ok, so strings it is. Upgrade complete !
--
You received this message because you are subscribed to the Google
Groups
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send
an
email to google-appengi...@googlegroups.com javascript:.
To post to this group, send email to
google-a...@googlegroups.comjavascript:.
Visit this group at
http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Does deleting a backup also delete the files in Cloud Storage?
Arie, the issue is that you can't provide dynamic parts in your cron.yaml (unless I were to upload a new cron.yaml every day): - description: brand analytics backup url: /_ah/datastore_admin/backup.create?name=my-backupfilesystem=gsgs_bucket_name=vendasta-backup/my-folderqueue=backupkind=Fookind=Bar... schedule: every day 00:00 To be sure, the technique that Bryce points out certainly works, but as a Platform as a Service, I always argue that database backup and restore should be a first class citizen and have strong, integrated tooling. j On Thursday, 4 April 2013 13:08:09 UTC-6, Arie Ozarov wrote: I think it should work if you provide the folder as part of the gs_bucket_name value (e.g. 'bucket/folder/'). Also, gsutil does support wildcard (and delete with wildcard) and the gs online browser supports deleting multiple files and/or folders. On Wednesday, April 3, 2013 3:13:09 PM UTC-7, Jason Collins wrote: Thanks for the response Arie. Once I get access to the Cloud Storage JSON API, I will have developed my own backup scrubber. Using a folder per backup can help with maintenance. I agree this would help (though the current tooling doesn't allow easy deletion of an entire folder), but the cron-based backup tool does not allow for dynamically-specified folder names. In my opinion, the backup tool should automatically create date-named subfolders when creating backups. j On Wednesday, 3 April 2013 14:26:54 UTC-6, Arie Ozarov wrote: Right. Deleting a backup does not delete the associated Google Cloud Storage files (but does delete the associated blobstore files). We may provide an option to delete the associated Google Cloud Storage files in the future (and the default would be False). Using a folder per backup can help with maintenance. Arie. On Tuesday, April 2, 2013 12:04:56 PM UTC-7, Bryce Cutt wrote: IIRC it does not. Works fine on blobstore though. On Monday, April 1, 2013 4:46:47 PM UTC-7, Jason Collins wrote: We use the Datastore Admin backup tool (fired by a cron) to backup our data into Cloud Storage nightly. Our storage costs have crept up and I'd like to delete the old backups. Aside: if you think, like I do, that you should be able to automate backup deletion, please star https://code.google.com/p/googleappengine/issues/detail?id=7412 or possible even https://code.google.com/p/googleappengine/issues/detail?id=7428 Datastore Admin has a feature that allows me to delete old backups. However, I don't think that it actually deletes the Cloud Storage files themselves. Here is the code I'm looking at from google.appengine.ext.datastore_admin.backup_handler: def delete_backup_files(filesystem, backup_files): if backup_files: if filesystem == files.BLOBSTORE_FILESYSTEM: blob_keys = [] for fname in backup_files: blob_key = files.blobstore.get_blob_key(fname) if blob_key: blob_keys.append(blob_key) if len(blob_keys) == MAX_BLOBS_PER_DELETE: blobstore_api.delete(blob_keys) blob_keys = [] if blob_keys: blobstore_api.delete(blob_keys) I'm guessing that blank line that has been redacted says TODO: implement Google Storage file deletion. Can anyone confirm or deny? How do people manage their backups today? Is my only option to write some kind of custom tool to dump old files on Cloud Storage? Thanks, j -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] export JSON to Cloud Storage
The file is in LevelDB format by default: https://code.google.com/p/leveldb/
The MapReduce code contains support for reading and writing it, so that it
can be passed between one pipeline and another.
If you want to control the file format yourself I would recommend using the
Appengine GCS client: https://code.google.com/p/appengine-gcs-client/
On Wed, Mar 27, 2013 at 6:25 AM, Ranjit Chacko rjcha...@gmail.com wrote:
I'm trying to create JSON representations of my models in the datastore
and then write them to a file in Cloud Storage in a MapperPipeline.
The map method looks something like this:
def map_method(entity):
json_message = make_json_message(entity)
yield(json_message)
and the params for the output_writer look something like this:
output_writer:{
filesystem: gs,
gs_bucket_name: json_export,
mime_type: text/utf-8
}
The pipeline completes successfully, but the file I'm getting in Cloud
Storage seems to be in a binary format.
How do I get a JSON file out that I can read?
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an
email to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: Limitation on “Exceeded maximum allocated IDs”
The time of id large jump is interesting. 2011/11 was when GAE exited beta. On Thursday, April 4, 2013 9:52:19 PM UTC+8, GoSharp Lite wrote: Kinds in my app with key generated by myself still function well. Kinds which I let datastore generate key automatically all has Exceeded maximum allocated IDs problem now. On Thursday, April 4, 2013 9:43:15 PM UTC+8, barryhunter wrote: This thread https://groups.google.com/forum/?fromgroups=#!topic/google-appengine/r7L2mH3VzLw mentions they where going to change the id allocation online. Maybe that is now causing issue? On Thu, Apr 4, 2013 at 2:26 PM, GoSharp Lite gosha...@gmail.com wrote: Another kind shows the id jump at about the same time. id=6071550, 2011-11-18 06:00:31.469000 id=9223259787545787652, 2011-11-18 15:51:32.743000 On Thursday, April 4, 2013 9:21:05 PM UTC+8, GoSharp Lite wrote: I have a kind which shows the time of id jump as shown below. id=6045690, 2011-11-17 03:24:34.576000 id=9223259787545788651, 2011-11-18 16:09:36.499000 On Thursday, April 4, 2013 9:13:27 PM UTC+8, GoSharp Lite wrote: I found another kind which gives Exceeded maximum allocated IDs. This kind only has 2545 entities. Looking at the id sequence, at around 1223 entity id=6070550, the next entity id=9223259787545785651 and increasing. The id generator is behaving strangely. On Thursday, April 4, 2013 8:40:28 PM UTC+8, GoSharp Lite wrote: The code is a simple datastore.put(entity). I'm getting close to find the problem. The kind which gives Exceeded maximum allocated IDs only has 1483 entities, but the last entity id=9223259787550119662. This is almost 2^63, which is the limit. I have been using this kind since 2010, it seems the ID generator might be root cause of this error. On Thursday, April 4, 2013 8:14:49 PM UTC+8, Ian Marshall wrote: What is the relevant code (and values) that experience this exception? On Apr 4, 10:13 am, GoSharp Lite gosharpl...@gmail.com wrote: *This might be a JDO limitation. Is there a setting to increase maximum allocation IDs?* java.lang.**IllegalArgumentException: Exceeded maximum allocated IDs at org.datanucleus.api.jdo.**NucleusJDOHelper.** getJDOExceptionForNucleusExcep**tion(NucleusJDOHelper.java:**488) at org.datanucleus.api.jdo.**JDOPersistenceManager.** jdoMakePersistent(**JDOPersistenceManager.java:**736) at org.datanucleus.api.jdo.**JDOPersistenceManager.**makePersistent(* *JDOPersistenceManager.java:**756) On Thursday, April 4, 2013 3:37:36 PM UTC+8, GoSharp Lite wrote: *Issue 9110:* Application ID : gochild2009.appspot.com My app is running fine for months. Today it starts to give error on Exceeded maximum allocated IDs with datastore put. Is this something new with appengine quota and limitation? What is the quota for allocated IDs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com. To post to this group, send email to google-a...@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: Does deleting a backup also delete the files in Cloud Storage?
Yes, I agree with that.We are constantly trying to improve it (and this request was noted). Arie. On Thu, Apr 4, 2013 at 1:37 PM, Jason Collins jason.a.coll...@gmail.comwrote: Arie, the issue is that you can't provide dynamic parts in your cron.yaml (unless I were to upload a new cron.yaml every day): - description: brand analytics backup url: /_ah/datastore_admin/backup.create?name=my-backupfilesystem=gsgs_bucket_name=vendasta-backup/my-folderqueue=backupkind=Fookind=Bar... schedule: every day 00:00 To be sure, the technique that Bryce points out certainly works, but as a Platform as a Service, I always argue that database backup and restore should be a first class citizen and have strong, integrated tooling. j On Thursday, 4 April 2013 13:08:09 UTC-6, Arie Ozarov wrote: I think it should work if you provide the folder as part of the gs_bucket_name value (e.g. 'bucket/folder/'). Also, gsutil does support wildcard (and delete with wildcard) and the gs online browser supports deleting multiple files and/or folders. On Wednesday, April 3, 2013 3:13:09 PM UTC-7, Jason Collins wrote: Thanks for the response Arie. Once I get access to the Cloud Storage JSON API, I will have developed my own backup scrubber. Using a folder per backup can help with maintenance. I agree this would help (though the current tooling doesn't allow easy deletion of an entire folder), but the cron-based backup tool does not allow for dynamically-specified folder names. In my opinion, the backup tool should automatically create date-named subfolders when creating backups. j On Wednesday, 3 April 2013 14:26:54 UTC-6, Arie Ozarov wrote: Right. Deleting a backup does not delete the associated Google Cloud Storage files (but does delete the associated blobstore files). We may provide an option to delete the associated Google Cloud Storage files in the future (and the default would be False). Using a folder per backup can help with maintenance. Arie. On Tuesday, April 2, 2013 12:04:56 PM UTC-7, Bryce Cutt wrote: IIRC it does not. Works fine on blobstore though. On Monday, April 1, 2013 4:46:47 PM UTC-7, Jason Collins wrote: We use the Datastore Admin backup tool (fired by a cron) to backup our data into Cloud Storage nightly. Our storage costs have crept up and I'd like to delete the old backups. Aside: if you think, like I do, that you should be able to automate backup deletion, please star https://code.google.com/** p/googleappengine/issues/**detail?id=7412https://code.google.com/p/googleappengine/issues/detail?id=7412or possible even https://code.google.com/**p/googleappengine/issues/**detail?id=7428https://code.google.com/p/googleappengine/issues/detail?id=7428 Datastore Admin has a feature that allows me to delete old backups. However, I don't think that it actually deletes the Cloud Storage files themselves. Here is the code I'm looking at from google.appengine.ext. **datastore_admin.backup_**handler: def delete_backup_files(filesystem**, backup_files): if backup_files: if filesystem == files.BLOBSTORE_FILESYSTEM: blob_keys = [] for fname in backup_files: blob_key = files.blobstore.get_blob_key(f**name) if blob_key: blob_keys.append(blob_key) if len(blob_keys) == MAX_BLOBS_PER_DELETE: blobstore_api.delete(blob_keys**) blob_keys = [] if blob_keys: blobstore_api.delete(blob_keys**) I'm guessing that blank line that has been redacted says TODO: implement Google Storage file deletion. Can anyone confirm or deny? How do people manage their backups today? Is my only option to write some kind of custom tool to dump old files on Cloud Storage? Thanks, j -- You received this message because you are subscribed to a topic in the Google Groups Google App Engine group. To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/UA75mV_JBP4/unsubscribe?hl=en . To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Google Cloud Support Pricing w/ App Engine
Hi Kinesh, The new support packages are introducing more tiers to the App Engine premier pricing. You get premier access starting from the Silver package without paying an additional $500. On Thu, Apr 4, 2013 at 11:04 AM, Kinesh Patel kin...@sevenrooms.co wrote: With the new support pricing for Google Cloud (e.g. Gold Standard..$400/ month), how does this work with App Engine premier pricing? If I want gold support, do I now have to pay $400 + $500 = $900 / month? Or do I get premier access with just $400 / month? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- Johan Euphrosine (proppy) Developer Programs Engineer Google Developer Relations -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: Limitation on “Exceeded maximum allocated IDs”
Instead of letting datastore to generate id automatically, I am now generating id for most of my kinds. Luckily several important kinds do not rely on automatic id generation. My app is back online. Is my app the only one experiencing this scary issue? On Friday, April 5, 2013 6:56:33 AM UTC+8, GoSharp Lite wrote: The time of id large jump is interesting. 2011/11 was when GAE exited beta. On Thursday, April 4, 2013 9:52:19 PM UTC+8, GoSharp Lite wrote: Kinds in my app with key generated by myself still function well. Kinds which I let datastore generate key automatically all has Exceeded maximum allocated IDs problem now. On Thursday, April 4, 2013 9:43:15 PM UTC+8, barryhunter wrote: This thread https://groups.google.com/forum/?fromgroups=#!topic/google-appengine/r7L2mH3VzLw mentions they where going to change the id allocation online. Maybe that is now causing issue? On Thu, Apr 4, 2013 at 2:26 PM, GoSharp Lite gosha...@gmail.com wrote: Another kind shows the id jump at about the same time. id=6071550, 2011-11-18 06:00:31.469000 id=9223259787545787652, 2011-11-18 15:51:32.743000 On Thursday, April 4, 2013 9:21:05 PM UTC+8, GoSharp Lite wrote: I have a kind which shows the time of id jump as shown below. id=6045690, 2011-11-17 03:24:34.576000 id=9223259787545788651, 2011-11-18 16:09:36.499000 On Thursday, April 4, 2013 9:13:27 PM UTC+8, GoSharp Lite wrote: I found another kind which gives Exceeded maximum allocated IDs. This kind only has 2545 entities. Looking at the id sequence, at around 1223 entity id=6070550, the next entity id=9223259787545785651 and increasing. The id generator is behaving strangely. On Thursday, April 4, 2013 8:40:28 PM UTC+8, GoSharp Lite wrote: The code is a simple datastore.put(entity). I'm getting close to find the problem. The kind which gives Exceeded maximum allocated IDs only has 1483 entities, but the last entity id=9223259787550119662. This is almost 2^63, which is the limit. I have been using this kind since 2010, it seems the ID generator might be root cause of this error. On Thursday, April 4, 2013 8:14:49 PM UTC+8, Ian Marshall wrote: What is the relevant code (and values) that experience this exception? On Apr 4, 10:13 am, GoSharp Lite gosharpl...@gmail.com wrote: *This might be a JDO limitation. Is there a setting to increase maximum allocation IDs?* java.lang.**IllegalArgumentException: Exceeded maximum allocated IDs at org.datanucleus.api.jdo.**NucleusJDOHelper.** getJDOExceptionForNucleusExcep**tion(NucleusJDOHelper.java:**488) at org.datanucleus.api.jdo.**JDOPersistenceManager.** jdoMakePersistent(**JDOPersistenceManager.java:**736) at org.datanucleus.api.jdo.**JDOPersistenceManager.**makePersistent( **JDOPersistenceManager.java:**756) On Thursday, April 4, 2013 3:37:36 PM UTC+8, GoSharp Lite wrote: *Issue 9110:* Application ID : gochild2009.appspot.com My app is running fine for months. Today it starts to give error on Exceeded maximum allocated IDs with datastore put. Is this something new with appengine quota and limitation? What is the quota for allocated IDs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com. To post to this group, send email to google-a...@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Allow/Deny access by user
When you first log into an appengine application that uses Authentication, you get a page that asks you if you want to allow that application to have access to your account information. It seems like you only get it once. If someone chooses to deny access, how does he or she change that, or even look it up later. Conversely, how do you revoke access you have given to test what your application does if the user denies access? ~Rik -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Resident instance not serving the traffic
The view logs link in the instances screen does not show logs or is broken. Hence, you cannot find out which instance served the traffic. -Aswath On Thu, Apr 4, 2013 at 10:59 PM, Vinny P vinny...@gmail.com wrote: The resident is there to absorb *spikes* in traffic, not to handle standard traffic operations. In an *ideal* world, what should be happening is that you start out with resident instances. Traffic comes in, then the scheduler kicks up a dynamic instance while simultaneously directing some traffic to resident instances to process. Once the dynamics are up, then the requests go to the dynamic instances while residents return to idle. It doesn't always work that way, but that's the general idea. Can you tell where is this documented? Whey should the resident instance be idle, and the traffic served by dynamic instance, with resident instance being idle. What is the use of the pending latency setting in the Application Settings. I have set it to 4sec - automatic. With this setting, I understand that, if there is a request waiting in the queue for less than 4s, then it should be served by the resident instance. There is no need to create a new instance, and getting charged for the new instance hours. Can you double check your logs, and specifically look at the instance id that is recorded on each log? Sometimes it can look like the dynamic instance is handling the request, when in reality the resident is handling the request; the simultaneous processes can sometimes confuse people. - -Vinny P Technology Media Advisor Chicago, IL @GOV on AppDotNet: https://alpha.app.net/gov On Wednesday, April 3, 2013 11:07:03 PM UTC-5, aswath wrote: Hello, I have the appid Application settings Idle instances: 1 - Automatic My app is idle, and I can see the logs, that there is no traffic There is one Resident instance. Now, I issue a servlet request from my browser - New instance is created - the request is served by the new instance What is the purpose of Resident instance? Google team, please suggest for the appropriate settings to avoid this situation -Aswath -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Very large entity ids on 1.7.6 dev server
On Tuesday, March 26, 2013 7:33:00 PM UTC-4, Jesse Rohwer wrote: 1. While we will be moving to scattered ids in production soon 4. If you need small ids, you won't be able to rely on automatic ids for this. One option would be to use the allocate_ids() functions to manually allocate ids. Definitely not happy about this. Will require a lot of effort on our end to mitigate. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Mocking framework that works in the GAE runtime
Are there any Java mocking framework than can work with GAE runtime? Such that I can do mocking in my application (not testing)? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Very large entity ids on 1.7.6 dev server
Hi all, After hearing from many of you that this would be a painful change, we've decided that when we switch to scattered auto ids we will provide a temporary option to continue sequential auto ids in production. We will still be deprecating sequential auto ids, for the performance reasons described above; but you will have time to prepare, and an interim period during which you can opt-out. Thanks again for your feedback. On Thursday, April 4, 2013 8:26:04 PM UTC-7, Brandon Thomson wrote: On Tuesday, March 26, 2013 7:33:00 PM UTC-4, Jesse Rohwer wrote: 1. While we will be moving to scattered ids in production soon 4. If you need small ids, you won't be able to rely on automatic ids for this. One option would be to use the allocate_ids() functions to manually allocate ids. Definitely not happy about this. Will require a lot of effort on our end to mitigate. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
