Re: [google-appengine] Re: Huge increase in datastore reads - hit $1,000 a day
I guess open an issue for these suggestions and star them would be a very good way for GAE Team to hear us. Saludos. Moisés Belchín. 2013/5/28 Bryce Cutt pandas...@gmail.com +1 for adding an optional daily limit for premier accounts. Obviously I work to remove this sort of issue but bugs happen and I don't see an easy way for me to see my monthly bill amount before I am actually billed. I kind of miss daily usage reports with dollar values On Tuesday, May 28, 2013 1:51:59 AM UTC-7, Marcel Manz wrote: For starting would it be too much to ask for a notification (e-mail, text message etc) at certain thresholds of the daily budget, e.g. when 75% is exceeded? Once you're a premier client you no longer have the daily budget option and can basically spend whatever money per day (unless there's some internal limit set by Google). I like your notification warning idea, but that should work for both non-premier (credit cards) as well as premier apps (which are getting invoiced). That said it would be good if Google would also introduce a daily limit for premier apps for protective reasons. If our code would do wrong and create such loops we could end up paying $100'000 per day or more. So as a premier client you have to be really careful not to create such loop holes. Marcel -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Google App Engine DataStore
Can any one let me know about how to retrieve data from multiple entities from DataStore?? I mean it should work like Join in MYSQL!!! Is that Possible -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Time to whitelist?
Just wondering if we could get an idea of the time it'd take to whitelist a PHP App Engine app submitted for whitelisting today. The counter says about 267 apps approved as of today, and we've seen a post from 11 days ago saying there was 76 at that point. So, that gives us an idea of the velocity - but we are left wondering how long the queue is.. It looks like a 3-5day wait would be expected, but how much longer could it be, with the recent announcement of GAE-PHP being official? Any further insight or assistance would be most welcome. Cheers! -- This email comes from the Lovatts Media Group Pty Ltd For information on Lovatts crossword and puzzle magazines including news, tutorials and subscriptions, visit www.lovattspuzzles.com Play online games puzzles with a chance to win prizes at www.youplay.com Order Lovatts syndicated puzzles for your own publication, website or other platform from www.puzzlexperts.com Disclaimer: This communication contains information which is confidential. If you are not the intended recipient of this communication please delete and destroy all copies and do not copy, disclose or distribute this communication without the prior authority of Lovatts Media Group. Any views expressed in this communication are those of the individual sender, except where the sender specifically states them to be the views of Lovatts Media Group. Except as required by law, Lovatts Media Group does not represent, warrant and/or guarantee that the integrity of this communication has been maintained. Please consider the environment before printing this email. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] GAE client API
Hello, I want to know is there is any client API for Google App Engine which help the developers to deploy, start, and stop applications to GAE, i.e., I need a library which I can use to deploy applications to GAE. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Time to whitelist?
From experience, anywhere between a few weeks, to a few months (from past invite only features). Definitly not days. I submitted a request the day after the annoncement (it was on 76 then) and not heard anything since. Probably different if you have a Premier account :) On Wed, May 29, 2013 at 4:31 AM, Matthew Lenton matth...@lovattsmedia.comwrote: Just wondering if we could get an idea of the time it'd take to whitelist a PHP App Engine app submitted for whitelisting today. The counter says about 267 apps approved as of today, and we've seen a post from 11 days ago saying there was 76 at that point. So, that gives us an idea of the velocity - but we are left wondering how long the queue is.. It looks like a 3-5day wait would be expected, but how much longer could it be, with the recent announcement of GAE-PHP being official? Any further insight or assistance would be most welcome. Cheers! This email comes from the Lovatts Media Group Pty Ltd For information on Lovatts crossword and puzzle magazines including news, tutorials and subscriptions, visit www.lovattspuzzles.com Play online games puzzles with a chance to win prizes at www.youplay.com Order Lovatts syndicated puzzles for your own publication, website or other platform from www.puzzlexperts.com Disclaimer: This communication contains information which is confidential. If you are not the intended recipient of this communication please delete and destroy all copies and do not copy, disclose or distribute this communication without the prior authority of Lovatts Media Group. Any views expressed in this communication are those of the individual sender, except where the sender specifically states them to be the views of Lovatts Media Group. Except as required by law, Lovatts Media Group does not represent, warrant and/or guarantee that the integrity of this communication has been maintained. Please consider the environment before printing this email. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Google App Engine DataStore
No, there are no 'joins' as such. But can use ReferenceProperty's to reference other entities https://developers.google.com/appengine/articles/modeling which will automatically be 'dereferenced' for you when used. NDB also has KeyProperty for the same purpose (but AFAIK its not automatically dereferenced) (in general though, its best to denormalize in the datastore, not normalize like used to with mysql and other rdbms's) On Wed, May 29, 2013 at 6:27 AM, Sravan Thotakura srvn...@gmail.com wrote: Can any one let me know about how to retrieve data from multiple entities from DataStore?? I mean it should work like Join in MYSQL!!! Is that Possible -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] GAE client API
The AppCfg tool itself. https://developers.google.com/appengine/docs/appcfg That having a CLI, is a API in and of itself. On Wed, May 29, 2013 at 10:52 AM, e.hos...@fci-cu.edu.eg wrote: Hello, I want to know is there is any client API for Google App Engine which help the developers to deploy, start, and stop applications to GAE, i.e., I need a library which I can use to deploy applications to GAE. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Attention Java MapReduce users
We get compile errors when we ant the latest version of the java mapreduce library with java SDK 1.8.0. Error is Builder() has private access. Is there an existing fix for that? [javac] /mr2/appengine-mapreduce-read-only/java/src/com/google/appengine/tools/mapreduce/outputs/GoogleCloudStorageFileOutputWriter.java:39: Builder() has private access in com.google.appengine.tools.cloudstorage.GcsFileOptions.Builder [javac] GCS_SERVICE.createOrReplace(file, new GcsFileOptions.Builder().mimeType(mimeType).build()); [javac] ^ [javac] /mr2/appengine-mapreduce-read-only/java/src/com/google/appengine/tools/mapreduce/outputs/GoogleCloudStorageFileOutputWriter.java:39: cannot find symbol [javac] symbol : method mimeType(java.lang.String) [javac] location: class com.google.appengine.tools.cloudstorage.GcsFileOptions.Builder [javac] GCS_SERVICE.createOrReplace(file, new GcsFileOptions.Builder().mimeType(mimeType).build()); [javac] ^ On Wed, May 22, 2013 at 4:48 PM, Tim Jones palan...@gmail.com wrote: Awesome, I downloaded a few minutes ago and have been running against it with no problems. Thanks! On Wed, May 22, 2013 at 4:46 PM, Tom Kaitchuck tkaitch...@google.comwrote: The issue mentioned above (The NPE when the last item was already written) has been fixed in the version 464 in the public svn. https://code.google.com/p/appengine-mapreduce/source/detail?r=464 On Mon, May 20, 2013 at 6:32 PM, Tom Kaitchuck tkaitch...@google.comwrote: This is a bug I am working on. It occurs when the last record to be written encounters a keyOrderingException (Meaning it was already written but an ACK was not received so it was retried.) So it should be rare and the retry of the shuffle that was added should cause it to be harmless. If you are seeing any broader problems send me a message off-list with your appId. I'll post an update here when a patch has been pushed out. On Mon, May 20, 2013 at 4:28 PM, Tim Jones palan...@gmail.com wrote: After upgrading, I'm getting the following NullPointerException in the InMemoryShuffler. Is this a known issue? Caused by: java.lang.NullPointerException at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob$1.run(InMemoryShuffleJob.java:234) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob$1.run(InMemoryShuffleJob.java:231) at com.google.appengine.tools.mapreduce.impl.util.RetryHelper.doRetry(RetryHelper.java:62) at com.google.appengine.tools.mapreduce.impl.util.RetryHelper.runWithRetries(RetryHelper.java:101) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.closeFinally(InMemoryShuffleJob.java:231) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.writeOutput(InMemoryShuffleJob.java:227) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.writeOutputs(InMemoryShuffleJob.java:243) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.run(InMemoryShuffleJob.java:253) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.run(InMemoryShuffleJob.java:42) ... 47 more On Wednesday, May 1, 2013 1:32:51 PM UTC-7, Tom Kaitchuck wrote: If you are using the experimental Java MapReduce library for App Engine, you are strongly encouraged to update to the latest version of the library in the public svn: https://code.google.com/p/** appengine-mapreduce/source/**checkouthttps://code.google.com/p/appengine-mapreduce/source/checkout Background: We are rolling out a fix to a long standing interaction bug between the experimental MapReduce library and the experimental Files API that, in certain circumstances, results in dropped data. Specifically this bug can cause some records emitted by the Map to be excluded from the input to Reduce. The bugfix involves patches to both the Files API and Java MapReduce. Unfortunately older versions of the Java MapReduce library running against the patched Files API will drop Map output under more common circumstances. The Files API fix will roll out on its own (no action required by you), but in order to avoid dropped data you must update to the latest version of the Java MapReduce libraryhttps://code.google.com/p/appengine-mapreduce/source/checkout . https://code.google.com/p/appengine-mapreduce/source/checkout We apologize for the trouble. Rest assured we are working aggressively to move MapReduce into a fully supported state. Tom Kaitchuck on behalf of the Google App Engine Team -- You received this message because you are subscribed to the Google Groups Google App Engine Pipeline API group. To unsubscribe from this group and stop receiving emails from it, send an email to app-engine-pipeline-api+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to a topic in the Google Groups Google
Re: [google-appengine] Re: Trusted Tester program for App Engine Datastore Backup to BigQuery Import
By the way, do you have any program about analyzing an application logs directly in BigQuery? That would be a great feature instead of having to write and manage jobs to read logs to write to Cloud Storage and to then import into BigQuery... On Wednesday, May 29, 2013 12:49:50 AM UTC+2, Takashi Matsuo (Google) wrote: Hi Michael, Sorry for the delay. I've just sent out another set of invitations. Let me know if you haven't received anything. -- Takashi On Tue, May 28, 2013 at 9:40 AM, Michael Chang mic...@firespotter.comjavascript: wrote: Hi Takashi, Is the trusted tester program still running for the Datastore to BigQuery import? I just applied but have not seen any updates regarding when we should hear back. Michael On Monday, October 1, 2012 5:34:21 PM UTC-7, Takashi Matsuo (Google) wrote: *Hi everyone, Do you want to quickly analyze your Datastore data with Google BigQuery? We are looking for a small group of trusted testers who can try out our new feature which allows you to import data from the experimental Datastore backup tool directly into BigQuery for analysis. If you’re interested, please fill out the formhttps://docs.google.com/spreadsheet/viewform?formkey=dHdpeXlmRlZCNWlYSE9BcE5jc2NYOUE6MQ [1] with more details about your use case.* * * *The BigQuery launch also includes support for JSON and its nested/repeated structure as well as significant improvements to the data loading pipeline. Check out their post on the Google Developers Bloghttp://googledevelopers.blogspot.com/2012/10/got-big-json-bigquery-expands-data.html[2] for more details on their latest release.** * *1. The application form for this TT program* https://docs.google.com/a/**google.com/spreadsheet/**viewform?formkey=** dHdpeXlmRlZCNWlYSE9BcE5jc2NYOU**E6MQhttps://docs.google.com/a/google.com/spreadsheet/viewform?formkey=dHdpeXlmRlZCNWlYSE9BcE5jc2NYOUE6MQ 2. The blog post about the new BigQuery release http://googledevelopers.**blogspot.jp/2012/10/got-big-** json-bigquery-expands-data.**htmlhttp://googledevelopers.blogspot.jp/2012/10/got-big-json-bigquery-expands-data.html * Thanks,* -- Takashi Matsuo | Developers Advocate | tma...@google.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com javascript:. To post to this group, send email to google-a...@googlegroups.comjavascript: . Visit this group at http://groups.google.com/group/google-appengine?hl=en . For more options, visit https://groups.google.com/groups/opt_out. -- Takashi Matsuo | Developers Programs Engineer | tma...@google.comjavascript: -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Attention Java MapReduce users
My fault. I forgot to update the revision of the GCS client the ant build.xml loads. If you want the fix right away just change the build.xml to have the line where it defines the property gcsversion to be r54.(You will also to need to delete the Jar if it has been previously downloaded into the same workspace.) I'll push out an update later today. On Wed, May 29, 2013 at 1:32 PM, Carter Maslan car...@maslan.com wrote: We get compile errors when we ant the latest version of the java mapreduce library with java SDK 1.8.0. Error is Builder() has private access. Is there an existing fix for that? [javac] /mr2/appengine-mapreduce-read-only/java/src/com/google/appengine/tools/mapreduce/outputs/GoogleCloudStorageFileOutputWriter.java:39: Builder() has private access in com.google.appengine.tools.cloudstorage.GcsFileOptions.Builder [javac] GCS_SERVICE.createOrReplace(file, new GcsFileOptions.Builder().mimeType(mimeType).build()); [javac] ^ [javac] /mr2/appengine-mapreduce-read-only/java/src/com/google/appengine/tools/mapreduce/outputs/GoogleCloudStorageFileOutputWriter.java:39: cannot find symbol [javac] symbol : method mimeType(java.lang.String) [javac] location: class com.google.appengine.tools.cloudstorage.GcsFileOptions.Builder [javac] GCS_SERVICE.createOrReplace(file, new GcsFileOptions.Builder().mimeType(mimeType).build()); [javac] ^ On Wed, May 22, 2013 at 4:48 PM, Tim Jones palan...@gmail.com wrote: Awesome, I downloaded a few minutes ago and have been running against it with no problems. Thanks! On Wed, May 22, 2013 at 4:46 PM, Tom Kaitchuck tkaitch...@google.comwrote: The issue mentioned above (The NPE when the last item was already written) has been fixed in the version 464 in the public svn. https://code.google.com/p/appengine-mapreduce/source/detail?r=464 On Mon, May 20, 2013 at 6:32 PM, Tom Kaitchuck tkaitch...@google.comwrote: This is a bug I am working on. It occurs when the last record to be written encounters a keyOrderingException (Meaning it was already written but an ACK was not received so it was retried.) So it should be rare and the retry of the shuffle that was added should cause it to be harmless. If you are seeing any broader problems send me a message off-list with your appId. I'll post an update here when a patch has been pushed out. On Mon, May 20, 2013 at 4:28 PM, Tim Jones palan...@gmail.com wrote: After upgrading, I'm getting the following NullPointerException in the InMemoryShuffler. Is this a known issue? Caused by: java.lang.NullPointerException at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob$1.run(InMemoryShuffleJob.java:234) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob$1.run(InMemoryShuffleJob.java:231) at com.google.appengine.tools.mapreduce.impl.util.RetryHelper.doRetry(RetryHelper.java:62) at com.google.appengine.tools.mapreduce.impl.util.RetryHelper.runWithRetries(RetryHelper.java:101) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.closeFinally(InMemoryShuffleJob.java:231) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.writeOutput(InMemoryShuffleJob.java:227) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.writeOutputs(InMemoryShuffleJob.java:243) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.run(InMemoryShuffleJob.java:253) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.run(InMemoryShuffleJob.java:42) ... 47 more On Wednesday, May 1, 2013 1:32:51 PM UTC-7, Tom Kaitchuck wrote: If you are using the experimental Java MapReduce library for App Engine, you are strongly encouraged to update to the latest version of the library in the public svn: https://code.google.com/p/** appengine-mapreduce/source/**checkouthttps://code.google.com/p/appengine-mapreduce/source/checkout Background: We are rolling out a fix to a long standing interaction bug between the experimental MapReduce library and the experimental Files API that, in certain circumstances, results in dropped data. Specifically this bug can cause some records emitted by the Map to be excluded from the input to Reduce. The bugfix involves patches to both the Files API and Java MapReduce. Unfortunately older versions of the Java MapReduce library running against the patched Files API will drop Map output under more common circumstances. The Files API fix will roll out on its own (no action required by you), but in order to avoid dropped data you must update to the latest version of the Java MapReduce libraryhttps://code.google.com/p/appengine-mapreduce/source/checkout . https://code.google.com/p/appengine-mapreduce/source/checkout We apologize for the trouble. Rest assured we are working aggressively to move MapReduce into a fully supported state. Tom Kaitchuck on behalf of
[google-appengine] Re: Attention Java MapReduce users
You should be able to sync to the SVN and get this update (r466) On Wed, May 29, 2013 at 3:52 PM, Tom Kaitchuck tkaitch...@google.comwrote: My fault. I forgot to update the revision of the GCS client the ant build.xml loads. If you want the fix right away just change the build.xml to have the line where it defines the property gcsversion to be r54.(You will also to need to delete the Jar if it has been previously downloaded into the same workspace.) I'll push out an update later today. On Wed, May 29, 2013 at 1:32 PM, Carter Maslan car...@maslan.com wrote: We get compile errors when we ant the latest version of the java mapreduce library with java SDK 1.8.0. Error is Builder() has private access. Is there an existing fix for that? [javac] /mr2/appengine-mapreduce-read-only/java/src/com/google/appengine/tools/mapreduce/outputs/GoogleCloudStorageFileOutputWriter.java:39: Builder() has private access in com.google.appengine.tools.cloudstorage.GcsFileOptions.Builder [javac] GCS_SERVICE.createOrReplace(file, new GcsFileOptions.Builder().mimeType(mimeType).build()); [javac] ^ [javac] /mr2/appengine-mapreduce-read-only/java/src/com/google/appengine/tools/mapreduce/outputs/GoogleCloudStorageFileOutputWriter.java:39: cannot find symbol [javac] symbol : method mimeType(java.lang.String) [javac] location: class com.google.appengine.tools.cloudstorage.GcsFileOptions.Builder [javac] GCS_SERVICE.createOrReplace(file, new GcsFileOptions.Builder().mimeType(mimeType).build()); [javac] ^ On Wed, May 22, 2013 at 4:48 PM, Tim Jones palan...@gmail.com wrote: Awesome, I downloaded a few minutes ago and have been running against it with no problems. Thanks! On Wed, May 22, 2013 at 4:46 PM, Tom Kaitchuck tkaitch...@google.comwrote: The issue mentioned above (The NPE when the last item was already written) has been fixed in the version 464 in the public svn. https://code.google.com/p/appengine-mapreduce/source/detail?r=464 On Mon, May 20, 2013 at 6:32 PM, Tom Kaitchuck tkaitch...@google.comwrote: This is a bug I am working on. It occurs when the last record to be written encounters a keyOrderingException (Meaning it was already written but an ACK was not received so it was retried.) So it should be rare and the retry of the shuffle that was added should cause it to be harmless. If you are seeing any broader problems send me a message off-list with your appId. I'll post an update here when a patch has been pushed out. On Mon, May 20, 2013 at 4:28 PM, Tim Jones palan...@gmail.com wrote: After upgrading, I'm getting the following NullPointerException in the InMemoryShuffler. Is this a known issue? Caused by: java.lang.NullPointerException at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob$1.run(InMemoryShuffleJob.java:234) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob$1.run(InMemoryShuffleJob.java:231) at com.google.appengine.tools.mapreduce.impl.util.RetryHelper.doRetry(RetryHelper.java:62) at com.google.appengine.tools.mapreduce.impl.util.RetryHelper.runWithRetries(RetryHelper.java:101) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.closeFinally(InMemoryShuffleJob.java:231) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.writeOutput(InMemoryShuffleJob.java:227) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.writeOutputs(InMemoryShuffleJob.java:243) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.run(InMemoryShuffleJob.java:253) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.run(InMemoryShuffleJob.java:42) ... 47 more On Wednesday, May 1, 2013 1:32:51 PM UTC-7, Tom Kaitchuck wrote: If you are using the experimental Java MapReduce library for App Engine, you are strongly encouraged to update to the latest version of the library in the public svn: https://code.google.com/p/** appengine-mapreduce/source/**checkouthttps://code.google.com/p/appengine-mapreduce/source/checkout Background: We are rolling out a fix to a long standing interaction bug between the experimental MapReduce library and the experimental Files API that, in certain circumstances, results in dropped data. Specifically this bug can cause some records emitted by the Map to be excluded from the input to Reduce. The bugfix involves patches to both the Files API and Java MapReduce. Unfortunately older versions of the Java MapReduce library running against the patched Files API will drop Map output under more common circumstances. The Files API fix will roll out on its own (no action required by you), but in order to avoid dropped data you must update to the latest version of the Java MapReduce libraryhttps://code.google.com/p/appengine-mapreduce/source/checkout . https://code.google.com/p/appengine-mapreduce/source/checkout
[google-appengine] Re: Attention Java MapReduce users
thank you. r466 compiles successfully. On Wed, May 29, 2013 at 4:10 PM, Tom Kaitchuck tkaitch...@google.comwrote: You should be able to sync to the SVN and get this update (r466) On Wed, May 29, 2013 at 3:52 PM, Tom Kaitchuck tkaitch...@google.comwrote: My fault. I forgot to update the revision of the GCS client the ant build.xml loads. If you want the fix right away just change the build.xml to have the line where it defines the property gcsversion to be r54.(You will also to need to delete the Jar if it has been previously downloaded into the same workspace.) I'll push out an update later today. On Wed, May 29, 2013 at 1:32 PM, Carter Maslan car...@maslan.com wrote: We get compile errors when we ant the latest version of the java mapreduce library with java SDK 1.8.0. Error is Builder() has private access. Is there an existing fix for that? [javac] /mr2/appengine-mapreduce-read-only/java/src/com/google/appengine/tools/mapreduce/outputs/GoogleCloudStorageFileOutputWriter.java:39: Builder() has private access in com.google.appengine.tools.cloudstorage.GcsFileOptions.Builder [javac] GCS_SERVICE.createOrReplace(file, new GcsFileOptions.Builder().mimeType(mimeType).build()); [javac] ^ [javac] /mr2/appengine-mapreduce-read-only/java/src/com/google/appengine/tools/mapreduce/outputs/GoogleCloudStorageFileOutputWriter.java:39: cannot find symbol [javac] symbol : method mimeType(java.lang.String) [javac] location: class com.google.appengine.tools.cloudstorage.GcsFileOptions.Builder [javac] GCS_SERVICE.createOrReplace(file, new GcsFileOptions.Builder().mimeType(mimeType).build()); [javac] ^ On Wed, May 22, 2013 at 4:48 PM, Tim Jones palan...@gmail.com wrote: Awesome, I downloaded a few minutes ago and have been running against it with no problems. Thanks! On Wed, May 22, 2013 at 4:46 PM, Tom Kaitchuck tkaitch...@google.comwrote: The issue mentioned above (The NPE when the last item was already written) has been fixed in the version 464 in the public svn. https://code.google.com/p/appengine-mapreduce/source/detail?r=464 On Mon, May 20, 2013 at 6:32 PM, Tom Kaitchuck tkaitch...@google.comwrote: This is a bug I am working on. It occurs when the last record to be written encounters a keyOrderingException (Meaning it was already written but an ACK was not received so it was retried.) So it should be rare and the retry of the shuffle that was added should cause it to be harmless. If you are seeing any broader problems send me a message off-list with your appId. I'll post an update here when a patch has been pushed out. On Mon, May 20, 2013 at 4:28 PM, Tim Jones palan...@gmail.comwrote: After upgrading, I'm getting the following NullPointerException in the InMemoryShuffler. Is this a known issue? Caused by: java.lang.NullPointerException at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob$1.run(InMemoryShuffleJob.java:234) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob$1.run(InMemoryShuffleJob.java:231) at com.google.appengine.tools.mapreduce.impl.util.RetryHelper.doRetry(RetryHelper.java:62) at com.google.appengine.tools.mapreduce.impl.util.RetryHelper.runWithRetries(RetryHelper.java:101) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.closeFinally(InMemoryShuffleJob.java:231) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.writeOutput(InMemoryShuffleJob.java:227) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.writeOutputs(InMemoryShuffleJob.java:243) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.run(InMemoryShuffleJob.java:253) at com.google.appengine.tools.mapreduce.impl.InMemoryShuffleJob.run(InMemoryShuffleJob.java:42) ... 47 more On Wednesday, May 1, 2013 1:32:51 PM UTC-7, Tom Kaitchuck wrote: If you are using the experimental Java MapReduce library for App Engine, you are strongly encouraged to update to the latest version of the library in the public svn: https://code.google.com/p/** appengine-mapreduce/source/**checkouthttps://code.google.com/p/appengine-mapreduce/source/checkout Background: We are rolling out a fix to a long standing interaction bug between the experimental MapReduce library and the experimental Files API that, in certain circumstances, results in dropped data. Specifically this bug can cause some records emitted by the Map to be excluded from the input to Reduce. The bugfix involves patches to both the Files API and Java MapReduce. Unfortunately older versions of the Java MapReduce library running against the patched Files API will drop Map output under more common circumstances. The Files API fix will roll out on its own (no action required by you), but in order to avoid dropped data you must update to the latest version of the Java MapReduce
[google-appengine] Re: GAE client API
Though you can stop an instance through the web console, there is not api to do that. On Thursday, May 30, 2013 8:52:07 AM UTC+8, timh wrote: As Barry said, appcfg is your api. However stop/start doesn't make a whole lot of sense unless you are talking about backends. On Wednesday, May 29, 2013 5:52:14 PM UTC+8, e.ho...@fci-cu.edu.eg wrote: Hello, I want to know is there is any client API for Google App Engine which help the developers to deploy, start, and stop applications to GAE, i.e., I need a library which I can use to deploy applications to GAE. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: GAE client API
As Barry said, appcfg is your api. However stop/start doesn't make a whole lot of sense unless you are talking about backends. On Wednesday, May 29, 2013 5:52:14 PM UTC+8, e.ho...@fci-cu.edu.eg wrote: Hello, I want to know is there is any client API for Google App Engine which help the developers to deploy, start, and stop applications to GAE, i.e., I need a library which I can use to deploy applications to GAE. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Time to whitelist?
So there's no set time frame ... generally we're looking for some diversity so we can get some coverage of the runtime. If you're really keen ping me with the app id you registered and I'll take a look at what I can do, no promises however On Thursday, 30 May 2013 02:29:44 UTC+10, barryhunter wrote: From experience, anywhere between a few weeks, to a few months (from past invite only features). Definitly not days. I submitted a request the day after the annoncement (it was on 76 then) and not heard anything since. Probably different if you have a Premier account :) On Wed, May 29, 2013 at 4:31 AM, Matthew Lenton matt...@lovattsmedia.comjavascript: wrote: Just wondering if we could get an idea of the time it'd take to whitelist a PHP App Engine app submitted for whitelisting today. The counter says about 267 apps approved as of today, and we've seen a post from 11 days ago saying there was 76 at that point. So, that gives us an idea of the velocity - but we are left wondering how long the queue is.. It looks like a 3-5day wait would be expected, but how much longer could it be, with the recent announcement of GAE-PHP being official? Any further insight or assistance would be most welcome. Cheers! This email comes from the Lovatts Media Group Pty Ltd For information on Lovatts crossword and puzzle magazines including news, tutorials and subscriptions, visit www.lovattspuzzles.com Play online games puzzles with a chance to win prizes at www.youplay.com Order Lovatts syndicated puzzles for your own publication, website or other platform from www.puzzlexperts.com Disclaimer: This communication contains information which is confidential. If you are not the intended recipient of this communication please delete and destroy all copies and do not copy, disclose or distribute this communication without the prior authority of Lovatts Media Group. Any views expressed in this communication are those of the individual sender, except where the sender specifically states them to be the views of Lovatts Media Group. Except as required by law, Lovatts Media Group does not represent, warrant and/or guarantee that the integrity of this communication has been maintained. Please consider the environment before printing this email. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com javascript:. To post to this group, send email to google-a...@googlegroups.comjavascript: . Visit this group at http://groups.google.com/group/google-appengine?hl=en . For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Google App Engine DataStore
You can use entity groups to model one root entity (e.g. customer) and multiple dependent child entities (e.g. order,cart items..). All entities belonging to one entity group (e.g. one single customer) can be retrieved together using an ancestor query - kind of like a 'join'. But unlike with SQL joins you cannot retrieve all entities of multiple entity groups in a single query. Also using entity groups like that gives you transactional consistency guarantees while reading and writing. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
