Re: [google-appengine] Implementing a scalable streaming data collector in GAE
Using the logs sounds like an interesting possibility. They would be amazingly scalable (if one thinks about the fact that every single request on App Engine is saving a record). I may have to look at that as memcache (even dedicated) seems to occasionally hit a long enough snag to loose a considerable number of records in a row. I wonder how fast one can read from the logs API and how quickly log events appear after the handler finishes a request. Will look at this. Big Query sounds more like a solution to analyse the data rather than storing it, but Mache does give me some ideas even if it's Java. I've seen an python look-alike called log2bq http://code.google.com/p/log2bq/(written by some Googlers). On Wednesday, 11 September 2013 23:35:41 UTC+10, barryhunter wrote: A possibly off the wall idea. Have a NOOP handler. Literally it does nothing aside from return the correct HTTP Status code. Then extract the data from the standard App Engine Logs! Google have obviouslly built a scalable logging infrastructure. Use it. The logs include the GET paramaters and more. They can be downloaded in bulk https://developers.google.com/appengine/docs/python/tools/uploadinganapp#Python_Downloading_logs There is also a API for accessing logs from an app directly https://developers.google.com/appengine/docs/python/logs/functions but there have been some questions as to it scalablity/performance. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Disassociate custom domain from appengine project
Thanks Vinny, Will look at adding the alias domain for the project. On Thu, Sep 12, 2013 at 3:51 AM, Vinny P vinny...@gmail.com wrote: On Wed, Sep 11, 2013 at 2:33 AM, Jeffery Fernandez jefferyfernan...@gmail.com wrote: I have an appengine project for which I have associated a custom domain to it (via Google Apps). However the project needs to be associated with a different domain name. Is this as simple as associating a new domain via Google Apps account and changing appropriate DNS records? You can't disassociate the original domain name, Google Apps accounts are locked to the original domain name they were created with. See http://support.google.com/a/bin/answer.py?hl=enanswer=54819 Quote: *However, at this time you can't change which domain is your primary domain* What you can do is create an alias domain, and map your application to that. See https://groups.google.com/d/msg/google-appengine/f27NB1ptv40/fMOpqQlct3AJfor a discussion on how to map alias domains in Apps. - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out. -- Mobile: +61 430 534 464 Home: +61 3 9764 4439 Work: +61 3 9723 9399 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Writes to cloud storage hanging after opening file?
On Wednesday, September 11, 2013 3:48:12 PM UTC+1, Vinny P wrote: You were able to write a single character without a problem, but 1 MB of characters was too much for it. So I were you, I'd try to find that inflection point and then save to Cloud Storage in chunks less than that. For example, try to write to Cloud Storage in chunks of 250 KB, if that works, try writing in chunks of 400 KB, and so on. Of course this is only a bandaid solution - something is clearly wrong with the underlying urlfetch implementation. I'm not too convinced - I wouldn't expect it to be so binary. Writes of 1MB aren't *always* failing so if there is some size-dependant problem, I would expect smaller writes to continue to fail but with a lower probability (this might be fine if a failure didn't cause the instance to hang indefinitely, as you could then retry!) On Wednesday, September 11, 2013 3:48:12 PM UTC+1, Vinny P wrote: But if I had to make a recommendation, I'd say skip the whole backend writing thing altogether. It's a waste of money to load up backends for the purposes of writing (unless you're Bill Gates or similar!). You said frontend instances seem to be much better in terms of writing - try using task queues to spawn off frontend requests which are solely dedicated to writing to Cloud Storage. If you need a temporary place to store data, write it to the datastore or Cloud SQL until the tasks can get to the GCS writing. Well yes, clearly my actual requirement isn't just to store some number of 'f's in GCS, the backends are required to do some amount of processing before writing results. Thanks for the suggestion though - that's definitely something I can explore if there is no actual fix for this issue. Cheers, Ben -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Deployment error after upgrading to 1.8.3
It did not work. When i switched back to GAEJ 1.7.3 with all the configurations remaining the same, it worked. But with GAEJ 1.83 it fails. On Thu, Sep 12, 2013 at 8:52 AM, Shilendra Sharma shilendra...@gmail.comwrote: Thanks vinny for your support.. On Sep 12, 2013 8:29 AM, Vinny P vinny...@gmail.com wrote: On Wed, Sep 11, 2013 at 3:04 PM, Deepak Singh deepaksingh...@gmail.com wrote: my project was being deployed successfully. I upgraded to GAE Java 1.8.3 and since after that i am getting the following error during deployment. Preparing to deploy: Created staging directory at: 'C:\Users\Deepak\AppData\Local\Temp\appcfg9147832672184820845.tmp' Scanning for jsp files. Compiling jsp files. java.lang.RuntimeException: Cannot get the System Java Compiler. Please use a JDK, not a JRE. When you upgraded GAE, you probably reset the JDK/JRE path. Go to Eclipse - Window - Preferences - Java - Installed JREs and make sure that there is a JDK in the list. If not, delete any JREs in there and add the JDK through the Add button on the right hand side. - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out. -- Deepak Singh -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: App Engine VM-based Backends - Trusted Tester Sign-up
What other options can you specify? This post points to the documentation, the documentation just mentions other options can be set but doesn't say what they are, unless I'm missing something. Thank you, Josh On Thursday, June 20, 2013 2:21:06 PM UTC-5, Takashi Matsuo (Google) wrote: Fellow App Engine Gurus, We're happy to announce the next generation of App Engine Managed Backends. These Backends utilize the App Engine VM Runtime, allowing developers to run Backends on Compute Engine VMs. By building on top of Compute Engine VMs, developers can: - take advantage of higher CPU and memory - rely on longer-lived processes - utilize a local filesystem - communicate via native network stacks - execute external processes - access the entire JRE - upload arbitrary Python extensions Given that these are App Engine Backends, you can still use all the App Engine APIs to access the existing managed services (Datastore, Task Queues, Memcache, etc.) Updating existing Backends to run on Compute Engine VMs is a simple config change: app.yaml application: app-id version: v1 runtime: python27 *vm: true* * * *manual_scaling:* * instances: 1* That’s all you need to get started. We’ll pick a deafult VM machine type and spin everything up your behalf. Of course there other options that you can set (including machine type) and these are documented in the Getting Started Guidehttps://docs.google.com/document/d/1VH1oVarfKILAF_TfvETtPPE3TFzIuWqsa22PtkRkgJ4/edit# . In order to build a great product, we need quality feedback from brave early adopters. If you’re interested test driving, please sign-up at the link below and we’ll take care of the rest. App Engine VM-based VM Runtime - Trusted Tester Sign-uphttps://docs.google.com/forms/d/1NTPROehZLn7lzu3pcXryB8BlZN5cu0SwiIzPnl35xHs/viewform Also, if you have any questions, please feel free to send an email to: appengine-...@googelgroups.com javascript: Thanks! -- Takashi Matsuo | Developers Programs Engineer | tma...@google.comjavascript: -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Deployment error after upgrading to 1.8.3
On Thu, Sep 12, 2013 at 11:40 AM, Deepak Singh deepaksingh...@gmail.com wrote: When i switched back to GAEJ 1.7.3 with all the configurations remaining the same, it worked. But with GAEJ 1.83 it fails. Then you may have other build paths and your computer's classpath set improperly. Make sure that they all include the path to the JDK, not the JRE. If they include a reference to both, make sure the JDK reference is listed before the JRE reference. - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Deployment error after upgrading to 1.8.3
All points that you mentioned are correct. I cross verified. Problem is it works with 1.7.3 but not with 1.8.3 On Thu, Sep 12, 2013 at 11:22 PM, Vinny P vinny...@gmail.com wrote: On Thu, Sep 12, 2013 at 11:40 AM, Deepak Singh deepaksingh...@gmail.com wrote: When i switched back to GAEJ 1.7.3 with all the configurations remaining the same, it worked. But with GAEJ 1.83 it fails. Then you may have other build paths and your computer's classpath set improperly. Make sure that they all include the path to the JDK, not the JRE. If they include a reference to both, make sure the JDK reference is listed before the JRE reference. - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out. -- Deepak Singh -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] GAE User service account logins with Android
I've built a web app on GAE, and I use the User service to login. When I login using an Android browser, the browser generates a little yellow tab asking if I want to login using one of the google accounts set up on the Android device. Now I've built my own Android app that wraps around a WebView to access my WebApp. I used some of the Android browser code to mimic the yellow auto-login tab. This worked fine for the first half of the year. Recently howerver, it stopped working. After I attempt to login, the URL I get back frrom the Android AccountManager.getAuthToken() callback is: https://accounts.google.com/MergeSession?args=service%3Dah%26continue%3Dhttps%253A%252F%252Fappengine.google.com%252F_ah%252Fconflogin%253Fcontinue%253Dhttp%253A%252F%252Ftest.dine-o.com%252Fcomplete%252Fgoogle-appengine%252Fuberauth=WILL_NOT_SIGN_IN,,%0Asource=AndroidWebLogin This URL is broken - ie goes to a GAE 500 error page. I'm trying to figure out whether this is something broken with the User service, or my Android app (which was working fine until maybe a month ago). -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Google Cloud Storage Account to connect
In my Google Apis Console https://code.google.com/apis/console/ I have 5-6 different projects. see pic http://i.snag.gy/vYfq0.jpg My appengine always connects to Cloud Storage account associated with one of these projects. How do I change it to connect to different Cloud Storage from my another project. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] GAE User service account logins with Android
On Thu, Sep 12, 2013 at 2:45 PM, D X drag...@gmail.com wrote: This URL is broken - ie goes to a GAE 500 error page. I'm trying to figure out whether this is something broken with the User service, or my Android app (which was working fine until maybe a month ago).\ Do you see any error logs in your App Engine admin console screen? Have you changed any part of the application code at the same time this error popped up? Also, are you logged into multiple Google accounts or just one when trying to do this? - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
