[google-appengine] How to create something similar to Zoho Creator

[Marc]

With a few drag'n'drop, Zoho creator lets you create a simple records 
management system i.e. create a few tables, a few forms, and you can 
add/edit/delete records in forms, search in list... all without any coding. 
They used to export to GAE but it looks like it's gone.

I'd like to know if there is a product that would do the same for GAE or 
maybe create the boilerplate code. I need to create a dozen forms, add CRUD 
capabilities to each form, have fields in the forms with auto-complete 
drop-down controls pointing to other tables and provide lists with 
sort/search/pagination.
I've looked at GWT libraries like SmartGWT and it helps with the UI but 
there's still a fair bit of code to go through to create all the CRUD 
service to the datastore. I'm also very bad CSS/HTML so what I got running 
looked pretty bad. :)

Ideas?

Thanks 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/OqLXcP2FuOMJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] How to I use xml.sax in google app engine??

[marc]

Hi list,

I'm just playing with the google app engine. But can't seem to get the
xml.sax to work :-(

This is my code to read the xml:

def returnTasks(xmldata):
handler = TaskHandler()
xml.sax.parseString(xmldata,handler)
return handler.tasks

I read the xmldata from a url with googles url fetch.
It works from command line. But when I run it in the app engine, i get
a:

AttributeError: 'module' object has no attribute 'unlink'

Why is this??

.Marc

--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: How to I use xml.sax in google app engine??

[marc]

Sorry about that.

Next time I will RTFM first.

.Marc

On Sep 11, 1:08 am, marc <[EMAIL PROTECTED]> wrote:
> Hi list,
>
> I'm just playing with the google app engine. But can't seem to get the
> xml.sax to work :-(
>
> This is my code to read the xml:
>
> def returnTasks(xmldata):
>     handler = TaskHandler()
>     xml.sax.parseString(xmldata,handler)
>     return handler.tasks
>
> I read the xmldata from a url with googles url fetch.
> It works from command line. But when I run it in the app engine, i get
> a:
>
> AttributeError: 'module' object has no attribute 'unlink'
>
> Why is this??
>
> .Marc
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: GAE alternatives? :-)

[marc]

Hi, I recommend you to have a look to these lists:

http://code.djangoproject.com/wiki/DjangoFriendlyWebHosts
http://djangohosting.org/

On the other hand, I've used webfaction for several projects, and it's
very easy and quick to use.


Marc
http://plazz.me


On Feb 28, 1:27 pm, KillIEbrowser  wrote:
> Hi, have you a full list of Django hosting?
>
> I'm looking for alternatives because I like Python but I don't like
> the Google's "New Terms of Service" :-(
>
> On Feb 27, 10:28 pm, phil jones  wrote:
>
> > not to the whole package ... but you can get Django hosting in various
> > places ... eg. Webfaction
>
> > On Fri, Feb 27, 2009 at 8:03 PM, KillIEbrowser  
> > wrote:
>
> > > Do alternatives exist?
>
>
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] GAE Datastore low-level API null=empty list=non-existent

[Marc Hacker]

Surely this is not intended!  Entity.getProperty() gives exactly the
same result, null, if there is no property, there is a property set to
null or there is an empty Collection!


DatastoreService datastore =
DatastoreServiceFactory.getDatastoreService();
Key key = KeyFactory.createKey("testKind", "testKey");
Entity e = new Entity(key);
e.setProperty("null", null);
e.setProperty("emptylist", new ArrayList());
datastore.put(e);
try {
Entity e2 = datastore.get(key);
System.out.println(e2.getProperty("null")==null);
System.out.println(e2.getProperty("emptylist")==null);

System.out.println(e2.getProperty("doesNotExist")==null);
} catch (EntityNotFoundException exc) {
exc.printStackTrace();
}
Result:
true
true
true

At the very least an empty list should be saved as an empty list no?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Update on Alfred Fuller's Next gen queries talk + geolocation

[Marc Hacker]

Is there any update and ETA on the exciting new features previewed
here
http://code.google.com/events/io/2010/sessions/next-gen-queries-appengine.html

Any advice how to prepare for this? For examples Alfred said there
will be special queries for geolocation. Is there a specific format in
which to store longitude/latitude today so that those queries will run
on my data in the future?

Any update when we might be able to query to number ranges?

Thanks

Marc

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Java: Can I retrieve a localhost or relative URL (or JSP workaround)

[Marc Hacker]

I need one JSP file to read another JSP file into a String

Is there some efficient way to just read the URL e.g. using
URLConnection to localhost/my.jsp

Or is there some trick for one JSP to read another JSP page into a
String?

I want to do this efficiently (i.e. make sure it goes to the same
server not out to the network) and without paying for the bandwidth!

Thanks

Marc

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Task Queue not working in Eclipse plugin (on Mac)

[Marc Hacker]

When I try to add to queue in the development environment I get:

java.lang.RuntimeException: org.quartz.SchedulerConfigException:
Unable to instantiate class load helper class:
org.quartz.simpl.CascadingClassLoadHelper cannot be cast to
org.quartz.spi.ClassLoadHelper [See nested exception:
java.lang.ClassCastException:
org.quartz.simpl.CascadingClassLoadHelper cannot be cast to
org.quartz.spi.ClassLoadHelper]
at
com.google.appengine.api.labs.taskqueue.dev.LocalTaskQueue.startScheduler(LocalTaskQueue.java:
433)



Caused by: org.quartz.SchedulerConfigException: Unable to instantiate
class load helper class: org.quartz.simpl.CascadingClassLoadHelper
cannot be cast to org.quartz.spi.ClassLoadHelper [See nested
exception: java.lang.ClassCastException:
org.quartz.simpl.CascadingClassLoadHelper cannot be cast to
org.quartz.spi.ClassLoadHelper]
at
org.quartz.impl.StdSchedulerFactory.instantiate(StdSchedulerFactory.java:
549)
at
org.quartz.impl.StdSchedulerFactory.getScheduler(StdSchedulerFactory.java:
1152)
at
org.quartz.impl.StdSchedulerFactory.getDefaultScheduler(StdSchedulerFactory.java:
1168)
at
com.google.appengine.api.labs.taskqueue.dev.LocalTaskQueue.startScheduler(LocalTaskQueue.java:
423)

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Task Queue not working in Eclipse plugin (on Mac)

[Marc Hacker]

Same on Windows

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Task Queue not working in Eclipse plugin (on Mac)

[Marc Hacker]

Please star this issue 
http://code.google.com/p/googleappengine/issues/detail?id=3651

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Eclipse plugin with 1.3.8 doesn't recognize local data from 1.3.7 (local_db.bin)

[Marc Hacker]

When I compile in eclipse using the new app engine 1.3.8 my app finds
no data that was saved into the local datastore when I previously ran
under 1.3.7. When I recompile using 1.3.7 everything works great.

Somehow 1.3.8 is not recognizing a local_db.bin file saved with 1.3.7

Issue raised: http://code.google.com/p/googleappengine/issues/detail?id=3909

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Early Christmas Present from Google?

[Marc Provost]

+1

Thanks googlers! This is awesome.

On Nov 7, 4:58 pm, nickmilon  wrote:
> + 1
> Impressive performance gains - congratulation to Google and App Engine
> team.
> Lets hope current performance will be a benchmark for the future.
>
> On Nov 7, 12:17 am, Greg  wrote:
>
>
>
>
>
>
>
> > Check out the datastore stats after today's maintenance...
>
> >http://code.google.com/status/appengine/detail/datastore/2010/11/06#a...

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: FAQ for out of preview pricing changes

[Marc Hede]

Hello Greg,

For all of those interested in the future of Python on App Engine, there has 
been a thread started on this topic.  See here: 
http://code.google.com/appengine/forum/python-forum.html?place=topic%2Fgoogle-appengine-python%2F85EcIif5vNQ%2Fdiscussion

This is mainly python specific, but Java developers may get some benefit 
from some of the content written here.

Best

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: What do you want to see answered in Greg's pricing FAQ?

[Marc Hede]

If anyone is still monitoring this topic, and interested in asking questions 
about Python concurrency on App Engine, please see this topic here:
http://code.google.com/appengine/forum/python-forum.html?place=topic%2Fgoogle-appengine-python%2F85EcIif5vNQ%2Fdiscussion

This may also benefit Java developers to but it is mainly geared towards 
Python runtime specifically.

Best

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Server Error 500 upon deploy

[marc fawzi]

been getting this message the last half hour:

Scanning files on local disk.
Error 500: --- begin server output ---

Server Error (500)
A server error has occurred.
--- end server output ---

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Servlet getInputStream fail with GAE 1.5!!

[Marc Hacker]

HttpServletRequest request.getInputStream() works great in 1.4 but
fails in 1.5. This is a pretty basic problem.

Here is some test code:

public void doPost(HttpServletRequest request, HttpServletResponse
response) {
try {
response.setContentType("text/plain; charset=utf-8");
byte [] b = new byte [10]; // reusable buffer for 
reading bytes
int len = request.getInputStream().read(b);
response.getWriter().println("Number of bytes = " + 
len);
} catch (IOException e) {
e.printStackTrace();
}
}

Then post some data with:






With 1.4 you get the length of the data, with 1.5.2 I get -1 !!

Also see 
http://stackoverflow.com/questions/5348298/servlets-request-getinputstream-request-getreader-not-working-struts2

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Erroneous billing? How to get addressed?

[Marc Matteo]

Hi all,

I'm sorry if this is the wrong place, I can't seem to find a better place...

I got hit with a small charge by App Engine and I don't think it's right 
and I don't know how to get it removed (besides calling my Credit Card 
company).

Here's what happened:

I have a very small app on App engine and transitioned it to the High 
Replication datastore.  I disabled the old app -- but left billing enabled. 
 I got billed for $2.10 which while I think that was a little shady, I can 
understand it.  I then disabled billing on the old, disabled app and wound 
up with a charge for $12.29 on my card which Google says is a "One-time 
charge for the outstanding balance that has not been paid..." but this 
isn't anywhere in the billing history.

I do note that I had a weekly charge limit of $14 (I said this was a small 
app) and I wonder if this is some odd proration of that $14.

So how do I go about getting said charge removed?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/o3Nrx4YLErkJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Erroneous billing? How to get addressed?

[Marc Matteo]

Thank you Amy, that form worked and someone from Google got back to me and 
clarified things.

It seems a charge failed sometime in the recent past and so it was never 
paid.  The charge however wasn't showing in the Balance column so it 
appeared to me as if everything was OK.  When billing was disabled, that 
outstanding charge popped up.

This is not the first time I've been hit by this, my employer had something 
similar happen when billing was disabled on an app.  A charge had failed 
almost a year prior but was not showing in the balance of the app.  Only 
when billing was disabled did it appear.

I consider this a bug. :(

Also, as for the whole "disabled the app but not the billing" thing, well 
that's a bug too ;).

Thanks again,
Marc

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/FcYPWNrsSHEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Google Channel API /_ah/channel/connected/ not called while /_ah/channel/disconnected/ is

[Marc Hacker]

Using Google Channel API I find that /_ah/channel/disconnected/ is
always called promptly while /_ah/channel/connected/ is not. Many
times I never get a connect call and then get a disconnect call for a
channel which the server has not been notified about!

(I saw some people had the opposite problem that disconnect is delayed)

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] SSL for custom domain not working with wild card subdomain and hyphenated domain (hyphen/dash - in subdomain)

[Marc Hacker]

We have installed using SNI a Godaddy certificate with a wildcard 
subdomain.  Google App Engine serves fine on all subdomains without a 
hyphen - but we get an SSL error on hyphenated domains.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/5-CjNwCF9YwJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: SSL for custom domain not working with wild card subdomain and hyphenated domain (hyphen/dash - in subdomain)

[Marc Hacker]

Strange it seems to be working now!  Did you guys change anything?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/k4lyzs6HwPMJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] RuntimeHelper.checkRestricted adding 25X overhead to antlr parsing on GAE Java 1.7

[Marc Hacker]

We are using *antlr* parsing on GAE 1.7 and find a 25x overhead running on 
GAE v. standalone Java app because it spends 96% of its time in 
RuntimeHelper.checkRestricted()!!

(We are NOT in GAE 1.6.4 which had a bug of extra calls to 
RuntimeHelper.checkRestricted)

Does anyone know a list of which method calls trigger calls to 
RuntimeHelper.checkRestricted so that we can potentially avoid those 
please? For some reason I can't find any documentation of this security 
manager and what triggers it.

One call which repeatedly triggers a time-consuming call to checkRestricted 
seems to be antlr.runtime.DFA.predict(IntStream)

How can we avoid this impossibly big security overhead please - thanks!

Thanks!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/yWpCiBYpl7AJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Do F1 F2 F4 Google App Engine frontend instances really cost more

[Marc Hacker]

If F2 costs double as much as F1 per CPU hour but takes half the time to 
complete tasks shouldn't the total cost be about the same?

Thanks

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/jnf-xzkuwD8J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Do F1 F2 F4 Google App Engine frontend instances really cost more

[Marc Hacker]

Thanks Barry.

So I think you're saying that the instance hours are charged even when the 
CPU is not busy and F2 costs twice as much as F1 even when the server is 
idle between requests or when waiting for database, right?

Strangely we are experimenting with switching between F1 / F2 / F4 and 
seeing *virtually no difference* in performance of a server benchmark (pure 
CPU - a big for loop).  Could it be that the F1/F2/F4 switch does not take 
effect immediately?  Or could it be that when the server is not loaded F1 
will perform the same as F4?

Thanks

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/JWWgK2CfWFkJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Do F1 F2 F4 Google App Engine frontend instances really cost more

[Marc Hacker]

Thanks yes we found that stopping instances is necessary to activate 
changes in the F1/F2/F4 settings.

But we are still getting F4 at most 2-3x faster than F1 even for a pure CPU 
benchmark (for loop)

On Thursday, July 19, 2012 10:50:22 AM UTC+3, Francois Masurel wrote:
>
> Have you tried to shutdown your currently running instances?  It should 
> help.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Heey-25_BqkJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] TOS question - may I add a dial button

[Marc Heinken]

I'm currently working on a CRM and help desk application where I wanted to 
add a dial button to easily call back customers by phone (PSTN).

Now paragraph 4.3(f) of the Terms of Service is forbidding to:

(f) use the Service to operate or enable any telecommunications service or 
in connection with any Application that allows End Users to place calls to 
or to receive calls from any public switched telephone network; 

The dial button would just trigger an XHR call to the PBX that sets up the 
call between the user's and the customer's phones. The phone call does not 
touch appengine at all.

So would that dial button still be in violation of the Terms of Service?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/ba5omQKj_yAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: TOS question - may I add a dial button

[Marc Heinken]

In earlier (around 2009) versions of the ToS that section reads like this:

*You agree not to use the XMPP API to operate or to enable any 
telecommunications service or in connection with any applications that 
allow users to place calls to or receive calls from any public switched 
telephone network.*

That seems reasonable to me. After all, looking at the heavy usage 
restrictions of the channel API, realtime-communication isn't the 
infrastructure's biggest forte and running a telephony system on top of 
XMPP could be considered misuse.

I don't think Google Voice is that big a profit center to justify such 
restrictions. Maybe it's some kind of regulation I don't know about. 

Does that section really disallow ANY type of interaction of an appengine 
hosted site with ANY other web based application that connects to the PSTN 
even if that interaction is only part of the client side HTML/Javascript 
code and does NOT happen inside appengine?
If so, would that include interacting with Google Voice? How about 
embedding a skype call button or a SIP-URL in my HTML?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/knlnsy6pyIAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] How do you memcache properly? :-)

[Marc Seiler]

Hey guys I am somewhat new to appengine and memcache and I am struggling to 
set my stuff up properly.


I have 2 different situations for the same dataset I need to figure out the 
best way to handle it.

-

First situation: On the devices checking in. Some check in very fast 
because they need to keep the service up to date with the newest 
information while some check in much slower. Doing this I learned that 
appengines free quota on read/write operations can be ran through rather 
quickly. So I started researching the memcache features. The problem is I 
am not sure how to use memcache with this type of thing but I have come up 
with 2 different methods and I ask for your help on chosing or being told 
that I am doing it stupid. The main requirement for later is that it has to 
be searchable by user because devices are attached to users and each user 
can have multiple devices. 

Method 1: When devices check in I store each one in a separate key/value 
pair in memcache and then have a global list in a key/value pair for each 
user that gets updated on new devices or when devices get deleted. The 
global list is So I can use get_multi to get the list all at once.

Method 2: When a device is checked in a key/pair is pulled for that user 
that contains that users list of devices and it is updated accordingly. 
Then the key/pair is pulled when needed later.

Both of these methods will also update a database for that device if it 
changes so we always have a database copy. The memcache is mainly what I am 
using to detect the changes so I make minimal read/write requests to 
database.

On top of not knowing which method is best if either one is at all I am not 
sure how I can set this up to repopulate them from the database if it ever 
goes away in memcache. This part I am sure I can figure out but I come to 
you guys and girls to see if I am even starting properly.

-

Second Situation: Listing the devices for the users on the site so they can 
control them. I was thinking since this is going to be way less frequent 
that I wouldn't really need to use memcache at all but I also thought that 
devices checking in like they did wasn't a big deal either until appengine 
said oops out of free quota lol. So. I was thinking I should be using 
memcache but I was worried about losing search capabilities THEN I thought 
maybe I could use angular.js to pull the devices and do client side 
searching. Thoughts?

-

All in all I am really lost and in over my head on this and I love it :P I 
am really REALLY impress with the appengine service and its been super fun 
developing for. its been days and days of staring at a screen going wtf do 
I do now. If anyone has any good resources/books for me to read I would be 
very thankful.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: "Instance Unavailable"

[Marc Dugger]

George,

Thanks for the reply. I already have retry parameters set for that 
particular queue:

<https://lh3.googleusercontent.com/-cA8IdOyA3d8/WYoS-rm9e4I/rPc/lS2Gl-MijGw5VgEIm_SYH92tlYDO-3fGACLcBGAs/s1600/Screen%2BShot%2B2017-08-08%2Bat%2B2.35.23%2BPM.png>

...and I'm unsure how adjusting the above parameters would help alleviate 
"Instance Unavailable".



On Friday, July 14, 2017 at 8:57:59 AM UTC-5, George (Cloud Platform 
Support) wrote:
>
> Hello Marc, 
>
> It is not so out-of-common for tasks in the task queue to fail for various 
> reason. This happens, and there are detailed documentation how to deal with 
> this situation and devise a strategy, namely on the "Retrying Failed Tasks" 
> page 
> <https://cloud.google.com/appengine/docs/standard/java/taskqueue/push/retrying-tasks>
> . 
>
> You can set retry parameters as detailed on that documentation page: 
>
> 
>   7
>   2d
> 
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/e049be61-871b-4099-8ec4-f7994c381588%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Task Queue's Enforced Rate perpetually lower than Max Rate

[Marc Dugger]

My task queues have a defined "Max Rate" of 6/m. However, the "Enforced 
Rate" is 0.1/s and has been for several weeks. There's no evidence of 503s 
in the logs. 

Why is this happening?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/e38338c6-b4cb-456f-b9f9-834a00dee29d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Task Queue's Enforced Rate perpetually lower than Max Rate

[Marc Dugger]

Ah, got it. I didn't pause to do the math. Thank you.

On Mon, Jan 1, 2018 at 10:45 AM, 'Fady (Google Cloud Platform)' via Google
App Engine  wrote:

> Hello Marc,
>
> Let me know if I’m missing something. It seems that when you checked the
> rate, it displayed it per second, even though you originally defined it per
> minute. (6/60s==0.1/s)
>
>
> On Sunday, December 31, 2017 at 1:38:56 PM UTC-5, Marc Dugger wrote:
>>
>> My task queues have a defined "Max Rate" of 6/m. However, the "Enforced
>> Rate" is 0.1/s and has been for several weeks. There's no evidence of 503s
>> in the logs.
>>
>> Why is this happening?
>>
> --
> You received this message because you are subscribed to a topic in the
> Google Groups "Google App Engine" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/
> topic/google-appengine/TNzZhhm_Dnw/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/9be63a4a-d777-42f6-a561-
> df9ac2ed0b7b%40googlegroups.com
> <https://groups.google.com/d/msgid/google-appengine/9be63a4a-d777-42f6-a561-df9ac2ed0b7b%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
>
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Marc Dugger
mdug...@gmail.com

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAJXgydKKpQS74B2ZsR%2Bm4_4hnjeWQm7scoBg0dR42eZROpABbA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Will App Engine Flex Environment ever support Memcache?

[Marc Garabedian]

Will App Engine Flexible Environment ever support Memcache? Documentation 
seemed to indicate it might, but I have not seen anything on this for a 
long time.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/fb57491c-3652-487b-b039-cc1a9bc491cb%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Why in Google App Engine Always 11 secs of Latency coming only for the first requests?

[Marc Samet]

remove me immediately from this group

> On Sep 2, 2018, at 1:51 PM, Sudhanshu Gaur  wrote:
> 
> I found that
> 
> This can be a caused when your application is still booting up or warming up 
> instances to serve the request and can be called as loading latency. To avoid 
> such scenarios you can implement health check handler like readiness check so 
> that your application will only receive traffic when its ready
> 
> That's why I checked in my Logs that readiness check is performed sometimes 
> around 1 sec and sometimes around 200 ms
> 
> 
> 
>  
> 
> Can anyone please tell me is there anything wrong in warming up my instances 
> because I don't think cold boot time is causing this problem.
> 
> 
> Please Help
> 
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to google-appengine+unsubscr...@googlegroups.com 
> <mailto:google-appengine+unsubscr...@googlegroups.com>.
> To post to this group, send email to google-appengine@googlegroups.com 
> <mailto:google-appengine@googlegroups.com>.
> Visit this group at https://groups.google.com/group/google-appengine 
> <https://groups.google.com/group/google-appengine>.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/google-appengine/bf7fdce9-8079-4227-a969-b88c555febb1%40googlegroups.com
>  
> <https://groups.google.com/d/msgid/google-appengine/bf7fdce9-8079-4227-a969-b88c555febb1%40googlegroups.com?utm_medium=email&utm_source=footer>.
> For more options, visit https://groups.google.com/d/optout 
> <https://groups.google.com/d/optout>.
> 

Marc K. Samet, Ph.D.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/6B046718-990B-47BB-AA2F-8845119A7490%40verizon.net.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] problem with gpu Quota Increase Request

[Marc Craun]

i was trying 4 p100 gpu and i make a Request to Increase my quota for 1 to 
4 
but support keep reply with this message

Thank you for requesting additional quota and I hope you're doing well 
today. My name is Allan from the Cloud Platform Support team and I am happy 
to help you. We have received your quota increase request for 
arctic-plasma-220511. Unfortunately, our approval team is unable to grant 
your request at this time due to the status of your billing account.

Please contact our Billing Support Team directly by creating a ticket via 
this link [1]. Once you have resolved the issue with your billing account, 
you can file a new request [2] for additional quotas.

I hope this information points you in the right direction. I’ll mark this 
case as closed now. If you have any further questions, you can also reach 
out to us at gc-t...@google.com 

.

Best regards, 

Allan H on behalf of the Google Compute Team

[1] 
https://support.google.com/cloud/contact/cloud_platform_billing?hl=en&cfsi=bronze_contact&cfnti=6186161&cft=3
 
[2] https://cloud.google.com/compute/quotas#requesting_additional_quota



icontact with billing team in live chat they said my billing account works 
fine

i dont understand where is the problem?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/3335b6b8-7640-42e5-8bc4-a8fafa68fa8e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Domain Wide Delegation not working on 2nd generation GAE (Python 3)

[Marc Fargas]

Hi,

I have a python app I want to deploy on App Engine (2nd Generation Python 
3.7) on which I use a Service Account with Domain-wide delegation enabled 
to access user data.


Locally I do:

import google.authfrom apiclient.discovery import build

creds, project = google.auth.default(
scopes=['https://www.googleapis.com/auth/admin.directory.user', ],)
creds = creds.with_subject(GSUITE_ADMIN_USER)

service = build('admin', 'directory_v1', credentials=creds)

This works good and, as far as I know it is the *current* way to do this 
when using Application Default Credentials (locally I have 
GOOGLE_APPLICATION_CREDENTIALS defined).


Problem is on GAE, when deployed, the call to with_subject raises: 
AttributeError: 
'Credentials' object has no attribute 'with_subject'

I have enabled Domain-wide delegation on the GAE service account already.


What is different between the GOOGLE_APPLICATION_CREDENTIALS I use locally 
and the ones in GAE when both are service accounts with domain-wide 
delegation?


Where is .with_subject() on GAE?


The creds object received is of type compute_engine.credentials.Credentials.


Thanks for the help,

Marc


PS: This is cross posted from StackOverflow, sadly could not get any help 
there in the past two days on this problem. [link] 
<https://stackoverflow.com/questions/53202767/gae-attributeerror-credentials-object-has-no-attribute-with-subject>
PSS: Please add python37 as a suggested tag on the group!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/56c9ccb1-a501-44d1-bd70-0a82d105b055%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Cron jobs fail with error "Request was aborted after waiting too long to attempt to service your request."

[Marc Provost]

This issue driving me crazy! I have cron jobs that must run overnight
and
I started to see this pattern about 3-4 weeks ago. I had to run the
jobs multiple times and
I still have to check them every morning, because sometimes all of
them failed (with the same duration as you guys). Also,
I get this error at a 4-5% rate for client requests.

Google, please let us know what is going on.


On Jan 15, 7:48 pm, Peter Liu  wrote:
> Also the duration is always between 10s and 11s. cpu is always 0ms.
>
> On Jan 15, 4:46 pm, Peter Liu  wrote:
>
> > 01-15 04:36PM 28.187 /p/tempClean 500 10081ms 0cpu_ms 0kb
>
> > Error in last 17 hours: 51      5.4%
>
> > Job run every minute, it query a kind and delete the entries.
> > Currently there's no entry so the task just do a simple query. There's
> > no other traffic either.
>
> > On Dec 14 2009, 4:11 am, Abhi  wrote:
>
> > > Sometimes my cron jobs fail with a HTTP 500 error and message:-
>
> > > Request was aborted after waiting too long to attempt to service your
> > > request. Most likely, this indicates that you have reached your
> > > simultaneous dynamic request limit. This is almost always due to
> > > excessively high latency in your app. Please 
> > > seehttp://code.google.com/appengine/docs/quotas.htmlformoredetails.
>
> > > When this happens the logs show that the job took about 10086ms of CPU
> > > time. The cron is the only job running in the application and it fires
> > > one request every 5 minutes. I don't see any reason of why the quota
> > > for simultaneous request should be exceed by this one req/5 minutes
> > > application. There is nothing else this application is doing.
>
> > > If i access the same page (which has admin only permissions - so i am
> > > sure no one else can access it) from a browser it never fails.
>
> > > Can someone help me with this?
-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Cron jobs fail with error "Request was aborted after waiting too long to attempt to service your request."

[Marc Provost]

This issue driving me crazy! I have cron jobs that must run overnight
and
I started to see this pattern about 3-4 weeks ago. I had to run the
jobs multiple times and
I still have to check them every morning, because sometimes all of
them failed (with the same duration as you guys). Also,
I get this error at a 4-5% rate for client requests.

Google, please let us know what is going on.


On Jan 15, 7:48 pm, Peter Liu  wrote:
> Also the duration is always between 10s and 11s. cpu is always 0ms.
>
> On Jan 15, 4:46 pm, Peter Liu  wrote:
>
> > 01-15 04:36PM 28.187 /p/tempClean 500 10081ms 0cpu_ms 0kb
>
> > Error in last 17 hours: 51      5.4%
>
> > Job run every minute, it query a kind and delete the entries.
> > Currently there's no entry so the task just do a simple query. There's
> > no other traffic either.
>
> > On Dec 14 2009, 4:11 am, Abhi  wrote:
>
> > > Sometimes my cron jobs fail with a HTTP 500 error and message:-
>
> > > Request was aborted after waiting too long to attempt to service your
> > > request. Most likely, this indicates that you have reached your
> > > simultaneous dynamic request limit. This is almost always due to
> > > excessively high latency in your app. Please 
> > > seehttp://code.google.com/appengine/docs/quotas.htmlformoredetails.
>
> > > When this happens the logs show that the job took about 10086ms of CPU
> > > time. The cron is the only job running in the application and it fires
> > > one request every 5 minutes. I don't see any reason of why the quota
> > > for simultaneous request should be exceed by this one req/5 minutes
> > > application. There is nothing else this application is doing.
>
> > > If i access the same page (which has admin only permissions - so i am
> > > sure no one else can access it) from a browser it never fails.
>
> > > Can someone help me with this?
-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Cron jobs fail with error "Request was aborted after waiting too long to attempt to service your request."

[Marc Provost]

Hi everybody,

Sorry for the double post! I wanted to let you know an issue already
exists for this problem: 
http://code.google.com/p/googleappengine/issues/detail?id=2396.
I'm still unsure if it's because we are using the API incorrectly or
if this is really a bug.

In the last few days, I've been trying to reduce the running time of
my tasks by splitting them even more. I realized that some of them did
timeout occasionally. They would eventually succeed, because failed
tasks are re-executed by the engine, but strangely those URLs did fail
very often with "Request was aborted..." (>40% of all requests failed
like this). I started to wonder if they were somehow marked as being
"bad" by the engine because they are long-running. Other faster URL
would occasionally fail, but the rate was much smaller. If we take a
look at these URL (data taken directly from my dashboard):

Task A, "Request was aborted..." error rate (45%)  (running time >
15s, will sometimes fail due to timeouts)
Task B, "Request was aborted..." error rate (4.8%) (running time <
200ms )
Task C, "Request was aborted..." error rate (18%)  (running time 4-5s)

I'm still experimenting with this, I will let you know if I'm able to
reduce the error rate of Task A. I'm currently splitting all my tasks
so that each of them writes to only one entity (before I would split
them in groups of 30-40).

Jason (Google), what are your thoughts on this?

Thanks!


On Jan 18, 10:05 am, Marc Provost  wrote:
> This issue driving me crazy! I have cron jobs that must run overnight
> and
> I started to see this pattern about 3-4 weeks ago. I had to run the
> jobs multiple times and
> I still have to check them every morning, because sometimes all of
> them failed (with the same duration as you guys). Also,
> I get this error at a 4-5% rate for client requests.
>
> Google, please let us know what is going on.
>
> On Jan 15, 7:48 pm, Peter Liu  wrote:
>
> > Also the duration is always between 10s and 11s. cpu is always 0ms.
>
> > On Jan 15, 4:46 pm, Peter Liu  wrote:
>
> > > 01-15 04:36PM 28.187 /p/tempClean 500 10081ms 0cpu_ms 0kb
>
> > > Error in last 17 hours: 51      5.4%
>
> > > Job run every minute, it query a kind and delete the entries.
> > > Currently there's no entry so the task just do a simple query. There's
> > > no other traffic either.
>
> > > On Dec 14 2009, 4:11 am, Abhi  wrote:
>
> > > > Sometimes my cron jobs fail with a HTTP 500 error and message:-
>
> > > > Request was aborted after waiting too long to attempt to service your
> > > > request. Most likely, this indicates that you have reached your
> > > > simultaneous dynamic request limit. This is almost always due to
> > > > excessively high latency in your app. Please 
> > > > seehttp://code.google.com/appengine/docs/quotas.htmlformoredetails.
>
> > > > When this happens the logs show that the job took about 10086ms of CPU
> > > > time. The cron is the only job running in the application and it fires
> > > > one request every 5 minutes. I don't see any reason of why the quota
> > > > for simultaneous request should be exceed by this one req/5 minutes
> > > > application. There is nothing else this application is doing.
>
> > > > If i access the same page (which has admin only permissions - so i am
> > > > sure no one else can access it) from a browser it never fails.
>
> > > > Can someone help me with this?
-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Cron jobs fail with error "Request was aborted after waiting too long to attempt to service your request."

[Marc Provost]

Hi everybody,

Sorry for the double post! I wanted to let you know an issue already
exists for this problem: 
http://code.google.com/p/googleappengine/issues/detail?id=2396.
I'm still unsure if it's because we are using the API incorrectly or
if this is really a bug.

In the last few days, I've been trying to reduce the running time of
my tasks by splitting them even more. I realized that some of them did
timeout occasionally. They would eventually succeed, because failed
tasks are re-executed by the engine, but strangely those URLs did fail
very often with "Request was aborted..." (>40% of all requests failed
like this). I started to wonder if they were somehow marked as being
"bad" by the engine because they are long-running. Other faster URL
would occasionally fail, but the rate was much smaller. If we take a
look at these URL (data taken directly from my dashboard):

Task A, "Request was aborted..." error rate (45%)  (running time >
15s, will sometimes fail due to timeouts)
Task B, "Request was aborted..." error rate (4.8%) (running time <
200ms )
Task C, "Request was aborted..." error rate (18%)  (running time 4-5s)

I'm still experimenting with this, I will let you know if I'm able to
reduce the error rate of Task A. I'm currently splitting all my tasks
so that each of them writes to only one entity (before I would split
them in groups of 30-40).

Jason (Google), what are your thoughts on this?

Thanks!


On Jan 18, 10:05 am, Marc Provost  wrote:
> This issue driving me crazy! I have cron jobs that must run overnight
> and
> I started to see this pattern about 3-4 weeks ago. I had to run the
> jobs multiple times and
> I still have to check them every morning, because sometimes all of
> them failed (with the same duration as you guys). Also,
> I get this error at a 4-5% rate for client requests.
>
> Google, please let us know what is going on.
>
> On Jan 15, 7:48 pm, Peter Liu  wrote:
>
> > Also the duration is always between 10s and 11s. cpu is always 0ms.
>
> > On Jan 15, 4:46 pm, Peter Liu  wrote:
>
> > > 01-15 04:36PM 28.187 /p/tempClean 500 10081ms 0cpu_ms 0kb
>
> > > Error in last 17 hours: 51      5.4%
>
> > > Job run every minute, it query a kind and delete the entries.
> > > Currently there's no entry so the task just do a simple query. There's
> > > no other traffic either.
>
> > > On Dec 14 2009, 4:11 am, Abhi  wrote:
>
> > > > Sometimes my cron jobs fail with a HTTP 500 error and message:-
>
> > > > Request was aborted after waiting too long to attempt to service your
> > > > request. Most likely, this indicates that you have reached your
> > > > simultaneous dynamic request limit. This is almost always due to
> > > > excessively high latency in your app. Please 
> > > > seehttp://code.google.com/appengine/docs/quotas.htmlformoredetails.
>
> > > > When this happens the logs show that the job took about 10086ms of CPU
> > > > time. The cron is the only job running in the application and it fires
> > > > one request every 5 minutes. I don't see any reason of why the quota
> > > > for simultaneous request should be exceed by this one req/5 minutes
> > > > application. There is nothing else this application is doing.
>
> > > > If i access the same page (which has admin only permissions - so i am
> > > > sure no one else can access it) from a browser it never fails.
>
> > > > Can someone help me with this?
-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Cron jobs fail with error "Request was aborted after waiting too long to attempt to service your request."

[Marc Provost]

Hi everybody,

Sorry for the double post! I wanted to let you know an issue already
exists for this problem: 
http://code.google.com/p/googleappengine/issues/detail?id=2396.
I'm still unsure if it's because we are using the API incorrectly or
if this is really a bug.

In the last few days, I've been trying to reduce the running time of
my tasks by splitting them even more. I realized that some of them did
timeout occasionally. They would eventually succeed, because failed
tasks are re-executed by the engine, but strangely those URLs did fail
very often with "Request was aborted..." (>40% of all requests failed
like this). I started to wonder if they were somehow marked as being
"bad" by the engine because they are long-running. Other faster URL
would occasionally fail, but the rate was much smaller. If we take a
look at these URL (data taken directly from my dashboard):

Task A, "Request was aborted..." error rate (45%)  (running time >
15s, will sometimes fail due to timeouts)
Task B, "Request was aborted..." error rate (4.8%) (running time <
200ms )
Task C, "Request was aborted..." error rate (18%)  (running time 4-5s)

I'm still experimenting with this, I will let you know if I'm able to
reduce the error rate of Task A. I'm currently splitting all my tasks
so that each of them writes to only one entity (before I would split
them in groups of 30-40).

Jason (Google), what are your thoughts on this?

Thanks!


On Jan 18, 10:05 am, Marc Provost  wrote:
> This issue driving me crazy! I have cron jobs that must run overnight
> and
> I started to see this pattern about 3-4 weeks ago. I had to run the
> jobs multiple times and
> I still have to check them every morning, because sometimes all of
> them failed (with the same duration as you guys). Also,
> I get this error at a 4-5% rate for client requests.
>
> Google, please let us know what is going on.
>
> On Jan 15, 7:48 pm, Peter Liu  wrote:
>
> > Also the duration is always between 10s and 11s. cpu is always 0ms.
>
> > On Jan 15, 4:46 pm, Peter Liu  wrote:
>
> > > 01-15 04:36PM 28.187 /p/tempClean 500 10081ms 0cpu_ms 0kb
>
> > > Error in last 17 hours: 51      5.4%
>
> > > Job run every minute, it query a kind and delete the entries.
> > > Currently there's no entry so the task just do a simple query. There's
> > > no other traffic either.
>
> > > On Dec 14 2009, 4:11 am, Abhi  wrote:
>
> > > > Sometimes my cron jobs fail with a HTTP 500 error and message:-
>
> > > > Request was aborted after waiting too long to attempt to service your
> > > > request. Most likely, this indicates that you have reached your
> > > > simultaneous dynamic request limit. This is almost always due to
> > > > excessively high latency in your app. Please 
> > > > seehttp://code.google.com/appengine/docs/quotas.htmlformoredetails.
>
> > > > When this happens the logs show that the job took about 10086ms of CPU
> > > > time. The cron is the only job running in the application and it fires
> > > > one request every 5 minutes. I don't see any reason of why the quota
> > > > for simultaneous request should be exceed by this one req/5 minutes
> > > > application. There is nothing else this application is doing.
>
> > > > If i access the same page (which has admin only permissions - so i am
> > > > sure no one else can access it) from a browser it never fails.
>
> > > > Can someone help me with this?
-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Uncatchable severe error "Operation commit failed on resource" logged

[Marc Provost]

Hi everybody!

I am using the java implementation and seeing the following error
logged sporadically, both in the development server and live. Note
that it does not seem to be a "real" error, as the commit always goes
through and my data looks perfectly fine. Could it be a low-level
exception that is not converted back to a JDOException? Is it a real
error?

org.datanucleus.transaction.Transaction commit: Operation commit
failed on resource:
org.datanucleus.store.appengine.datastorexaresou...@608d41, error code
UNKNOWN and transaction: [DataNucleus Transaction, ID=Xid=

I think the root cause of this problem is that I'm reading entities
from one entity group, cache them and then I open a transaction on
another entity group. In short, I spawn tasks that first read 30 or so
entities and copy a subset of their content into memory. Then, I open
a transaction and cache this content to a "global" entity (just a
wrapper around a Blob) for later use.  My goal is to go over all the
entities of a kind (1000s) and cache a subset of their data that I
often need. The cache and the other entities are not in the same
entity group. If I only perform the transaction, without reading the
other entities first the error does not occur.

Note that I'm doing this very carefully -- I perform all my data store
operations inside of a try/catch && for loop to retry if necessary.

Thanks for any help!
Marc

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: JDO: Owned 1 to Many relationship between the objects of the same class

[Marc Provost]

Hi Alex,

This is a known issue. Check out this thread for discussion +
workarounds: 
http://groups.google.com/group/google-appengine-java/browse_thread/thread/3affdf1441f864b6

Marc

On Feb 12, 3:55 am, Alexander Arendar 
wrote:
> Hi guys,
>
> yesterday I was trying to model a simple forum comments. Just a
> comments which you can add more comments to.
> So, the approximation of the entity is like this:
> ---
> @PersistenceCapable (detachable = "true", identityType =
> IdentityType.APPLICATION)
> public class CommentEntity {
>
>         @PrimaryKey
>         @Persistent(valueStrategy = IdGeneratorStrategy.IDENTITY)
>         private Key key;
>
>         @Persistent
>         private String category;
>
>         @Persistent
>         private String commentDate;
>
>         @Persistent
>         private String userName;
>
>         @Persistent
>         private String commentBody;
>
>         @Persistent
>         private List children = new
> ArrayList();
>
>         getters/setters/etc.
>
> }
>
> DataNucleus enhancement goes ok, no errors in the console.
> Call of the pm.makePersistent() goes without any exceptions for such
> entity.
> BUT IT IS NOT PERSISTED.
>
> I found out that problem is in "children" property. And the problem is
> it's a list of objects of the same class as the parent entity. If I
> comment that property declaration the entity is persisted. Also if I
> change the type of the child entities to some new class (not extending
> the CommentEntity) it also gets persisted.
>
> So my suspicion is that JDO (or GAE JDO impl) does not allow child
> entities to be of the same class. Is it correct? Maybe I'm missing
> something essential? Please advice.
>
> Sincerely,
> Alex

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Task Queue oddness

[Marc Provost]

This is a wild guess, but maybe they need to prevent people from
"externally" scheduling cron jobs at a faster rate than what is
allowed. Currently, cron jobs can be executed at most every minute,
allowing a refresh to bypass that limit would allow an external server
to schedule cron jobs at a faster rate.

On Feb 21, 6:54 pm, "Ben W."  wrote:
> I have been testing the taskqueue with mixed success. Currently I am
> using the default queue, in default settings ect ect
>
> I have a test url setup which inserts about 8 tasks into the queue.
> With short order, all 8 are completed properly. So far so good.
>
> The problem comes up when I re-load that url twice under say a minute.
> Now watching the task queue, all the tasks are added properly, but
> only the first batch execute it seems.  But the "Run in Last Minute" #
> shows the right number of tasks being run
>
> The request logs tell a different story. They show only the first set
> of 8 running, but all task creation urls working successfully.
>
> The oddness of this is that if I wait say a minute between the task
> creation url requests, it will work fine.
>
> Oddly enough changing the bucket_size or execution speed does not seem
> to help. Only the first batch are executed. I have also reduced the
> number of requests all the way down to 2, and still found only the
> first 2 execute. Any others added display the same issues as above.
>
> Any suggestions?
>
> Thanks

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: how to improve performance

[Marc Provost]

Hi AJ,

Here's a few tips from my experience:

* If your application currently does not have much traffic, most of
your requests will be "loading requests". This could explain the
randomness your are seeing. The app engine needs to load and prepare
your application to handle a request. In my application (java), a
loading request takes around 2-6 seconds. Once your application is
loaded, it will stay in memory for some time and subsequent requests
will be "normal requests". See 
http://googleappengine.blogspot.com/2009/12/request-performance-in-java.html
for more info. Also, make sure you are using the most recent version
of the app engine so that pre-compilation is enabled by default. I
have not tried the python implementation of the app engine yet, but I
heard that it process loading requests faster.

* Once my application is loaded, fetching the 20 first results of a
simple query takes at most 1-2 seconds, most of the time less than a
second. I use memcache to cache the derived product (usually an html
page) of common requests. Once a request is cached, it will take
100-200ms to serve.

* When you list the topics, make sure you are using cursors:
http://code.google.com/appengine/docs/java/datastore/queriesandindexes.html#Query_Cursors

* When you fetch feeds, you will need to split the work in very small
chunks because of the 30 seconds limit. When you say "fails randomly",
are you getting
"com.google.apphosting.runtime.HardDeadlineExceededError"? From my
experience, appengine behave much better when each of your tasks write
to very few entities. In my application, I'm being very strict: each
task writes to at most one entity. For example, I also need to parse
an external feed and then update 1000 entities with the data from that
feed. In order to achieve that efficiently, I spawn a thousand tasks,
each one updating only one entity.

Hope it helps,
Marc


On Feb 21, 7:02 pm, AJ Chen  wrote:
> I like the potential of appengine as cloud computing platform. Using
> eclipse, I can code in eclipse and then one-click to deploy the changes to
> production. It's awesome!  It's also an exciting experience to learn the new
> programing patterns GAE requires, such as task queue, object data store,
> mencache. All these new stuff are fine as long as it delivers the
> performance at the end. After running my apphttp://realmon9.appspot.comon
> production for a while, I found the response time very often is too long,
> 5-20sec, in the unusable range. Of course, the performce depends on how
> complicated it is to generate the response per request. I'm going to give a
> very brief description of a typical request, and appreciate your suggestion
> for improving the performance..
>
> My app "realmon9" <http://realmon9.appspot.com> is a social media monitoring
> application designed as a component in the google cloud so that it can be
> connected to enterprise CRM like salesforce. It basically allows
> organization to monitor a large number of topics on social media and brings
> the relevant conversations/leads to CRM for marketing/PR/support/research
> purpose. The topics, twiter conversations and blogs are stored in datastore
> and the operation is quite simple and straightforward. For example, listing
> a list of topics or listing conversations (20 per page) for a topic. I
> expect this type of viewing request takes <1 sec to respond. It requires
> querying 2-4 kinds of data per request and there are only small number of
> data in this initial stage. But, very often it takes 10 second to respond to
> a simple request.  I'm using java and JDO to query datastore. I have not
> done anything to customize the index configuration yet. Where should I look
> for performance optimization?
>
> I also use task queue to fetch feeds in the background. Because the reponse
> is slow, a large percentage of simple feed fatch tasks fail randomly.
>
> One observation: viewing the same page (e.g. listing topics) sometimes takes
> no time, but sometimes takes 10 second. it's all random, which is probably
> due to the distributed nature of GAE. It may be hard to figure out what to
> improve on the app side when GAE varies wildly in terms response time.
> Anybody know the expected response time or behavior from GAE?
>
> This google app is porting from my server application 
> onhttp://web2express.org. I can make the responce on regular tomcat server
> fast, but GAE is the uncharted torritory. I"m still learning and looking for
> best practice ideas.
>
> thanks,
> -aj
> --
> AJ Chen, PhD
> Chair, Semantic Web SIG, sdforum.orghttp://web2express.org
> @web2express on twitter
> Palo Alto, CA, USA
> 650-283-4091
> *Monitoring social media in real time*

-- 
You received this message because you are 

[google-appengine] My max requests / seconds is 3. My cron jobs fail with: "Request was aborted after waiting too long.."

[Marc Provost]

Ok, here's my situation:

* I use the java implementation and my app id is poolfana.
* I have a bunch of cron jobs scheduled at night (Eastern Time)
* They are all very much parallelized. I am being very strict: they
spawn tasks that only write to one entity each. Each tasks will
execute in a few hundred ms.
* A given cron job and its spawned tasks will terminate in a few
minutes at most.
* I have scheduled each cron job at least 10 minutes apart, so they do
not overlap.
* In my dashboard, my max request per second is 3. The max limit is
supposed to be 30.
* My problem? The cron jobs fail sporadically (marked as "failed" in
the dashboard) with this error:

"Request was aborted after waiting too long to attempt to service your
request. Most likely, this indicates that you have reached your
simultaneous dynamic request limit. This is almost always due to
excessively high latency in your app. Please see
http://code.google.com/appengine/docs/quotas.html for more details."

There is an issue for this problem: 
http://code.google.com/p/googleappengine/issues/detail?id=2396

It was starred 50+ times, but it was not acknowledged yet by the
google team. I'm writing this post to discuss potential workarounds,
potential misuses of the API with the google team or other people that
might have solved this problem. What else can I do? Is it a problem on
the google side or I'm I doing something wrong? Right now, I need to
re-execute the cron jobs manually everyday...

Thank you!
Marc

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: My max requests / seconds is 3. My cron jobs fail with: "Request was aborted after waiting too long.."

[Marc Provost]

Thanks for your quick reply!

I parse several external sources (around 8) and from each source I
need to update the same 1000 entities (most of them already existing,
creation of new entities is rare). For each data source, I schedule a
cron job which spawns 1000 tasks (with attached data) and each of them
will update a single entity. I found by trial and error that app
engine was behaving better the shorter the tasks. So, when I say very
much parallelized, I mean spawning as many tasks as I can for each
cron job, each of them as small as possible. Since I have more
independent tasks running in parallel, my cron jobs execute faster. In
addition, I schedule my cron jobs apart so that they don't overlap,
but this should not matter, as I use the same queue which is limited
at 5 tasks per second.

So, in summary, I have 8 cron jobs and each cron job spawns 1000
tasks. A given cron job and its children tasks terminates in 3-4
minutes at most. The cron jobs are separated so that 2 crons jobs
never execute together.

Marc





On Feb 26, 3:47 pm, Eli Jones  wrote:
> How many is "a bunch"?  Also, You say "they are all very much parallelized"
> but then you say that you've scheduled them 10 minutes apart and they don't
> overlap.. those two statements are contradictory, please explain more
> clearly your cron-taskqueu setup and how it works and what exactly it is
> doing.
>
> When you say that the cron jobs "spawn tasks that write to one entity
> each".. what do you mean?  The cron job is there to fire of the initial
> task.. and that task runs once, putting one entity and that's it?
>
> If so, why are you having these tasks only put one entity at a time..
> instead of creating multiple entities and putting them in batches?  Does
> each task put() new entities? or are they sometimes putting an entity that
> may already exist?
>
> More info is more better for help.
>
> On Fri, Feb 26, 2010 at 3:35 PM, Marc Provost  wrote:
> > Ok, here's my situation:
>
> > * I use the java implementation and my app id is poolfana.
> > * I have a bunch of cron jobs scheduled at night (Eastern Time)
> > * They are all very much parallelized. I am being very strict: they
> > spawn tasks that only write to one entity each. Each tasks will
> > execute in a few hundred ms.
> > * A given cron job and its spawned tasks will terminate in a few
> > minutes at most.
> > * I have scheduled each cron job at least 10 minutes apart, so they do
> > not overlap.
> > * In my dashboard, my max request per second is 3. The max limit is
> > supposed to be 30.
> > * My problem? The cron jobs fail sporadically (marked as "failed" in
> > the dashboard) with this error:
>
> > "Request was aborted after waiting too long to attempt to service your
> > request. Most likely, this indicates that you have reached your
> > simultaneous dynamic request limit. This is almost always due to
> > excessively high latency in your app. Please see
> >http://code.google.com/appengine/docs/quotas.htmlfor more details."
>
> > There is an issue for this problem:
> >http://code.google.com/p/googleappengine/issues/detail?id=2396
>
> > It was starred 50+ times, but it was not acknowledged yet by the
> > google team. I'm writing this post to discuss potential workarounds,
> > potential misuses of the API with the google team or other people that
> > might have solved this problem. What else can I do? Is it a problem on
> > the google side or I'm I doing something wrong? Right now, I need to
> > re-execute the cron jobs manually everyday...
>
> > Thank you!
> > Marc
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appeng...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: My max requests / seconds is 3. My cron jobs fail with: "Request was aborted after waiting too long.."

[Marc Provost]

Thanks for you help Eli! I didn't know about the unique name feature.
I will use that trick, at least for the most important crons. Still, I
wonder why I see this failure if my requests / seconds is never higher
than 3 in my dashboard. I mean, if I saw spikes close to 30 at least I
could start debugging. And the failure rate is much higher than 0.1%.
It's more like 5%. And it's weird, sometimes the first cron will fail
when there is no activity at all... why? It always fail after 10
seconds. Sometimes the first cron fails, sometimes the 5th, etc. And
my app itself has almost no traffic.

A few notes:

* Yeah, I use chaining. I am not adding the 1000s tasks in one shot.
Sorry for not specifying that. None of my cron/queue is close to the
30 second limit. I didn't see a 30 second timeout error in my logs for
a long time.
* I use a queue with a rate of 5 tasks per second, so approximately
300 tasks will go through per minute and 1200 tasks in 4 minutes.
Hence my approximation. I also manually ran the cron jobs and saw them
complete in about 4 minutes.

Basically, the question I'm trying to answer here is:

Why I'm I seeing the "simultaneous dynamic request limit error" if:

1) In my dashboard, the max rate of requests I see is 3. Far from 30.
2) The rate of my queue is 5 / second. Again, far from 30.
3) This error occurs even for the first cron job, when there is no
other tasks / cron running (and my app has almost no traffic)

Thanks again for your tips.
Marc




On Feb 26, 8:16 pm, Wooble  wrote:
> On Feb 26, 7:46 pm, Locke  wrote:
>
> > I have also seen this timeout error when trying to add to the task
> > queue. What is interesting to me is that it kills my process after 10
> > seconds, instead of the thirty seconds we supposedly are allowed.
>
> The 30 seconds are for a request that actually runs.  This message
> indicates your request handler didn't get run at all, because too many
> instances of your application were already running.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: The server encountered an error and could not complete your request.

[Marc Provost]

Hi Waleed,

You are not seeing any errors/warnings in the logs? There are a few
possibilities here.

If the request hits your app:

* You could be hitting the 30 seconds limit (maybe because the input
is too large or something). You should see an error in the logs.
* Your code could also be raising an exception that you do not catch.
You should see an error in the logs.
* It is also possible that the return status of the request is set to
500 somehow. In this case, if your application could silently catch
the exception without logging anything. But you should be able to
debug it by logging info messages in your request handler.

If your request does not hit your app:

* You could be hitting the simultaneous requests limit. That's a
warning in the logs, but it shouldn't be reproducible every time.

Hope it helps,
Marc

On Mar 2, 3:09 am, Waleed  wrote:
> I'm getting this error for some requests:
>
> The server encountered an error and could not complete your
> request.If the problem persists, please report your problem and
> mention this error message and the query that caused it.
>
> It's repeatable and the error happens every time for that specific
> request I'm sending. I tested with another AE app and I get the same
> problem. The request doesn't seem to be hitting my app, but fails
> before that, so I can't do anything about it. When I submit the same
> request with different data in the POST body, it goes through and
> works well.
>
> My request is a simple POST with a blog feed in the body of the post.
> Nothing particularly unique about it. And as I mentioned earlier, it
> works for most feeds, except for a few where it breaks 100% of the
> time.
>
> How can I debug this? Can anyone shed some light? App id is:
> networkedblogs

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: simultaneous dynamic request limit

[Marc Provost]

Hi David,

I don't have a precise answer, but I think you are going in the right
direction. The idea is to minimize the response time of your most
popular requests using memcache. Try to cache the html pages derived
from the datastore queries. It is easy to drop the request time to a
few hundred ms or even less that way (depending how much you can cache
and if you use java or python). This approach works well if your users
are interested in the same entities. For example a news site can
easily cache its more popular articles that way. For entities/queries
that are specific to each user, but might be reused in many pages,
cache it as soon as possible!

Hope it helps,
Marc


On Mar 2, 3:21 am, Waleed Abdulla  wrote:
> I got the same errors today on my dev app, which I'm the only user of. So it
> doesn't seem to be related to how much load the app has!! I've been noticing
> them on my production app as well on and off.
>
> Waleed
>
> On Mon, Mar 1, 2010 at 7:22 PM, Satoshi  wrote:
> > I've got the same warnings several time today too. The peak access
> > rate was only 3.00 requests/sec, and the CPU time usage over the last
> > 24 hours is 6% (1.08 CPU hours) out of 18.50 CPU hours (I am a paying
> > customer).
>
> > Satoshi
>
> > On Mar 1, 6:51 pm, David  wrote:
> > > I am losing sleep over this, so any help would be greatly appreciated!
>
> > > APP ID: conit-app01
>
> > > Since our app released about a week ago, it has been getting an
> > > average of about 60 requests/second.  On February 27, our app suddenly
> > > crashed and was down for several hours, with thousands of these errors
> > > appearing in the logs:
>
> > > Request was aborted after waiting too long to attempt to service your
> > > request. Most likely, this indicates that you have reached your
> > > simultaneous dynamic request limit. This is almost always due to
> > > excessively high latency in your app. Please seehttp://
> > code.google.com/appengine/docs/quotas.htmlfor more details.
>
> > > Since getting this error, I filled out a request to increase this
> > > limit at:
> >http://code.google.com/support/bin/request.py?contact_type=AppEngineC...
>
> > > This request was denied, because, "your app has been using, over the
> > > past 24 hours, on average 60 QPS with a peak of ~135 QPS; thus you're
> > > well under the 500 QPS limit described above."
>
> > > Since this crash, I've also been working to decrease calls to the
> > > datastore, and I think our average CPU time has decreased around 30%.
> > > In the dashboard, one of our pages still appears "yellow" under the
> > > column "Average CPU (API)", with a speed of about 1100.  This page is
> > > about 6% of the volume of our app.  The other pages don't have any
> > > warnings.  We are well within the limits of our billing.
>
> > > I would feel much better if I could understand the math/metrics that
> > > go into producing this error, so it doesn't happen again.  How can I
> > > know if my page request times are low enough?  If I add a new page
> > > with a higher CPU time, how can I know if it would make the app crash?
>
> > > Any help or references to details on this error would be appreciated.
>
> > > Thank you in advance.
> > > -David
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appeng...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Post-mortem for February 24th, 2010 outage

[Marc Provost]

Wow, I second lennysan. Awesome postmortem! Thank you so much for
sharing it with us.

Marc

On Mar 5, 12:25 pm, lennysan  wrote:
> I've been working on a Guideline for Postmortem Communication, and ran
> this post through the 
> guideline:http://www.transparentuptime.com/2010/03/google-app-engine-downtime-p...
>
> Overall, this may be the simple most impressive postmortem I've seen
> yet. The amount of time and though put into this post is staggering,
> and the takeaways are useful to every organization. I'm especially
> impressed with the proposed new functionality that turns this event
> into a long term positive, which is really all you can ask for after
> an incident.
>
> On Mar 4, 3:22 pm, App Engine Team 
> wrote:
>
> > Post-Mortem Summary
>
> > This document details the cause and events occurring immediately after
> > App Engine's outage on February 24th, 2010, as well as the steps we
> > are taking to mitigate the impact of future outages like this one in
> > the future.
>
> > On February 24th, 2010, all Googe App Engine applications were in
> > varying degraded states of operation for a period of two hours and
> > twenty minutes from 7:48 AM to 10:09 AM PT | 15:48 to 18:09 GMT.  The
> > underlying cause of the outage was a power failure in our primary
> > datacenter. While the Google App Engine infrastructure is designed to
> > quickly recover from these sort of failures, this type of rare
> > problem, combined with internal procedural issues  extended the time
> > required to restore the service.
>
> > <>
>
> > What did we do wrong?
>
> > Though the team had planned for this sort of failure, our response had
> > a few important issues:
>
> > - Although we had procedures ready for this sort of outage, the oncall
> > staff was unfamiliar with them and had not trained sufficiently with
> > the specific recovery procedure for this type of failure.
>
> > - Recent work to migrate the datastore for better multihoming changed
> > and improved the procedure for handling these failures significantly.
> > However, some documentation detailing the procedure to support the
> > datastore during failover incorrectly referred to the old
> > configuration. This led to confusion during the event.
>
> > - The production team had not agreed on a policy that clearly
> > indicates when, and in what situations, our oncall staff should take
> > aggressive user-facing actions, such as an unscheduled failover.  This
> > led to a bad call of returning to a partially working datacenter.
>
> > - We failed to plan for the case of a power outage that might affect
> > some, but not all, of our machines in a datacenter (in this case,
> > about 25%). In particular, this led to incorrect analysis of the
> > serving state of the failed datacenter and when it might recover.
>
> > - Though we were able to eventually migrate traffic to the backup
> > datacenter, a small number of Datastore entity groups, belonging to
> > approximately 25 applications in total,  became stuck in an
> > inconsistent state as a result of the failover procedure. This
> > represented considerably less than 0.2% of data stored in the
> > Datastore.
>
> > Ultimately, although significant work had been done over the past year
> > to improve our handling of these types of outages, issues with
> > procedures reduced their impact.
>
> > What are we doing to fix it?
>
> > As a result, we have instituted the following procedures going
> > forward:
>
> > - Introduce regular drills by all oncall staff of all of our
> > production procedures. This will include the rare and complicated
> > procedures, and all members of the team will be required to complete
> > the drills before joining the oncall rotation.
>
> > - Implement a regular bi-monthly audit of our operations docs to
> > ensure that all needed procedures are properly findable, and all out-
> > of-date docs are properly marked "Deprecated."
>
> > - Establish a clear policy framework to assist oncall staff to quickly
> > and decisively make decisions about taking intrusive, user-facing
> > actions during failures. This will allow them to act confidently and
> > without delay in emergency situations.
>
> > We believe that with these new procedures in place, last week's outage
> > would have been reduced in impact from about 2 hours of total
> > unavailability to about 10 to 20 minutes of partial unavailability.
>
> > In response to this outage, we have also decided to make a major
> > infrastructural change in

[google-appengine] Blobstore serving really slow today?

[Marc Hughes]

It seems that serving files from the blobstore is sometimes going
really slow.  It's not all the time, maybe 1 in 5 requests.

Here's an example of the timing, a 292KB piece of content took 83
seconds.

Request Start Time  3/20/10 12:00:12 PM
Response Start Time 3/20/10 12:00:12 PM
Response End Time   3/20/10 12:01:36 PM
Duration83.96 sec
Response Duration   83.44 sec
Latency 513 ms
Speed   3.51 KB/s
Response Speed  3.51 KB/s
Request Header Size 1.23 KB (1262 bytes)
Response Header Size217 bytes
Response Size   292.93 KB (299965 bytes)
Total Size  294.38 KB (301444 bytes)

That was done from the app engine blobstore viewer, but I'm having
similar results in my application as well.

Any ideas of what I should look at?  Anyone else seeing something
similar?

The app name is jess-hughes-photography

-Marc

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Java test if running on eclipse or deployed

[Marc Hacker]

Can anyone suggest an easy way to test within Java whether running on
the eclipse dev environment or deployed?

Something the code has to do certain things differently in development
than when deployed to Google

Thoughts?

Thanks

Marc

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Does GAE Java eclipse plugin simulate services like Memcache, Taskqueues?

[Marc Hacker]

If not has anyone developed good simulators so that I can run the same
code in development and in production?

Thanks

Marc

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] very simple news mashup

[marc puig]

Hi all,

after one month running successfully, today I submitted Current FM
(http://current.fm) to the Application Gallery, and I also decided to
make it public here.

CurrentFM is a very very simple mashup that takes the twitter trends
from Twitter and show related news by topic. It's been my first
attempt to write an app engine project, and I think it won't be the
last one ;-)

Let me know what do you think, and if you like it, you are welcome to
vote for it:

http://appgallery.appspot.com/about_app?app_id=agphcHBnYWxsZXJ5chQLEgxBcHBsaWNhdGlvbnMY-qgBDA

Thanks,

Marc

--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Locate your twits

[marc puig]

Hi all!

yesterday I uploaded my last microproject based on GAE+twitter+google
maps: http://plazz.me

With plazz.me Twitter users can locate places entering a full Address
or the Geographical coordinates (latitude and longitude). With this
information, plazz.me generates a shortURL which is appended at the
end of the message, and submitted to Twitter (like twitpic.com, but
with position instead of photos).

The system doesn't store passwords, because users are authenticated
every time via Twitter API. Next steps are prepare some simple API for
external apps, and give some more info about near friends/followers.

Comments are welcome,

Enjoy it!

Marc
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] App engine is blocking our server (... Our systems have detected unusual traffic from your computer network ...)

[Marc Provost]

This isssue has been covered on other posts -- with no clear answer.
(see: 
http://groups.google.com/group/google-appengine/browse_thread/thread/88cde75072a08fc2/56b80e93e40ce3dd
and 
http://groups.google.com/group/google-appengine/browse_thread/thread/1c8dd575aa6804c2/e84294dc934a1500
for reference)

We are releasing a web version of our app today and we expect a lot of
traffic! We use app engine as a service and our main server calls it a
lot. It seems google thinks our server is a bot:

*

Our systems have detected unusual traffic from your computer network.
Please try your request again later. Why did this happen?

This page appears when Google automatically detects requests coming
from your computer network which appear to be in violation of the
Terms of Service. The block will expire shortly after those requests
stop.

This traffic may have been sent by malicious software, a browser plug-
in, or a script that sends automated requests. If you share your
network connection, ask your administrator for help — a different
computer using the same IP address may be responsible. Learn more

Sometimes you may see this page if you are using advanced terms that
robots are known to use, or sending requests very quickly.

IP address: 74.59.65.112
Time: 2011-02-22T14:57:38Z

**

How can we avoid this problem? Is it possible to whitelist an ip? We
currently do not use authenticated urls on app engine -- could that
solve the issue?

Thank you!
Marc







-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: How to upload date/time csv data in google app engine with bulkloader tool ?

[Marc B]

Look at the date/time format ('%Y-%m-%dT%H:%M:%S').  Your data does
not match the import format.  Either reformat your data to match this
format.  Looking at your sample data, you could also change the format
to '%Y-%m-%d %H:%M:%S.%f'

Marc

On Mar 24, 1:43 pm, Philippe REGALL  wrote:
> How to upload date/time csv data in google app engine with bulkloader
> tool ?
>
> For example, I uploaded a csv file:
> date,tag,value
> 2011-03-22 10:10:21.812274,abacus,abaque
>
> but in the datastore viewer I have a  type & value loaded into
> date column:
>  ID/name     date    tag     value
>  id=13108    abacus    abaque
>
> My bulkloader.yaml looks like:
>
> python_preamble:
> - import: base64
> - import: re
> - import: google.appengine.ext.bulkload.transform
> - import: google.appengine.ext.bulkload.bulkloader_wizard
> - import: google.appengine.ext.db
> - import: google.appengine.api.datastore
> - import: google.appengine.api.users
>
> transformers:
> - kind: StoredData
> connector: csv
>
> property_map:
>
> - property: date
> external_name: date
>
> # Type: Date/Time Stats: 11 properties of this type in this kind.
> import_transform: transform.import_date_time('%Y-%m-%dT%H:%M:%S')
> export_transform: transform.export_date_time('%Y-%m-%dT%H:%M:%S')
>
> - property: tag
> external_name: tag
> # Type: String Stats: 11 properties of this type in this kind.
>
> - property: value
> external_name: value
> # Type: String Stats: 11 properties of this type in this kind.
>
> => How to upload date/time value from my csv file ?
>
> In fact, I don't mind if it is an auto generated date/time when
> uploading.
>
> Many thanks in advance.
>
> Philippe R

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: New Pricing for high traffic apps - in our case 2x == ~$20'000 per month

[Jean-Marc Truillet]

When are the created idle instances deleted when the traffic is going
down? After an amount of time? When the latency is below a certain
duration?

Thanks,

JM

On 5 sep, 15:53, Johan Euphrosine  wrote:
> The time needed to spin up an instance is mostly dependent on how long it
> takes for your application to warm up.
>
> *You* have to choose what are the reasonable values of Max-Idle-Instances
> and Minimum pending latency for your application:
> - according to the number of idle instance (currently 150) you are willing
> GAE to keep for handling loading spikes (Max-Idle-Instances)
> - the amount of user latency you are willing to trade (currently none/very
> low) for waiting for an existing instance to be available instead spinning a
> new one immediately (Min-Pending-Latency).
>
> Those are entrepreneurial choices involving cost versus risk strategy that
> could not be resolved only with technical advises.
>
> Hope that helps.
>
> On Mon, Sep 5, 2011 at 3:38 PM, Andrin von Rechenberg 
> wrote:
>
>
>
>
>
> > Proppy, how long does it take to spin up an instance?
>
> > What would you say are reasonable values for
> > Max-Idle-Instances and minimum pending latency?
>
> > -Andrin
>
> > On Mon, Sep 5, 2011 at 2:02 PM, Johan Euphrosine wrote:
>
> >> HI Andrin,
>
> >> The default scheduler settings (Automatic) are very aggressive for
> >> achieving the instant scalability that you are used to on GAE:
> >> - it keeps a lot of idle instances around to be able to scale instantly on
> >> traffic spikes
> >> - it enforce the minimum pending latency possible for your incoming
> >> request
>
> >> You can alter that behavior by tweaking the Max-Idle-Instances and
> >> Min-Pending-Latency in "Application Settings > Performance" as described
> >> here:
> >>  http://code.google.com/appengine/articles/managing-resources.html
>
> >> Min Pending Latency: Xms will enforce that the scheduler wait at least Xms
> >> if all instances are busy before taking the decision to spawn a new 
> >> instance
> >> to handle an incoming request:
> >> -> It will maximize usage of existing instances over new instance
> >> creation.
>
> >> Max Idle Instance: N will instruct the scheduler not to keep more that N
> >> idle instances around to handle traffic spikes.
> >> -> It will enforce that you are not billed for more than (Active Instances
> >> + Max Idle Instances).
>
> >> Note that instances waiting for a RPC are not considered "Idle" but
> >> "Active" since, from the point of view of the scheduler, they are currently
> >> processing a request.
>
> >> Once multi-threading is implemented with Python 2.7 the scheduler will be
> >> able to make use of these active-waiting instances for handling incoming
> >> requests, in the meantime you can use the various async APIs availables to
> >> be able to make a better usage of the time waiting for RPCs to complete.
>
> >> Hope that helps.
>
> >> On Mon, Sep 5, 2011 at 10:11 AM, Andrin von Rechenberg <
> >> andri...@gmail.com> wrote:
>
> >>> Hi there
>
> >>> We are running a Python GAE service called MiuMeet.
>
> >>> The current cost is about $296 per day. In November it will be $600 per
> >>> day.
>
> >>> Most of our cost comes from the Frontend Instance hours. We apparently
> >>> need
> >>> 4677h per day, thats roughly 200 instances. We peak at around 240 qps.
> >>> The
> >>> average latency is 800ms / request. 240 * 0.8 => 192. So it seems 200
> >>> instances
> >>> is exactly what we need at peak.
>
> >>> However our instances are only 25% active, see here:
> >>>http://bit.ly/pXZH4t
>
> >>> We need someone to talk to about the new pricing model and what can be
> >>> done.
> >>> Idle instances will cost us an extra $10k per month. We can't afford
> >>> that.
>
> >>> The biggest problem we see is that it seems that AppEngine instances are
> >>> idle
> >>> often by design: The datastore is slow you have to wait and idle around,
> >>> that's
> >>> a fact for us.
>
> >>> We would be really grateful for any advice.
>
> >>> -Andrin, Founder of MiuMeet
>
> >>> PS: Here is our billing comparison
>
> >>>   Resource Used Free Billable Charge *CPU Time:*
> >>> $0.10/CPU hour 2,797.15 6.50 2,790.65 $279.07 *Bandwidth Out:*
> >>> $0.12/GByte 109.32 1.00 108.32 $13.00 *Bandwidth In:*
> >>> $0.10/GByte 30.55 1.00 29.55 $2.96 *Stored Data:*
> >>> $0.005/GByte-day 101.13 1.00 100.13 $0.51 *Recipients Emailed:*
> >>> $0.10/1000 Emails 0.00 2.00 0.00 $0.00 *High Replication Storage:*
> >>> $0.008/GByte-day 109.92 0.50 109.42 $0.88 *Backend Usage:*
> >>> Prices
> >>> $0.00 $0.72 $0.00 $0.00 *Always On:*
> >>> $0.30/Day No - - $0.00 *Total:* $296.42
> >>>  Estimated Charges Under New Pricing
>
> >>> The charges below are estimates of what you would be paying once App
> >>> Engine's new pricing 
> >>> model goes
> >>> live. The amounts shown below are for your information only, they are

[google-appengine] Re: google app engine for extremely demanding multiplayer browser game

[Jean-Marc Truillet]

Hi Karel,

Another advantage of GAE for a multiplayer game like yours is the
channel API. It is a Comet-like push system that avoids you polling
the server (and the DataStore) to retrieve the actions of the other
players.
Have also a look at www.ovh.com. They propose (virtual) dedicated
servers and PaaS solutions. Their datacenter is located in Lille
(Rijsel), in your area.

JM


On 12 sep, 16:00, Karel Crombecq  wrote:
> Hey guys,
>
> I am currently investigating possibilities for writing a sequel to the
> popular text-based browser game that I released in 2001 called Castle Quest
> 2 (http://www.castlequest.be). One of the options I am considering is
> developing the game in GWT, and running it on app engine. But I am not sure
> whether app engine will be able to scale to the degree needed for my game.
>
> CQ2 at its peak generated easily 3 million page views per day (90 million
> per month!), with bandwidth usage of 2.5GB each month. The database grew to
> a size of about 1GB. There were at least 250 sql queries each second. And it
> is expected that CQ3, with the advent of social networks and social gaming,
> will reach multiples of these numbers.
>
> Now I don't really know how big the sites are that are hosted by Google app
> engine, as information is rather scarce on that part. So my question to the
> Google team is: do you think (know?) if app engine can handle this kind of
> pressure from one app? Will the data store hold up, and will it scale well?
>
> It is extremely important that I have trustworthy information about this. If
> I decide to go with app engine and the system doesn't hold up, a massive
> money and time investment will be lost.
>
> Thanks in advance,
> Kind regards,
> Karel Crombecq

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Jar too large

[Jean-Marc Truillet]

Hello,

In fact is it really useful to deploy “appengine-api-1.0-
sdk-1.5.1.jar” in GAE? Isn't it provided in GAE context, as the Java
EE jars are in the EJB containers.
I also have my gwt-dev.jar that is very big (27Mb) and cannot be
deployed without splitting. Since the deployed application runs in
production mode, is it necessary to upload gwt-dev.jar in GAE?

Thanks.

JM

On 16 août, 23:38, "Ikai Lan (Google)"  wrote:
> Is that the largest JAR file, or could you have other JAR files?
>
> I wonder if another possibility is that you just have a large file, and
> you're getting a wrong error message?
>
> --
> Ikai Lan
> Developer Programs Engineer, Google App Engine
> plus.ikailan.com | twitter.com/ikai
>
>
>
> On Tue, Aug 16, 2011 at 5:04 AM, Fuankarion  wrote:
> > Hi
>
> > This is most likely a silly mistake, but I just can't figure out
> > what's wrong, so I have to ask it here.
>
> > I'm trying to upload an application to GAE, with the folloing command
>
> > {pathToAppEngineSKD}/bin/appcfg.sh update {pathToNetbeansProjectDir}/
> > build/web/
>
> > This worked fine until last week, but now I always get the error
> > report:
>
> > “java.lang.IllegalStateException: Found a jar file too large to
> > upload”
>
> > It also says  “Consider using --enable_jar_splitting”, but if I change
> > the input on the command line to
>
> > {pathToAppEngineSKD}/bin/appcfg.sh --enable_jar_splitting  update
> > {pathToNetbeansProjectDir}/build/web/
>
> > I keep getting the same error, apparently the --enable_jar_splitting
> > option has no effect.
>
> > What is really weird here is that I have uploaded the same project
> > with the same command (first one) many many times to GAE without
> > having any problems, and suddenly it never worked again; the large jar
> > “appengine-api-1.0-sdk-1.5.1.jar” has been there all the time.
>
> > What am I missing?
>
> > Thanks
> > Fuanka
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: 1.6.0 Prerelease SDKs are out

[Marc Nieper-Wißkirchen]

I am also interested in an answer to this question as I would like to have 
my old app id with the new HRD.

Is it true that Jinja2 is not bundled with the prerelease? As the 
production system supports this, it should be included in the SDK as well.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/fA-D0nn7g4IJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Cannot activate the Google App Engine

[Jean-Marc Lagace]

I had activated the app engine a long time ago on my personal account to 
start development and have since moved to a Google Apps for Business 
account with my company name (m2i3.com). 

I'm looking at restarting development on the App engine but cannot activate 
the account anywhere. Considering you got my credit card, address it feels 
a bit strange that you need to activate the App Engine again using a cell 
number. 

In any case can my number mobile number be unassociated from my old account 
and made available to activate the App Engine onto this account.

Regards,

--
Jean-Marc Lagacé
owner, M2i3.com 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/fVKBAIKDsFwJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Why is there a static/proxy.html used for certain requests?

[Marc-Andre Bruneau]

Some requests, originating from IE11, seem to be go thru the cloud endpoint 
static proxy (project.appspot.com/_ah/api/static/proxy.html).

Why?

In some cases, these requests fail with the following error:

response: {
 status: 0
 statusText: No status text available
 body: {"error":{"code":-1,"message":"A network error occurred, and the 
request could not be completed."}}
}

Any help would be appreciated!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/7dbe7f94-7456-450b-b5c5-e224b71da651%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Unusual Java Endpoint 503 Error

[Marc-Andre Bruneau]

Hi,

We noticed an unusual issue from our client javascript app, calling our 
Java backend endpoint app. 

"code": 503,
"message": "UNREACHABLE;rpc3/HTTPOverRPC.HTTPRequest;Server is not 
responding;StartTimeMs=1473524910406;tcp;Deadline(sec)=65.0;ResFormat=UNCOMPRESSED;NoServerTime;LogBytes=0;FailFast;EndUserCredsRequested;EffSecLevel=none;ReqFormat=UNCOMPRESSED;ReqID=50ae948f809540b4;GlobalID=816728cea85c0a70;Server=10.73.204.145:4167"

Does anyone know how to interpret this error?

Thanks

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/deb7cf5c-47ba-4855-bcf5-8acae9a530cb%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Differences in generated endpoint Java client libraries (1.9.48 -> 1.9.50)

[Marc-Andre Bruneau]

Hi,

I just upgraded my project to Java SDK 1.9.50 and when generating the 
endpoint java client libraries, using the below command, the resulting 
interface is different from before (when using 1.9.48):

Command:

   - mvn compile appengine:endpoints_get_clients_lib

Resulting issues in 1.9.50

   - Doubles are now Number (Type mismatch: cannot convert from Number to 
   double)
   - The parameter order of some function has been switched 
  - The method getServiceConfiguration(String, Integer) in the type 
  Foo.Bar is not applicable for the arguments (int, String)
  - Sometimes, 2 strings got swapped, so my session string is now 
  something else
   
Upgrading to 1.9.50 is therefore very dangerous to introduce hard to 
predict bugs.

My questions:

   - Are these changes expected?
   - Is there anything else that changed?
   - Where can I find documentation about this?
   
Thanks

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/353d0f36-871e-468c-ad4b-743eef9fdb81%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Python App Engine - MySQLdb connection pool

[Marc-Andre Bruneau]

Hi everyone,

Is there a way to enable connection pooling with MySQLdb or is it enabled 
by default? 

Thanks

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/586ca629-f768-4370-ba05-deee58452fb6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Google App Engine is slow to deploy, hangs on "Updating service [someproject]..."

[Jean-Marc Arsan]

Experiencing the same issue with google-appengine :(. I was trying to 
migrate from AWS; however, after banging my head for the past few hours. 
I'll probably quit if it can't complete by tomorrow.

On Thursday, August 24, 2017 at 3:19:11 PM UTC-4, Samuel Cousin wrote:
>
> Thanks for the debug info! I'm experiencing the exact same issue but with 
> a nodejs 8.x environment. This inertia to deploy a mere 100 lines of JS is 
> really testing my limit...
>
> On Monday, August 21, 2017 at 8:06:19 PM UTC+1, Adrien Di Pasquale wrote:
>>
>> Hi ! I'm experiencing the same slowness : the "Update service ...|" step 
>> is taking anywhere from 5 to 30 minutes. 
>>
>> Here is what I've tried so far to fix it, without success: 
>> - use a different region (I've switched from europe-west to us-central)
>> - deploy the hello_world app from the sample github repo
>> - use the `no-promote` option
>> - use the `manual_scaling: instances: 1` option in app.yml
>>
>> I've isolated it down to a single operation that hangs, it's always the 
>> same :
>> ```
>> $ gcloud app operations describe [...]
>> metadata:
>>   '@type': type.googleapis.com/google.appengine.v1.OperationMetadataV1
>>   ephemeralMessage: Waiting for instances to become available for serving 
>> traffic.
>>   insertTime: '2017-08-21T13:18:17.363Z'
>>   method: google.appengine.v1.Versions.CreateVersion
>>   target: [...]
>>   user: [...]
>> name: [...]
>> ```
>>
>> After it finally completes (5-30 minutes), when I check back the 
>> operation with the same command, it consistently shows an endTime ~= 
>> insertTime + 10s. So I'm guessing there's a buggy delay in the callback 
>> that marks the operation as completed (this echoes a previous comment in 
>> this thread, that the operation is actually done, but not marked as such).
>>
>> Hope this can help ! This is ruining my first steps with GAE :/
>>
>> FYI I'm using Python Flexible Environment with python 3.6, so I'm 
>> guessing my next steps will be to try with 2.7 or the Standard environment.
>>
>> Le mercredi 16 août 2017 15:53:08 UTC+2, Gunar Cassiano Gessner a écrit :
>>>
>>> Hi Nick, thank you for the information.
>>>
>>> Are there any updates on decreasing GCLB configuration push times?
>>> Is there a way for me to bypass it if using "manual_scaling: instances: 
>>> 1"?
>>>
>>> Thank you,
>>> Gunar.
>>>
>>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/149739e9-4508-41d4-9102-6e78218bf016%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] When deploying a simple custom flexible nodejs app, the process gets stuck at "Updating service..."

[Jean-Marc Arsan]

When deploying nodejs custom flex containers to the google app engine, the 
process never finalizes and gets stuck at "Updating service..."
To help troubleshoot this issue, I created a simple "hello world" http 
server (available here: 
https://nodejs.org/en/docs/guides/nodejs-docker-webapp/) and then used the 
gcloud gen-config command.

gcloud beta app gen-config --custom
echo "service: test-node-fail" >> app.yaml
gcloud app deploy



My repository is available here: 
https://github.com/arsanjea/test-node-fail/blob/master/server.js
On my machine, the following commands work perfectly (I can browse the app 
on http://localhost):


docker build . -t testnodefail
docker run -p 80:8080 -d testnodefail

I've been struggling to make this work for the past 8 hours. Cancelling my 
plans to move to google cloud if I can't resolve it soon :(

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/18dc4145-535c-449d-8fc7-bfaea5a32120%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: When deploying a simple custom flexible nodejs app, the process gets stuck at "Updating service..."

[Jean-Marc Arsan]

Alright, so things seem to be working now.
Thanks!

On Tuesday, October 17, 2017 at 1:57:29 PM UTC-4, Kenworth (Google Cloud 
Platform) wrote:
>
> I cloned your repository and tried it on my VM. It took me around 5-9 
> minutes on a couple of retries (this is normal by the way). How long does 
> it get stuck on your end? You can also send me privately the log result of 
> running 'gcloud app deploy --verbosity=debug'.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/8bb393da-7536-42a5-aa95-dd7d7f272f85%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] gql query for a specific user

[Marc-Antoine Ruel]

See Rietveld's Issue definition at:
http://google.com/codesearch?q=class+Issue+package%3Ahttp%3A%2F%2Frietveld.googlecode.com
->
class Issue(db.Model):
  # ...
  owner = db.UserProperty(auto_current_user_add=True, required=True)
  # ...

I'm trying to debug a weird failure and I want to retrieve issues for
a specific user in Data Viewer. Tried variations of
SELECT * FROM Issue WHERE owner = xx
with xx being
'mar...@chromium.org'
KEY('User', 'mar...@chromium.org')
USER('mar...@chromium.org')

http://code.google.com/intl/fr/appengine/docs/python/datastore/gqlreference.html
seems to imply USER(email-address) but I just get an invalid GQL query
with USER(mar...@chromium.org).

What's the right way to express a user credential?

Thanks,

M-A

--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: comment récupérer des image à partir de la data store

[Jean-Marc (M2i3.com)]

Hello Kais,

L'image dans le data store n'est pas différent d'une page HTML...

Le lien suivant de la documentations de Google App Engine devrait
pourvoir t'aider:

http://code.google.com/appengine/articles/images.html

Il est très important de bien configurer le "Content-Type" pour
informer le fureteur qu'il s'agit d'une image.

--
Jean-Marc Lagacé
Partenaire Principal :: M2i3.com
jean-marc.lag...@m2i3.com :: http://m2i3.com :: +1.888.403.5998 x101

On Feb 7, 12:53 pm, kais louetri  wrote:
> hi
> j'utilise l'exemple du guestbook (http://code.google.com/intl/fr/
> appengine/docs/python/images/usingimages.html) pour stocker des image
> dans la dat store, et je cherche maintenant à récupère ces image pour
> les afficher dans une autre page web, est ce qu'il y a quelqu'un qui
> peut m'aider pour résoudre ce problème ?
> merci

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: re-use phone number for SMS?

[Jean-Marc (M2i3.com)]

Got a similar problem  except I changed my email address for my
account and altough it now says I have 10 applications available
(which is not true I got one running) I can no longer add application
to my account since it is asking me to enter a mobile phone number
again which has already been used on my business account.

any help would be appreciated thanks!

Jean-Marc Lagacé
M2i3.com

On Oct 13, 7:56 am, "Nick Johnson (Google)" 
wrote:
> Hi kiren,
> Let us know both emails involved and we'll activate the second account for
> you.
>
> -Nick Johnson
>
> On Mon, Oct 12, 2009 at 9:36 PM, kiren  wrote:
>
> > Hello,
>
> > I have an app engine account for personal use.  Now I want to create a
> > new account for my company.  However, when I try to verify my new
> > account by SMS, it complains because my phone number has already been
> > used to confirm an account (I only have one mobile phone for both
> > personal and work.)  Is there a workaround for this?
>
> > Thanks
> > Kiren
>
> --
> Nick Johnson, Developer Programs Engineer, App Engine
> Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number:
> 368047

--

You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.