[google-appengine] datastore advice?

[Charles]

Hi all,

I'm wondering, since the datastore is hierarchical, does the number of
children an entity has affect the performance on querying on the
parents themselves? For example, if I have a set of parents, say...

Jane
Margaret
Graham
Arthur

...and I have a set of children associated with those parents...

Jane
-Sam
-Robert
Margaret
-Lisa
Graham
Arthur
-Rowen
-Jerry

...will the number of children for each parent affect the performance
of querying the parents themselves? For instance, if I wanted to select
all of the parents (SELECT * FROM parents), that would be easy with the
data above. But, since the datastore is hierarchical, does the
performance get hampered if say the parents have many thousands or even
millions of children? Say, like...

Jane
-Sam
-Robert
...1 million more
Margaret
...

If so, I'm just wondering if it would make more sense to make the
children root entities too, so as not to affect the performance of
querying on the parents. Anyways, hope I've explained my question well
enough.

Thanks in advance!


Charles

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Google Gadget help

[Charles]

We have a google gadget running on our site, see the bottom right of
this page:

http://www.health.com/health/gallery/0,,20546698,00.html

The xml it's running is on our server, we recently made some changes
to it, but it doesn't appear. I was just wondering how long does the
google gadget cache take to expire or if there is something else we
need to do on our side?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Application seems to restart after arbitrary amount of time...?

[Charles]

Hi all,

I've created a very simple application as a test for a bigger
application I'm thinking of building on GAE.  Right now, it mostly
contains only two servlets and a single cron job.  One servlet is
loaded on init (and logs an init message), and the other one is called
every minute by the cron job (and also logs a message).  My issue is
that I'm watching the logs and I'm noticing that my applications
context is reloaded after an arbitrary amount of time.  To be more
precise, here is an example of what I'd see in the logs...

[INFO] Application initializing...
[INFO] Servlet called 1 times.
[INFO] Servlet called 2 times.
[INFO] Servlet called 3 times.
...
[INFO] Servlet called 79 times.
[INFO] Servlet called 80 times.
[INFO] Application initializing...
[INFO] Servlet called 1 times.
[INFO] Servlet called 2 times.

So, as you can see, the application starts and the init servlet is
loaded (as expected) and I get the "Application initializing" info log
message.  After that, cron calls the other servlet every minute, and
it posts another log message.  However, after a seemingly random
amount of time, in this case 80 minutes, the application context
reloads which makes me assume that my entire application restarted.
It happens at different intervals each time, anywhere from half an
hour to a few hours.  And, I never get any error messages in my log.
Can someone help me understand this?

Thanks in advance


Charles

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Application seems to restart after arbitrary amount of time...?

[Charles]

Hi Brandon,

Thanks for the reply.  Just from a bit more research, this seems to be
related to loading requests (http://code.google.com/appengine/kb/
java.html#What_Is_A_Loading_Request) and their frequency.  From the
FAQ, it seems like with apps with minimal traffic, or test traffic,
VMs seem to be recycled during inactivity.  When subsequent requests
hit your app after your VM has been handed off, GAE has to spin up a
new JVM (a loading request) which re-initializes the entire context
(and also eats up significant CPU time).  Anyways, kinda sucks that
this is how it works, but I can understand why they'd want to do
that.  And, this only really affects apps in testing or production
apps with little traffic.  When we get real traffic, *hopefully* this
becomes a non-issue.

Also, it looks like they're playing around with the idea of being able
to pay to reserve a dedicated JVM (http://code.google.com/appengine/kb/
java.html#Can_I_Pay_To_Reserve_My_JVM).  This would be a good solution
as well.


Charles


On Feb 12, 12:31 pm, Brandon Thomson  wrote:
> Charles, the app instance can be unloaded at any time and a new one
> will initialize to handle the next incoming request. there can be up
> to 30 at once. it is by design, not an error.
>
> On Feb 12, 12:20 am, Charles  wrote:
>
> > Hi all,
>
> > I've created a very simple application as a test for a bigger
> > application I'm thinking of building on GAE.  Right now, it mostly
> > contains only two servlets and a single cron job.  One servlet is
> > loaded on init (and logs an init message), and the other one is called
> > every minute by the cron job (and also logs a message).  My issue is
> > that I'm watching the logs and I'm noticing that my applications
> > context is reloaded after an arbitrary amount of time.  To be more
> > precise, here is an example of what I'd see in the logs...
>
> > [INFO] Application initializing...
> > [INFO] Servlet called 1 times.
> > [INFO] Servlet called 2 times.
> > [INFO] Servlet called 3 times.
> > ...
> > [INFO] Servlet called 79 times.
> > [INFO] Servlet called 80 times.
> > [INFO] Application initializing...
> > [INFO] Servlet called 1 times.
> > [INFO] Servlet called 2 times.
>
> > So, as you can see, the application starts and the init servlet is
> > loaded (as expected) and I get the "Application initializing" info log
> > message.  After that, cron calls the other servlet every minute, and
> > it posts another log message.  However, after a seemingly random
> > amount of time, in this case 80 minutes, the application context
> > reloads which makes me assume that my entire application restarted.
> > It happens at different intervals each time, anywhere from half an
> > hour to a few hours.  And, I never get any error messages in my log.
> > Can someone help me understand this?
>
> > Thanks in advance
>
> > Charles

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] What additional JARs do I need to use the Memcache Java API?

[Charles]

Hi all,

I've tried adding caching functionality to my app using the Memcache
Java API but I'm hitting a wall here.  I've followed the "Using
JCache" instructions on the GAE docs page (http://code.google.com/
appengine/docs/java/memcache/usingjcache.html).  I've downloaded the
jsr107cache-1.1.jar and added it to my build path, as recommended.  I
run the example locally and I get an exception...

"Could not find class: 'ri.cache.BasicCacheFactory'"

I did some searching and downloaded a jcache-1.0-dev-3.jar file
(http://www.findjar.com/class/ri/cache/BasicCacheFactory.html) and
also added that to my build path.  The "Could not find class" error
disappeared and I got a new error...

"Class: 'ri.cache.BasicCacheFactory' does not implement CacheFactory"

I must be missing something.  If anyone is using Memcache, can you let
me know if I need to add any other JARs besides the
jsr107cache-1.1.jar that App Engine provides?  Or maybe I'm just doing
something stupid in my app and missed something in the instructions.

Thanks in advance


Charles

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Application seems to restart after arbitrary amount of time...?

[Charles]

Hi Tim, I agree.  It's not the persistence of any statics or memory
that concerns me though.  It's the fact that every time my VM gets
recycled, the next hit to my site takes a few seconds to resolve while
GAE spins up another JVM to service it.  It's the performance that I'm
more worried about, not to mention that every time GAE creates a new
VM for me, it takes significant CPU cycles to do so.


On Feb 12, 11:52 pm, Tim Hoffman  wrote:
> Hi
>
> You should never depend on any specific instance hanging around just
> the same
> as you cannot depend on anything in memcache hanging around.
>
> Rgds
>
> T
>
> On Feb 13, 12:29 pm, Charles  wrote:
>
> > Hi Brandon,
>
> > Thanks for the reply.  Just from a bit more research, this seems to be
> > related to loading requests (http://code.google.com/appengine/kb/
> > java.html#What_Is_A_Loading_Request) and their frequency.  From the
> > FAQ, it seems like with apps with minimal traffic, or test traffic,
> > VMs seem to be recycled during inactivity.  When subsequent requests
> > hit your app after your VM has been handed off, GAE has to spin up a
> > new JVM (a loading request) which re-initializes the entire context
> > (and also eats up significant CPU time).  Anyways, kinda sucks that
> > this is how it works, but I can understand why they'd want to do
> > that.  And, this only really affects apps in testing or production
> > apps with little traffic.  When we get real traffic, *hopefully* this
> > becomes a non-issue.
>
> > Also, it looks like they're playing around with the idea of being able
> > to pay to reserve a dedicated JVM (http://code.google.com/appengine/kb/
> > java.html#Can_I_Pay_To_Reserve_My_JVM).  This would be a good solution
> > as well.
>
> > Charles
>
> > On Feb 12, 12:31 pm, Brandon Thomson  wrote:
>
> > > Charles, the app instance can be unloaded at any time and a new one
> > > will initialize to handle the next incoming request. there can be up
> > > to 30 at once. it is by design, not an error.
>
> > > On Feb 12, 12:20 am, Charles  wrote:
>
> > > > Hi all,
>
> > > > I've created a very simple application as a test for a bigger
> > > > application I'm thinking of building on GAE.  Right now, it mostly
> > > > contains only two servlets and a single cron job.  One servlet is
> > > > loaded on init (and logs an init message), and the other one is called
> > > > every minute by the cron job (and also logs a message).  My issue is
> > > > that I'm watching the logs and I'm noticing that my applications
> > > > context is reloaded after an arbitrary amount of time.  To be more
> > > > precise, here is an example of what I'd see in the logs...
>
> > > > [INFO] Application initializing...
> > > > [INFO] Servlet called 1 times.
> > > > [INFO] Servlet called 2 times.
> > > > [INFO] Servlet called 3 times.
> > > > ...
> > > > [INFO] Servlet called 79 times.
> > > > [INFO] Servlet called 80 times.
> > > > [INFO] Application initializing...
> > > > [INFO] Servlet called 1 times.
> > > > [INFO] Servlet called 2 times.
>
> > > > So, as you can see, the application starts and the init servlet is
> > > > loaded (as expected) and I get the "Application initializing" info log
> > > > message.  After that, cron calls the other servlet every minute, and
> > > > it posts another log message.  However, after a seemingly random
> > > > amount of time, in this case 80 minutes, the application context
> > > > reloads which makes me assume that my entire application restarted.
> > > > It happens at different intervals each time, anywhere from half an
> > > > hour to a few hours.  And, I never get any error messages in my log.
> > > > Can someone help me understand this?
>
> > > > Thanks in advance
>
> > > > Charles

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: What additional JARs do I need to use the Memcache Java API?

[Charles]

Bump!

Anyone have any suggestions?


Charles


On Feb 12, 8:42 pm, Charles  wrote:
> Hi all,
>
> I've tried adding caching functionality to my app using the Memcache
> Java API but I'm hitting a wall here.  I've followed the "Using
> JCache" instructions on the GAE docs page (http://code.google.com/
> appengine/docs/java/memcache/usingjcache.html).  I've downloaded the
> jsr107cache-1.1.jar and added it to my build path, as recommended.  I
> run the example locally and I get an exception...
>
> "Could not find class: 'ri.cache.BasicCacheFactory'"
>
> I did some searching and downloaded a jcache-1.0-dev-3.jar file
> (http://www.findjar.com/class/ri/cache/BasicCacheFactory.html) and
> also added that to my build path.  The "Could not find class" error
> disappeared and I got a new error...
>
> "Class: 'ri.cache.BasicCacheFactory' does not implement CacheFactory"
>
> I must be missing something.  If anyone is using Memcache, can you let
> me know if I need to add any other JARs besides the
> jsr107cache-1.1.jar that App Engine provides?  Or maybe I'm just doing
> something stupid in my app and missed something in the instructions.
>
> Thanks in advance
>
> Charles

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: What additional JARs do I need to use the Memcache Java API?

[Charles]

Hi Nick,

Thanks for the reply.  As an update to anyone else that hits this,
I've tried this same project on my Mac which has a fresh install of
Eclipse and GAE and it worked as expected, no errors.  So, as a
result, I've done a complete re-install of my development environment
(i.e. re-downloaded Eclipse, re-installed GAE plug-in, and even re-
installed JDK) on my Windows machine and it seemed to fix things.
Unfortunately, I still couldn't pinpoint what was causing it, but
refreshing my dev environment worked for me.


Charles


On Feb 17, 6:52 am, "Nick Johnson (Google)" 
wrote:
> Hi Charles,
>
> You shouldn't need any additional JARs - everything should be included in
> the SDK.
>
> -Nick Johnson
>
>
>
> On Tue, Feb 16, 2010 at 9:28 PM, Charles  wrote:
> > Bump!
>
> > Anyone have any suggestions?
>
> > Charles
>
> > On Feb 12, 8:42 pm, Charles  wrote:
> > > Hi all,
>
> > > I've tried adding caching functionality to my app using the Memcache
> > > Java API but I'm hitting a wall here.  I've followed the "Using
> > > JCache" instructions on the GAE docs page (http://code.google.com/
> > > appengine/docs/java/memcache/usingjcache.html).  I've downloaded the
> > > jsr107cache-1.1.jar and added it to my build path, as recommended.  I
> > > run the example locally and I get an exception...
>
> > > "Could not find class: 'ri.cache.BasicCacheFactory'"
>
> > > I did some searching and downloaded a jcache-1.0-dev-3.jar file
> > > (http://www.findjar.com/class/ri/cache/BasicCacheFactory.html) and
> > > also added that to my build path.  The "Could not find class" error
> > > disappeared and I got a new error...
>
> > > "Class: 'ri.cache.BasicCacheFactory' does not implement CacheFactory"
>
> > > I must be missing something.  If anyone is using Memcache, can you let
> > > me know if I need to add any other JARs besides the
> > > jsr107cache-1.1.jar that App Engine provides?  Or maybe I'm just doing
> > > something stupid in my app and missed something in the instructions.
>
> > > Thanks in advance
>
> > > Charles
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appeng...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.
>
> --
> Nick Johnson, Developer Programs Engineer, App Engine
> Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number:
> 368047

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] directories need trailing slashes

[Charles]

Hi all,

This is a pretty simple problem, but I'm not sure how to approach it
with GAE.  The problem is this.  I have an about page set up as an
index.jsp page under the directory /about/.  So, when I access...

www.example.com/about/index.jsp
www.example.com/about/

...it works just fine.  BUT, when I access...

www.example.com/about (notice, no trailing slash)

...it fails.  I know why.  It's interpreting it as a file and not a
directory.  But, with traditional webservers like Apache, if it finds
no file, it will look for it as a directory and return the proper
page.  An extra round-trip, sure, but it's definitely desirable.  The
problem is, GAE doesn't seem to do that.  The only solutions I've
found online were to do URL-rewriting, or create redirect servlets, or
dedicated servlets for certain pages.  This seems excessive, and I'm
hoping I'm missing something.  Anyone have any suggestions?

Thanks in advance


Charles

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: directories need trailing slashes

[Charles]

Hmmm, I think I might have fixed it...but I don't get how.

I've added error-pages to my web.xml which catches 404 and 500 errors
and returns an appropriate error page (via
http://code.google.com/appengine/docs/java/config/webxml.html#Error_Handlers).
After I fixed and deployed that, the previous URLs that didn't work
(i.e. www.examples.com/about) all of a sudden started to redirect
properly (i.e. to www.examples.com/about/).  Weird.  I'm not sure
exactly what happened, but this seems to be a non-issue now.  Anyways,
false alarm...I guess :p

Thanks


Charles


On Mar 30, 6:53 pm, Charles  wrote:
> Hi all,
>
> This is a pretty simple problem, but I'm not sure how to approach it
> with GAE.  The problem is this.  I have an about page set up as an
> index.jsp page under the directory /about/.  So, when I access...
>
> www.example.com/about/index.jspwww.example.com/about/
>
> ...it works just fine.  BUT, when I access...
>
> www.example.com/about(notice, no trailing slash)
>
> ...it fails.  I know why.  It's interpreting it as a file and not a
> directory.  But, with traditional webservers like Apache, if it finds
> no file, it will look for it as a directory and return the proper
> page.  An extra round-trip, sure, but it's definitely desirable.  The
> problem is, GAE doesn't seem to do that.  The only solutions I've
> found online were to do URL-rewriting, or create redirect servlets, or
> dedicated servlets for certain pages.  This seems excessive, and I'm
> hoping I'm missing something.  Anyone have any suggestions?
>
> Thanks in advance
>
> Charles

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Where is my data - in Relation to Data Protection Laws - US? EU? Elsewhere

[Charles]

Dear All,

I have a successful app engine site up and running and although I
don't care where the data is - it's out there somewhere, I would like
to know so as to be able to understand the implications of Data
Protection Laws - for instance is it in the US, EU or elsewhere?

With Best Regards
Charles

--

You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=.

[google-appengine] How do I create the a image object that is located on my local file system?

[charles]

I tried to create a image object:
 avatar = images.Image(os.path.join(os.path.dirname(__file__),'images/
head.jpg')
but this will lead to error, can anyone help me with this?

--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: How do I create the a image object that is located on my local file system?

[charles]

Thanks a lot for this info

On 11月20日, 上午5时44分, Alexander Kojevnikov <[EMAIL PROTECTED]>
wrote:
> You cannot access the static files in app 
> engine.http://code.google.com/appengine/docs/configuringanapp.html#Static_Fi...
>
> If you need to read your image, keep it with the application files or
> in the datastore.
>
> Alex
> --www.muspy.com
>
> On Nov 20, 6:12 am, charles <[EMAIL PROTECTED]> wrote:
>
> > I tried to create a image object:
> >  avatar = images.Image(os.path.join(os.path.dirname(__file__),'images/
> > head.jpg')
> > but this will lead to error, can anyone help me with this?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] appstats: "Stats data was too big"

[Charles Falconer]

After I added appstats to my Java app, I started getting these log messages.

Does anyone know would cause this message?

> com.google.appengine.tools.appstats.MemcacheWriter logMaybe
> WARNING: Stats data was too big, all stack traces were removed.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Trying to create application - Mobile Phone Error

[Charles Fisher]

Hi, when I go to create my application it is telling me my phone number has 
received too many confirmation texts or it has been used to register 
already. Problem is, I have no received any texts yet nor have I registered 
my phone number with an application already. I know 100% I am entering the 
information correctly, too.

What can I do?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/nj0IaQuZtYYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] GDATA -- ACL Feed ... It's possible to access/modify site level security BUT Is it possible to access/modify page-level security

[Charles Daubner]

Has anyone had any luck accessing/modifying PAGE-LEVEL security using the 
GDATA API; specifically 
com.google.gdata.data.acl.AclEntry;
com.google.gdata.data.acl.AclFeed;
com.google.gdata.data.acl.AclRole;
com.google.gdata.data.acl.AclScope;
???

Thanks!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/EmtUbojftekJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Errorrs loading calendars using java sample of calendar-api and oath on google app engine GAE

[charles witter]

I am attempting to get familiar using the java calendar api (v3r7) on GAE 
(oauth-1.8-beta) with GWT. 

I am running an updated calendar sample originally provided by Yaniv Inbar. 

I believe I am logged in but I get the attached error when I am trying to 
authorize in order to initially load my calendars. BTW - The StockWatcher 
samples with RPC and JDO store I previously tried worked great.

Any help or a pointer to an updated CalendarAPI sample would be very 
appreciated!!!

*Here is the error in the GAE server log ...* 

javax.servlet.ServletContext log: Exception while dispatching incoming RPC 
call com.google.gwt.user.client.rpc.SerializationException: Type 
'com.google.api.client.googleapis.json.GoogleJsonResponseException' was not 
included in the set of types which can be serialized by this 
SerializationPolicy or its Class object could not be loaded. For security 
purposes, this type will not be serialized.: instance = 
com.google.api.client.googleapis.json.GoogleJsonResponseException: 401 { 
"code" : 401, "errors" : [ { "domain" : "global", "location" : 
"Authorization", "locationType" : "header", "message" : "Login Required", 
"reason" : "required" } ], "message" : "Login Required" } at 
com.google.gwt.user.server.rpc.impl.ServerSerializationStreamWriter.serialize(ServerSerializationStreamWriter.java:619)
 
at 
com.google.gwt.user.client.rpc.impl.AbstractSerializationStreamWriter.writeObject(AbstractSerializationStreamWriter.java:126)
 
at 

. omitted

*Here is the CalanderServerImpl RPC call ..*

Calendar loadCalendarClient() throws IOException, NotLoggedInException {
GoogleAuthorizationCodeFlow newFlow=Utils.newFlow();
Credential credential = newFlow.loadCredential(Utils.getUser().getUserId());
return Calendar.builder(HTTP_TRANSPORT, JSON_FACTORY)
.setHttpRequestInitializer(credential).build();
}

*Here are the Utils methods ...*

  static GoogleAuthorizationCodeFlow newFlow() throws IOException, 
NotLoggedInException {
checkLoggedIn();
String userId = 
UserServiceFactory.getUserService().getCurrentUser().getUserId();
String clientId="stackoverflowomitted.apps.googleusercontent.com";
String clientSecret="ommitted for stackoverflow";
Iterable scopes=Collections.singleton(CalendarScopes.CALENDAR);

GoogleAuthorizationCodeFlow.Builder builder
=new GoogleAuthorizationCodeFlow.Builder(HTTP_TRANSPORT, JSON_FACTORY, 
clientId,clientSecret, scopes);

builder.setCredentialStore(new AppEngineCredentialStore());

GoogleAuthorizationCodeFlow newFlow=builder.build();

return newFlow;
  }

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/TIvr735BOekJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Unable to change socket read timeout in SDK

[Charles Pritchard]

I've not been able to change the socket read timeout in the SDK for GAE.

I went ahead and posted a bug report -- but I wanted to check and see if 
anyone else is hitting this issue or has worked around it.
https://code.google.com/p/googleappengine/issues/detail?id=10916

First: I'm using new Socket because the HttpURLConnection does not seem to 
work with text/event-stream connections.
It simply hangs, waiting until the connection is closed. If anyone has a 
workaround for that, let me know.
I know we can do chunked transfers for sending data, but apparently not 
receiving.

So.. I use new Socket, then readLine() but I get an API timeout in the 
implementation, though I am using setSoTimeout().
It seems that the Socket implementation is not sending the deadline 
argument when it runs its API makeSyncCall command.

It looks like other implementations for API do send that argument.

So, long story short, this looks like a bug, and one that's difficult to 
work around.
The idea here is to go ahead and listen on an http socket for a little 
while, for some data.
HttpURLConnection only works for a single data packet, for getInputStream, 
and Socket will only wait up to 5 seconds to receive data, otherwise it 
throws an API error.

-Charles

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] AngularJS and CORS

[Charles Libicki]

I have a number of apps on GAE for Python and one based on AngularJS. The 
others are working fine, and the AngularJS one used to work OK. Now I get 
the following error:

XMLHttpRequest cannot load 
https://odorpatrol-toy.appspot.com/rest/loadlocale?locale=en. Redirect from 
'https://odorpatrol-toy.appspot.com/rest/loadlocale?locale=en' to 
'https://www.google.com/accounts/ServiceLogin?service=ah&passive=true&contin…wtdG95DBICYWgiFMpDF9nfp_N1BV6vlDLbk9fW6W52KAEyFCKyrQ1UB8dhlT02lpSU12eccFZu'
 
has been blocked by CORS policy: No 'Access-Control-Allow-Origin' header is 
present on the requested resource. Origin 
'http://odorpatrol-toy.appspot.com' is therefore not allowed access.

If I go to https://www.google.com/accounts/ServiceLogin explicitly from 
Chrome, the the app will work OK for a while. After a while (I assume when 
the login expires) the error crops up again. 

app.yaml has the following section:

- url: /rest/.*
  script: main.APP
  login: required
  secure: always


but removing "secure: always" makes no difference.


The error occurs at the first client http request, but the Python server code 
for the request handler shows not sign of ever being 

accessed.


Thanks, for any help.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a6be3304-9a8b-4e68-a2ca-bd34cb252bda%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Java8 on standard: need to migrate off Endpoints v1?

[Charles Capps]

Hi, I have a very important question pertaining to our use of Java8 on GAE 
Standard. In the Release Notes for the Appengine SDK [1], it says:

   - Cloud Endpoints must be migrated 
   
 
   from v1 to v2.
   
in the release on June 28, 2017. We would like to use Java8, but we need to 
stay on Endpoints v1 for a few months until we have the time to do the 
migration (we are actually migrating to a different HTTP Framework, but 
that is irrelevant to this discussion.) 

Will anything break if we use Endpoints v1 with Java8 for the time being?

[1] https://cloud.google.com/appengine/docs/standard/java/release-notes 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/87594945-eef0-47a3-be51-112bad038c46%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Java8 on standard: need to migrate off Endpoints v1?

[Charles Capps]

Thanks for clarifying, Yannick. Our migration is somewhat difficult, mainly 
because we are moving to a different REST framework entirely (Jersey) 
because we found the performance of Endpoints v2 to be slow in multiple 
experiments, and we simply don't need the layer that Endpoints v2 provides 
on top of a REST framework. We have to do a 2-phased migration since Jersey 
can't host paths at /_ah/api/* and switch over all consumers of our API to 
the new Jersey paths before turning off Endpoints v1.

TL; DR it's OK we're planning on migrating anyway, but this means we can't 
use Java8 until after we migrate off Endpoints v1. Thanks again for 
clarifying.

On Thursday, September 21, 2017 at 7:46:23 AM UTC-7, Yannick (Cloud 
Platform Support) wrote:
>
> Hello Charles, the Endpoints API v1 is indeed deprecated and thus, like 
> Stefano points out, doesn't have support for new features such as Java 8 on 
> App Engine standard.
>
> Is the migration procedure prohibitively difficult to use in your 
> situation?
>
> On Thursday, September 21, 2017 at 9:30:17 AM UTC-4, Stefano Ciccarelli 
> wrote:
>>
>> Endpoints V1 simply don't work on Java8, you get some exception on boot 
>> for missing classes.
>>
>>
>> Il giorno gio 21 set 2017 alle ore 15:06 Charles Capps <
>> cha...@premise.com > ha scritto:
>>
>>> Hi, I have a very important question pertaining to our use of Java8 on 
>>> GAE Standard. In the Release Notes for the Appengine SDK [1], it says:
>>>
>>>- Cloud Endpoints must be migrated 
>>>
>>> <https://cloud.google.com/endpoints/docs/frameworks/legacy/v1/java/migrating>
>>>  
>>>from v1 to v2.
>>>
>>> in the release on June 28, 2017. We would like to use Java8, but we need 
>>> to stay on Endpoints v1 for a few months until we have the time to do the 
>>> migration (we are actually migrating to a different HTTP Framework, but 
>>> that is irrelevant to this discussion.) 
>>>
>>> Will anything break if we use Endpoints v1 with Java8 for the time being?
>>>
>>> [1] https://cloud.google.com/appengine/docs/standard/java/release-notes 
>>>
>>> -- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "Google App Engine" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to google-appengi...@googlegroups.com .
>>> To post to this group, send email to google-a...@googlegroups.com 
>>> .
>>> Visit this group at https://groups.google.com/group/google-appengine.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/google-appengine/87594945-eef0-47a3-be51-112bad038c46%40googlegroups.com
>>>  
>>> <https://groups.google.com/d/msgid/google-appengine/87594945-eef0-47a3-be51-112bad038c46%40googlegroups.com?utm_medium=email&utm_source=footer>
>>> .
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>> -- 
>>
>> *Stefano Ciccarelli* 
>> GAE Application Division 
>> / Director 
>> stefano.c...@mmbsoftware.it  
>>
>> *M.M.B. s.r.l.* 
>> via Granarolo, 177/7 - 48018 Faenza (RA) - Italy 
>> tel. +39.0546.637711 - fax +39.0546.46077 
>> www.mmbsoftware.it - in...@mmbsoftware.it 
>>
>> Le informazioni contenute in questa comunicazione sono riservate e 
>> destinate esclusivamente alla/e persona/e o all'ente sopra indicati. E' 
>> vietato ai soggetti diversi dai destinatari qualsiasi uso, copia, 
>> diffusione di quanto in esso contenuto sia ai sensi dell'art. 616 c.p., sia 
>> ai sensi del DL n. 196/03. Se questa comunicazione Vi e' pervenuta per 
>> errore, Vi preghiamo di rispondere a questa e-mail e successivamente 
>> cancellarla dal Vostro sistema.
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/eeec5c99-73d2-4007-bb17-c201dbb46dc3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Java8 on standard: need to migrate off Endpoints v1?

[Charles Capps]

Hi Nico,

It's a straightforward process if you use the Jersey Servlet container, 
since GAE works well with any servlet-based technology. In the services we 
have already migrated to Jersey, we only need these 2 maven dependencies 
from Jersey (currently using version 2.25.1):


>   org.glassfish.jersey.containers
>   jersey-container-servlet-core
>   ${jersey.version}
> 
> 
>   org.glassfish.jersey.media
>   jersey-media-json-jackson
>   ${jersey.version}
> 


Then, in your web.xml, you can define a servlet like:

> 
> MyServiceApplication
> 
> org.glassfish.jersey.servlet.ServletContainer
> 
>   javax.ws.rs.Application
>   com.mycompany.jersey.MyServiceApplication
> 
> 1
>   


where the MyServiceApplication class extends the JAX-RS Application base 
class, for which you can find documentation 
at https://jersey.github.io/documentation/latest/index.html
 
Good luck migrating!

On Thursday, September 21, 2017 at 11:52:47 PM UTC-7, Nico Verwer wrote:
>
> Is there a guide on how to use Jersey on App Engine?
> I am still on Cloud Endpoints v1, and I am reluctant to migrate to v2 
> because it might be deprecated before I finish the migration. Jersey is 
> probably more stable and future-proof. And, as you indicate, it is faster 
> than GCE v2.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/d4f6bd08-1895-4225-8e3d-8b3682a62938%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Java8 on standard: need to migrate off Endpoints v1?

[Charles Capps]

We did A/B testing where we deployed:
* Version A of simple service - implemented with Jersey and swagger 
annotations
* Version B of simple service - identical code, but with Endpoints v2 
servlet filters, and Endpoints v2 deployed along with the service using the 
generated swagger.json.

We ran Gatling tests that did thousands of requests from a GCE virtual 
machine (to rule out any slowness in our local internet connection.) 

Version A -- which was identical except we didn't deploy Endpoints v2 -- 
was consistently ~100ms faster. 

We reproduced this in multiple tests, including a test that deployed one of 
our real world services with or without Endpoints v2.

There seems to be some significant lag introduced by Endpoints v2. We also 
just don't need whatever console page is added by adding the Endpoints v2 
servlet filters and so on.

On Tuesday, September 26, 2017 at 1:44:33 PM UTC-7, Frank Natividad wrote:
>
> Hi Charles,
>
> I'm curious about the different experiments performed with Endpoints 
> Frameworks v2. Could you tell us more about that? 
>
> Thanks!
>
> On Friday, September 22, 2017 at 8:32:01 AM UTC-7, Charles Capps wrote:
>>
>> Hi Nico,
>>
>> It's a straightforward process if you use the Jersey Servlet container, 
>> since GAE works well with any servlet-based technology. In the services we 
>> have already migrated to Jersey, we only need these 2 maven dependencies 
>> from Jersey (currently using version 2.25.1):
>>
>> 
>>>   org.glassfish.jersey.containers
>>>   jersey-container-servlet-core
>>>   ${jersey.version}
>>> 
>>> 
>>>   org.glassfish.jersey.media
>>>   jersey-media-json-jackson
>>>   ${jersey.version}
>>> 
>>
>>
>> Then, in your web.xml, you can define a servlet like:
>>
>>> 
>>> MyServiceApplication
>>> 
>>> org.glassfish.jersey.servlet.ServletContainer
>>> 
>>>   javax.ws.rs.Application
>>>   
>>> com.mycompany.jersey.MyServiceApplication
>>> 
>>> 1
>>>   
>>
>>
>> where the MyServiceApplication class extends the JAX-RS Application base 
>> class, for which you can find documentation at 
>> https://jersey.github.io/documentation/latest/index.html
>>  
>> Good luck migrating!
>>
>> On Thursday, September 21, 2017 at 11:52:47 PM UTC-7, Nico Verwer wrote:
>>>
>>> Is there a guide on how to use Jersey on App Engine?
>>> I am still on Cloud Endpoints v1, and I am reluctant to migrate to v2 
>>> because it might be deprecated before I finish the migration. Jersey is 
>>> probably more stable and future-proof. And, as you indicate, it is faster 
>>> than GCE v2.
>>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/cea39b28-145f-442d-91b7-3910d3909f79%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Java8 on standard: need to migrate off Endpoints v1?

[Charles Capps]

Typo, it was slower, not faster.

On Sep 26, 2017 2:20 PM, "Charles Capps"  wrote:

> We did A/B testing where we deployed:
> * Version A of simple service - implemented with Jersey and swagger
> annotations
> * Version B of simple service - identical code, but with Endpoints v2
> servlet filters, and Endpoints v2 deployed along with the service using the
> generated swagger.json.
>
> We ran Gatling tests that did thousands of requests from a GCE virtual
> machine (to rule out any slowness in our local internet connection.)
>
> Version A -- which was identical except we didn't deploy Endpoints v2 --
> was consistently ~100ms faster.
>
> We reproduced this in multiple tests, including a test that deployed one
> of our real world services with or without Endpoints v2.
>
> There seems to be some significant lag introduced by Endpoints v2. We also
> just don't need whatever console page is added by adding the Endpoints v2
> servlet filters and so on.
>
> On Tuesday, September 26, 2017 at 1:44:33 PM UTC-7, Frank Natividad wrote:
>>
>> Hi Charles,
>>
>> I'm curious about the different experiments performed with Endpoints
>> Frameworks v2. Could you tell us more about that?
>>
>> Thanks!
>>
>> On Friday, September 22, 2017 at 8:32:01 AM UTC-7, Charles Capps wrote:
>>>
>>> Hi Nico,
>>>
>>> It's a straightforward process if you use the Jersey Servlet container,
>>> since GAE works well with any servlet-based technology. In the services we
>>> have already migrated to Jersey, we only need these 2 maven dependencies
>>> from Jersey (currently using version 2.25.1):
>>>
>>> 
>>>>   org.glassfish.jersey.containers
>>>>   jersey-container-servlet-core
>>>>   ${jersey.version}
>>>> 
>>>> 
>>>>   org.glassfish.jersey.media
>>>>   jersey-media-json-jackson
>>>>   ${jersey.version}
>>>> 
>>>
>>>
>>> Then, in your web.xml, you can define a servlet like:
>>>
>>>> 
>>>> MyServiceApplication
>>>> org.glassfish.jersey.servlet.ServletContainer
>>>> 
>>>> 
>>>>   javax.ws.rs.Application
>>>>   com.mycompany.jersey.MyServiceApplication>>> m-value>
>>>> 
>>>> 1
>>>>   
>>>
>>>
>>> where the MyServiceApplication class extends the JAX-RS Application base
>>> class, for which you can find documentation at
>>> https://jersey.github.io/documentation/latest/index.html
>>>
>>> Good luck migrating!
>>>
>>> On Thursday, September 21, 2017 at 11:52:47 PM UTC-7, Nico Verwer wrote:
>>>>
>>>> Is there a guide on how to use Jersey on App Engine?
>>>> I am still on Cloud Endpoints v1, and I am reluctant to migrate to v2
>>>> because it might be deprecated before I finish the migration. Jersey is
>>>> probably more stable and future-proof. And, as you indicate, it is faster
>>>> than GCE v2.
>>>>
>>> --
> You received this message because you are subscribed to a topic in the
> Google Groups "Google App Engine" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/
> topic/google-appengine/Ab-1Pa8GJE0/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/cea39b28-145f-442d-91b7-
> 3910d3909f79%40googlegroups.com
> <https://groups.google.com/d/msgid/google-appengine/cea39b28-145f-442d-91b7-3910d3909f79%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAGnsvRUsAHn7FB2mnHP%3DPWgz1vgBRbNHSLe%2BtjBCZWHnXxoYng%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Java runtime displayed incorrectly on /appengine/versions page?

[Charles Capps]

Hi, I just want to confirm that this is a known issue.

I deployed a microservice using the Java8 runtime, but it still displays as 
"java7" in the "Runtime" column on the 
page https://console.cloud.google.com/appengine/versions.

This is a Java service, and I'm certain it's deployed as Java8, I took the 
following steps:
* Added java8 to appengine-web.xml
* Changed source/target to 1.8 in the maven-compiler-plugin
* Updated javax.servlet dependency to 3.1.0
* Verified our CI/CD box is using Java8
* Deploy succeeded


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/6697bd49-cdd4-44d0-8a36-b403a4ea71ad%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Python 3.7 and Dajngo 2.x

[Charles tenorio]

Is anyone using django 2.0 like App Engine and python 3.7 and Cloud 
Datastore? if you can send me an example of CRUD! Thank you

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/ad46b3e1-130a-41f2-9356-77b5ce77ed35%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Python 3.7 and Dajngo 2.x

[Charles tenorio]

HI!!

has some framework to work with python 3.7 and cloud DateStore?

Em sábado, 10 de novembro de 2018 21:21:55 UTC-3, Charles tenorio escreveu:
>
> Is anyone using django 2.0 like App Engine and python 3.7 and Cloud 
> Datastore? if you can send me an example of CRUD! Thank you
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a40798c6-9d28-4763-a2bd-ac5a4077e312%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] crud samples python 3.7

[Charles tenorio]

Hi!!! 
Good morning people! who has an example of a crud using
datastore python 3.7
tanks!!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a69f2ef3-11c1-47ac-aef7-c9051d44ba64%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] cpu usage for getPersistenceManager?

[charles eubanks]

Included is the source of my entire servlet.  When I run this servlet
it says that I am using as much as
{"totalCpu":3671926.97333,"pmCpu":3671926.97333}

And to back up this my logs are telling me I am using a high amount of
CPU ( > 4600cpu_ms) and may soon exceed my quota. .

In any case am I doing something wrong?  It seems that if I am nearing
my max quota just getting the PersistenceManager then something is
just not right.

 I am not a paying user yet if that makes a difference.

Any clues for a newbie?

Thanks,

package reminder;

import java.io.IOException;
import java.util.logging.Level;
import java.util.logging.Logger;

import javax.jdo.PersistenceManager;
import javax.servlet.ServletException;
import javax.servlet.http.HttpServlet;
import javax.servlet.http.HttpServletRequest;
import javax.servlet.http.HttpServletResponse;

import org.json.simple.JSONObject;

import com.google.appengine.api.quota.QuotaService;
import com.google.appengine.api.quota.QuotaServiceFactory;
import com.google.appengine.api.users.User;
import com.google.appengine.api.users.UserService;
import com.google.appengine.api.users.UserServiceFactory;

public class NoopServlet extends HttpServlet {
/**
 *
 */
private static final long serialVersionUID = 1L;
private static final Logger log =
Logger.getLogger(NoopServlet.class.getName());

@Override
protected void doGet(HttpServletRequest req, HttpServletResponse
resp)
throws ServletException, IOException {
QuotaService qs = QuotaServiceFactory.getQuotaService();
long start = qs.getCpuTimeInMegaCycles();


JSONObject obj = new JSONObject();


SubqUser sUser = null;
start = qs.getCpuTimeInMegaCycles();
PersistenceManager pm = PMF.get().getPersistenceManager();
  long end = qs.getCpuTimeInMegaCycles();
 double cpuSeconds = qs.convertMegacyclesToCpuSeconds(end - 
start);
 obj.put("pmCpu", cpuSeconds);


   cpuSeconds = qs.convertMegacyclesToCpuSeconds(end - start);
   obj.put("totalCpu", cpuSeconds);
   System.out.println(this.getClass().getName()+" used  " +
cpuSeconds+ " cpu seconds");
resp.getWriter().print(obj.toJSONString());
}



@Override
protected void doPost(HttpServletRequest req, HttpServletResponse
resp)
throws ServletException, IOException {
// TODO Auto-generated method stub
doGet(req, resp);
}

}

package reminder;

import javax.jdo.JDOHelper;
import javax.jdo.PersistenceManagerFactory;

public final class PMF {
private static final PersistenceManagerFactory pmfInstance =
JDOHelper.getPersistenceManagerFactory("transactions-
optional");

private PMF() {}

public static PersistenceManagerFactory get() {
return pmfInstance;
}
}

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Prerelease 1.3.4 SDK ready for download

[Charles Abreu]

Please, I have the same doubt.

Charles Abreu

On May 13, 3:13 pm, Ross M Karchner  wrote:
> If we want to switch an existing app from Google accounts to OpenID,
> will we have to delete them and remake them?
>
> On Thu, May 13, 2010 at 1:46 PM, Ikai L (Google)  wrote:
>
>
>
>
>
> > Hello, App Engine developers!
> > Just wanted to let everyone know that prerelease 1.3.4 SDK is now available
> > for download. As usual, we're looking for feedback. Please post it in this
> > thread.
> > The release notes are below:
> > Java
> > ---
> > Version 1.3.4
> > =
> > - Client side bulkloader available with the Python SDK that has a new
> >   configuration syntax and wizard for easier import/export with the
> > datastore.
> >   Can be used by enabling remote_api in your Java application
> > - Applications can now be configured to authenticate with OpenID by
> > selecting
> >   the OpenID option when creating your application in the admin console
> >     http://code.google.com/p/googleappengine/issues/detail?id=248
> >     http://code.google.com/p/googleappengine/issues/detail?id=56
> > - New API to allow App Engine apps to act as OAuth service providers
> >     http://code.google.com/p/googleappengine/issues/detail?id=919
> > - The version update check in the Java SDK now uses https
> > - Allow full access to javax.el.*
> >     http://code.google.com/p/googleappengine/issues/detail?id=3157
> > - Increased the timeout during deployment to 15 minutes
> > - Fixed an issue with JPA where an illegal cast exception was thrown during
> > the
> >   fetch of integer fields
> > - MemcacheService.setNamespace() is deprecated in favor of
> >   MemcacheServiceFactory.getMemcacheManager(namespace)
> > - Support in the SDK for Java 1.5 is being deprecated. These warnings now
> > appear
> >   when starting the SDK
>
> > Python
> > -
> > Version 1.3.4
> > =
> > - New bulkloader configuration syntax and wizard for easier import/export
> > with
> >   the datastore.
> > - Applications can now be configured to authenticate with OpenID by
> > selecting
> >   the OpenID option when creating your application in the admin console.
> >     http://code.google.com/p/googleappengine/issues/detail?id=248
> >     http://code.google.com/p/googleappengine/issues/detail?id=56
> > - New API to allow App Engine apps to act as OAuth service providers.
> >     http://code.google.com/p/googleappengine/issues/detail?id=919
> > - Auto task execution is now enabled in the dev_appserver. To turn this off
> >   use the flag --disable_task_running.
> > - Fixed an issue using db.put() with constructor initialized id based keys.
> >     http://code.google.com/p/googleappengine/issues/detail?id=3209
> > --
> > Ikai Lan
> > Developer Relations, Google App Engine
> > Twitter: http://twitter.com/ikai
> > Delicious: http://delicious.com/ikailan
> > 
> > Google App Engine links:
> > Blog: http://googleappengine.blogspot.com
> > Twitter: http://twitter.com/app_engine
> > Reddit: http://www.reddit.com/r/appengine
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appeng...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group 
> athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] can you use contacts API within an AppEngine app?

[Graham Charles]

Can I import gdata.contacts.service into an AppEngine app to work with
contacts of the app's domain? I realize that google.appengine.api.user
exposes some read-only access to a user's e-mail and name, but I'd
like to be able to update contacts, forwarding addresses, etc., given
an administrator's login. It seems like a call to

gdata.contacts.service.ContactsService()

Wouldn't work from within an app's sandbox... but I may be wrong?

Thanks,

g.

--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] is there a Python client library reference somewhere?

[Graham Charles]

I'm finding it difficult to locate a true reference for the Python
client library. In trying to implement service.RetrieveUser, for
example, I'm told that the method returns a UserEntry object, but no
documentation on UserEntry's members is forthcoming.

The .Net and PHP client libraries provide such a document -- cf.
http://framework.zend.com/apidoc/core/Zend_Gdata/Gapps/Zend_Gdata_Gapps_UserEntry.html
for example -- but the pydocs included with the Python library (/
pydocs/gdata.apps.html#UserEntry) do not illuminate any of the class
members at all.

Eventually, I settled on using

inspect.getmembers

to interrogate my UserEntry just to determine that there's a member of
class Name called name, which in turn has string members given_name
and family_name.

It seems incredible to me that this class (or any of the scores of
other Google Apps API classes exposed by the Python client library)
isn't documented anywhere. If anyone can point me to such a document,
I'd be very grateful.

Thanks,

g.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: is there a Python client library reference somewhere?

[Graham Charles]

Thanks for your time.

g.

On Sep 25, 5:01 am, "Nick Johnson (Google)" 
wrote:
> Hi Graham,
> You'll probably have more luck asking this on the GData groups; the Python
> GData library runs on App Engine, but is otherwise unrelated.
>
> -Nick Johnson
>
> On Thu, Sep 24, 2009 at 4:24 AM, Graham Charles 
> wrote:
>
>
>
>
>
>
>
> > I'm finding it difficult to locate a true reference for the Python
> > client library. In trying to implement service.RetrieveUser, for
> > example, I'm told that the method returns a UserEntry object, but no
> > documentation on UserEntry's members is forthcoming.
>
> > The .Net and PHP client libraries provide such a document -- cf.
>
> >http://framework.zend.com/apidoc/core/Zend_Gdata/Gapps/Zend_Gdata_Gap...
> > for example -- but the pydocs included with the Python library (/
> > pydocs/gdata.apps.html#UserEntry) do not illuminate any of the class
> > members at all.
>
> > Eventually, I settled on using
>
> > inspect.getmembers
>
> > to interrogate my UserEntry just to determine that there's a member of
> > class Name called name, which in turn has string members given_name
> > and family_name.
>
> > It seems incredible to me that this class (or any of the scores of
> > other Google Apps API classes exposed by the Python client library)
> > isn't documented anywhere. If anyone can point me to such a document,
> > I'd be very grateful.
>
> > Thanks,
>
> > g.
>
> --
> Nick Johnson, Developer Programs Engineer, App Engine
> Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number:
> 368047
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: Porting from AppEngine Data Store to Standalone/AWS S3 and back

[Charles Schmidt]

I posted the main code up here, http://pastebin.com/f2bbb3cda, feel
free to do what you please with it.  This code suits my very limited
needs and should be simple enough for anyone to grok. It could be
useful to turn the properties into real properties with setters and
getters, but I didn't need that.

As far as urlfetch, I would recommend sticking with python's own
urllib, this has been supported in AppEngine for a while.

On Sep 23, 5:05 pm, Benjamin Schuster-Böckler 
wrote:
> That does actually sound like a very useful piece of code. I'm writing  
> an app for a client, who sees the advantages of deploying on GAE, but  
> has some (understandable) doubts if it'll be the best platform in the  
> long run. Having a simple drop-in replacement for the datastore (and  
> possibly urlfetch) classes would make an initial transition to another  
> server setup much easier.
>
> So, if you're releasing the code, I'd be quite interested in it.
>
> Cheers,
> Ben
>
> On 24 Sep 2009, at 01:36, Charlie  wrote:
>
>
>
>
>
> > I recently had to port one of my applications, which makes heavy use
> > of the Data Store API, to run outside AppEngine. A client needed the
> > ability to install the application on their own internal web servers
> > (Apache+mod_wsgi).  Thankfully I wasn't using any GQL, so I was able
> > to write a very simple drop-in replacement for the
> > google.appengine.ext.db module. I replaced memcache with a null API
> > that just returns None for everything, eventually I'll have the client
> > install memcached and link in a real API. These modifications allowed
> > me to deploy the application to an Apache server with almost zero
> > changes to the application's code base.  In fact the only changes were
> > the import statements, (from myapp_wsgi.lib import db) which selects
> > either my standalone db module or google's based on a config file.
>
> > The AppEngine SDK obviously includes a free standing db module, but
> > without fully understanding the code base I wasn't willing to deploy
> > it in a production environment.  However, the simplicity of replacing
> > the ext.db API (or at least a subset of it) got me thinking about
> > writing a back-end for Amazon's S3, and running my app on EC2.  I
> > could also imagine back-ends that tie into a relational database such
> > as MySQL (though I'm not immediately sure of the utility there). I
> > like developing on AppEngine, but I would like it even more if I could
> > easily move my applications from AppEngine to a client's server to EC2
> > and back without major refactoring.  Managing servers sucks, which
> > makes App Engine amazingly simple, but sometimes you need more
> > flexibility.
>
> > Are there any existing libraries that allow one to use the Data Store
> > API without being tied to AppEngine? Does anyone see utility in such a
> > library? I'm not thinking of an abstraction layer, more a drop in
> > replacement for the API.  The App Engine SDK is released under the
> > Apache License so I don't see any immediate legal issues, but perhaps
> > I'm missing something?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] bulk uploading to related tables

[Graham Charles]

I'm struggling with bulk uploading CSV files to related tables. I have
foreign keys in the source data, but obviously, GAE doesn't use them.
The code at

http://code.google.com/appengine/docs/python/tools/uploadingdata.html

Works great for one flat table at a time, but doesn't reference how to
relate entries in a Child table to its Parent.

Thanks,

Graham Charles

--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: bulk uploading to related tables

[Graham Charles]

Thanks for the reply! Any idea where I can find any documentation or
sample code?

Thanks,

g.

On Oct 5, 2:39 am, "Nick Johnson (Google)" 
wrote:
> Hi Graham,
>
> On Sun, Oct 4, 2009 at 10:25 PM, Graham Charles 
> wrote:
>
>
>
> > I'm struggling with bulk uploading CSV files to related tables. I have
> > foreign keys in the source data, but obviously, GAE doesn't use them.
>
> You can translate foreign keys into db.Key instances, and use a
> ReferenceProperty in you model for them.
>
> > The code at
>
> >http://code.google.com/appengine/docs/python/tools/uploadingdata.html
>
> > Works great for one flat table at a time, but doesn't reference how to
> > relate entries in a Child table to its Parent.
>
> Override the generate_key method in your Loader class, and have it return a
> key specifying the desired Parent.
>
> -Nick Johnson
>
>
>
> > Thanks,
>
> > Graham Charles
>
> --
> Nick Johnson, Developer Programs Engineer, App Engine
> Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number:
> 368047
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: bulk uploading to related tables

[Graham Charles]

Thanks for that; I'll take a look. I'm interested that you write about
uploading data directly from a SQL source, too -- can't wait for
that!

I'm a little surprised that data loading is so minimally implemented
on GAE to date -- it seems pretty crucial to most applications.

Maybe it's just a feature in development?

g.


On Oct 7, 1:48 am, "Nick Johnson (Google)" 
wrote:
> Hi Graham,
> I covered specifying key names briefly in this 
> article:http://blog.notdot.net/2009/9/Advanced-Bulk-Loading-part-2-Customization
>
> It doesn't explicitly demonstrate returning key objects from generate_key,
> but it's a fairly straightforward modification of that.
>
> -Nick Johnson
>
> On Tue, Oct 6, 2009 at 12:24 AM, Graham Charles 
> wrote:
>
>
>
>
>
>
>
> > Thanks for the reply! Any idea where I can find any documentation or
> > sample code?
>
> > Thanks,
>
> > g.
>
> > On Oct 5, 2:39 am, "Nick Johnson (Google)" 
> > wrote:
> > > Hi Graham,
>
> > > On Sun, Oct 4, 2009 at 10:25 PM, Graham Charles <
> > grahampchar...@gmail.com>wrote:
>
> > > > I'm struggling with bulk uploading CSV files to related tables. I have
> > > > foreign keys in the source data, but obviously, GAE doesn't use them.
>
> > > You can translate foreign keys into db.Key instances, and use a
> > > ReferenceProperty in you model for them.
>
> > > > The code at
>
> > > >http://code.google.com/appengine/docs/python/tools/uploadingdata.html
>
> > > > Works great for one flat table at a time, but doesn't reference how to
> > > > relate entries in a Child table to its Parent.
>
> > > Override the generate_key method in your Loader class, and have it return
> > a
> > > key specifying the desired Parent.
>
> > > -Nick Johnson
>
> > > > Thanks,
>
> > > > Graham Charles
>
> > > --
> > > Nick Johnson, Developer Programs Engineer, App Engine
> > > Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration
> > Number:
> > > 368047
>
> --
> Nick Johnson, Developer Programs Engineer, App Engine
> Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number:
> 368047
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: HTTPS Support for appspot.com

[Charles Yan]

EXCELLENT! Greate appericiate!
On Oct 17, 6:03 am, "Marzia Niccolai" <[EMAIL PROTECTED]> wrote:
> One of the most frequently requested features for App Engine has been HTTPS
> serving capabilities.  Today we're excited to announce that App Engine now
> supports incoming HTTPS connections using a certificate valid for all
> appspot.com URLs.  Here's how it works:
>
> * app.yaml files now support a new handler attribute, called "secure":
>
> - url: /accounts/.*
>   script: admin.py
>   login: admin
>   *secure: always*
>
> *This attribute can be either "always", "optional", or "never" (default),
> and determines the behavior of the handler for HTTP and HTTPS requests.  See
> our documentation for more 
> details:http://code.google.com/appengine/docs/configuringanapp.html#Secure_URLs
>
> * HTTPS requests have their own bandwidth quotas, but also count toward your
> total bandwidth quotas.  You can monitor these quotas on your dashboard.
>
> You may be wondering why we're only supporting appspot.com right now, and
> not arbitrary Google Apps domains.  This has to do with fundamental
> limitations in the SSL protocol 
> (see:http://en.wikipedia.org/wiki/Https#Limitations).  We're currently
> investigating workarounds for this using e.g.
> SNI 
> (http://en.wikipedia.org/wiki/Server_Name_Indication), which provides a
> viable solution for newer browsers--we'll keep you posted!
>
> This functionality is already available starting with the 1.1.5 SDK.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: SproutCore app on AppEngine, authentication concerns

[Charles Jolley]

Hi Devraj,

You can setup a proxy from sc-server to your AppEngine.  This way you
can visit localhost:4020 and you should be able to work from there.
You can find the samplecode for http://sproutcore-demo.appspot.com at:

http://github.com/sproutit/samples-todos/tree/step-6

Look the servers/sproutcore-demo directory for the AppEngine code.
There is also a Merb server in there.  The rest is SproutCore code.

-Charles

On Nov 13, 2:00 am, "Devraj Mukherjee" <[EMAIL PROTECTED]> wrote:
> Hi all,
>
> Our app engine application is going to use SproutCore as its
> JavaScript framework. As SproutCore or JavaScript sits quite
> independently of App Engine or any server side technology we are
> assuming that this should work 
> (actuallyhttp://sproutcore-demo.appspot.com/confirms that it should not be a
> problem).
>
> Authentication should be quite simple as well, as long as both our
> HTML/JS deliver and REST services use Google authentication its should
> all work fine.
>
> The question is while developing the SproutCore application we need to
> run two dev servers, so if our rest services required authentication
> and we deliver our SproutCore app from the SC dev server how can we
> test that everything works? Although the two dev servers are running
> at different ports do they still honour the cookies set by the domain
> (localhost)?
>
> Our application is user centric so we will require the user to login.
>
> Any SproutCore / App Engine developers out there that could give me a
> few pointers?
>
> Thanks for your time.
>
> --
> "I never look back darling, it distracts from the now", Edna Mode (The
> Incredibles)

--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: weird/interesting "multiple entity groups" case

[Charles Srisuwananukorn]

I was seeing this in my app too. The get_by_key_name on line 134 is actually
getting a different GoogleUser than the one put in on line 144.

The full key of an entity includes the key names for each of its ancestors
back to some root entity, meaning two entities of the same kind can have the
same key name if they have different parents. From the docs:

The keys of two different entities can have similar parts as long as at
least one part is different. For instance, two entities can have the same
kind and name if they have different parents. (
http://code.google.com/appengine/docs/datastore/keysandentitygroups.html)

So the get_by_key_name below is fetching a GoogleUser whose key name matches
the value of "hash" and has no parents. To get the right GoogleUser, you'd
need to use

GoogleUser.get(Key.from_path('Account', ,
'GoogleUser', hash))

where you specify either the ID or the key name of the account as well.

Hope that helps.

--Charles

On Thu, Nov 13, 2008 at 3:21 AM, Jay Freeman (saurik) <[EMAIL PROTECTED]>wrote:

>  I am  running into a confusing "can't operate on multiple entity groups
> in a single transaction" case when I am, in fact, not accessing "multiple
> entity groups". I think I understand what might be going on, but A) am not
> certain and B) others might find it interesting, anyway.
>
> What is happening is that I have a transaction that is operating over two
> models: GoogleUser and Account. I get the GoogleUser instance associated
> with the current e-mail address with get_by_key_name and then return
> gooser.account. If I fail to find that GoogleUser, I add a new Account, and
> into the /same entity group/ I add the GoogleUser in question.
>
> For reference, here is the actual code of my transaction:
>
> 132 @staticmethod
> 133 def goi_account_by_primary_key_(user, hash, **kw):
> 134 gooser = GoogleUser.get_by_key_name(hash)
> 135 if gooser:
> 136 account = db.get(gooser.account)
> 137 keys = kw.keys()
> 138 for key in keys:
> 139 setattr(account, key, kw[key])
> 140 account.put()
> 141 else:
> 142 account = Account(**kw)
> 143 account.put()
> 144 gooser = GoogleUser(parent=account, key_name=hash,
> user=user, account=account)
> 145 gooser.put()
> 146 return account
> Note that moving the creation of the gooser above the creation of the
> account (and swapping the parent/child relationship between them and making
> other required code changes to temporarily support that) does work.
>
> Why does this happen?
>
> Currently my two theories are: A) the detection code is incorrect, and is
> making assumptions about "same model", and B) entities that don't exist
> yet are only considered in the same entity group as that entity itself, so
> even though I'm going to create that entity later into the same entity
> group, I can't put a different object first as the data store can't tell the
> difference. I am guessing that B is correct, in which case maybe someone
> else working on this same problem will find this post and be helped by it.
> If it isn't B, then maybe someone would be kind enough to tell me what the
> problem actually is ;P.
>
> -J
>
> >
>

--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Dashboard - Logs, not all errors are logged?

[Charles Yan]

I'm trying to use the logs in the dashboard to debug my script. It's a
callback script so I can not debug it locally. I can output some
information by using logging.info(msg).
But sometimes the script just crashed, maybe syntax error or others, I
found that GAE logs only log the  exceptions, if there's other error,
for example: ImportError, it just display nothing.
It bring me a lot of trouble to guess what the error is.

Anyway to get through this? Thanks!
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: Dashboard - Logs, not all errors are logged?

[Charles Yan]

Ok, so I'd better do code more carefully. thanks for reply.

On Dec 19, 2:56 am, Marzia Niccolai  wrote:
> Hi,
>
> The logs should display all logging messages up to the point where the
> script is crashing.  So any logging messages that would take place after the
> crash point will not be logged.
>
> If there is a syntax error, or something like that, there won't be any
> logging messages, since the script never executes at all.
>
> -Marzia
>
> On Thu, Dec 18, 2008 at 8:02 AM, Charles Yan  wrote:
>
> > I'm trying to use the logs in the dashboard to debug my script. It's a
> > callback script so I can not debug it locally. I can output some
> > information by using logging.info(msg).
> > But sometimes the script just crashed, maybe syntax error or others, I
> > found that GAE logs only log the  exceptions, if there's other error,
> > for example: ImportError, it just display nothing.
> > It bring me a lot of trouble to guess what the error is.
>
> > Anyway to get through this? Thanks!
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: sms validation requested

[Charles Rojo]

Hello. I am trying to create an app on Google App Engine, but I am
having a similar issue. When I click Create Application, it asks me to
verify my account. I enter my phone number details (Verizon), but the
SMS never comes through. I must have done so about 4 or 5 times. Now
it reads "The phone number has been sent too many messages or has
already been used to confirm an account."  Is anyone else having
similar problems on Verizon?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] "The process handling this request has unexpectedly died... (Error Code 203)"

[Charles Batty-Capps]

To whomever at Google with knowledge of this error message,
We are using AppEngine Standard with a mix of Java7/8 (on Tuesday our 
production environment will all be on Java8). We are using *basic scaling, 
*generally 
with a max of ~20 instances, and we rarely see services scale above 5 
instances. We frequently get this error in our logs:

The process handling this request unexpectedly died. This is likely to 
> cause a new process to be used for the next request to your application. 
> (Error code 203)


We used to think this was due to an OOM (perhaps an OOM is one possible 
root cause), however we've been seeing this error more and more frequently, 
and checking in the Cloud Console, the services were at low memory usage 
when it happened, and there was no spike in memory usage or other anomaly. 
So it's fairly safe to assume that this error has multiple root causes 
(perhaps any java *Error* ?) 

This seems to be due to high traffic, but our services getting this error 
haven't nearly scaled to the maximum allowed configured instances, as 
mentioned above.

So my question to you is:

   - What are all the root causes of this issue?
   - How can we troubleshoot this issue?
   - FYI, I don't believe this is due to performance; we've done a lot of 
   work on performance and generally requests are under 500ms for all 
   endpoints, except for a few endpoints that may take up to 10s when under 
   load. When we see this error, the request time was often under 100ms. We 
   haven't been seeing any 60s timeouts.


*Some troubleshooting info*
This is happening mostly for 2 of our microservices, and in deferred tasks 
of a third microservice. The one that sees this error the most seems to be 
scaling up and down the number of "active" instances fairly frequently. I'm 
not sure how "active" is determined, other than the obvious of whether 
there is traffic to the instance.



This happens for a wide variety of requests; requests from our app to our 
mobile proxy service, requests between services, and deferred tasks. This 
happens for some slow requests, for some fast requests, for background 
threads, etc. So it's quite difficult to pinpoint the cause. We can do some 
blanket work to try to "generally improve performance" but that's a rather 
inefficient way to solve this problem. I appreciate any help on this matter 
and I may also create a support ticket, but the ticket system often doesn't 
provide very useful info. 

Here are some example requests that all had this error:


 

Thanks for any help!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/64a4983b-0695-4c22-9f9a-461f49cc64af%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: "The process handling this request has unexpectedly died... (Error Code 203)"

[Charles Batty-Capps]

I would add that when this error happens, it seems to have a cascading 
effect where multiple requests that were executing very close together in 
time all have the same failure. In other words, it happens in "clumps" 
where each clump seems to have a discrete root cause that leads to all the 
requests in the clump failing together.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/233175d5-5061-46c9-b317-a2be92e06ebf%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: "The process handling this request has unexpectedly died... (Error Code 203)"

[Charles Batty-Capps]

We see "spikes" of 5xx errors -- all of the 5xx errors being due to this 
issue - 



-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a9821102-f334-490f-8f1b-309829cdaa5b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: "The process handling this request has unexpectedly died... (Error Code 203)"

[Charles Batty-Capps]

Your post may have given me an idea, but the root cause isn't what you think. 
We always use a REST framework for all our services (the latest version of 
Jersey currently), so I am 100% certain an unexpected application level 
exception results in a 500 error and the stacktrace is logged by an Exception 
handler in Jersey. We never see anything in the logs except for the process 
death error when this happens. 

It stands to reason that maybe an exception is being thrown in the Jersey layer 
before it reaches the HTTP layer, and somehow nothing is logged in this case.

I'll investigate options with Jersey. Maybe there's a thread pool that needs 
reconfiguring or something.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/2d928357-c828-43ab-a365-1d28e3566fde%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: "The process handling this request has unexpectedly died... (Error Code 203)"

[Charles Batty-Capps]

I can look into this, but I'm not sure that you carefully read my post. I'm 
getting a "process has died unexpectedly" error, NOT a "deadline exceeded 
error".

On Monday, August 6, 2018 at 2:13:27 PM UTC-7, Dan S (Cloud Platform 
Support) wrote:
>
> There are many possible reasons to cause this kind of issues such as 
> Slow-Loading Apps,
> Performance Settings, Warmup Requests, Delays Associated with Logging
> Delays Associated with UrlFetch… you can find more details about the root 
> causes and how to avoid errors in the following documentation[1].
>
> Also note that while using Java, the runtime may not terminate the 
> process, so this could cause problems for future requests to the same 
> instance. “To be safe, you should not rely on the DeadlineExceededError, 
> and instead ensure that your requests complete well before the time limit.” 
> as per docs[2].
>
> [1] 
> https://cloud.google.com/appengine/articles/deadlineexceedederrors#the-request-timer
> [2]
> https://cloud.google.com/appengine/docs/standard/python/how-requests-are-handled#specifying_a_request_deadline
>
>
> On Sunday, August 5, 2018 at 7:56:04 PM UTC-4, Charles Batty-Capps wrote:
>>
>> Your post may have given me an idea, but the root cause isn't what you 
>> think. We always use a REST framework for all our services (the latest 
>> version of Jersey currently), so I am 100% certain an unexpected 
>> application level exception results in a 500 error and the stacktrace is 
>> logged by an Exception handler in Jersey. We never see anything in the logs 
>> except for the process death error when this happens. 
>>
>> It stands to reason that maybe an exception is being thrown in the Jersey 
>> layer before it reaches the HTTP layer, and somehow nothing is logged in 
>> this case.
>>
>> I'll investigate options with Jersey. Maybe there's a thread pool that 
>> needs reconfiguring or something.
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/6c0ee29d-51ac-4358-9923-3653d19d5207%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: "The process handling this request has unexpectedly died... (Error Code 203)"

[Charles Batty-Capps]

Yep, and thanks for the info. Our 500 errors were due to the "process 
death" issue, though, and their latencies were well under the 60s deadline. 
So JFYI, I don't think the deadline exceeded error is related to what we're 
experiencing. 

I will investigate when I have a chance to see if our REST framework 
(latest version of Jersey) is somehow throwing uncaught exceptions before 
our application code runs. That's currently my best guess about what's 
going on, because anywhere in our application code an uncaught exception 
will be logged and result in a 500 error.

On Wednesday, August 8, 2018 at 1:19:47 PM UTC-7, Dan S (Cloud Platform 
Support) wrote:
>
> Hello Charles,
>
> In fact, I understand this part of your issue, and I believe that there is 
> a good answer from Nick. However, my concern and my answer concerns to the 
> HTTP 500 server error displayed in your screenshots. Sorry for do not let 
> this clear.
>
> On Monday, August 6, 2018 at 8:54:35 PM UTC-4, Charles Batty-Capps wrote:
>>
>> I can look into this, but I'm not sure that you carefully read my post. 
>> I'm getting a "process has died unexpectedly" error, NOT a "deadline 
>> exceeded error".
>>
>> On Monday, August 6, 2018 at 2:13:27 PM UTC-7, Dan S (Cloud Platform 
>> Support) wrote:
>>>
>>> There are many possible reasons to cause this kind of issues such as 
>>> Slow-Loading Apps,
>>> Performance Settings, Warmup Requests, Delays Associated with Logging
>>> Delays Associated with UrlFetch… you can find more details about the 
>>> root causes and how to avoid errors in the following documentation[1].
>>>
>>> Also note that while using Java, the runtime may not terminate the 
>>> process, so this could cause problems for future requests to the same 
>>> instance. “To be safe, you should not rely on the DeadlineExceededError, 
>>> and instead ensure that your requests complete well before the time limit.” 
>>> as per docs[2].
>>>
>>> [1] 
>>> https://cloud.google.com/appengine/articles/deadlineexceedederrors#the-request-timer
>>> [2]
>>> https://cloud.google.com/appengine/docs/standard/python/how-requests-are-handled#specifying_a_request_deadline
>>>
>>>
>>> On Sunday, August 5, 2018 at 7:56:04 PM UTC-4, Charles Batty-Capps wrote:
>>>>
>>>> Your post may have given me an idea, but the root cause isn't what you 
>>>> think. We always use a REST framework for all our services (the latest 
>>>> version of Jersey currently), so I am 100% certain an unexpected 
>>>> application level exception results in a 500 error and the stacktrace is 
>>>> logged by an Exception handler in Jersey. We never see anything in the 
>>>> logs 
>>>> except for the process death error when this happens. 
>>>>
>>>> It stands to reason that maybe an exception is being thrown in the 
>>>> Jersey layer before it reaches the HTTP layer, and somehow nothing is 
>>>> logged in this case.
>>>>
>>>> I'll investigate options with Jersey. Maybe there's a thread pool that 
>>>> needs reconfiguring or something.
>>>>
>>>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/d3b201db-9f36-42b4-8c51-3af9ff268d11%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: "The process handling this request has unexpectedly died... (Error Code 203)"

[Charles Batty-Capps]

Thanks edga...@google.com,

You've given the first genuinely useful answer! It makes more sense that 
this could be due to the rate of 500 errors in our services. 

However, the service in question only has twenty-eight* 5xx errors in the 
past week that are not due to "The process handling this request 
unexpectedly died."*
In contrast, is has about 200 errors that ARE due to *"The process handling 
this request unexpectedly died."* in the past week.

I'm a bit incredulous that 28 5xx errors resulted in a high enough rate to 
generate all these "process died" errors, so I suspect there is some 
non-ideal behavior of the instance scheduler or a bug on Google's end.

That being said, thank you, because this gives me a lead at least. 

We do have 2 suspicious 500 error requests that resulted in 204 error codes 
in the past week: "A problem was encountered with the process that handled 
this request, causing it to exit.".
So I'll address that issue; it's one place where we're still using a raw 
HttpServlet instead of a proper REST API Framework. 

As I said, I am still finding it very hard to believe that there's not an 
issue on Google's end. We're getting hundreds and hundreds of these 203 
errors, far away in time from the legitimate 500 errors that are due to our 
application code.

Thanks,
Charles

On Friday, August 10, 2018 at 3:46:07 PM UTC-7, edgaral...@google.com wrote:
>
> When an instance returns to many sequential 5xx errors, our instance 
> scheduling system will consider the instance unhealthy. The instance 
> scheduler will then terminate this instance.  
>
> When an instance gets terminated, and it still has a request queued, the 
> queued request will throw the 203 error. While the instance is being 
> terminated, no new requests get queued for that instance by our scheduler. 
>
> This means that the 203 only gets thrown when there's a request queued 
> when the instance gets terminated, and only for the request that was 
> queued. 
>
> The root cause is/should in fact be that our instance scheduler will 
> terminate an instance that serves to many sequential 5xx errors, and this 
> is expected and desired behavior.
>
> The cause of the problem that needs to be addressed is this high incidence 
> of 5xx errors. You could filter the logs by the instance Id and look at the 
> 5xx errors prior to the instance shutdown to verify this claim.
>
>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/6d779836-6578-4524-b551-795848257fe1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: gcloud app deploy fail for even HelloWorld. Is it down?

['David Charles Martinez' via Google App Engine]

Hello Rahul,

I have answered you in the Issue Tracker you have opened [1]. Please 
continue following the Issue Tracker if you still require support.

[1]https://issuetracker.google.com/136967608

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/263464e0-0459-4699-a1b5-a83afc5b1c11%40googlegroups.com.

[google-appengine] Re: Does enabling IAP for AppEngine change sa context?

['David Charles Martinez' via Google App Engine]

Hello,

The service account provided to IAP is just used for authentication to IAP 
which will let you access your App Engine application. Any calls made once 
authenticated, will still use the App Engine default service account unless 
you have specified otherwise in your App Engine application. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/df7e59f4-b33d-494e-ac2f-168976410fa4%40googlegroups.com.

[google-appengine] Re: Unable export data to drive when running through app engine

['David Charles Martinez' via Google App Engine]

Hello,

>From the information you have given me, I don’t know what language you are 
using or if you are using app engine standard or flex. This Stack overflow 

 
link may be helpful at the moment of troubleshooting this issue you are 
having with not seeing the exported csv. However depending on the language 
you are using, you may need to adapt the information. Also, as a general 
information, here is our documentation on how to read/write to Google Cloud 
Storage 

 
[3]. Now, when exporting to Google Drive, you need to use the Google Drive 
Api and you can see guides about how to do this in python 
 and java 
. I would 
recommend you to make sure you are being properly authenticated 

 
which can be a common issue.

If you require additional help with troubleshooting the exporting of your 
csv file from your App Engine Application to Cloud Storage or Google Drive, 
please go to Stack overflow  as Google Groups 
is meant for conceptual questions and discussions.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/8ec1c6aa-bf7b-4d4a-9455-ab972c53d85b%40googlegroups.com.

Re: [google-appengine] Re: Task queue not executing tasks / backlogged

['David Charles Martinez' via Google App Engine]

Hello Govind,

Google Issue Tracker is the right place for these types of issues and with 
the provided details we can track it and troubleshoot it accordingly since 
Google Groups is meant for conceptual questions and discussions and this 
will require proper troubleshooting. In addition, I would like to inform 
you that this issue is currently being investigated.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/74ae877e-23fe-4d85-b4cc-b9b06f3cf3f1%40googlegroups.com.

[google-appengine] Re: DEADLINE_EXCEEDED error while deploying

['David Charles Martinez' via Google App Engine]

Hello Joshua,

About “gcloud config set app/cloud_build_timeout “ command, please follow 
this Google Issue Tracker  where 
this issue will be investigated as I have confirmed the gcloud command 
seems not to be working properly. As a workaround, you can try using the 
[--timeout=DURATION] flag to change the timeout threshold which should work 
properly at the moment of running the command.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/8c7de2dc-450e-42b7-8952-94d29db6eed3%40googlegroups.com.

[google-appengine] Re: DEADLINE_EXCEEDED error while deploying

['David Charles Martinez' via Google App Engine]

Hello Joshua,

Yes, you would need to use "gcloud builds submit 
" to use the 
--timeout flag. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/58eb9d5a-e5c7-4381-aa70-5a423d69c8e2%40googlegroups.com.

[google-appengine] Re: App without sensitive or restricted scopes still showing "Unverified App" message to clients

['David Charles Martinez' via Google App Engine]

Hello,

The answer is no. They should not see the “unverified app” message if the 
application is whitelisted. We can confirm this by reviewing this Gsuite 
updates documentation 
 
which I understand is not the clearest but it does states that after july 
8, New users will not be able to install unverified apps unless you “trust 
them” which would be whitelisting. Hence, after whitelisting, the 
“unverified app” message should not be displayed.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/8a5a0d5c-68e3-4406-82e6-417d6f9d95fd%40googlegroups.com.