Re: [google-appengine] Re: increased latencies in App Engine in the last 6-8 hours

[Sameer Lodha]

For the last 4 hours there again seems to be issues with AppEngine.
Specifically, the Task Queue execution rate has slowed down dramatically.
The system is hardly executing one task a minute.

Hope somebody at AppEngine end is already aware about these issues &
working on resolving the same.


On Tue, Jun 25, 2013 at 4:17 AM, James Gilliam  wrote:

> Here's the thing about the latency.
>
> GAE has a serious datastore issue right now.  Old records are being
> returned instead of the most recent ones.  It is random.  In some cases,
> they are not returning all the rows for a particular table.  We are seeing
> this behavior in tables which were updated yesterday.  I submitted a
> critical production error documenting these issues with GAE, yesterday.
>
> I was able to get around one of the most serious situations I was having
> by recopying a namespace, after repeatedly querying to determine the real
> number of rows -- about half the time GAE was reporting the wrong number of
> rows.  The copied namespace is working ok for now.
>
> GAE is not transparent when they have serious issues imo.
>
> On Saturday, June 22, 2013 7:50:47 PM UTC-7, Jacob G wrote:
>>
>> I have noticed large latency increases in App Engine in the last 6-8
>> hours, seemingly from the HR datastore. It is not all the time, but it is
>> frequent. Http requests begin to be processed by an instance quickly, but
>> then a datastore request will be latent for 15+ seconds. Http requests that
>> used to complete in less than a second will take 25-60 seconds.
>>
>> Are you aware of this issue? I don't see any documentation of it in the
>> server status page, but there's definitely a problem!
>>
>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Instances trying to start and failing.

[Aswath Satrasala]

Hello Appengine Team,
http://accountingguru-india.appspot.com customers are facing the latency
issues, and are not able to login to the application.

Logs show the following

A problem was encountered with the process that handled this request,
causing it to exit. This is likely to cause a new process to be used
for the next request to your application. (Error code 121


   1.
  1. 2013-06-25 16:18:41.749 /tenantmgr/listTenant 500 14192ms 0kb
Mozilla/4.0
  (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0;
SLCC2; .NET CLR
  2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0)
  2. W2013-06-25 16:18:41.749 A problem was encountered with the
  process that handled this request, causing it to exit. This is likely to
  cause a new process to be used for the nex
   2.
  1. 2013-06-25 16:18:07.028 /tenantmgr/listTenant 500 33426ms 0kb
Mozilla/4.0
  (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0;
SLCC2; .NET CLR
  2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0)
  2. I2013-06-25 16:18:06.584 This request caused a new process to be
  started for your application, and thus caused your application code to be
  loaded for the first time. This requ
  3. W2013-06-25 16:18:06.584 A problem was encountered with the
  process that handled this request, causing it to exit. This is likely to
  cause a new process to be used for the nex
   3.
  1. 2013-06-25 16:17:35.852 /tenantmgr/listTenant 500 41223ms 0kb
Mozilla/4.0
  (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0;
SLCC2; .NET CLR
  2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0)
  2. W2013-06-25 16:17:35.852 A problem was encountered with the
  process that handled this request, causing it to exit. This is likely to
  cause a new process to be used for the nex
   4.
  1. 2013-06-25 16:17:26.627 /tenantmgr/listTenant 500 52491ms 0kb
Mozilla/5.0
  (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko)
  Chrome/27.0.1453.116 Safari/537.36
  2. I2013-06-25 16:17:26.562 This request caused a new process to be
  started for your application, and thus caused your application code to be
  loaded for the first time. This requ
  3. W2013-06-25 16:17:26.562 A problem was encountered with the
  process that handled this request, causing it to exit. This is likely to
  cause a new process to be used for the nex



A production issue is also submitted.
https://code.google.com/p/googleappengine/issues/detail?id=9569.

Any other appid facing similar issue?


Regards
-Aswath
www.acccounting-guru.net

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: increased latencies in App Engine in the last 6-8 hours

[Sandeep Koduri]

Same problem, few tasks which runs on taskqueues and which gets executed in
30 mins regular days. We see not even 10% progress in 4 hrs. There is some
serious problem, but the system status says all is well.

When I see the instances active, all my resident instances are having 0
latency and a couple other instaces showing a very high latency. all the
instances are serving 0 request.

GAE team know why this is happening.


On Tue, Jun 25, 2013 at 4:09 PM, Sameer Lodha  wrote:

> For the last 4 hours there again seems to be issues with AppEngine.
> Specifically, the Task Queue execution rate has slowed down dramatically.
> The system is hardly executing one task a minute.
>
> Hope somebody at AppEngine end is already aware about these issues &
> working on resolving the same.
>
>
>
> On Tue, Jun 25, 2013 at 4:17 AM, James Gilliam wrote:
>
>> Here's the thing about the latency.
>>
>> GAE has a serious datastore issue right now.  Old records are being
>> returned instead of the most recent ones.  It is random.  In some cases,
>> they are not returning all the rows for a particular table.  We are seeing
>> this behavior in tables which were updated yesterday.  I submitted a
>> critical production error documenting these issues with GAE, yesterday.
>>
>> I was able to get around one of the most serious situations I was having
>> by recopying a namespace, after repeatedly querying to determine the real
>> number of rows -- about half the time GAE was reporting the wrong number of
>> rows.  The copied namespace is working ok for now.
>>
>> GAE is not transparent when they have serious issues imo.
>>
>> On Saturday, June 22, 2013 7:50:47 PM UTC-7, Jacob G wrote:
>>>
>>> I have noticed large latency increases in App Engine in the last 6-8
>>> hours, seemingly from the HR datastore. It is not all the time, but it is
>>> frequent. Http requests begin to be processed by an instance quickly, but
>>> then a datastore request will be latent for 15+ seconds. Http requests that
>>> used to complete in less than a second will take 25-60 seconds.
>>>
>>> Are you aware of this issue? I don't see any documentation of it in the
>>> server status page, but there's definitely a problem!
>>>
>>  --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to google-appengine+unsubscr...@googlegroups.com.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> Visit this group at http://groups.google.com/group/google-appengine.
>> For more options, visit https://groups.google.com/groups/opt_out.
>>
>>
>>
>
>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>



-- 
Regards
Sandeep Koduri
Phone: +91- 99 666 02 456
Gtalk: sandeep.koduri | Skype: sandeep.koduri
P Please consider the environment before printing this email

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Instances trying to start and failing.

[Aswath Satrasala]

 Datastore Errors:

2013-06-25 16:55:32.342

http://www.accounting-guru.net/tenantmgr/listTenant
javax.servlet.ServletException:
com.google.appengine.api.datastore.DatastoreFailureException: internal
error.
at 
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.handle(AppVersionHandlerMap.java:268)
at 
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at 
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at 
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:923)
at 
com.google.apphosting.runtime.jetty.RpcRequestParser.parseAvailable(RpcRequestParser.java:76)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at 
com.google.apphosting.runtime.jetty.JettyServletEngineAdapter.serviceRequest(JettyServletEngineAdapter.java:146)
at 
com.google.apphosting.runtime.JavaRuntime$RequestRunnable.run(JavaRuntime.java:439)
at 
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:483)
at 
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:490)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:777)
at 
com.google.tracing.TraceContext$DoInTraceContext.runInContext(TraceContext.java:754)
at 
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:345)
at 
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:337)
at 
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:487)
at 
com.google.apphosting.runtime.ThreadGroupPool$PoolEntry.run(ThreadGroupPool.java:251)
at java.lang.Thread.run(Thread.java:722)
Caused by: com.google.appengine.api.datastore.DatastoreFailureException:
internal error.
at 
com.google.appengine.api.datastore.DatastoreApiHelper.translateError(DatastoreApiHelper.java:53)
at 
com.google.appengine.api.datastore.DatastoreApiHelper$1.convertException(DatastoreApiHelper.java:76)
at 
com.google.appengine.api.utils.FutureWrapper.get(FutureWrapper.java:106)
at 
com.google.appengine.api.datastore.FutureHelper$CumulativeAggregateFuture.get(FutureHelper.java:145)
at 
com.google.appengine.api.utils.FutureWrapper.get(FutureWrapper.java:90)
at 
com.google.appengine.api.utils.FutureWrapper.get(FutureWrapper.java:90)
at 
com.google.appengine.api.datastore.FutureHelper.getInternal(FutureHelper.java:72)
at 
com.google.appengine.api.datastore.FutureHelper.quietGet(FutureHelper.java:33)
at 
com.google.appengine.api.datastore.DatastoreServiceImpl$1.runInternal(DatastoreServiceImpl.java:78)
at 
com.google.appengine.api.datastore.DatastoreServiceImpl$1.runInternal(DatastoreServiceImpl.java:75)
at 
com.google.appengine.api.datastore.TransactionRunner.runInTransaction(TransactionRunner.java:31)
at 
com.google.appengine.api.datastore.DatastoreServiceImpl.get(DatastoreServiceImpl.java:75)
at 
com.google.appengine.api.datastore.DatastoreServiceImpl.get(DatastoreServiceImpl.java:62)
at 
com.google.apphosting.runtime.jetty.DatastoreSessionStore.getSession(DatastoreSessionStore.java:82)
at 
com.google.apphosting.runtime.jetty.SessionManager.loadSession(SessionManager.java:327)
at 
com.google.apphosting.runtime.jetty.SessionManager.getSession(SessionManager.java:301)
at 
org.mortbay.jetty.servlet.AbstractSessionManager.getHttpSession(AbstractSessionManager.java:237)
at 
org.mortbay.jetty.servlet.SessionHandler.setRequestedId(SessionHandler.java:246)
at 
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:136)
at 
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)
at 
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.handle(AppVersionHandlerMap.java:266)


On Tue, Jun 25, 2013 at 4:36 PM, Aswath Satrasala <
aswath.satras...@gmail.com> wrote:

> Hello Appengine Team,
> http://accountingguru-india.appspot.com customers are facing the latency
> issues, and are not able to login to the application.
>
> Logs show the following
>
> A problem was encountered with the process that handled this request, causing 
> it to exit. This is likely to cause a new process to be used for the next 
> request to your application. (Error code 121
>
>
>1.
>   1. 2013-06-25 16:18:41.749 /tenantmgr/listTenant 500 14192ms 0kb 
> Mozilla/4.0
>   (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET 
> CLR
>   2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0)
>   2. W2013-06-25 16:18:41.749 A problem was encountered with the
>   proce

[google-appengine] Task Queues console showing errors

[Aswath Satrasala]

Hello Appengine Team,

In the Console, I click on the Task Queues.  It shows the following error

Server Error

A server error has occurred.

Return to Applications screen » 

-Aswath

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Task Queues console showing errors

[Aswath Satrasala]

My app-id:  accountingguru-india.appspot.com

-Aswath

On Tue, Jun 25, 2013 at 5:07 PM, Aswath Satrasala <
aswath.satras...@gmail.com> wrote:

> Hello Appengine Team,
>
> In the Console, I click on the Task Queues.  It shows the following error
>
> Server Error
>
> A server error has occurred.
>
> Return to Applications screen » 
>
> -Aswath
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: increased latencies in App Engine in the last 6-8 hours

[Jacob G]

I'm also seeing slow-down on Task Queue execution rate. I emailed some 
Google contacts I have, but they usually do not reply. I presume they read 
it, and follow up on it. But they are very non-transparent.

On Tuesday, June 25, 2013 6:39:41 AM UTC-4, Sam wrote:
>
> For the last 4 hours there again seems to be issues with AppEngine. 
> Specifically, the Task Queue execution rate has slowed down dramatically. 
> The system is hardly executing one task a minute.
>
> Hope somebody at AppEngine end is already aware about these issues & 
> working on resolving the same.
>
>
> On Tue, Jun 25, 2013 at 4:17 AM, James Gilliam 
> 
> > wrote:
>
>> Here's the thing about the latency.  
>>
>> GAE has a serious datastore issue right now.  Old records are being 
>> returned instead of the most recent ones.  It is random.  In some cases, 
>> they are not returning all the rows for a particular table.  We are seeing 
>> this behavior in tables which were updated yesterday.  I submitted a 
>> critical production error documenting these issues with GAE, yesterday.
>>
>> I was able to get around one of the most serious situations I was having 
>> by recopying a namespace, after repeatedly querying to determine the real 
>> number of rows -- about half the time GAE was reporting the wrong number of 
>> rows.  The copied namespace is working ok for now.
>>
>> GAE is not transparent when they have serious issues imo.
>>
>> On Saturday, June 22, 2013 7:50:47 PM UTC-7, Jacob G wrote:
>>>
>>> I have noticed large latency increases in App Engine in the last 6-8 
>>> hours, seemingly from the HR datastore. It is not all the time, but it is 
>>> frequent. Http requests begin to be processed by an instance quickly, but 
>>> then a datastore request will be latent for 15+ seconds. Http requests that 
>>> used to complete in less than a second will take 25-60 seconds.
>>>
>>> Are you aware of this issue? I don't see any documentation of it in the 
>>> server status page, but there's definitely a problem!
>>>
>>  -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to google-appengi...@googlegroups.com .
>> To post to this group, send email to 
>> google-a...@googlegroups.com
>> .
>> Visit this group at http://groups.google.com/group/google-appengine.
>> For more options, visit https://groups.google.com/groups/opt_out.
>>  
>>  
>>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Task queue Problem

[Eric Ka Ka Ng]

Since around 2 hours ago, the task queues in our apps seems stop
functioning. The rate of task execution is very very slow (sometimes 0,
sometimes 10 / min, sometimes normal). is there any wrong with the task
queue and could someone from Google help? our apps relies heavily on task
queue

- eric

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Task queue Problem

[Sameer Lodha]

We too can confirm that this issue is consistently affecting all our (HR)
Apps for the last 4 hours. The surprising thing is that during most of the
last 4 hours the "Task Queue" Status Page shows things as normal.


On Tue, Jun 25, 2013 at 5:53 PM, Eric Ka Ka Ng  wrote:

> Since around 2 hours ago, the task queues in our apps seems stop
> functioning. The rate of task execution is very very slow (sometimes 0,
> sometimes 10 / min, sometimes normal). is there any wrong with the task
> queue and could someone from Google help? our apps relies heavily on task
> queue
>
> - eric
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Task queue Problem

[Jacob G]

testing thread, b/c i think this group has been locked down...

On Tuesday, June 25, 2013 8:43:57 AM UTC-4, Sam wrote:
>
> We too can confirm that this issue is consistently affecting all our (HR) 
> Apps for the last 4 hours. The surprising thing is that during most of the 
> last 4 hours the "Task Queue" Status Page shows things as normal.
>
>
> On Tue, Jun 25, 2013 at 5:53 PM, Eric Ka Ka Ng 
> > wrote:
>
>> Since around 2 hours ago, the task queues in our apps seems stop 
>> functioning. The rate of task execution is very very slow (sometimes 0, 
>> sometimes 10 / min, sometimes normal). is there any wrong with the task 
>> queue and could someone from Google help? our apps relies heavily on task 
>> queue
>>
>> - eric
>>
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to google-appengi...@googlegroups.com .
>> To post to this group, send email to 
>> google-a...@googlegroups.com
>> .
>> Visit this group at http://groups.google.com/group/google-appengine.
>> For more options, visit https://groups.google.com/groups/opt_out.
>>  
>>  
>>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Task queue Problem

[Jacob G]

+1 for us

On Tuesday, June 25, 2013 8:23:09 AM UTC-4, Eric Ka Ka Ng wrote:
>
> Since around 2 hours ago, the task queues in our apps seems stop 
> functioning. The rate of task execution is very very slow (sometimes 0, 
> sometimes 10 / min, sometimes normal). is there any wrong with the task 
> queue and could someone from Google help? our apps relies heavily on task 
> queue
>
> - eric
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Modeling a graph database for use with App Engine API

[Renzo Nuccitelli]

 Take a look at GaeGraph:  https://github.com/renzon/gaegraph. You can 
install it using "pip install gaegraph".

  A build one proof of concept with it:  
https://github.com/renzon/zen-gaegraph-base. You can install it with 
virtualenv, once there is a requirements.txt file.

 Good Lucky,
 Renzo.

On Monday, June 24, 2013 4:41:29 PM UTC-3, Pumplerod wrote:
>
> Using python, I'm just learning with regard to GAE and the datastore so am 
> probably going about this all wrong and I'd love some advice from the more 
> experienced.
>
> As an exercise I wanted to emulate a graph database structure using ndb.  
> However, I'm having trouble accessing entities when all I have is a string 
> value for the key...
>
> Because this is an API I am using messages...
>
> class NewItemReturnMessage(messages.Message):
> key_string = messages.StringField(1, required=True)
> class NewVertexRequestMessage(messages.Message):
> parameters = messages.StringField(1)
>
> class Vertex(ndb.Model):
> parameters = ndb.JsonProperty(repeated=True)
> class VertexIndex(ndb.Model):
> inEdges = ndb.KeyProperty(repeated=True)
> outEdges = ndb.KeyProperty(repeated=True)
>
> class Edge(ndb.Model):
> parameters = ndb.JsonProperty(repeated=True)
> class EdgeIndex(ndb.Model):
> inVert = ndb.KeyProperty(required=True)
> outVert = ndb.KeyProperty(required=True)
>
>
>
>
> So to create a new Vertex through the API I have the following method...
>
> @endpoints.method(NewVertexRequestMessage, NewItemReturnMessage,
> name='vertex.generate', 
> path='vertex',
> http_method='POST')
> def generate_vertex(self, request):
> if request.parameters != "" and request.parameters != None:
> newVertex = Vertex(parameters = request.parameters.split(','))
> else:
> newVertex = Vertex()
> vertex_key = newVertex.put()
> newVertexIndex = VertexIndex(parent=vertex_key)
> vertexIndex_key = newVertexIndex.put()
> retMessage = NewItemReturnMessage(key = str(vertex_key))
> return retMessage
>
>
> notice that I'm returning a string object for my vertex_key because there 
> is no messages.KeyField
>
> When I want to connect two vertices through the API I need to supply the 
> key for each one but I'm having no success being able to retrieve the 
> entity based on supplying a string value for the key.  I'm trying something 
> like this...
>
> inVert = Vertex.query(Vertex.__key__ == request.inVertKey)
>
> Am I even in the ball park?
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Task queue Problem

[bFlood]

everything seems slow, Search API and Cloud Storage access

On Tuesday, June 25, 2013 9:16:56 AM UTC-4, Jacob G wrote:
>
> +1 for us
>
> On Tuesday, June 25, 2013 8:23:09 AM UTC-4, Eric Ka Ka Ng wrote:
>>
>> Since around 2 hours ago, the task queues in our apps seems stop 
>> functioning. The rate of task execution is very very slow (sometimes 0, 
>> sometimes 10 / min, sometimes normal). is there any wrong with the task 
>> queue and could someone from Google help? our apps relies heavily on task 
>> queue
>>
>> - eric
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Task queue Problem

[troppoli]

+1

We're seeing the same thing. The status console is reporting elevated 
latency in task add, but that's it. Our tasks execution has basically 
stopped they are starting to pile up, looking scary.

-s


On Tuesday, June 25, 2013 8:23:09 AM UTC-4, Eric Ka Ka Ng wrote:
>
> Since around 2 hours ago, the task queues in our apps seems stop 
> functioning. The rate of task execution is very very slow (sometimes 0, 
> sometimes 10 / min, sometimes normal). is there any wrong with the task 
> queue and could someone from Google help? our apps relies heavily on task 
> queue
>
> - eric
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Task queue Problem

[Jacob G]

Google has finally officially ackowledged the problem on 
the google-appengine-downtime-notify group.

Also, it seems that the tasks are actually executing, but they are still 
being listed in the admin console task queue list. Something is slow about 
updating that list. I determined this by checking the logs for 
"/_ah/queue/deferred" which are tasks, and comparing 
the X-Appengine-Taskname header to the tasks listed in the queue. I have 
tasks completed 10 minutes ago still listed in the queue.


On Tuesday, June 25, 2013 8:23:09 AM UTC-4, Eric Ka Ka Ng wrote:
>
> Since around 2 hours ago, the task queues in our apps seems stop 
> functioning. The rate of task execution is very very slow (sometimes 0, 
> sometimes 10 / min, sometimes normal). is there any wrong with the task 
> queue and could someone from Google help? our apps relies heavily on task 
> queue
>
> - eric
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] compilation python failure

[Ubaldo Huerta]

Starting today, I'm seeing this

09:22 AM Compilation starting.
09:26 AM Error 500: --- begin server output ---



500 Server Error


Error: Server Error
The server encountered an error and could not complete your 
request.If the problem persists, please http://code.google.com/appengine/community.html";>report your 
problem and mention this error message and the query that caused it.


--- end server output ---
Precompilation failed. Your app can still serve but may have reduced 
startup performance. You can retry the update later to retry the 
precompilation step.

Is this a transient problem? Any way to debug this?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: Delete Entire Namespace ... Entity Still Persist ... What does eventual consistency really mean?

[Jim Gilliam]

Wolfram --

Thank you for the response.

I will do as you suggest ... access the stale group with a GET to clear up
the stale replica.

Also, in rare cases, we have seen a get for a single row in the datastore,
return an old result and the current result randomly,  many days after the
item was updated.  You can reload the page with the data on it and
literally see it flip between the two versions of the row.  I assume this
is because the row is being retrieved from different replica.  Any thoughts
on that and how we can resolve it?

Thanks again for your help.

On Mon, Jun 24, 2013 at 11:27 PM, Wolfram Gürlich wrote:

> Hi James,
>
> what you see is a combination of two things: (a) indexes are eventually
> consistent - meaning that there is a lag between writing and them
> reflecting the current state and (b) replication which also happens to be
> eventual consistent meaning that not all replicas have the same state. Each
> replica (datacenter) has a complete copy of all your data AND all your
> indexes.
> When you do a query that query will hit exactly one (randomly choosen)
> datacenter (replica). So your result set might be stale because that
> replica hasn't yet applied all your writes. The next query may give you a
> very different result because it hits another replica.
>
> I've experienced inconsistencies for more than 12 hours which isn't the
> regular case though. At least 99.9% of the time inconsistencies will last
> for less than a second. But sometimes after REALLY heavy updates (a couple
> 100K writes within minutes) I've seen a small portion of entities remaining
> stale for hours.
>
> From what I've seen, most of the time an inconsistency will instantly
> vanish (on all replicas) as soon as you access the stale entity group
> consistently (doing a GET). The datastore detects the inconsistency and
> applies the writes that are still pending on some replica. Never will a
> consistent operation (like GET) give you a stale result (provided you
> haven't changed your read policy to inconsistent).
>
> Wolfram
>
>  --
> You received this message because you are subscribed to a topic in the
> Google Groups "Google App Engine" group.
> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/google-appengine/OkCjziExt74/unsubscribe
> .
> To unsubscribe from this group and all its topics, send an email to
> google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: increased latencies in App Engine in the last 6-8 hours

[Sandeep Koduri]

Any update, Seems like the state is still the same. any update from App
engine team?


On Tue, Jun 25, 2013 at 5:40 PM, Jacob G  wrote:

> I'm also seeing slow-down on Task Queue execution rate. I emailed some
> Google contacts I have, but they usually do not reply. I presume they read
> it, and follow up on it. But they are very non-transparent.
>
>
> On Tuesday, June 25, 2013 6:39:41 AM UTC-4, Sam wrote:
>
>> For the last 4 hours there again seems to be issues with AppEngine.
>> Specifically, the Task Queue execution rate has slowed down dramatically.
>> The system is hardly executing one task a minute.
>>
>> Hope somebody at AppEngine end is already aware about these issues &
>> working on resolving the same.
>>
>>
>> On Tue, Jun 25, 2013 at 4:17 AM, James Gilliam wrote:
>>
>>> Here's the thing about the latency.
>>>
>>> GAE has a serious datastore issue right now.  Old records are being
>>> returned instead of the most recent ones.  It is random.  In some cases,
>>> they are not returning all the rows for a particular table.  We are seeing
>>> this behavior in tables which were updated yesterday.  I submitted a
>>> critical production error documenting these issues with GAE, yesterday.
>>>
>>> I was able to get around one of the most serious situations I was having
>>> by recopying a namespace, after repeatedly querying to determine the real
>>> number of rows -- about half the time GAE was reporting the wrong number of
>>> rows.  The copied namespace is working ok for now.
>>>
>>> GAE is not transparent when they have serious issues imo.
>>>
>>> On Saturday, June 22, 2013 7:50:47 PM UTC-7, Jacob G wrote:

 I have noticed large latency increases in App Engine in the last 6-8
 hours, seemingly from the HR datastore. It is not all the time, but it is
 frequent. Http requests begin to be processed by an instance quickly, but
 then a datastore request will be latent for 15+ seconds. Http requests that
 used to complete in less than a second will take 25-60 seconds.

 Are you aware of this issue? I don't see any documentation of it in the
 server status page, but there's definitely a problem!

>>>  --
>>> You received this message because you are subscribed to the Google
>>> Groups "Google App Engine" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to google-appengi...@**googlegroups.com.
>>> To post to this group, send email to google-a...@googlegroups.**com.
>>>
>>> Visit this group at 
>>> http://groups.google.com/**group/google-appengine
>>> .
>>> For more options, visit 
>>> https://groups.google.com/**groups/opt_out
>>> .
>>>
>>>
>>>
>>
>>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>



-- 
Regards
Sandeep Koduri
Phone: +91- 99 666 02 456
Gtalk: sandeep.koduri | Skype: sandeep.koduri
P Please consider the environment before printing this email

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: increased latencies in App Engine in the last 6-8 hours

[Sameer Lodha]

Although it does not talk about the specific Task execution issue, here is
the update from App Engine team...

https://groups.google.com/forum/#!topic/google-appengine-downtime-notify/1pJZnl4EMKk

On Tue, Jun 25, 2013 at 8:34 PM, Sandeep Koduri wrote:

> Any update, Seems like the state is still the same. any update from App
> engine team?
>
>
> On Tue, Jun 25, 2013 at 5:40 PM, Jacob G  wrote:
>
>> I'm also seeing slow-down on Task Queue execution rate. I emailed some
>> Google contacts I have, but they usually do not reply. I presume they read
>> it, and follow up on it. But they are very non-transparent.
>>
>>
>> On Tuesday, June 25, 2013 6:39:41 AM UTC-4, Sam wrote:
>>
>>> For the last 4 hours there again seems to be issues with AppEngine.
>>> Specifically, the Task Queue execution rate has slowed down dramatically.
>>> The system is hardly executing one task a minute.
>>>
>>> Hope somebody at AppEngine end is already aware about these issues &
>>> working on resolving the same.
>>>
>>>
>>> On Tue, Jun 25, 2013 at 4:17 AM, James Gilliam wrote:
>>>
  Here's the thing about the latency.

 GAE has a serious datastore issue right now.  Old records are being
 returned instead of the most recent ones.  It is random.  In some cases,
 they are not returning all the rows for a particular table.  We are seeing
 this behavior in tables which were updated yesterday.  I submitted a
 critical production error documenting these issues with GAE, yesterday.

 I was able to get around one of the most serious situations I was
 having by recopying a namespace, after repeatedly querying to determine the
 real number of rows -- about half the time GAE was reporting the wrong
 number of rows.  The copied namespace is working ok for now.

 GAE is not transparent when they have serious issues imo.

 On Saturday, June 22, 2013 7:50:47 PM UTC-7, Jacob G wrote:
>
> I have noticed large latency increases in App Engine in the last 6-8
> hours, seemingly from the HR datastore. It is not all the time, but it is
> frequent. Http requests begin to be processed by an instance quickly, but
> then a datastore request will be latent for 15+ seconds. Http requests 
> that
> used to complete in less than a second will take 25-60 seconds.
>
> Are you aware of this issue? I don't see any documentation of it in
> the server status page, but there's definitely a problem!
>
  --
 You received this message because you are subscribed to the Google
 Groups "Google App Engine" group.
 To unsubscribe from this group and stop receiving emails from it, send
 an email to google-appengi...@**googlegroups.com.
 To post to this group, send email to google-a...@googlegroups.**com.

 Visit this group at 
 http://groups.google.com/**group/google-appengine
 .
 For more options, visit 
 https://groups.google.com/**groups/opt_out
 .



>>>
>>>  --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to google-appengine+unsubscr...@googlegroups.com.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> Visit this group at http://groups.google.com/group/google-appengine.
>> For more options, visit https://groups.google.com/groups/opt_out.
>>
>>
>>
>
>
>
> --
> Regards
> Sandeep Koduri
> Phone: +91- 99 666 02 456
> Gtalk: sandeep.koduri | Skype: sandeep.koduri
> P Please consider the environment before printing this email
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: compilation python failure

[emerix]

on my java, my deployment is stuck on "Initializing precompilation..."
I have been trying to deploy without success for one hour now

On Tuesday, June 25, 2013 9:28:56 AM UTC-5, Ubaldo Huerta wrote:
>
> Starting today, I'm seeing this
>
> 09:22 AM Compilation starting.
> 09:26 AM Error 500: --- begin server output ---
>
> 
> 
> 500 Server Error
> 
> 
> Error: Server Error
> The server encountered an error and could not complete your 
> request.If the problem persists, please http://code.google.com/appengine/community.html";>report your problem 
> and mention this error message and the query that caused it.
> 
> 
> --- end server output ---
> Precompilation failed. Your app can still serve but may have reduced 
> startup performance. You can retry the update later to retry the 
> precompilation step.
>
> Is this a transient problem? Any way to debug this?
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: compilation python failure

[Francois Masurel]

Same here, haven't been able to deploy my app for several hours now, stuck 
on precompilation...


On Tuesday, June 25, 2013 5:16:52 PM UTC+2, emerix wrote:
>
> on my java, my deployment is stuck on "Initializing precompilation..."
> I have been trying to deploy without success for one hour now
>
> On Tuesday, June 25, 2013 9:28:56 AM UTC-5, Ubaldo Huerta wrote:
>>
>> Starting today, I'm seeing this
>>
>> 09:22 AM Compilation starting.
>> 09:26 AM Error 500: --- begin server output ---
>>
>> 
>> 
>> 500 Server Error
>> 
>> 
>> Error: Server Error
>> The server encountered an error and could not complete your 
>> request.If the problem persists, please http://code.google.com/appengine/community.html";>report your problem 
>> and mention this error message and the query that caused it.
>> 
>> 
>> --- end server output ---
>> Precompilation failed. Your app can still serve but may have reduced 
>> startup performance. You can retry the update later to retry the 
>> precompilation step.
>>
>> Is this a transient problem? Any way to debug this?
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Delete Entire Namespace ... Entity Still Persist ... What does eventual consistency really mean?

[James Gilliam]

One final note ...

All of the inconsistencies that I was seeing on Sunday and Monday are now 
gone, including the one that I reported here regarding the deleted 
namespace.  It is now consistently reporting no records.

I did my read test on about a dozen other situations and they are all 
passing now.

Thanks for your efforts

On Monday, June 24, 2013 10:17:16 PM UTC-7, James Gilliam wrote:
>
> I deleted a namespace today ... every kind and entity in the namespace, 
> everything!  I kept fetching and deleting rows until there were no more to 
> delete.
>
> Ten hours later, I did a count on every kind in the previous namespace.
>
> To my surprise, some tables are still showing entities -- not every time 
> you do a count; but if you do the count 20 times, it will show rows 3 or 4 
> of those times.
>
> Why is delete not really delete?
>
> What does eventual consistency mean?
>
> How long exactly do I have to wait for the records to all be deleted?
>
> Very frustrating dealing with a datastore that doesn't seem to work 
> reliably.
>
> Here is the output of successive counting the entities in a kind -- notice 
> the 4s
>
> So, 80% of the time there are no entities, 20% there are 4 rows.
>
> Any GAE help out there?
>
>count 4count 0count 4count 0count 4count 0count 0count 0count 0count 
> 0count 
>0count 0count 0count 0count 4count 0count 0count 0count 0count 0
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: compilation python failure

[Francois Masurel]

It's a java app BTW.


On Tuesday, June 25, 2013 5:23:30 PM UTC+2, Francois Masurel wrote:
>
> Same here, haven't been able to deploy my app for several hours now, stuck 
> on precompilation...
>
>
> On Tuesday, June 25, 2013 5:16:52 PM UTC+2, emerix wrote:
>>
>> on my java, my deployment is stuck on "Initializing precompilation..."
>> I have been trying to deploy without success for one hour now
>>
>> On Tuesday, June 25, 2013 9:28:56 AM UTC-5, Ubaldo Huerta wrote:
>>>
>>> Starting today, I'm seeing this
>>>
>>> 09:22 AM Compilation starting.
>>> 09:26 AM Error 500: --- begin server output ---
>>>
>>> 
>>> 
>>> 500 Server Error
>>> 
>>> 
>>> Error: Server Error
>>> The server encountered an error and could not complete your 
>>> request.If the problem persists, please http://code.google.com/appengine/community.html";>report your 
>>> problem and mention this error message and the query that caused it.
>>> 
>>> 
>>> --- end server output ---
>>> Precompilation failed. Your app can still serve but may have reduced 
>>> startup performance. You can retry the update later to retry the 
>>> precompilation step.
>>>
>>> Is this a transient problem? Any way to debug this?
>>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: compilation python failure

[emerix]

I added false in 
appengine-web.xml as a temporary workaround as documented here 
: 
https://developers.google.com/appengine/docs/java/config/appconfig#Disabling_Precompilation

On Tuesday, June 25, 2013 10:23:59 AM UTC-5, Francois Masurel wrote:
>
> It's a java app BTW.
>
>
> On Tuesday, June 25, 2013 5:23:30 PM UTC+2, Francois Masurel wrote:
>>
>> Same here, haven't been able to deploy my app for several hours now, 
>> stuck on precompilation...
>>
>>
>> On Tuesday, June 25, 2013 5:16:52 PM UTC+2, emerix wrote:
>>>
>>> on my java, my deployment is stuck on "Initializing precompilation..."
>>> I have been trying to deploy without success for one hour now
>>>
>>> On Tuesday, June 25, 2013 9:28:56 AM UTC-5, Ubaldo Huerta wrote:

 Starting today, I'm seeing this

 09:22 AM Compilation starting.
 09:26 AM Error 500: --- begin server output ---

 
 
 500 Server Error
 
 
 Error: Server Error
 The server encountered an error and could not complete your 
 request.If the problem persists, please http://code.google.com/appengine/community.html";>report your 
 problem and mention this error message and the query that caused it.
 
 
 --- end server output ---
 Precompilation failed. Your app can still serve but may have reduced 
 startup performance. You can retry the update later to retry the 
 precompilation step.

 Is this a transient problem? Any way to debug this?

>>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: App Engine VM-based Backends - Trusted Tester Sign-up

[Kristopher Giesing]

>
> PS : Now that we've got these great new backends and all the goodness of 
>> BigQuery, CloudSQL, Datastore, ..., the only remaining "evil problem" in 
>> the AppEngine world is the behavior of the dispatcher which sends 
>> "user-facing requests to starting instances".
>>
>
> we have engineers dedicated to fixing this.  once we have an ETA that 
> we're more confident, we'll update the larger group.
>

That is absolutely fantastic news! 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Some Datastore items no longer accessible via queries (although still present in the store)

[Bartek Bargiel]

hi,

we experienced a quite serious issue in our thingscloud app and we'd like 
to get some feedback from GAE engineers.

Brief summary:

- 2 objects are still present in the Datastore
- yet they do no longer get returned in responses for our queries (no 
matter if we filter by key or any other property)

I ran tests both in the server app and using a remote shell access as well 
- no results. Searching in the datastore viewer displays the objects 
properly.

As far as I can tell from the server logs the problem manifested itself at 
~12.20 PM UTC time - one of our app's users is located in Finland, the 
other one in Poland.

We use Python in our codebase (if it's relevant).

please advice.

-- Bartek Bargiel

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: compilation python failure

[Francois Masurel]

Thanx Emerix, just forgot about that option ;-)


On Tuesday, June 25, 2013 5:34:31 PM UTC+2, emerix wrote:
>
> I added false in 
> appengine-web.xml as a temporary workaround as documented here : 
> https://developers.google.com/appengine/docs/java/config/appconfig#Disabling_Precompilation
>
> On Tuesday, June 25, 2013 10:23:59 AM UTC-5, Francois Masurel wrote:
>>
>> It's a java app BTW.
>>
>>
>> On Tuesday, June 25, 2013 5:23:30 PM UTC+2, Francois Masurel wrote:
>>>
>>> Same here, haven't been able to deploy my app for several hours now, 
>>> stuck on precompilation...
>>>
>>>
>>> On Tuesday, June 25, 2013 5:16:52 PM UTC+2, emerix wrote:

 on my java, my deployment is stuck on "Initializing precompilation..."
 I have been trying to deploy without success for one hour now

 On Tuesday, June 25, 2013 9:28:56 AM UTC-5, Ubaldo Huerta wrote:
>
> Starting today, I'm seeing this
>
> 09:22 AM Compilation starting.
> 09:26 AM Error 500: --- begin server output ---
>
> 
> 
> 500 Server Error
> 
> 
> Error: Server Error
> The server encountered an error and could not complete your 
> request.If the problem persists, please http://code.google.com/appengine/community.html";>report your 
> problem and mention this error message and the query that caused it.
> 
> 
> --- end server output ---
> Precompilation failed. Your app can still serve but may have reduced 
> startup performance. You can retry the update later to retry the 
> precompilation step.
>
> Is this a transient problem? Any way to debug this?
>


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Search API questions for app engine team

[Mahron]

Hi,

the doc says there is a 250 GB limit on search data storage.

Is that only for the preview ? Or will this limit be also for production ?

Also, would it be possible to give us details about how search indexes are 
stored, like it is done for the datastore, in order to understand the 
storage overheads.

Thanks. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: compilation python failure

[Sandeep Koduri]

I dont know if this works but, I faced this problems earlier, rollback and
deploy used to work in some cases.
Luck if this works, we can work without a work around.


On Tue, Jun 25, 2013 at 10:07 PM, Francois Masurel wrote:

> Thanx Emerix, just forgot about that option ;-)
>
>
> On Tuesday, June 25, 2013 5:34:31 PM UTC+2, emerix wrote:
>>
>> I added **false in
>> appengine-web.xml as a temporary workaround as documented here :
>> https://developers.google.**com/appengine/docs/java/**
>> config/appconfig#Disabling_**Precompilation
>>
>> On Tuesday, June 25, 2013 10:23:59 AM UTC-5, Francois Masurel wrote:
>>>
>>> It's a java app BTW.
>>>
>>>
>>> On Tuesday, June 25, 2013 5:23:30 PM UTC+2, Francois Masurel wrote:

 Same here, haven't been able to deploy my app for several hours now,
 stuck on precompilation...


 On Tuesday, June 25, 2013 5:16:52 PM UTC+2, emerix wrote:
>
> on my java, my deployment is stuck on "Initializing precompilation..."
> I have been trying to deploy without success for one hour now
>
> On Tuesday, June 25, 2013 9:28:56 AM UTC-5, Ubaldo Huerta wrote:
>>
>> Starting today, I'm seeing this
>>
>> 09:22 AM Compilation starting.
>> 09:26 AM Error 500: --- begin server output ---
>>
>> 
>> 
>> 500 Server Error
>> 
>> 
>> Error: Server Error
>> The server encountered an error and could not complete your
>> request.If the problem persists, please http://code.google.com/**appengine/community.html
>> ">**report your problem and mention this error message and the
>> query that caused it.
>> 
>> 
>> --- end server output ---
>> Precompilation failed. Your app can still serve but may have reduced
>> startup performance. You can retry the update later to retry the
>> precompilation step.
>>
>> Is this a transient problem? Any way to debug this?
>>
>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>



-- 
Regards
Sandeep Koduri
Phone: +91- 99 666 02 456
Gtalk: sandeep.koduri | Skype: sandeep.koduri
P Please consider the environment before printing this email

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Some Datastore items no longer accessible via queries (although still present in the store)

[Sameer Lodha]

That's eventual consistency for you. We experienced the same issue earlier
today. Try after some time (maybe an hour), things should hopefully be fine
by then.

On Tue, Jun 25, 2013 at 10:04 PM, Bartek Bargiel
wrote:

> hi,
>
> we experienced a quite serious issue in our thingscloud app and we'd like
> to get some feedback from GAE engineers.
>
> Brief summary:
>
> - 2 objects are still present in the Datastore
> - yet they do no longer get returned in responses for our queries (no
> matter if we filter by key or any other property)
>
> I ran tests both in the server app and using a remote shell access as well
> - no results. Searching in the datastore viewer displays the objects
> properly.
>
> As far as I can tell from the server logs the problem manifested itself at
> ~12.20 PM UTC time - one of our app's users is located in Finland, the
> other one in Poland.
>
> We use Python in our codebase (if it's relevant).
>
> please advice.
>
> -- Bartek Bargiel
>
>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Some Datastore items no longer accessible via queries (although still present in the store)

[John Lowry]

We are experiencing an issue with the Datastore and are providing updates 
on this thread as soon as they are available: 
https://groups.google.com/forum/#!topic/google-appengine-downtime-notify/1pJZnl4EMKk

On Tuesday, June 25, 2013 9:54:22 AM UTC-7, Sam wrote:
>
> That's eventual consistency for you. We experienced the same issue earlier 
> today. Try after some time (maybe an hour), things should hopefully be fine 
> by then.
>
> On Tue, Jun 25, 2013 at 10:04 PM, Bartek Bargiel 
> 
> > wrote:
>
>> hi,
>>
>> we experienced a quite serious issue in our thingscloud app and we'd like 
>> to get some feedback from GAE engineers.
>>
>> Brief summary:
>>
>> - 2 objects are still present in the Datastore
>> - yet they do no longer get returned in responses for our queries (no 
>> matter if we filter by key or any other property)
>>
>> I ran tests both in the server app and using a remote shell access as 
>> well - no results. Searching in the datastore viewer displays the objects 
>> properly.
>>
>> As far as I can tell from the server logs the problem manifested itself 
>> at ~12.20 PM UTC time - one of our app's users is located in Finland, the 
>> other one in Poland.
>>
>> We use Python in our codebase (if it's relevant).
>>
>> please advice.
>>
>> -- Bartek Bargiel
>>
>>  -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to google-appengi...@googlegroups.com .
>> To post to this group, send email to 
>> google-a...@googlegroups.com
>> .
>> Visit this group at http://groups.google.com/group/google-appengine.
>> For more options, visit https://groups.google.com/groups/opt_out.
>>  
>>  
>>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Some Datastore items no longer accessible via queries (although still present in the store)

[Bartek Bargiel]

Thanks for the update!

W dniu wtorek, 25 czerwca 2013 19:13:54 UTC+2 użytkownik John Lowry napisał:
>
> We are experiencing an issue with the Datastore and are providing updates 
> on this thread as soon as they are available: 
> https://groups.google.com/forum/#!topic/google-appengine-downtime-notify/1pJZnl4EMKk
>
> On Tuesday, June 25, 2013 9:54:22 AM UTC-7, Sam wrote:
>>
>> That's eventual consistency for you. We experienced the same issue 
>> earlier today. Try after some time (maybe an hour), things should hopefully 
>> be fine by then.
>>
>> On Tue, Jun 25, 2013 at 10:04 PM, Bartek Bargiel wrote:
>>
>>> hi,
>>>
>>> we experienced a quite serious issue in our thingscloud app and we'd 
>>> like to get some feedback from GAE engineers.
>>>
>>> Brief summary:
>>>
>>> - 2 objects are still present in the Datastore
>>> - yet they do no longer get returned in responses for our queries (no 
>>> matter if we filter by key or any other property)
>>>
>>> I ran tests both in the server app and using a remote shell access as 
>>> well - no results. Searching in the datastore viewer displays the objects 
>>> properly.
>>>
>>> As far as I can tell from the server logs the problem manifested itself 
>>> at ~12.20 PM UTC time - one of our app's users is located in Finland, the 
>>> other one in Poland.
>>>
>>> We use Python in our codebase (if it's relevant).
>>>
>>> please advice.
>>>
>>> -- Bartek Bargiel
>>>
>>>  -- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "Google App Engine" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to google-appengi...@googlegroups.com.
>>> To post to this group, send email to google-a...@googlegroups.com.
>>> Visit this group at http://groups.google.com/group/google-appengine.
>>> For more options, visit https://groups.google.com/groups/opt_out.
>>>  
>>>  
>>>
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] we can't access on GAE Web Application

[gae-support]

Help.
 
We cant access GAE Web application .
we access, but 500 Error returns.
 
>From about 17:50 on GMT+09:00 June 25th.
 
Application is 
 
s~aggolfinfo
s~aggolfinfo-dev
please what can I do to access successful?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] create_bulkloader_config doesn't reflect the latest schema changes

[Hooman Korasani]

I have created a bulkloader.yaml like this:

appcfg.py create_bulkloader_config --filename=tools/bulkloader.yaml --url=
https://myid.appspot.com/_ah/remote_api


However it doesn't reflect my changes from a day ago.  How long do I have 
to wait until it picks it up?

According to the data-store statistics, the last statistic update was *Last 
updated: 1 day, 21:11:28 ago
*However it also says *"**Statistics are updated at least once per day"

*Is there any other way to get the bulkloader consider my latest changes?*

*Many Thanks,
Hooman*

*

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Google App Engine community support is moving to Stack Overflow

[Hooman Korasani]

-1 
Stackoverflow has a very strict FAQ rules, and questions are easily 
closed.  I don't think it is a good idea to move support to that platform.


On Tuesday, 7 February 2012 02:14:54 UTC, Ikai Lan wrote:
>
> *Hi App Engine Developers,
>
> In the last few years, the Q&A website Stack 
> Overflowhas become an invaluable tool for 
> developer communities. We’re pleased to 
> announce that we are migrating to Stack Overflow as the official channel 
> for answering development questions about Google App Engine.The 
> google-appengine  group 
> will remain open for general discussions and announcements that are better 
> suited for the groups format.
>
> We believe that Stack Overflow is better platform for sharing knowledge 
> and answering support questions given its larger community, de-duping of 
> similar questions and contributor reputation system. We also expect that 
> App Engine developers will be able to contribute and benefit from the wider 
> range of language-related information not specific to App Engine. In 
> addition, due to Stack Overflow’s use of OpenID for account management, 
> developers will not need to create a new account to participate in the 
> discussion - developers will be able to log in with any of the identity 
> providers supported by Stack Overflow, including Google Accounts.
>
> We plan on deprecating the App Engine language-specific groups, namely 
> google-appengine-pythonand
>  
> google-appengine-java. 
> The 
> google-appengine-godiscussion
>  group will continue to remain open for at least as long as the 
> Go runtime is in experimental status. 
>
> The Python and Java groups will be placed into read-only on March 5th, 
> 2012. While answering technical questions, we will begin nudging developers 
> to ask their questions on Stack Overflow using the google-app-engine 
> tag
> .
>
> Please let us know if there are any questions or concerns about this 
> announcement.
>
> Happy coding!
>
> - Ikai Lan, on behalf of the App Engine team*
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] does the channel api work across domains?

[puriketu99]

Hi Kris

Thanks for your hack but my js file does not work.My js file is as 
following.
If you notice my mistake,Please tell me it.
https://gist.github.com/puriketu99/5860424

-puriketu99

2012年10月28日日曜日 2時48分26秒 UTC+9 Kristopher Giesing:
>
> I added a function like this to the channel javascript:
>
> goog.appengine.DevSocket.setConnectionBase = function(base) { 
> goog.appengine.DevSocket.BASE_URL = base + "_ah/channel/"};
>
> ...
>
> goog.exportSymbol("goog.appengine.Channel.setConnectionBase", 
> goog.appengine.DevSocket.setConnectionBase);
>
> This allowed me to serve the channel javascript as a static file served 
> outside of appspot.com instead of through the normal page load process. 
> (This is a static mobile app based on PhoneGap.) The base URL I set to was 
> the appspot.com domain.
>
> - Kris
>
> On Wednesday, October 24, 2012 2:10:20 PM UTC-7, niedbalski wrote:
>>
>> Hi Kristopher,
>>
>> On Tuesday, October 23, 2012 3:15:02 AM UTC-3, Kristopher Giesing wrote:
>>
>>> The live version uses an embedded iFrame.  The dev server version can't 
>>> work across domains without modifications, but I have gotten it to work by 
>>> adding a method that overrides the base URL.
>>>
>>> - Kris
>>>
>>> On Monday, October 22, 2012 2:27:28 PM UTC-7, niedbalski wrote:

 ...


>>
>> Do you know why the development server is not using the same iframe 
>> work-around ?  Can you share your hack for this?
>>
>> Thanks you.
>>
>> JNR.
>>
>>
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Java Error code 104: A problem was encountered with the process that handled this request, causing it to exit

[tringappsappengine]

A problem was encountered with the process that handled this request, causing 
it to exit. This is likely to cause a new process to be used for the next 
request to your application. If you see this message frequently, you may be 
throwing exceptions during the initialization of your application. (Error code 
104)


I am seeing this issue for more times in todays logs.

Can you please help us.


thanks



On Tuesday, March 13, 2012 4:13:26 AM UTC+5:30, Matt Mastracci wrote:
>
> Hey all,
>
> Has anyone been seeing a large number of error code 104s today? We haven't 
> made any significant code changes today, but these started showing up in 
> logs, with no additional information.
>
> I've tried upgrading our instance types to F2, just in case we're hitting 
> some sort of memory limit, but it doesn't appear to have helped. I've 
> noticed that there's a Java issue on the status screen: could this be 
> related?
>
> Attached is a graph showing the milliseconds/request graph, which seems to 
> correlate with the issue we've been seeing.
>
>
>1. 
>   1. 
>   
>   A problem was encountered with the process that handled this request, 
> causing it to exit. This is likely to cause a new process to be used for the 
> next request to your application. If you see this message frequently, you may 
> be throwing exceptions during the initialization of your application. (Error 
> code 104)
>   
>   2. 
>   1. 
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Datastore Strong vs Eventual Consistency -- When is Eventual ?

[James Gilliam]

We have used eventual consistency for a long time without any issues.  We 
would see multiple versions of data but only in the shortest time frames, 
usually a few seconds.

Recently, eventual consistency started being measured in hours and even 
days.  

So, the question is ... how long do we have to wait for eventual 
consistency?

And if it is more than a few minutes, do we have to use strong consistency 
to get our data consistent?

Thanks

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] App Engine Performance

[Robert Lancer]

When will there be a week when App Engine is performing properly? As a 
business with a product on top of App Engine this is starting to make me 
question continued use of App Engine as a platform despite the significant 
investment in building for App Engine.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Modeling a graph database for use with App Engine API

[Pumplerod]

Interesting.  Not much documentation yet so I'm a little fuzzy on how to 
implement, but looking through the code will be a good learning exercise.

On Tuesday, June 25, 2013 6:41:06 AM UTC-7, Renzo Nuccitelli wrote:
>
>  Take a look at GaeGraph:  https://github.com/renzon/gaegraph. You can 
> install it using "pip install gaegraph".
>
>   A build one proof of concept with it:  
> https://github.com/renzon/zen-gaegraph-base. You can install it with 
> virtualenv, once there is a requirements.txt file.
>
>  Good Lucky,
>  Renzo.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] ndb Query using parent?

[Pumplerod]

I have this type of Model...

class Item(ndb.Model):
type = ndb.StringProperty(indexed=True)
parameters = ndb.JsonProperty()

class ItemIndex(ndb.Model):
members = ndb.KeyProperty(repeated=True)

When I create an Item I also create an ItemIndex with it's parent set to be 
the Item.key

I would like to be able to look through all the ItemIndex instances and 
find one that has a particular member but whose parent is of a certain 
type.  Ideally something like...

ItemIndex.query(parent.type == 'Target' and ItemIndex.key.IN(ndb.Key(
'ItemIndex'))).fetch()

I'm sure I've butchered even my ideal example.  But is there a way to 
traverse through the query similar to the way I might structure a gremlin 
query to find a deeply nested item?



-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: ndb Query using parent?

[Pumplerod]

put another way...

If I have a list "members" which are all of class ItemIndex, can I search 
through and pull out just the ones who's parent is of a given "type" 
without having to use a loop?

On Tuesday, June 25, 2013 4:45:15 PM UTC-7, Pumplerod wrote:
>
> I have this type of Model...
>
> class Item(ndb.Model):
> type = ndb.StringProperty(indexed=True)
> parameters = ndb.JsonProperty()
>
> class ItemIndex(ndb.Model):
> members = ndb.KeyProperty(repeated=True)
>
> When I create an Item I also create an ItemIndex with it's parent set to 
> be the Item.key
>
> I would like to be able to look through all the ItemIndex instances and 
> find one that has a particular member but whose parent is of a certain 
> type.  Ideally something like...
>
> ItemIndex.query(parent.type == 'Target' and ItemIndex.key.IN(ndb.Key(
> 'ItemIndex'))).fetch()
>
> I'm sure I've butchered even my ideal example.  But is there a way to 
> traverse through the query similar to the way I might structure a gremlin 
> query to find a deeply nested item?
>
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: Reverting migration stuck

[Ryan Huebsch]

There were problems with HRD migrations over the last week. They have now
been mostly resolved. In particular, the app m0n0wall-mod has finished
reverting.


On Sun, Jun 23, 2013 at 3:54 PM, johnP  wrote:

>
> Any update?  Did the issue resolve eventually?
>
>
> On Wednesday, June 19, 2013 9:08:23 PM UTC-7, Dmitry Kononov wrote:
>>
>> Hi!
>> Yesterday I started migration for m0n0wall-mod application from old
>> Master/Slave to HRD datastore.
>> After several hours passed migration stuck at Copy stage.
>> I decided to cancel migration and after 24 hours there is still
>> "Reverting..." at Copy stage.
>> Is it possible to stop migration?
>>
>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: Migration progress sucks at Sync reverting!

[Ryan Huebsch]

The problems with HRD migrations have been resolved for new migrations. If
you are still experiencing a problem, please provide your appid or file a
production ticket on the issue tracker so we can investigate your specific
migration. We apologize for any inconvenience in the migration process.


On Sun, Jun 23, 2013 at 3:53 PM, johnP  wrote:

>
> My migration seems to be stuck for the past 2-3 days too.  I'm afraid to
> click 'revert' because I'd rather be stuck going forward than stuck going
> backwards.
>
>
>
>
> On Sunday, June 23, 2013 8:11:49 AM UTC-7, Edward Zhou wrote:
>>
>> My app was Master/Slave ModeAccording to Google's guide, I use the
>> migration tool to upgrade to HRD mode.
>> However, It converting Sync about 2 days, then I clicked Revert..
>> Ooops, now about 10 days past, it still sucks at Sync Reverting ...
>>
>>
>> What can I do ?
>>
>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Today, GAE finally reported an HR Datastore Outage -- eventual consistency was three days

[James Gilliam]

Since Sunday, the HR Datastore has not been performing right.  

I had dozens of tables in many different namespaces which were reporting 
inconsistent number of rows for hours and even days.  I had old values for 
rows being reported for days.  I presume some replicas were messed up and 
not getting updated -- perhaps it was a software bug -- don't really know.  

I was monitoring the situation, reporting critical production issues.  All 
I was getting back was a lecture about eventual consistency.   Eventual 
consistency has never caused us any problems but it has never been THREE 
days before either.

Today I ran the same tests that were failing and they all passed -- not one 
table is reporting an inconsistent number of rows.  

But it was GAE hell for me the last three days.


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: ndb Query using parent?

[timh]

Use an ancestor query 

https://developers.google.com/appengine/docs/python/ndb/queries#ancestor

On Wednesday, June 26, 2013 7:48:42 AM UTC+8, Pumplerod wrote:
>
> put another way...
>
> If I have a list "members" which are all of class ItemIndex, can I search 
> through and pull out just the ones who's parent is of a given "type" 
> without having to use a loop?
>
> On Tuesday, June 25, 2013 4:45:15 PM UTC-7, Pumplerod wrote:
>>
>> I have this type of Model...
>>
>> class Item(ndb.Model):
>> type = ndb.StringProperty(indexed=True)
>> parameters = ndb.JsonProperty()
>>
>> class ItemIndex(ndb.Model):
>> members = ndb.KeyProperty(repeated=True)
>>
>> When I create an Item I also create an ItemIndex with it's parent set to 
>> be the Item.key
>>
>> I would like to be able to look through all the ItemIndex instances and 
>> find one that has a particular member but whose parent is of a certain 
>> type.  Ideally something like...
>>
>> ItemIndex.query(parent.type == 'Target' and ItemIndex.key.IN(ndb.Key(
>> 'ItemIndex'))).fetch()
>>
>> I'm sure I've butchered even my ideal example.  But is there a way to 
>> traverse through the query similar to the way I might structure a gremlin 
>> query to find a deeply nested item?
>>
>>
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: App Engine VM-based Backends - Trusted Tester Sign-up

[Robert Kluin]

This is a really exciting feature.

Will the durability of these backends look and feel more like GCE 
(long-term / stable) or will the be more like GAE's current backends (flaky 
and unstable)?


Robert



On Thursday, June 20, 2013 2:21:06 PM UTC-5, Takashi Matsuo (Google) wrote:
>
>
> Fellow App Engine Gurus,
>
> We're happy to announce the next generation of App Engine Managed 
> Backends. These Backends utilize the App Engine VM Runtime, allowing 
> developers to run Backends on Compute Engine VMs. By building on top of 
> Compute Engine VMs, developers can:
>
>
>- take advantage of higher CPU and memory
>- rely on longer-lived processes
>- utilize a local filesystem
>- communicate via native network stacks
>- execute external processes
>- access the entire JRE
>- upload arbitrary Python extensions
>
>
> Given that these are App Engine Backends, you can still use all the App 
> Engine APIs to access the existing managed services (Datastore, Task 
> Queues, Memcache, etc.)
>
> Updating existing Backends to run on Compute Engine VMs is a simple config 
> change:
>
> app.yaml
> 
> application: app-id
> version: v1
> runtime: python27
> *vm: true*
> *
> *
> *manual_scaling:*
> *  instances: 1*
>
>
> That’s all you need to get started. We’ll pick a deafult VM machine type 
> and spin everything up your behalf. Of course there other options that you 
> can set (including machine type) and these are documented in the Getting 
> Started 
> Guide
> .
>
> In order to build a great product, we need quality feedback from brave 
> early adopters. If you’re interested test driving, please sign-up at the 
> link below and we’ll take care of the rest.
>
> App Engine VM-based VM Runtime - Trusted Tester 
> Sign-up
>
> Also, if you have any questions, please feel free to send an email to:
> appengine-...@googelgroups.com 
>
> Thanks!
>
> -- 
> Takashi Matsuo | Developers Programs Engineer | tma...@google.com
>  

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: App Engine VM-based Backends - Trusted Tester Sign-up

[Takashi Matsuo]

Hi Robert,

The VMs won't live forever, but definitely live long enough for the most
use-case. Generally there will be one periodic restart per weak.

-- Takashi


On Tue, Jun 25, 2013 at 9:33 PM, Robert Kluin wrote:

> This is a really exciting feature.
>
> Will the durability of these backends look and feel more like GCE
> (long-term / stable) or will the be more like GAE's current backends (flaky
> and unstable)?
>
>
> Robert
>
>
>
> On Thursday, June 20, 2013 2:21:06 PM UTC-5, Takashi Matsuo (Google) wrote:
>
>>
>> Fellow App Engine Gurus,
>>
>> We're happy to announce the next generation of App Engine Managed
>> Backends. These Backends utilize the App Engine VM Runtime, allowing
>> developers to run Backends on Compute Engine VMs. By building on top of
>> Compute Engine VMs, developers can:
>>
>>
>>- take advantage of higher CPU and memory
>>- rely on longer-lived processes
>>- utilize a local filesystem
>>- communicate via native network stacks
>>- execute external processes
>>- access the entire JRE
>>- upload arbitrary Python extensions
>>
>>
>> Given that these are App Engine Backends, you can still use all the App
>> Engine APIs to access the existing managed services (Datastore, Task
>> Queues, Memcache, etc.)
>>
>> Updating existing Backends to run on Compute Engine VMs is a simple
>> config change:
>>
>> app.yaml
>> 
>> application: app-id
>> version: v1
>> runtime: python27
>> *vm: true*
>> *
>> *
>> *manual_scaling:*
>> *  instances: 1*
>>
>>
>> That’s all you need to get started. We’ll pick a deafult VM machine type
>> and spin everything up your behalf. Of course there other options that you
>> can set (including machine type) and these are documented in the Getting
>> Started 
>> Guide
>> .
>>
>> In order to build a great product, we need quality feedback from brave
>> early adopters. If you’re interested test driving, please sign-up at the
>> link below and we’ll take care of the rest.
>>
>> App Engine VM-based VM Runtime - Trusted Tester 
>> Sign-up
>>
>> Also, if you have any questions, please feel free to send an email to:
>> appengine-...@**googelgroups.com
>>
>> Thanks!
>>
>> --
>> Takashi Matsuo | Developers Programs Engineer | tma...@google.com
>>
>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>



-- 
Takashi Matsuo | Developers Programs Engineer | tmat...@google.com

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Running DFP on GAE

[Youdhveer Panwar]

I am facing issue in running a servlet to fetch data from DFP Java API,

Here is the complete code...
**

package com.lin.web.servlet;

import java.io.IOException;
import java.io.PrintWriter;
import java.util.List;
import java.util.logging.Logger;

import javax.servlet.ServletConfig;
import javax.servlet.ServletException;
import javax.servlet.http.HttpServlet;
import javax.servlet.http.HttpServletRequest;
import javax.servlet.http.HttpServletResponse;

import com.google.api.ads.common.lib.exception.ValidationException;
import com.google.api.ads.dfp.appengine.oauth.CredentialException;
import com.google.api.ads.dfp.jaxws.factory.DfpServices;
import com.google.api.ads.dfp.jaxws.v201302.ApiException_Exception;
import com.google.api.ads.dfp.jaxws.v201302.Network;
import com.google.api.ads.dfp.jaxws.v201302.NetworkServiceInterface;
import com.google.api.ads.dfp.lib.client.DfpSession;
import com.lin.web.util.ClientLoginAuth;
import com.lin.web.util.LinMobiileProperties;
import com.lin.web.util.LinMobileConstants;


@SuppressWarnings("serial")
public class DfpV302Servlet extends HttpServlet {
 
  private static final Logger log = 
Logger.getLogger(DfpV302Servlet.class.getName());
  
  private String clientLoginToken = null;

public void init(ServletConfig config) throws ServletException {
super.init(config);
try {
  clientLoginToken = regenerateAuthToken();
  log.info(" clientLoginToken : "+clientLoginToken);
} catch (Exception exception) {
log.severe("init(), Exception.."+exception);
exception.printStackTrace();  
}
}


  @Override
  public void doGet(HttpServletRequest req, HttpServletResponse resp) throws 
ServletException,IOException {
log.info("started...");
PrintWriter out=resp.getWriter();
resp.setContentType("text/plain");

out.println("");

try {
log.info("going to make DfpSession instance...");
DfpSession session = new DfpSession.Builder()
.withClientLoginToken(clientLoginToken) 


.withNetworkCode(LinMobileConstants.DFP_NETWORK_CODE)
.build();

log.info("going to make DfpServices instance...");
DfpServices dfpServices = new DfpServices();


log.info("loading networks...");

List networks = loadNetworks(dfpServices, 
session);

for (Network network : networks) {
out.println(
  "Network with network 
code"+network.getNetworkCode()+"  and display name "+
   network.getDisplayName());
}

log.warning("done");

} catch (ValidationException e) {
log.severe("ValidationException :"+e.getMessage());
e.printStackTrace();
} catch (ApiException_Exception e) {
log.severe("ApiException_Exception:"+e.getMessage());
e.printStackTrace();
} catch (CredentialException e) {
log.severe("CredentialException:"+e.getMessage());
e.printStackTrace();
}


out.println("");
  }
  
  private List loadNetworks(DfpServices dfpServices,DfpSession 
session) throws ValidationException, ApiException_Exception,
  CredentialException{
  NetworkServiceInterface networkService =
dfpServices.get(session, NetworkServiceInterface.class);
log.info("Fetching networks...");
List networks = networkService.getAllNetworks();
return networks;
  }
  public String regenerateAuthToken() throws Exception {
 String clientLoginToken=LinMobiileProperties.getAuthToken();
 if(clientLoginToken ==null){
 ClientLoginAuth clientLoginAuth = new 
ClientLoginAuth(LinMobileConstants.EMAIL_ADDRESS, 
LinMobileConstants.EMAIL_PASSWORD);
 clientLoginToken =clientLoginAuth.getAuthToken();
 LinMobiileProperties.setAuthToken(clientLoginToken);
 }  
 

[google-appengine] Flood of warm up requests!

[chilang]

Hi,

I'm seeing 15 warm up requests per secs causing 60+ instances to be spin 
up, despite having little traffic!

I haven't changed anything (code nor settings) recently. 
This has started in the last 2 hours. 

I've only noticed this due to app suddenly running out of quota. 
I'm trying to cap Idle Instances to 1-1 to no avail. I've increased the 
quota but at this rate it is going to burn through it very soon.

Anyone else seeing this ?

Regards,
Chi Lang

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Why does Google App Engine Datastore uses BigTable to store indexes instead of using BigQuery?

[Aniket Bhatnagar]

Considering BigQuery is an AppEngine offering, it seems like a natural fit 
to store indexes. However, Datastore uses BigTable to store indexes. Why is 
that so?

One possible explanation provided on Quora[1] is that BigQuery is not a 
right fit for heavy write scenario. If so, what is the recommended rate at 
which BigQuery can accept data?

References :

[1] 
http://www.quora.com/Google-App-Engine/Why-does-Google-App-Engine-Datastore-uses-BigTable-to-store-indexes-instead-of-using-BigQuery

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: Google App Engine community support is moving to Stack Overflow

[Moises Belchin]

I'm not a big fan of SO.


Saludos.
Moisés Belchín.


2013/6/25 Hooman Korasani 

> -1
> Stackoverflow has a very strict FAQ rules, and questions are easily
> closed.  I don't think it is a good idea to move support to that platform.
>
>
> On Tuesday, 7 February 2012 02:14:54 UTC, Ikai Lan wrote:
>>
>> *Hi App Engine Developers,
>>
>> In the last few years, the Q&A website Stack 
>> Overflowhas become an invaluable tool for 
>> developer communities. We’re pleased to
>> announce that we are migrating to Stack Overflow as the official channel
>> for answering development questions about Google App Engine.The
>> google-appengine  group
>> will remain open for general discussions and announcements that are better
>> suited for the groups format.
>>
>> We believe that Stack Overflow is better platform for sharing knowledge
>> and answering support questions given its larger community, de-duping of
>> similar questions and contributor reputation system. We also expect that
>> App Engine developers will be able to contribute and benefit from the wider
>> range of language-related information not specific to App Engine. In
>> addition, due to Stack Overflow’s use of OpenID for account management,
>> developers will not need to create a new account to participate in the
>> discussion - developers will be able to log in with any of the identity
>> providers supported by Stack Overflow, including Google Accounts.
>>
>> We plan on deprecating the App Engine language-specific groups, namely
>> google-appengine-pythonand
>> google-appengine-java.
>> The 
>> google-appengine-godiscussion
>>  group will continue to remain open for at least as long as the
>> Go runtime is in experimental status.
>>
>> The Python and Java groups will be placed into read-only on March 5th,
>> 2012. While answering technical questions, we will begin nudging developers
>> to ask their questions on Stack Overflow using the google-app-engine 
>> tag
>> .
>>
>> Please let us know if there are any questions or concerns about this
>> announcement.
>>
>> Happy coding!
>>
>> - Ikai Lan, on behalf of the App Engine team*
>>
>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] We're having problems with Text Search

[Moises Belchin]

Hi folks,

We're having a lot of Exceptions with Text Search.

Does anyone have this same problem?

Thanks and regards.


File 
"/python27_runtime/python27_lib/versions/1/google/appengine/api/search/search.py",
line 2730, in search
raise _ToSearchError(e)
TransientError




Saludos.
Moisés Belchín.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.