[google-appengine] Sudden increase in Datastore READ operations
Hi, Suddenly, I am seeing a lot of Datastore read operations. I would like to see the details of reads and writes by KINDS during a certain period. Is there a way to do this? Regards -Aswath -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] TaskQueue and genetic algo tasks
Each task runs a genetic program. In desktop, each task takes 5 mins and consumes 250 MB ram. A user-level job consists of 10 such tasks. In desktop ( a normal Windows PC ), It takes about 50 minutes to complete one user-level job. Can I use App Engine to run the tasks in parallel and achieve a response of ~5 mins for the user-level job ? Specifically, a single http request triggers 10 DeferredTasks. The DeferredTask need not do any datastore operation. Can taskqueue process the DeferredTasks in parallel and handle the 10 DeferredTasks simultaneously? As each DeferredTask runs, it has to notify the progress to the client using Channels API. Is it possible ? Channel being not serializable, how can I keep a channel as a member variable to a DeferredTask? Could you please share your experience in CPU and memory intensive DeferredTasks ? J.Ganesan -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] JCache memcache namespacing doesn't work
Thought I would give this some visibility: http://code.google.com/p/googleappengine/issues/detail?id=5935 Basically, setting different values for the same key in different namespaced caches - sets the key+value in all namespaces. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/uYqQBYF6COsJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: How can I access GAE application?
Can anybody help me? My project ran smoothly until yesterday. Now I cannot access my project anymore even though Dashboard is Ok and Logs with no errors. Does GAE change anything? Vào 20:45:42 UTC+7 Thứ tư, ngày 26 tháng mười hai năm 2012, star_movie_02 đã viết: > > Dear all, > I have been using GAE for three months. But within today, I could not > access any projects on GAE. I don't know why and I am worry about this > because they are important to me. Can anyone help me to answer what's > wrong is that? And when will it revive? > Thanks > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/7Jz0W3FP4DsJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Pull task leasing question
On Wednesday, 26 December 2012 19:26:35 UTC+13, Mahron wrote: > > Hi, > > I would like to know what happens if two simultaneous lease_tasks are > called, is it possible that both get returned the same tasks ? or is > there something to prevent that scenario ? > The recommendation from Google about pull queues is "Tasks should be idempotent, so even if a task lease expires and another client leases the task, performing the same task twice should not cause an error." With push queues (standard task queues) there is also no guarantee that a task will not be executed more than once so probably the same caveat is true when you manage the queue yourself. How likely is this? The push queue docs say: "App Engine's Task Queue API is designed to only invoke a given task once; however, it is possible in exceptional circumstances that a task may execute multiple times (such as in the unlikely case of major system failure). Thus, your code must ensure that there are no harmful side-effects of repeated execution." However I have seen it happen more frequently than "major system failures". I have a task chain that uses named tasks (can only be added once) and roughly 1 / 500,000 tasks gets repeated. If you truly need to ensure tasks execute only once you can give each a serial number (in a task chain increment the value for each new task) and at the start of your task do a transactional "check and increment" operation on the datastore. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/WqFUEfLAinoJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Datastore write costs
On Thursday, 27 December 2012 01:27:47 UTC+13, aschmid wrote: > > even if a property is not indexed is needs to be written to the datastore > so it costs 1 write instead of 2 (one to the datastore and one to the > index). > Unindexed properties do not cost anything to write. They are included in the one write operation that writes the entity data. Basically, all properties are serialised and written as a single opaque unit. It costs no more to write 1000 unindexed properties as 1 - however the latency to read and write will be higher which will cost you in terms of instance hours. An indexed property costs 2 writes because each index (ASC, DESC) is a separate write. > > vlad UNEXISTING props do not add any write cost ;) > > What do you mean by UNEXISTING? Be careful here because null values will also cost 2 writes if they are indexed. Twig (prob also Objectify) can be configured store null values as indexed or not indexed (also or stored or not stored) while still storing non-null values. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/SDxdWsxYrC4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] cannot delete the task from the default queue
Hello, I am unable to delete the task from the 'default' queue. I also tried purge queue, but it not seem to be working. appengine-mrcontrol-15823324380678DD3CD06-13155 ↓ 2012/12/26 18:44:33 0:00:01 from now2012/12/26 18:44:31 0:00:01 agoPOST /_ah/mapreduce/controller_callback1356 bytes 6 Headers -Aswath -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] java application uploading error
my error while uploading *appcfg --use_java7 update f:/akshaypakanati/war* *Unable to update:* *com.google.appengine.tools.admin.HttpIoException: * * * *Error posting to URL: * * * *https://appengine.google.com/api/appversion/create?* * * *app_id=cvsrportal&version=2&* *400 Bad Request* * * *Invalid runtime or the current user is not authorized to use it.* -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/3dy5_ZCNQawJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. Unable to update: com.google.appengine.tools.admin.HttpIoException: Error posting to URL: https://appengine.google.com/api/appversion/create?app_id=cvsrportal&version=2&; 400 Bad Request Invalid runtime or the current user is not authorized to use it. at com.google.appengine.tools.admin.AbstractServerConnection.send1(AbstractServerConnection.java:293) at com.google.appengine.tools.admin.AbstractServerConnection.send(AbstractServerConnection.java:253) at com.google.appengine.tools.admin.AbstractServerConnection.post(AbstractServerConnection.java:232) at com.google.appengine.tools.admin.AppVersionUpload.send(AppVersionUpload.java:644) at com.google.appengine.tools.admin.AppVersionUpload.beginTransaction(AppVersionUpload.java:449) at com.google.appengine.tools.admin.AppVersionUpload.doUpload(AppVersionUpload.java:124) at com.google.appengine.tools.admin.AppAdminImpl.doUpdate(AppAdminImpl.java:371) at com.google.appengine.tools.admin.AppAdminImpl.update(AppAdminImpl.java:53) at com.google.appengine.tools.admin.AppCfg$UpdateAction.execute(AppCfg.java:1072) at com.google.appengine.tools.admin.AppCfg.(AppCfg.java:219) at com.google.appengine.tools.admin.AppCfg.(AppCfg.java:102) at com.google.appengine.tools.admin.AppCfg.main(AppCfg.java:98) com.google.appengine.tools.admin.AdminException: Unable to update app: Error posting to URL: https://appengine.google.com/api/appversion/create?app_id=cvsrportal&version=2&; 400 Bad Request Invalid runtime or the current user is not authorized to use it. at com.google.appengine.tools.admin.AppAdminImpl.doUpdate(AppAdminImpl.java:376) at com.google.appengine.tools.admin.AppAdminImpl.update(AppAdminImpl.java:53) at com.google.appengine.tools.admin.AppCfg$UpdateAction.execute(AppCfg.java:1072) at com.google.appengine.tools.admin.AppCfg.(AppCfg.java:219) at com.google.appengine.tools.admin.AppCfg.(AppCfg.java:102) at com.google.appengine.tools.admin.AppCfg.main(AppCfg.java:98) Caused by: com.google.appengine.tools.admin.HttpIoException: Error posting to URL: https://appengine.google.com/api/appversion/create?app_id=cvsrportal&version=2&; 400 Bad Request Invalid runtime or the current user is not authorized to use it. at com.google.appengine.tools.admin.AbstractServerConnection.send1(AbstractServerConnection.java:293) at com.google.appengine.tools.admin.AbstractServerConnection.send(AbstractServerConnection.java:253) at com.google.appengine.tools.admin.AbstractServerConnection.post(AbstractServerConnection.java:232) at com.google.appengine.tools.admin.AppVersionUpload.send(AppVersionUpload.java:644) at com.google.appengine.tools.admin.AppVersionUpload.beginTransaction(AppVersionUpload.java:449) at com.google.appengine.tools.admin.AppVersionUpload.doUpload(AppVersionUpload.java:124) at com.google.appengine.tools.admin.AppAdminImpl.doUpdate(AppAdminImpl.java:371) ... 5 more
[google-appengine] 400 bad request
I am new to app engine. I've created a simple Java web application with one html page. but am getting error as " *Unable to update:* * * *com.google.appengine.tools.admin.HttpIoException: * * * *Error posting to URL: * * * *https://appengine.google.com/api/appversion/create?* * * *app_id=cvsrportal&version=2&* * * *400 Bad Request* * * *Invalid **runtime or the current user is not authorized to **use it.*" please help me out.. Thank you. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/ARv7hw-cSKMJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. Unable to update: com.google.appengine.tools.admin.HttpIoException: Error posting to URL: https://appengine.google.com/api/appversion/create?app_id=cvsrportal&version=2&; 400 Bad Request Invalid runtime or the current user is not authorized to use it. at com.google.appengine.tools.admin.AbstractServerConnection.send1(AbstractServerConnection.java:293) at com.google.appengine.tools.admin.AbstractServerConnection.send(AbstractServerConnection.java:253) at com.google.appengine.tools.admin.AbstractServerConnection.post(AbstractServerConnection.java:232) at com.google.appengine.tools.admin.AppVersionUpload.send(AppVersionUpload.java:644) at com.google.appengine.tools.admin.AppVersionUpload.beginTransaction(AppVersionUpload.java:449) at com.google.appengine.tools.admin.AppVersionUpload.doUpload(AppVersionUpload.java:124) at com.google.appengine.tools.admin.AppAdminImpl.doUpdate(AppAdminImpl.java:371) at com.google.appengine.tools.admin.AppAdminImpl.update(AppAdminImpl.java:53) at com.google.appengine.tools.admin.AppCfg$UpdateAction.execute(AppCfg.java:1072) at com.google.appengine.tools.admin.AppCfg.(AppCfg.java:219) at com.google.appengine.tools.admin.AppCfg.(AppCfg.java:102) at com.google.appengine.tools.admin.AppCfg.main(AppCfg.java:98) com.google.appengine.tools.admin.AdminException: Unable to update app: Error posting to URL: https://appengine.google.com/api/appversion/create?app_id=cvsrportal&version=2&; 400 Bad Request Invalid runtime or the current user is not authorized to use it. at com.google.appengine.tools.admin.AppAdminImpl.doUpdate(AppAdminImpl.java:376) at com.google.appengine.tools.admin.AppAdminImpl.update(AppAdminImpl.java:53) at com.google.appengine.tools.admin.AppCfg$UpdateAction.execute(AppCfg.java:1072) at com.google.appengine.tools.admin.AppCfg.(AppCfg.java:219) at com.google.appengine.tools.admin.AppCfg.(AppCfg.java:102) at com.google.appengine.tools.admin.AppCfg.main(AppCfg.java:98) Caused by: com.google.appengine.tools.admin.HttpIoException: Error posting to URL: https://appengine.google.com/api/appversion/create?app_id=cvsrportal&version=2&; 400 Bad Request Invalid runtime or the current user is not authorized to use it. at com.google.appengine.tools.admin.AbstractServerConnection.send1(AbstractServerConnection.java:293) at com.google.appengine.tools.admin.AbstractServerConnection.send(AbstractServerConnection.java:253) at com.google.appengine.tools.admin.AbstractServerConnection.post(AbstractServerConnection.java:232) at com.google.appengine.tools.admin.AppVersionUpload.send(AppVersionUpload.java:644) at com.google.appengine.tools.admin.AppVersionUpload.beginTransaction(AppVersionUpload.java:449) at com.google.appengine.tools.admin.AppVersionUpload.doUpload(AppVersionUpload.java:124) at com.google.appengine.tools.admin.AppAdminImpl.doUpdate(AppAdminImpl.java:371) ... 5 more
[google-appengine] Uncaught exception from servlet javax.servlet.UnavailableException: java.security.AccessControlException
My context is deploying ringojs web application to google app engine. All goes fine, until i want to test it on the browser: http://myappname.appspot.com Gives me this error: Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please report your problem and mention this error message and the query that caused it. My app log shows me this stack: Uncaught exception from servlet javax.servlet.UnavailableException: java. security.AccessControlException: access denied (java.lang.RuntimePermissionmodifyThreadGroup ) at org.mortbay.jetty.servlet.ServletHolder.makeUnavailable(ServletHolder. java:415) at org.mortbay.jetty.servlet.ServletHolder.initServlet( ServletHolder.java:451) at org.mortbay.jetty.servlet.ServletHolder.doStart( ServletHolder.java:263) at org.mortbay.component.AbstractLifeCycle.start( AbstractLifeCycle.java:50) at org.mortbay.jetty.servlet.ServletHandler. initialize(ServletHandler.java:685) at org.mortbay.jetty.servlet.Context. startContext(Context.java:140) at org.mortbay.jetty.webapp.WebAppContext. startContext(WebAppContext.java:1250) at org.mortbay.jetty.handler. ContextHandler.doStart(ContextHandler.java:517) at org.mortbay.jetty.webapp. WebAppContext.doStart(WebAppContext.java:467) at org.mortbay.component. AbstractLifeCycle.start(AbstractLifeCycle.java:50) at com.google.apphosting. runtime.jetty.AppVersionHandlerMap.createHandler(AppVersionHandlerMap.java: 219) at com.google.apphosting.runtime.jetty.AppVersionHandlerMap.getHandler( AppVersionHandlerMap.java:194) at com.google.apphosting.runtime.jetty. JettyServletEngineAdapter.serviceRequest(JettyServletEngineAdapter.java:134)at com .google.apphosting.runtime.JavaRuntime$RequestRunnable.run(JavaRuntime.java: 447) at com.google.tracing.TraceContext$TraceContextRunnable.runInContext( TraceContext.java:454) at com.google.tracing. TraceContext$TraceContextRunnable$1.run(TraceContext.java:461) at com.google .tracing.TraceContext.runInContext(TraceContext.java:703) at com.google. tracing.TraceContext$AbstractTraceContextCallback. runInInheritedContextNoUnref(TraceContext.java:338) at com.google.tracing. TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext .java:330) at com.google.tracing.TraceContext$TraceContextRunnable.run( TraceContext.java:458) at com.google.apphosting.runtime. ThreadGroupPool$PoolEntry.run(ThreadGroupPool.java:251) at java.lang.Thread. run(Thread.java:679) Could you please point me what's causing this how to fix it. Thanx in advance. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/OOK3kwIT9ioJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Datastore write costs
On Wednesday, December 26, 2012 4:27:47 AM UTC-8, aschmid wrote: > > even if a property is not indexed is needs to be written to the datastore > so it costs 1 write instead of 2 (one to the datastore and one to the > index). > We also charge an extra 1 write operation per entity (and only for new entities) for the kind index. a list property adds 1 write per item for example + another one for each > one if they are indexed. > > vlad UNEXISTING props do not add any write cost ;) > > On Dec 23, 2012, at 2:45 PM, vlad > > wrote: > > My understanding is UNINDEXED properties add no write cost at all. See > https://developers.google.com/appengine/docs/python/datastore/entities#Understanding_Write_Costs > > > On Friday, December 21, 2012 1:29:26 PM UTC-8, Ryan Chazen wrote: >> >> Hi - I find the following a bit confusing - is it correct? >> >> Using unindexed properties only: >> >> If I write 10 numbers in a list to the datastore, _ah/admin on the local >> dev server shows 10 write operations. >> If I write 10 numbers inside an embedded entity (or comma delimited), the >> local dev server shows 1 write operation. >> >> Since billing is by write operations, is using the list 10x more >> expensive in reality? If so, I need to make sure all of my unindexed >> properties get put into an embedded entity first before writing as it will >> mean I only use 1 write op for all unindexed properties... > > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/google-appengine/-/CGmpJvoIF_EJ. > To post to this group, send email to google-a...@googlegroups.com > . > To unsubscribe from this group, send email to > google-appengi...@googlegroups.com . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/5c69CLPMDuIJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] How can I access GAE application?
Dear all, I have been using GAE for three months. But within today, I could not access any projects on GAE. I don't know why and I am worry about this because they are important to me. Can anyone help me to answer what's wrong is that? And when will it revive? Thanks -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Datastore write costs
even if a property is not indexed is needs to be written to the datastore so it costs 1 write instead of 2 (one to the datastore and one to the index). a list property adds 1 write per item for example + another one for each one if they are indexed. vlad UNEXISTING props do not add any write cost ;) On Dec 23, 2012, at 2:45 PM, vlad wrote: > My understanding is UNINDEXED properties add no write cost at all. See > https://developers.google.com/appengine/docs/python/datastore/entities#Understanding_Write_Costs > > > On Friday, December 21, 2012 1:29:26 PM UTC-8, Ryan Chazen wrote: > Hi - I find the following a bit confusing - is it correct? > > Using unindexed properties only: > > If I write 10 numbers in a list to the datastore, _ah/admin on the local dev > server shows 10 write operations. > If I write 10 numbers inside an embedded entity (or comma delimited), the > local dev server shows 1 write operation. > > Since billing is by write operations, is using the list 10x more expensive in > reality? If so, I need to make sure all of my unindexed properties get put > into an embedded entity first before writing as it will mean I only use 1 > write op for all unindexed properties... > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/google-appengine/-/CGmpJvoIF_EJ. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
