[google-appengine] Any chance of an API for Application Settings?
I have a multi-tenancy paid-for app, that I've been running in production for 18 months now. In the last few months I've been tweaking the runtime configuration to get the best performance for my buck. I think I've found a fairly optimal solution, involving some idle instances, max instance, reserved hours etc etc. My clients are generally European based at the moment, so I find myself turning my idle servers on for a European day, and off again at night. This is a manual chore I'd clearly much rather do without, as its time-consuming and error-prone. I don't intend to spend any less money, as my budgets are already set according to my client-numbers, I'm just optimising the response times they get based on their time-zones. I'm sure I can't be alone in wanting such automated configuration, and I'm hoping it would be fairly simple to implement. Question is, are there any plans to release an API for control of these settings? copy posted here - original in S.O.) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/KZ_cP_dvXjUJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] onBrowserEvent doesn't work after the application is deployed
I implemented onBrowserevent for my customize AbstractCell. It's working perfectly when I tested in development mode. For example, if I click on the cell, Window.alert is popped up and says 'clicked'. But, after deploying it to the app engine, it's not working anymore. When I click on the cell, it doesn't seem to respond anymore. Anyone has had the same problem before? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/njOrq6w0OAkJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Datastore Viewer
Hi, I am trying to a create a Entity using the Datastore Viewer UI. I followed the following steps * Click on the Datastore Viewer * By default it is in the Query tab * Click on the Create tab * Choose the kind * Click 'Next' Now, all the properties for the KIND is not shown for entering the values. It is showing fewer properties for which the values can be entered. It is not the same case for all KINDS What is the criteria to show all the properties for the KIND? -Aswath -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Query unowned relationship in JPA (with Key identifiers)
We are trying to manually retreive Records (entity) from a specific
User. We are using exclusively JPA with unowned relationship. We
noticed that the primaryKey isn't in the same format as the FK (user)
in the datastore viewer.
This is our code of the Record:
@PrimaryKey
@Persistent(valueStrategy = IdGeneratorStrategy.IDENTITY)
private Key key;
@Persistent
private Key user;
@Persistent
private double value;
// Constructors
which is generated this way in the appengine:
| Key
|ID/Name| user|value |
+-
+--+--+--+
| aglub19hcHBfaWRyEwsSDU1lZGljYWxSZWNvcmQYBAw | 4 | User(2)
| 0.54|
| aglub19hcHBfaWRyEwsSDU1lZGljYWxSZWNvcmQYBgw | 6 | User(2)
| 0.51|
We tried to retreive the records this way but it doesn't work because
the (Key)Record.user=User(2) is not encoded while
(Key)User.key=aglub19hcHBfaWRyCgsSBFVzZXIYAQw is indeed encoded.
---CODE---
public ListMedicalRecord getAll(User user) {
PersistenceManager pm = PMF.get().getPersistenceManager();
Query query = pm.newQuery(MedicalRecord.class);
query.setFilter(user == userParam);
query.declareParameters(Key.class.getName() + userParam);
Transaction transaction = pm.currentTransaction();
try{
transaction.begin();
ListMedicalRecord results = (ListMedicalRecord)
query.execute(user.getKey());
transaction.commit();
return results;
}
catch (Exception e) {
transaction.rollback();
return null;
}
finally{
pm.close();
}
}
---CODE---
What is the right way of query unowned relationship in JPA? Your help
is very much appreciated.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: How to update eclipse plugin to google app engine 1.6.5 sdk?
Thank everyone for reply. I am waiting for update. 2012년 4월 30일 월요일 오전 10시 11분 18초 UTC+9, 김종민 님의 말: Last week, I couldn't upload Google App Engine because of version. In eclipse plugin, there was no update at google app engine. I connected http://dl.google.com/eclipse/plugin/3.7. Let me know how to update eclipse plugin? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/pXsrLRZjTzoJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: How to update eclipse plugin to google app engine 1.6.5 sdk?
Again, Jeff zaps a dark, bruised section of my brain, bringing it back to life. The part that makes me laugh. Rubytard... love it. -David (Must wipe nasal ejected Diet Mtn. Dew off the monitor now.) Yes, this is a minor annoyance, but using Eclipse is a thousand minor annoyances like this and each one I can purge makes me feel just a little less like hurling my laptop across the room and becoming a rubytard. P.S. please star this: http://code.google.com/p/googleappengine/issues/detail?id=3856 Jeff -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/k9cM1_lOBiwJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Outage - 503 error requests not returning
I am getting a 503 error 'An unexpected failure has occurred. Please try again.' going to https://appengine.google.com/ my app requests are not working (timing out). Hopefully this is already being looked into. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/7ioW2_hfozEJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Outage - 503 error requests not returning
Working again now - https://appengine.google.com/ loads - and requests working. Looks like everything got reset (my instances are at 1 and dashboard cleared/reset). Wonder how often these types of resets happen? On Tuesday, May 1, 2012 2:13:33 PM UTC-7, Mark wrote: I am getting a 503 error 'An unexpected failure has occurred. Please try again.' going to https://appengine.google.com/ my app requests are not working (timing out). Hopefully this is already being looked into. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/w0RALXVJ0F4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Outage - 503 error requests not returning
Hi Mark, We're investigating the issue and I'll reply with more details (and/or resolution) when I know more. Thanks, Dan On Tue, May 1, 2012 at 2:21 PM, Mark markrobertdav...@gmail.com wrote: Working again now - https://appengine.google.**com/https://appengine.google.com/ loads - and requests working. Looks like everything got reset (my instances are at 1 and dashboard cleared/reset). Wonder how often these types of resets happen? On Tuesday, May 1, 2012 2:13:33 PM UTC-7, Mark wrote: I am getting a 503 error 'An unexpected failure has occurred. Please try again.' going to https://appengine.google.**com/https://appengine.google.com/ my app requests are not working (timing out). Hopefully this is already being looked into. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/w0RALXVJ0F4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Dan Holevoet Google Developer Relations -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Outage - 503 error requests not returning
Hi Mark, It appears that the issue is resolved. If you continue to see errors, please let us know. Thanks, Dan On Tue, May 1, 2012 at 2:25 PM, Dan Holevoet danielholev...@google.comwrote: Hi Mark, We're investigating the issue and I'll reply with more details (and/or resolution) when I know more. Thanks, Dan On Tue, May 1, 2012 at 2:21 PM, Mark markrobertdav...@gmail.com wrote: Working again now - https://appengine.google.**com/https://appengine.google.com/ loads - and requests working. Looks like everything got reset (my instances are at 1 and dashboard cleared/reset). Wonder how often these types of resets happen? On Tuesday, May 1, 2012 2:13:33 PM UTC-7, Mark wrote: I am getting a 503 error 'An unexpected failure has occurred. Please try again.' going to https://appengine.google.**com/https://appengine.google.com/ my app requests are not working (timing out). Hopefully this is already being looked into. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/w0RALXVJ0F4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Dan Holevoet Google Developer Relations -- Dan Holevoet Google Developer Relations -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Outage - 503 error requests not returning
what happened? does anyone know? On Tue, May 1, 2012 at 6:21 PM, Mark markrobertdav...@gmail.com wrote: Working again now - https://appengine.google.**com/https://appengine.google.com/ loads - and requests working. Looks like everything got reset (my instances are at 1 and dashboard cleared/reset). Wonder how often these types of resets happen? On Tuesday, May 1, 2012 2:13:33 PM UTC-7, Mark wrote: I am getting a 503 error 'An unexpected failure has occurred. Please try again.' going to https://appengine.google.**com/https://appengine.google.com/ my app requests are not working (timing out). Hopefully this is already being looked into. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/w0RALXVJ0F4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Felipe Assoline http://about.me/fassoline -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Wouldn't it be great if pull queues supported arbitrary tagging
It looks like you recently got your wish for this excellent feature. Am I
right in thinking that this can (and should) be used to address the
challenges with high throughput updates that still exist? I know the 2010
Google I/O presentation by Brett Slatkin has been referenced by many folks,
but there seem to be some issues with that, specifically the Eventual
Consistency of the HRD. A push/pull queue based implementation might look
like this:
For each unit of work:
-Write work to Pull queue with tag=BatchID
-Write named 'fan-in' task to Push Queue for execution batch period ms in
the future, containing the BatchID
When the named task executes:
-Lease all available tasks from the Pull queue using the tag=BatchID
-Aggregate the work
-Apply the update to the Datastore
Is a feasible/appropriate/recommended use of the Pull Queue tag mechanism?
On Monday, May 16, 2011 9:53:03 PM UTC-4, Jason Collins wrote:
As pointed out by all-around-smart-dude Robert Kluin, it would be
great if you could place arbitrary tags on a task when submitting to a
pull queue, and then lease the tasks back out with that tag. This
would provide a great, built-in mechanism to do groupings, etc.
This would yield:
q = taskqueue.Queue('pull0')
q.add(taskqueue.Task(payload=payload_str, method='PULL',
tag='mytag'))
and
q = taskqueue.Queue('pull0')
sometasks = q.lease_tasks(3600, 100, tag='mytag')
where tag is an optional kwarg in both cases.
Star http://code.google.com/p/googleappengine/issues/detail?id=5061,
or discuss there.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/WEfUTqDVHcAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Django on AppEngine, django-rocket-engine
Hi I'm quite new in AppEngine development but was using Django for few years now. I've found that setup described in docs is not like django that I got used to. So I decided to write small helper library to bring django AppEngine usage as close as possible to 'normal' (in subjective way) django usage that I got used to. Project is more like prof-of-concept than stable library that you should use on production. But since I'm using this for my small projects maybe someone will find this useful as well. http://django-rocket-engine.readthedocs.org/en/latest/index.html with an example application: https://github.com/xando/rocket-project http://xando-1.appspot.com/ Project was highly inspired by work done in djangoappengine of All Button Pressed, but since that project was dedicated to work with django-nonrel, I decided to write my own and focus only on Google CloudSQL. Thanks seba -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Wouldn't it be great if pull queues supported arbitrary tagging
Indeed! For each unit of work: -Write work to Pull queue with tag=BatchID -Write named 'fan-in' task to Push Queue for execution batch period ms in the future, containing the BatchID Example: http://code.google.com/p/8-bits/source/browse/trunk/backend/main.py#168 When the named task executes: -Lease all available tasks from the Pull queue using the tag=BatchID -Aggregate the work -Apply the update to the Datastore Is a feasible/appropriate/recommended use of the Pull Queue tag mechanism? Example: http://code.google.com/p/8-bits/source/browse/trunk/backend/main.py#202 I haven't load tested this yet, but I think it should work? -Brett -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Outage - 503 error requests not returning
I also got spikes of latency and errors for about 20 minutes 4 hours ago, on my four apps in production. Would be nice to have some details -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/_qLA8Jd82ysJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Datastore Small Operations - datastore.get(key)
I settled with Generic DAO classes for Objectify wrapped by Jersey. I am using Backbone for the frontend MVC - so far, I have to admit that it is shaping up well. Jerff - thanks for the library. On Apr 20, 8:48 am, Jeff Schnitzer j...@infohazard.org wrote: No, get-by-key that reaches the datastore is a Read Operation. However, memcache hits are free. Jeff On Fri, Apr 20, 2012 at 1:56 AM, Peter Han devifr...@gmail.com wrote: However, you can convert queries into keys-only queries followed by batch get()s; this will cost small datastore operations for cache hits rather than full read operations keys-only query is a small datastore operation thats is clear, but batch get of entities by key also? Thank you. On Apr 18, 6:49 pm, Jeff Schnitzer j...@infohazard.org wrote: On Wed, Apr 18, 2012 at 3:36 AM, cloudpre pbx.ku...@gmail.com wrote: Jeff - thanks for the note. I have been trying to add few items in memcache manually. Can put operations also be saved? Let's say I am updating the same query again after few seconds. I'm not sure what you mean here. The cache covers get(), put(), and delete() operations. Queries do not affect the cache at all. However, you can convert queries into keys-only queries followed by batch get()s; this will cost small datastore operations for cache hits rather than full read operations. Objectify4 will actually do this for you. Does it work flawlessly in the production? The last thing I want to see is our thousands of customers coming back and complaining. There have not been any complaints for the current cache code (3.1+), and it is fairly widely used. Older versions of the cache code (3.0 and prior) had synchronization issues, but for 3.1 I rewrote it with some help from Ari and Alfred (Google). It should be transactionally safe - even under heavy contention - as long as you don't hit DeadlineExceededExceptions. Jeff -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] concurrent request issues on GAE
Hi, We have a mobile application using GAE as application backend. The mobile client communicates with GAE via REST API. The user data is stored on GAE datastore. So far, things are smooth with GAE. In preparation of launch, we tried a mini concurrent load test 100 qps to retrieve data from datastore for 100 users in a second. The results are pretty bad. Each API request can take from 1-4 secs based on user data. We had a paid billing application. When 100 concurrent requests were issues, we saw 50% failure rate with 503 service errors. We bumped reserve instances to 10 and we still saw high failure rates. We bumped to 30 front end instances and they we had a successful test run. The app is 'threadsafe'. Why would we need 30 instances to support 100 concurrent qps?? We also tried to change pending latency but not much affect on error rate. The servlet request is not memory or CPU intensive.. It reads daa from datastore and returns a json representation of data.. We were expecting to support 100qps with 3-5 instances. Are we missing something? Our goal is to support 1000 qps with reasonable number of front instances. But 30 instances for 100 concurrent qps seems insanely expensive compared to EC2 or any other provider. The distribution of load also is not anywhere close to even distribution on the available instances. Does anyone has similar experiences? Should we move to EC2? The doc link https://developers.google.com/appengine/kb/general#activerequests has some related information. If the requests take 1s, is GAE not a good candidate for scaling up? Is there a published limit on how many concurrent requests are supported? We will submit the form and see if we get the restrictions(if any) removed. This thread talks about 10 threads limit for java instances. Can anyone from appengine team confirm this? http://groups.google.com/group/google-appengine/browse_thread/thread/6efce99e84a61646/6401778addb115d2?show_docid=6401778addb115d2 Thanks Neeli -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
