Re: [appengine-java] Jaxb2Marshaller
JAXB is working fine in my GAE app (I am NOT using Spring although). If using Eclipse, try this tutorial : http://www.webmanie.de/cms158/index.php?option=com_contentview=articleid=1 3Itemid=0 On 14/09/10 21:41, Shweta Deshpande shweta...@gmail.com wrote: Hello, Is the class org.springframework.oxm.jaxb.Jaxb2Marshaller supported in App Engine? I tried deploying an application that uses it, but I'm getting the following error: Cannot resolve reference to bean 'jaxbMarshaller' while setting bean property 'jaxb2Marshaller'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'jaxbMarshaller' defined in ServletContext resource [/WEB-INF/rest-servlet.xml]: Invocation of init method failed; nested exception is java.lang.ExceptionInInitializerError If not, which of Spring's OXM marshaller classes are supported? Thanks, Shweta -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Avoid exploding indexes : design question
Hi Big Brains,
I carefully watched the Brett¹s speech about large scale apps and how to use
the list property. I encourage everyone to watch it.
My need : to query on BOTH a single property AND a list property.
This will create a custom index over ONE single property and ONE list
property.
My question : I need to know from your experience if this would lead to
query or index performance issues, knowing that we intend to manage a VERY
large number of those small entities.
Following is a sample example of my model (where I removed all JDO
annotations for clarity) :
Class HelpMeBigBrains {
private Key key;// primary key of the object
private Key objectAkey; // unowned one-to-one
private ListKey objectBkeys; // unowned one-to-many
}
My JDO query would look like this :
Query query = pm.newQuery(SELECT key FROM +
HelpMeBigBrains.class.getName());
query.setFilter(³objectAkey == aKey²);
query.setFilter(³objectBkeys.contains(b1Key)²);
query.setFilter(³objectBkeys.contains(b2Key)²);
query.declareParameters(³com.google.appengine.api.datastore.Key aKey, b1Key,
b2Key²);
ListKey results = (ListKey) query.execute(keyA, keyB1, keyB2);
Thank you in advance for your answer(s).
Kind regards,
Cyrille
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Avoid exploding indexes : design question
What speech/presentation are you refering ?
On Sep 15, 11:44 am, Crll Vnc crll...@gmail.com wrote:
Hi Big Brains,
I carefully watched the Brett¹s speech about large scale apps and how to use
the list property. I encourage everyone to watch it.
My need : to query on BOTH a single property AND a list property.
This will create a custom index over ONE single property and ONE list
property.
My question : I need to know from your experience if this would lead to
query or index performance issues, knowing that we intend to manage a VERY
large number of those small entities.
Following is a sample example of my model (where I removed all JDO
annotations for clarity) :
Class HelpMeBigBrains {
private Key key; // primary key of the object
private Key objectAkey; // unowned one-to-one
private ListKey objectBkeys; // unowned one-to-many
}
My JDO query would look like this :
Query query = pm.newQuery(SELECT key FROM +
HelpMeBigBrains.class.getName());
query.setFilter(³objectAkey == aKey²);
query.setFilter(³objectBkeys.contains(b1Key)²);
query.setFilter(³objectBkeys.contains(b2Key)²);
query.declareParameters(³com.google.appengine.api.datastore.Key aKey, b1Key,
b2Key²);
ListKey results = (ListKey) query.execute(keyA, keyB1, keyB2);
Thank you in advance for your answer(s).
Kind regards,
Cyrille
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] What is the scope for NamespaceManager?
We are building a multi-tenant application and want to use the
NamespaceManager to distinguish between tenants on the basis of server-
name. So for example inphina.bookmyhours.com would be a different
tenant than te-con.bookmyhours.com
we are currently using NamespaceFilter with code similar to
if (NamespaceManager.get() == null) {
switch (strategy) {
case SERVER_NAME: {
logger.info(The namespace for the request is:
+
request.getServerName());
NamespaceManager.set(request.getServerName());
if(seedDataSetup.setSeedData()) {
adminAccountValidator.updateAdminPassword();
}
break;
}
What we observed is that we always fall into the condition of
NamespaceManager.get() == null and hence the code has to set
NamespaceManager.set(request.getServerName()); again. Is it possible
to retain this setting at a session level. For all our users logging
in from inphina.bookmyhours.com, they would remain to be within the
same tenant.
From the current implementation, it looks like the NamespaceManager
has a request scope. Comments/Suggestions?
Regards | Vikas
www.inphina.com
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: Avoid exploding indexes : design question
http://www.youtube.com/watch?v=AgaL6NGpkB8
Enjoy !
On 15/09/10 12:55, Ice13ill andrei.fifi...@gmail.com wrote:
What speech/presentation are you refering ?
On Sep 15, 11:44 am, Crll Vnc crll...@gmail.com wrote:
Hi Big Brains,
I carefully watched the Brett¹s speech about large scale apps and how to use
the list property. I encourage everyone to watch it.
My need : to query on BOTH a single property AND a list property.
This will create a custom index over ONE single property and ONE list
property.
My question : I need to know from your experience if this would lead to
query or index performance issues, knowing that we intend to manage a VERY
large number of those small entities.
Following is a sample example of my model (where I removed all JDO
annotations for clarity) :
Class HelpMeBigBrains {
private Key key; // primary key of the object
private Key objectAkey; // unowned one-to-one
private ListKey objectBkeys; // unowned one-to-many
}
My JDO query would look like this :
Query query = pm.newQuery(SELECT key FROM +
HelpMeBigBrains.class.getName());
query.setFilter(³objectAkey == aKey²);
query.setFilter(³objectBkeys.contains(b1Key)²);
query.setFilter(³objectBkeys.contains(b2Key)²);
query.declareParameters(³com.google.appengine.api.datastore.Key aKey, b1Key,
b2Key²);
ListKey results = (ListKey) query.execute(keyA, keyB1, keyB2);
Thank you in advance for your answer(s).
Kind regards,
Cyrille
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Getting email address of user from Google Account ID
Hey, For the primary key of my User object, I store the Google Account ID instead of the user's email address (in the event they change the email address). Is there a way of taking the Account ID and obtaining the current email address associated with the account? Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: 1MB URL Fetch limit and blobstore service
It worked! GREAT suggestion! Thank you, Lucian On Sep 14, 1:14 am, Robert Lancer robert.lan...@gmail.com wrote: Humm, Im not sure this would work but maybe you could use a transfer or send redirect to do the upload since the blob store upload URL is within your app. On Sep 13, 3:08 pm, Lucian Baciu lucianba...@gmail.com wrote: What I meant is actually send POST requests using the URL Fetch API to the blobstore. I've done a test and the request limit does apply :( so I can't send files larger then 1MB in size. My app has a dropbox servlet (i.e. users send emails to the app with attachments) and my app saves these attachments to the blobstore, this is the reason why I need to call the blobstore service from a servlet. So it would be so great if you would remove this limit at least for requests send to the blobstore or offer some other way to archive this. Thank you, Lucian On Mon, Sep 13, 2010 at 9:58 PM, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: No. You will be able to upload large files to the blobstore. On Mon, Sep 13, 2010 at 6:54 AM, Lucian Baciu lucianba...@gmail.comwrote: Does the 1MB request limit listed here: http://code.google.com/appengine/docs/java/urlfetch/overview.html apply to upload requests send to the blobstore as well? Thanks, Lucian -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2B unsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2B unsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Query on ListKey where the keys are not primary
I have two entities:
public class People {
@PrimaryKey
@Persistent(valueStrategy = IdGeneratorStrategy.IDENTITY)
private Key key;
@Persistent
private ListKey contactmethods;
}
public class ContactMethod {
@PrimaryKey
@Persistent(valueStrategy = IdGeneratorStrategy.IDENTITY)
private Key key;
@Persistent
private String contactmethodaddress;
}
Every time I add a new contact method, i.e. phone number, email, etc I
add an entry into the person's list so we know all of the ways we can
contact them. Now, I want to find out who a person is based on one of
those entries.
So if I have the key for a specific contactmethod, how do I select the
Person(s) to which it belongs? I have tried:
javax.jdo.Query q = pm.newQuery(People.class);
q.setFilter(this.contactmethods.contains(pContactMethod)); and
q.setFilter(contactmethods == pContactMethod);
q.declareImports(import com.google.appengine.api.datastore.Key);
q.declareParameters(Key pContactMethod);
ListPeople allPeople = (ListPeople)
pm.newQuery(q).execute(lContactMethodKey);
Where lContactMethodKey is the Key of the contact method being
searched for.
either way I get:
javax.jdo.JDOFatalUserException: Exception converting
com.appointment.datastoreobjects.peo...@2c453c47 to an internal key.
Received a request to find an object of type
com.appointment.datastoreobjects.People identified by
com.appointment.datastoreobjects.peo...@2c453c47. This is not a valid
representation of a primary key for an instance of
com.appointment.datastoreobjects.People.
Thanks for any insight you can give!
Shaun
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Blobstore Write
Hey all, Am I reading it right that there really no way to write data into a Blobstore object programmatically? I swear I had read something about it, but can only see the InputStream additions now and maybe I'd misread it as an OutputStream. I have several million images I've collected from RSS feed polling, and several million more coming that I would love to use with the new fast image serving functionality, but I can't get them into the Blobstore in the first place as no user is ever involved with the creation of them. Toyed with the idea of using an HTTP POST from inside an AppEngine task, but that seems fragile and wasteful. Is this something that will ever be supported with Blobstore? Thanks, -Casey -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Does AppEngine recycle threads (Is using ThreadLocal considered good practice on the GAE?)
Hello, I'm wondering (after some internal discussion we had) is using ThreadLocal for applications running on the AppEngine is performance beneficial ? For this to work AppEngine should recycle threads, right? Another question is how many threads does the appengine allows per JVM ? Such ThreadLocal based approach would (probably) be inefficient if the JVM allowed 2 threads. Help is appreciated. Maxim. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Delete indexes for application
Hi, I need to delete the indexes for my java app as the column name has changed. I am now unable to perform any entity deletions because of the existing entries in the index table. Would it be possible to somehow delete all the indexes for my app? Regards Barada Sahu -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Storing values with GAE LowLevel Api ( com.google.appengine.api.datastore)
Hi everyone, I have an app who actually work with a dao layer. This layer as actually only one Hibernate implementation. I want to make this app available on Google App Engine. But I don't want to annotate all my data classes. So I have tried to write a default Dao who use the Google LowLevel api and the Sun|Oracle Reflexion api to convert my data classes to entities . He is doing what I want but fail when a data class contains other data classes. I have tried to convert the sub data class to an entity and persist but now my dao fail when a property is an Integer because the LowLevel api return a Long. Is there an existing DefaultLowLevelDao or something like that or a may to easilly convert the entity property type to the expected one ? Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] How can i allow user to download a zip file?
My app creates dinamically two files so that then the users can download these files in one zip file. But i have problem in implementing this operations. Some suggestion to help me? Library, if gae supports this operations, etc. (i have tried to use gaeVfs, but i have met problems: i cannot write the content of a file on the response, so i can download the file but its content is empty ) -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Random HTTP 500 errors with the RemoteApiServlet
Hi,
The upload process is problematic (for large data sets) but using splitting
into smaller chunks becomes reasonably bearable.
I'm attaching an email I've sent internally(= raw format) after playing with
bulkupload a bit on Unbuntu 10.04 64bit.
Note: I've used Python 2.6 (It's possibly that this is the root cause of the
problems, as the python sdk designed to work with python 2.5).
-- Forwarded message --
From: Maxim Veksler ma...@vekslers.org
Date: Wed, Sep 1, 2010 at 5:00 PM
Subject: Loading MaxMind GeoIP Country database
To: ...
Provides below summary of the steps that were required to upload the content
of Maxmind *Country* database to AppEngine data store.
Provided for future reference.
*
*
*Download DB in CSV format from MaxMind*
Download CSV from http://www.maxmind.com/app/geoip_country
*Split the CSV file*
Then we need to split this file into chunks, so we do something like this:
$ mkdir /home/maxim/Downloads/GeoIPCountryWhois_SPLIT
$ mkdir /home/maxim/Downloads/GeoIPCountryWhois_SPLIT/processed
$ cd /home/maxim/Downloads/GeoIPCountryWhois_SPLIT
$ wc -l /home/maxim/Downloads/GeoIPCountryWhois.csv
131578 /home/maxim/Downloads/GeoIPCountryWhois.csv
$ cat /home/maxim/Downloads/GeoIPCountryWhois.csv | chunksplit.sh
/home/maxim/Downloads/GeoIPCountryWhois_SPLIT/SPLIT
WRITING:
/home/maxim/Downloads/GeoIPCountryWhois_SPLIT/SPLIT_001-0001000.csv
WRITING:
/home/maxim/Downloads/GeoIPCountryWhois_SPLIT/SPLIT_0001001-0002000.csv
WRITING:
/home/maxim/Downloads/GeoIPCountryWhois_SPLIT/SPLIT_0002001-0003000.csv
...
...
...
WRITING:
/home/maxim/Downloads/GeoIPCountryWhois_SPLIT/SPLIT_0130001-0131000.csv
WRITING:
/home/maxim/Downloads/GeoIPCountryWhois_SPLIT/SPLIT_0131001-0132000.csv
chunksplit is this little utility script:
$ cat /home/maxim/bin/chunksplit.sh
#!/bin/bash
DST_TEMPLATE=$1
__line_counter=0
BLOCKSIZE=1000
while read line; do
if [[ $(( $__line_counter % $BLOCKSIZE )) == 0 ]]; then
TARGET=$(printf %s_%015d-%015d.csv $DST_TEMPLATE
$((${__line_counter}+1)) $((${__line_counter} + $BLOCKSIZE)))
echo WRITING: $TARGET
#
TARGET=${DST_TEMPLATE}_$((${__line_counter}+1))-$((${__line_counter} +
$BLOCKSIZE)).csv
fi
echo $line $TARGET
__line_counter=$(($__line_counter + 1))
done
*Upload the file to DataStore*
*
*
*Next we upload the file to our application data store.*
*Note: This is not a stable process: Google sometimes will return
JavaException errors, the script can hang or it's possible that your request
will timeout. Therefor it's important to continue rerunning this command
until all files are moved from /**home/maxim/Downloads/GeoIPCountryWhois_SPLIT
to home/maxim/Downloads/GeoIPCountryWhois_SPLIT/processed*
*
*
*The actual command to execute is:*
*
*
for split in $(find /home/maxim/Downloads/GeoIPCountryWhois_SPLIT/ -maxdepth
1 -name 'SPLIT*' -type f); do
echo WORKING ON $split
appcfg.py upload_data \
--num_threads=30 --batch_size=100 --bandwidth_limit=500
--rps_limit=50 --http_limit=1000 \
--config_file=/home/maxim/workspace/FooBar-Python/bulkloader.yaml \
--kind=GeoIPCountryZone \
--filename=$split --url=http://FooBar-staging.appspot.com/remote_api mv
$split /home/maxim/Downloads/GeoIPCountryWhois_SPLIT/processed;
done
The yaml we are using for the bulkuploader looks like this:
$ cat /home/maxim/workspace/FooBar-Python/bulkloader.yaml
python_preamble:
- import: google.appengine.ext.bulkload.transform
- import: google.appengine.ext.db
- import: re
- import: base64
transformers:
- kind: GeoIPCountryZone
connector: csv
connector_options:
column_list: [ip_range_start, ip_range_end, ip_range_n_start,
ip_range_n_end, country_code, country_name]
property_map:
- property: __key__
import_template: %(ip_range_start)s-%(ip_range_end)s
- property: ip_range_start
external_name: ip_range_start
- property: ip_range_end
external_name: ip_range_end
- property: ip_range_n_start
external_name: ip_range_n_start
import_transform: long
- property: ip_range_n_end
external_name: ip_range_n_end
import_transform: long
- property: country_code
external_name: country_code
- property: country_name
external_name: country_name
-- Forwarded message --
From: Maxim Veksler ma...@vekslers.org
Date: Wed, Sep 1, 2010 at 5:46 PM
Subject: Re: Loading MaxMind GeoIP Country database
Also forgot to mention,
A little hack to keep the sdk for asking you for username password on each
call to appcfg
ma...@maxim-desktop:/tmp/appengine-python-sdk-1.3.7$ diff -Naur -x '*.pyc'
google_appengine/ /home/maxim/Desktop/sdk/appengine-python-sdk-1.3.7/
diff -Naur -x '*.pyc' google_appengine/google/appengine/tools/bulkloader.py
/home/maxim/Desktop/sdk/appengine-python-sdk-1.3.7/google/appengine/tools/bulkloader.py
---
Re: [appengine-java] How can i allow user to download a zip file?
Hi, Have you looked at Java's ZipOutputStream? http://download.oracle.com/javase/1.4.2/docs/api/java/util/zip/ZipOutputStream.html Since you can't create files on the file system, I suspect the approach of streaming the zip through a ZipOutputStream would be the most plausible one. That and you set a content-disposition header of myfilename.zip. And I hope it'll work :-) Guillaume PS: I've never tried that, but that's what I'd investigate first. On Wed, Sep 15, 2010 at 03:19, Bit Liner bitli...@gmail.com wrote: My app creates dinamically two files so that then the users can download these files in one zip file. But i have problem in implementing this operations. Some suggestion to help me? Library, if gae supports this operations, etc. (i have tried to use gaeVfs, but i have met problems: i cannot write the content of a file on the response, so i can download the file but its content is empty ) -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- Guillaume Laforge Groovy Project Manager Head of Groovy Development at SpringSource http://www.springsource.com/g2one -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Delete indexes for application
run appcfg.py vacuum_indexes as described in http://code.google.com/appengine/docs/python/datastore/queriesandindexes.html#Big_Entities_and_Exploding_Indexes On Tue, Sep 14, 2010 at 11:43 AM, Barada Sahu bar...@gmail.com wrote: Hi, I need to delete the indexes for my java app as the column name has changed. I am now unable to perform any entity deletions because of the existing entries in the index table. Would it be possible to somehow delete all the indexes for my app? Regards Barada Sahu -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] What is the scope for NamespaceManager?
Why not just do this with a servlet filter? It's very cheap to do and isnt't
computationally expensive - it's not like you're reestablishing an expensive
connection or anything.
On Wed, Sep 15, 2010 at 12:08 PM, Vikas Hazrati vhazr...@gmail.com wrote:
We are building a multi-tenant application and want to use the
NamespaceManager to distinguish between tenants on the basis of server-
name. So for example inphina.bookmyhours.com would be a different
tenant than te-con.bookmyhours.com
we are currently using NamespaceFilter with code similar to
if (NamespaceManager.get() == null) {
switch (strategy) {
case SERVER_NAME: {
logger.info(The namespace for the request
is: +
request.getServerName());
NamespaceManager.set(request.getServerName());
if(seedDataSetup.setSeedData()) {
adminAccountValidator.updateAdminPassword();
}
break;
}
What we observed is that we always fall into the condition of
NamespaceManager.get() == null and hence the code has to set
NamespaceManager.set(request.getServerName()); again. Is it possible
to retain this setting at a session level. For all our users logging
in from inphina.bookmyhours.com, they would remain to be within the
same tenant.
From the current implementation, it looks like the NamespaceManager
has a request scope. Comments/Suggestions?
Regards | Vikas
www.inphina.com
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to
google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Getting email address of user from Google Account ID
No. Save the email if you need it, but be aware that it may change. On Wed, Sep 15, 2010 at 3:04 PM, mscwd01 mscw...@gmail.com wrote: Hey, For the primary key of my User object, I store the Google Account ID instead of the user's email address (in the event they change the email address). Is there a way of taking the Account ID and obtaining the current email address associated with the account? Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] What is the scope for NamespaceManager?
Out of curiosity, the namespace info is stored in a thread-local?
So I can have two concurrent requests (from, say, two different customers)
using a different namespace?
The fact of doing NamespaceManager.set() with a static method is quite
frightening as it could be thought of as being done globally to the whole
application.
But I suspect this is not the case, hopefully :-)
Guillaume
On Wed, Sep 15, 2010 at 23:14, Ikai Lan (Google)
ikai.l+gro...@google.comikai.l%2bgro...@google.com
wrote:
Why not just do this with a servlet filter? It's very cheap to do and
isnt't computationally expensive - it's not like you're reestablishing an
expensive connection or anything.
On Wed, Sep 15, 2010 at 12:08 PM, Vikas Hazrati vhazr...@gmail.comwrote:
We are building a multi-tenant application and want to use the
NamespaceManager to distinguish between tenants on the basis of server-
name. So for example inphina.bookmyhours.com would be a different
tenant than te-con.bookmyhours.com
we are currently using NamespaceFilter with code similar to
if (NamespaceManager.get() == null) {
switch (strategy) {
case SERVER_NAME: {
logger.info(The namespace for the request
is: +
request.getServerName());
NamespaceManager.set(request.getServerName());
if(seedDataSetup.setSeedData()) {
adminAccountValidator.updateAdminPassword();
}
break;
}
What we observed is that we always fall into the condition of
NamespaceManager.get() == null and hence the code has to set
NamespaceManager.set(request.getServerName()); again. Is it possible
to retain this setting at a session level. For all our users logging
in from inphina.bookmyhours.com, they would remain to be within the
same tenant.
From the current implementation, it looks like the NamespaceManager
has a request scope. Comments/Suggestions?
Regards | Vikas
www.inphina.com
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to
google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to
google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
Guillaume Laforge
Groovy Project Manager
Head of Groovy Development at SpringSource
http://www.springsource.com/g2one
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Storing values with GAE LowLevel Api ( com.google.appengine.api.datastore)
Slim3 does this, I believe. It creates Meta classes from POJOs that you can edit: http://sites.google.com/site/slim3appengine/ On Tue, Sep 14, 2010 at 7:37 PM, Gervais.b gervai...@gmail.com wrote: Hi everyone, I have an app who actually work with a dao layer. This layer as actually only one Hibernate implementation. I want to make this app available on Google App Engine. But I don't want to annotate all my data classes. So I have tried to write a default Dao who use the Google LowLevel api and the Sun|Oracle Reflexion api to convert my data classes to entities . He is doing what I want but fail when a data class contains other data classes. I have tried to convert the sub data class to an entity and persist but now my dao fail when a property is an Integer because the LowLevel api return a Long. Is there an existing DefaultLowLevelDao or something like that or a may to easilly convert the entity property type to the expected one ? Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] What is the scope for NamespaceManager?
Yes, it should be thread local. That'd be a pretty bad design flaw if it
wasn't! The reason you may have thought it wasn't is because the Python
implementation isn't - but that's a non issue since Python app servers are
single threaded in production.
On Wed, Sep 15, 2010 at 9:24 PM, Guillaume Laforge glafo...@gmail.comwrote:
Out of curiosity, the namespace info is stored in a thread-local?
So I can have two concurrent requests (from, say, two different customers)
using a different namespace?
The fact of doing NamespaceManager.set() with a static method is quite
frightening as it could be thought of as being done globally to the whole
application.
But I suspect this is not the case, hopefully :-)
Guillaume
On Wed, Sep 15, 2010 at 23:14, Ikai Lan (Google)
ikai.l+gro...@google.comikai.l%2bgro...@google.com
wrote:
Why not just do this with a servlet filter? It's very cheap to do and
isnt't computationally expensive - it's not like you're reestablishing an
expensive connection or anything.
On Wed, Sep 15, 2010 at 12:08 PM, Vikas Hazrati vhazr...@gmail.comwrote:
We are building a multi-tenant application and want to use the
NamespaceManager to distinguish between tenants on the basis of server-
name. So for example inphina.bookmyhours.com would be a different
tenant than te-con.bookmyhours.com
we are currently using NamespaceFilter with code similar to
if (NamespaceManager.get() == null) {
switch (strategy) {
case SERVER_NAME: {
logger.info(The namespace for the
request is: +
request.getServerName());
NamespaceManager.set(request.getServerName());
if(seedDataSetup.setSeedData()) {
adminAccountValidator.updateAdminPassword();
}
break;
}
What we observed is that we always fall into the condition of
NamespaceManager.get() == null and hence the code has to set
NamespaceManager.set(request.getServerName()); again. Is it possible
to retain this setting at a session level. For all our users logging
in from inphina.bookmyhours.com, they would remain to be within the
same tenant.
From the current implementation, it looks like the NamespaceManager
has a request scope. Comments/Suggestions?
Regards | Vikas
www.inphina.com
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to
google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to
google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
Guillaume Laforge
Groovy Project Manager
Head of Groovy Development at SpringSource
http://www.springsource.com/g2one
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to
google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] What is the scope for NamespaceManager?
Yeah, that would have been a design flaw, definitely :-)
The fear I had was when seeing a static methods being used. I'm always
afraid when I see 'static' somewhere.
For Gaelyk (http://gaelyk.appspot.com/tutorial#namespace), I've added a
method to wrap the usage of a namespace under a certain scope.
An example is better than my crappy explanation, what I meant is this:
// temporarily set a new namespace
namespace.of(customerA) {
// use whatever service leveraging the namespace support
// like the datastore or memcache
}
// once the closure is executed, the old namespace is restored
That way, I can deal with setting a temporary namespace for a customer, for
a limited scope (like admin data could be in their own namespace, etc).
But of course, the approach of using filters is great for various scenarios,
and it's transparent for the servlets down the filter chain.
Anyhow, thanks a lot for lifting the doubt about the thread-local usage :-)
Guillaume
On Wed, Sep 15, 2010 at 23:48, Ikai Lan (Google)
ikai.l+gro...@google.comikai.l%2bgro...@google.com
wrote:
Yes, it should be thread local. That'd be a pretty bad design flaw if it
wasn't! The reason you may have thought it wasn't is because the Python
implementation isn't - but that's a non issue since Python app servers are
single threaded in production.
On Wed, Sep 15, 2010 at 9:24 PM, Guillaume Laforge glafo...@gmail.comwrote:
Out of curiosity, the namespace info is stored in a thread-local?
So I can have two concurrent requests (from, say, two different customers)
using a different namespace?
The fact of doing NamespaceManager.set() with a static method is quite
frightening as it could be thought of as being done globally to the whole
application.
But I suspect this is not the case, hopefully :-)
Guillaume
On Wed, Sep 15, 2010 at 23:14, Ikai Lan (Google)
ikai.l+gro...@google.com ikai.l%2bgro...@google.com wrote:
Why not just do this with a servlet filter? It's very cheap to do and
isnt't computationally expensive - it's not like you're reestablishing an
expensive connection or anything.
On Wed, Sep 15, 2010 at 12:08 PM, Vikas Hazrati vhazr...@gmail.comwrote:
We are building a multi-tenant application and want to use the
NamespaceManager to distinguish between tenants on the basis of server-
name. So for example inphina.bookmyhours.com would be a different
tenant than te-con.bookmyhours.com
we are currently using NamespaceFilter with code similar to
if (NamespaceManager.get() == null) {
switch (strategy) {
case SERVER_NAME: {
logger.info(The namespace for the
request is: +
request.getServerName());
NamespaceManager.set(request.getServerName());
if(seedDataSetup.setSeedData()) {
adminAccountValidator.updateAdminPassword();
}
break;
}
What we observed is that we always fall into the condition of
NamespaceManager.get() == null and hence the code has to set
NamespaceManager.set(request.getServerName()); again. Is it possible
to retain this setting at a session level. For all our users logging
in from inphina.bookmyhours.com, they would remain to be within the
same tenant.
From the current implementation, it looks like the NamespaceManager
has a request scope. Comments/Suggestions?
Regards | Vikas
www.inphina.com
--
You received this message because you are subscribed to the Google
Groups Google App Engine for Java group.
To post to this group, send email to
google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to
google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
Guillaume Laforge
Groovy Project Manager
Head of Groovy Development at SpringSource
http://www.springsource.com/g2one
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to
google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
You received this message because
Re: [appengine-java] What is the scope for NamespaceManager?
To provide a bit more detail, NamespaceManager.set() mutates the
current ApiProxy environment, which is scoped to a single request and
is stored in a thread-local.
On Wed, Sep 15, 2010 at 4:54 PM, Guillaume Laforge glafo...@gmail.com wrote:
Yeah, that would have been a design flaw, definitely :-)
The fear I had was when seeing a static methods being used. I'm always
afraid when I see 'static' somewhere.
For Gaelyk (http://gaelyk.appspot.com/tutorial#namespace), I've added a
method to wrap the usage of a namespace under a certain scope.
An example is better than my crappy explanation, what I meant is this:
// temporarily set a new namespace
namespace.of(customerA) {
// use whatever service leveraging the namespace support
// like the datastore or memcache
}
// once the closure is executed, the old namespace is restored
That way, I can deal with setting a temporary namespace for a customer, for
a limited scope (like admin data could be in their own namespace, etc).
But of course, the approach of using filters is great for various scenarios,
and it's transparent for the servlets down the filter chain.
Anyhow, thanks a lot for lifting the doubt about the thread-local usage :-)
Guillaume
On Wed, Sep 15, 2010 at 23:48, Ikai Lan (Google) ikai.l+gro...@google.com
wrote:
Yes, it should be thread local. That'd be a pretty bad design flaw if it
wasn't! The reason you may have thought it wasn't is because the Python
implementation isn't - but that's a non issue since Python app servers are
single threaded in production.
On Wed, Sep 15, 2010 at 9:24 PM, Guillaume Laforge glafo...@gmail.com
wrote:
Out of curiosity, the namespace info is stored in a thread-local?
So I can have two concurrent requests (from, say, two different
customers) using a different namespace?
The fact of doing NamespaceManager.set() with a static method is quite
frightening as it could be thought of as being done globally to the whole
application.
But I suspect this is not the case, hopefully :-)
Guillaume
On Wed, Sep 15, 2010 at 23:14, Ikai Lan (Google)
ikai.l+gro...@google.com wrote:
Why not just do this with a servlet filter? It's very cheap to do and
isnt't computationally expensive - it's not like you're reestablishing an
expensive connection or anything.
On Wed, Sep 15, 2010 at 12:08 PM, Vikas Hazrati vhazr...@gmail.com
wrote:
We are building a multi-tenant application and want to use the
NamespaceManager to distinguish between tenants on the basis of server-
name. So for example inphina.bookmyhours.com would be a different
tenant than te-con.bookmyhours.com
we are currently using NamespaceFilter with code similar to
if (NamespaceManager.get() == null) {
switch (strategy) {
case SERVER_NAME: {
logger.info(The namespace for the
request is: +
request.getServerName());
NamespaceManager.set(request.getServerName());
if(seedDataSetup.setSeedData()) {
adminAccountValidator.updateAdminPassword();
}
break;
}
What we observed is that we always fall into the condition of
NamespaceManager.get() == null and hence the code has to set
NamespaceManager.set(request.getServerName()); again. Is it possible
to retain this setting at a session level. For all our users logging
in from inphina.bookmyhours.com, they would remain to be within the
same tenant.
From the current implementation, it looks like the NamespaceManager
has a request scope. Comments/Suggestions?
Regards | Vikas
www.inphina.com
--
You received this message because you are subscribed to the Google
Groups Google App Engine for Java group.
To post to this group, send email to
google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
You received this message because you are subscribed to the Google
Groups Google App Engine for Java group.
To post to this group, send email to
google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
Guillaume Laforge
Groovy Project Manager
Head of Groovy Development at SpringSource
http://www.springsource.com/g2one
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to
google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
[appengine-java] URL Fetch is not working for HTTP.PUT
Hi There is a problem with URLConnection Apps engine API. It's always going for URL Fetch using GET. And POST/PUT method requests are going to GET itself. Please let me know how to fix this. -raghu -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Does AppEngine recycle threads (Is using ThreadLocal considered good practice on the GAE?)
Hi Maxim, Multi-threading is not the way to go under GAEJ, see http://code.google.com/appengine/docs/java/runtime.html#The_Sandbox The right way to go is Tasks: http://code.google.com/appengine/docs/java/taskqueue/overview.html regards didier On Sep 15, 2:00 pm, Maxim Veksler ma...@vekslers.org wrote: Hello, I'm wondering (after some internal discussion we had) is using ThreadLocal for applications running on the AppEngine is performance beneficial ? For this to work AppEngine should recycle threads, right? Another question is how many threads does the appengine allows per JVM ? Such ThreadLocal based approach would (probably) be inefficient if the JVM allowed 2 threads. Help is appreciated. Maxim. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Define entity groups on selected operations in unowned relationships
Hi, 1. Is it always necessary to define an entity group in order to use transactions for multiple entities? If so, then is it possible to define entity groups specific to the operation on the entities? i.e have define entity group for update but not delete? e.g. update of a parent's properties need not require any update of the child (in a one- many unowned relationship) whereas deleting a parent cascaded to all its children. As per documentation at : http://code.google.com/appengine/docs/java/datastore/relationships.html#Unowned_Relationships Second, all objects must belong to the same entity group in order to perform an atomic update of objects on both sides of the relationship. 2. For defining entity groups it is also mandated that we need to model the key field as a : Key or an encoded String as a Key. However we can model the key fields of unowned relationships as Long/numeric. If we use numeric keys for unowned relationships, then does it mean that we cannot use transactions for the same. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[google-appengine] Re: Do we have an ETA for the resolution of ongoing performance issues.
Hi Ikai I have been watching that, but it hadn't been updated for a very long time. (It has now though) There just seemed to be deathly silence for over 4 hours ;-) T On Sep 15, 12:17 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hi Tim, You can track the progress here: http://groups.google.com/group/google-appengine-downtime-notify/brows... It's pretty hard to give an ETA, but we'd like to resolve this as soon as possible. We're seeing signs that the issues may have subsided, but we'd like a bit more confidence before giving the all clear. On Tue, Sep 14, 2010 at 6:49 PM, Tim Hoffman zutes...@gmail.com wrote: Hi http://groups.google.com.au/group/google-appengine-downtime-notify/br... was posted several hours ago, with no updates. I certainly am experiencing significant ongoing issues with taskqueues and datastore timeouts and half the time can't get to the dashboard. I know someone must be working hard on this, but a little more detail on progress, ie ETA to recovery would be really great Thanks Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Want better GAE downtime tracking / visibility??
Star this: http://code.google.com/p/googleappengine/issues/detail?id=3725 Like many of you, we rely on the GAE, as do our customers. We feel that the GAE has an excellent overall uptime, and are in awe of the people who made GAE happen and keep it running on a daily basis. Some downtime is inevitable, and it's not important to us that GAE experiences occasional downtime. What's important is how it is handled, and the communications around this (we feel) could use improvement. The feature request asks that Google provide regular and structured updates on outage handling. By clicking on and starring the issue we can help Google quantify the demand for this sort of process, and make it easier to prioritize. So, if you want to see better tracking of downtime issues: open the link above, and click on the little star next to the Issue: 3725 header title. J -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Annoyed with GAE System Status: Investigation Complete - Issue Resolved?
Star this: http://code.google.com/p/googleappengine/issues/detail?id=3726 The App Engine System Status frequently shows the following message: --- Investigation Complete - Issue Resolved We have determined that this spike did not affect the performance or uptime of applications. If you feel we have incorrectly diagnosed this issue please inform us by posting in our developer forum. --- We appreciate that this accurately conveys the diagnostics output on the back end, and that the tools that generate these are (presumably) largely automated, but the wording of this message really needs to be improved. The text is simply not appropriate at times when the key metric indicators are going red and apps are failing. The feature request asks that Google change the wording of this message. By clicking on and starring the issue we can help Google quantify the our collective frustration with this, and make it easier to prioritize. (There is a larger issue here relating to what triggers this message in the first place, and if it is appropriate to display this when the indicators are going red and apps are failing...) J -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Want better GAE downtime tracking / visibility??
HI I couldn't agree more. Absolutely the single biggest issue I see with app engine is not feature set, performance or availability but the lack of communication when things go wrong, and if you are in a appengine dead-zone trying to get any form acknowledgement that there is a problem. I have lost count of the number of posts I have made along these lines. (as you will see about half way down this thread http://groups.google.com.au/group/google-appengine/browse_thread/thread/ff1a8d0051b0bc64/d78e8ca4482c5ab2?q=#d78e8ca4482c5ab2 and http://groups.google.com.au/group/google-appengine/browse_thread/thread/23e988d494144242/8ff964f7ffcc0b37?q=#8ff964f7ffcc0b37) Once it took over a week to get any form of acknowledgement. And just for the record, I think appengine is great! (I have starred this one) T On Sep 15, 2:16 pm, Jan Z/ Hapara jan.zawad...@gmail.com wrote: Star this:http://code.google.com/p/googleappengine/issues/detail?id=3725 Like many of you, we rely on the GAE, as do our customers. We feel that the GAE has an excellent overall uptime, and are in awe of the people who made GAE happen and keep it running on a daily basis. Some downtime is inevitable, and it's not important to us that GAE experiences occasional downtime. What's important is how it is handled, and the communications around this (we feel) could use improvement. The feature request asks that Google provide regular and structured updates on outage handling. By clicking on and starring the issue we can help Google quantify the demand for this sort of process, and make it easier to prioritize. So, if you want to see better tracking of downtime issues: open the link above, and click on the little star next to the Issue: 3725 header title. J -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Do we have an ETA for the resolution of ongoing performance issues.
Ditto, I have seen an unusual higt number of timeout the last 24 hours. Usually i see 2-4 a da - i think I'm past 40 by now. /Tonny On Sep 15, 7:29 am, Raymond C. windz...@gmail.com wrote: As of 10:01pm (PDT, log msg time), my app is still generating a lot of deadline exceeded error. It happens like every 30min (not able to backtrace too far since the log viewer is broken for me after paging) and when it happens, all db put requests in that minute or two prompt the error. On Sep 15, 12:17 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hi Tim, You can track the progress here: http://groups.google.com/group/google-appengine-downtime-notify/brows... It's pretty hard to give an ETA, but we'd like to resolve this as soon as possible. We're seeing signs that the issues may have subsided, but we'd like a bit more confidence before giving the all clear. On Tue, Sep 14, 2010 at 6:49 PM, Tim Hoffman zutes...@gmail.com wrote: Hi http://groups.google.com.au/group/google-appengine-downtime-notify/br... was posted several hours ago, with no updates. I certainly am experiencing significant ongoing issues with taskqueues and datastore timeouts and half the time can't get to the dashboard. I know someone must be working hard on this, but a little more detail on progress, ie ETA to recovery would be really great Thanks Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] GAE downtime email marked as spam by gmail
Does anyone else get the downtime emails marked as spam pretty much always? The first one yesterday got through fine but the second got caught as a phishing email. http://imgur.com/HMrRL.png -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Do we have an ETA for the resolution of ongoing performance issues.
This is still ongoing this morning. Come on Google, App Engine has been impaired now for 24 hours. This is really really shocking. Take the whole thing down for an hour if you have to, just please please stop with this limping along throwing random errors thing. Thanks. On Sep 15, 8:37 am, Tonny 12br...@gmail.com wrote: Ditto, I have seen an unusual higt number of timeout the last 24 hours. Usually i see 2-4 a da - i think I'm past 40 by now. /Tonny On Sep 15, 7:29 am, Raymond C. windz...@gmail.com wrote: As of 10:01pm (PDT, log msg time), my app is still generating a lot of deadline exceeded error. It happens like every 30min (not able to backtrace too far since the log viewer is broken for me after paging) and when it happens, all db put requests in that minute or two prompt the error. On Sep 15, 12:17 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hi Tim, You can track the progress here: http://groups.google.com/group/google-appengine-downtime-notify/brows... It's pretty hard to give an ETA, but we'd like to resolve this as soon as possible. We're seeing signs that the issues may have subsided, but we'd like a bit more confidence before giving the all clear. On Tue, Sep 14, 2010 at 6:49 PM, Tim Hoffman zutes...@gmail.com wrote: Hi http://groups.google.com.au/group/google-appengine-downtime-notify/br... was posted several hours ago, with no updates. I certainly am experiencing significant ongoing issues with taskqueues and datastore timeouts and half the time can't get to the dashboard. I know someone must be working hard on this, but a little more detail on progress, ie ETA to recovery would be really great Thanks Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: GAE downtime email marked as spam by gmail
same here On Sep 15, 3:41 pm, Kenneth goo...@kmacleod.ie wrote: Does anyone else get the downtime emails marked as spam pretty much always? The first one yesterday got through fine but the second got caught as a phishing email. http://imgur.com/HMrRL.png -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Increased CPU Time/Request after yesterdays maintenance?
Still not solved? We're still getting quiet a lot 500s. app id: radiodeck On Sep 15, 2:22 am, Ikai Lan (Google) ikai.l+gro...@google.com wrote: There's a thread we'll be updating: http://groups.google.com/group/google-appengine-downtime-notify/brows... On Tue, Sep 14, 2010 at 5:05 PM, David s2kd...@gmail.com wrote: I am getting a large percentage of errors in my app yesterday and today too. (appid: word-play) I wasn't getting any of the throttling errors before that. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Do we have an ETA for the resolution of ongoing performance issues.
I agree ... I am seeing all sorts of errors that are due to timouts, and I also have problems accessing the dashboard. It has been unstable for over 24 hours now (since the datastore maintenance?) -Alex On Sep 15, 10:16 am, Kenneth goo...@kmacleod.ie wrote: This is still ongoing this morning. Come on Google, App Engine has been impaired now for 24 hours. This is really really shocking. Take the whole thing down for an hour if you have to, just please please stop with this limping along throwing random errors thing. Thanks. On Sep 15, 8:37 am, Tonny 12br...@gmail.com wrote: Ditto, I have seen an unusual higt number of timeout the last 24 hours. Usually i see 2-4 a da - i think I'm past 40 by now. /Tonny On Sep 15, 7:29 am, Raymond C. windz...@gmail.com wrote: As of 10:01pm (PDT, log msg time), my app is still generating a lot of deadline exceeded error. It happens like every 30min (not able to backtrace too far since the log viewer is broken for me after paging) and when it happens, all db put requests in that minute or two prompt the error. On Sep 15, 12:17 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hi Tim, You can track the progress here: http://groups.google.com/group/google-appengine-downtime-notify/brows... It's pretty hard to give an ETA, but we'd like to resolve this as soon as possible. We're seeing signs that the issues may have subsided, but we'd like a bit more confidence before giving the all clear. On Tue, Sep 14, 2010 at 6:49 PM, Tim Hoffman zutes...@gmail.com wrote: Hi http://groups.google.com.au/group/google-appengine-downtime-notify/br... was posted several hours ago, with no updates. I certainly am experiencing significant ongoing issues with taskqueues and datastore timeouts and half the time can't get to the dashboard. I know someone must be working hard on this, but a little more detail on progress, ie ETA to recovery would be really great Thanks Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Do we have an ETA for the resolution of ongoing performance issues.
We're still getting a lot of 500s (dashboard front end). Did you transferred our apps to lower-cost servers or why is everything working that bad since the maintenance? When are the REAL paid services coming? On Sep 15, 6:17 am, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hi Tim, You can track the progress here: http://groups.google.com/group/google-appengine-downtime-notify/brows... It's pretty hard to give an ETA, but we'd like to resolve this as soon as possible. We're seeing signs that the issues may have subsided, but we'd like a bit more confidence before giving the all clear. On Tue, Sep 14, 2010 at 6:49 PM, Tim Hoffman zutes...@gmail.com wrote: Hi http://groups.google.com.au/group/google-appengine-downtime-notify/br... was posted several hours ago, with no updates. I certainly am experiencing significant ongoing issues with taskqueues and datastore timeouts and half the time can't get to the dashboard. I know someone must be working hard on this, but a little more detail on progress, ie ETA to recovery would be really great Thanks Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: No more this request caused a new process to be started in the logs
Yep, you're right, they are still there. I can see them again. On Sep 14, 9:22 pm, Geoffrey Spear geoffsp...@gmail.com wrote: On Sep 14, 3:14 pm, Francois Masurel fm2...@mably.com wrote: this request caused a new process to be started messages seem to have disappeared from my application logs. But request durations indicate clearly that GAE is still starting new processes from time to time. Francois; I have a log with that message from as recently as 3 minutes ago, so they haven't gone away. Maybe you're just getting lucky with hot instances staying around? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Please Stop Throttling my App!
Hi, We don't throttle apps. If your average latency is over 700 milliseconds for user-facing requests, we may not schedule additional servers for your app, however. What leads you to conclude that your app is being throttled? -Nick Johnson On Tue, Sep 14, 2010 at 9:47 PM, Coding Social codingsoc...@gmail.comwrote: Hi, I have had appid mapthislink for many months now. Recently my extensions that use this web service to unwind urls have been featured by Google Chrome and Apple Safari so usage is up substantially. Can someone turn off the throttle? Causing latency and 13% error rate. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Stringified Key format: which characters?
Hi Franceso, Entity keys use URLsafe base64 encoding, which uses - and _ in place of + and /. -Nick Johnson On Tue, Sep 14, 2010 at 2:34 PM, Francesco Donadon nonn...@gmail.comwrote: Hello. I am developing an application using django, and I need a regexp to match the stringified keys in an URL, so that I can use urls like / view/key. I started off using letters and digits, but then I realised searching in this group that the key in its string format is actually a base64 encoding of something. I saw that one of the two symbols used by the google implementation of base64 is the hyphen (-), but I have not been able to experimentally find the other symbol (there must be another one), nor find an answer searching. For now I am capturing all the other symbols that I've read on wikipedia, that is plus (+), underscore (_) and dot(.). I assume that the slash is out of discussion, as Google recommends using keys in URLs. So my question is, as I am a perfectionist :-), which is the other symbol that may appear in the keys beside the hyphen? Thank you very much for your replies, and for the marvellous job in creating AppEngine. Best Regards, Francesco Donadon -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Please Stop Throttling my App!
not for nothing, but isn't we may not schedule additional servers for your app throttling? when did 700ms become a magic number? On Sep 15, 9:33 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi, We don't throttle apps. If your average latency is over 700 milliseconds for user-facing requests, we may not schedule additional servers for your app, however. What leads you to conclude that your app is being throttled? -Nick Johnson On Tue, Sep 14, 2010 at 9:47 PM, Coding Social codingsoc...@gmail.comwrote: Hi, I have had appid mapthislink for many months now. Recently my extensions that use this web service to unwind urls have been featured by Google Chrome and Apple Safari so usage is up substantially. Can someone turn off the throttle? Causing latency and 13% error rate. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: GAE downtime email marked as spam by gmail
Happens randomly to me too. Yesterday first announcement was spam, subsequent update not. Emails are marked as spam or phishing about 20% of times. Regards Lorenzo On Sep 15, 11:46 am, Raymond C. windz...@gmail.com wrote: same here On Sep 15, 3:41 pm, Kenneth goo...@kmacleod.ie wrote: Does anyone else get the downtime emails marked as spam pretty much always? The first one yesterday got through fine but the second got caught as a phishing email. http://imgur.com/HMrRL.png -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: GAE downtime email marked as spam by gmail
BTW I checked, and looks like messages are marked as spam only if coming by the address appengine.notificati...@google.com In my inbox at least...appengine.noreply seems to go to inbox correctly. On Sep 15, 4:38 pm, l.denardo lorenzo.dena...@gmail.com wrote: Happens randomly to me too. Yesterday first announcement was spam, subsequent update not. Emails are marked as spam or phishing about 20% of times. Regards Lorenzo On Sep 15, 11:46 am, Raymond C. windz...@gmail.com wrote: same here On Sep 15, 3:41 pm, Kenneth goo...@kmacleod.ie wrote: Does anyone else get the downtime emails marked as spam pretty much always? The first one yesterday got through fine but the second got caught as a phishing email. http://imgur.com/HMrRL.png -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Bad Owner List (400)
up! 2010/9/11 w...@lezizi.org w...@lezizi.org I deleted my Google account and created it again. But I can not log on to Google APP Engine . It says: Bad Owner List (400) The owner list is invalid. How can I deal with it? Or how can I delete the application? Thanks! My App ID: lezizistudio -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: High-Performance Image Serving Cache-Control
Thanks Peter, you are correct. When I deployed my app the my images were set to cache for 1 day. On Sep 14, 7:14 pm, Peter Liu tinyee...@gmail.com wrote: You have to test it production. The headers on dev on all requests are very different than in live. I believe all the images from the live image server has a 1 day cache expiration. On Sep 14, 4:25 pm, Joseph Letness joe.letn...@gmail.com wrote: Hi everybody, I would like to allow browser caching of images served from get_serving_url(). I've had success using get_serving_url() for generating images and thumbnails but the Cache-Control is set to no- cache and the expiration dates are in the past (I've only implemented this functionality on the development server, I have not tried to deploy yet). Is there any way of setting the Cache-Control? I can't seem to find any info in the documentation or with a general search, other than a reference to High-Performance Image Serving: It also handles setting proper Cache-Control headers so you don't have to worry about that. I'm using django (appenginepatch). Thanks, in advance! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 500 error trying to reach dashboard
Yep, same problem here. On Sep 15, 12:50 pm, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 500 error trying to reach dashboard
glad to see this post and know it's not me - i did an update to my app today and now i can't access the dashboard navigating to : https://appengine.google.com/ gives me Error: Server Error On Sep 15, 6:50 am, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 500 error trying to reach dashboard
same here and most (not all) GAE requests over multiple apps seem really slow On Sep 15, 11:25 am, Francois Masurel fm2...@mably.com wrote: Yep, same problem here. On Sep 15, 12:50 pm, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] 500 server errors
still getting a 500 server error trying to get to the dashboard https://appengine.google.com/dashboard?app_id=nimbits1 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 500 error trying to reach dashboard
Some problem for our apps. Please help as our customers are already complaining... On Sep 15, 5:48 pm, bFlood bflood...@gmail.com wrote: same here and most (not all) GAE requests over multiple apps seem really slow On Sep 15, 11:25 am, Francois Masurel fm2...@mably.com wrote: Yep, same problem here. On Sep 15, 12:50 pm, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 500 error trying to reach dashboard
same here On Sep 15, 12:00 pm, dflorey daniel.flo...@gmail.com wrote: Some problem for our apps. Please help as our customers are already complaining... On Sep 15, 5:48 pm, bFlood bflood...@gmail.com wrote: same here and most (not all) GAE requests over multiple apps seem really slow On Sep 15, 11:25 am, Francois Masurel fm2...@mably.com wrote: Yep, same problem here. On Sep 15, 12:50 pm, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 500 error trying to reach dashboard
issues here too. On Sep 15, 5:02 pm, Daniel danielshaneup...@gmail.com wrote: same here On Sep 15, 12:00 pm, dflorey daniel.flo...@gmail.com wrote: Some problem for our apps. Please help as our customers are already complaining... On Sep 15, 5:48 pm, bFlood bflood...@gmail.com wrote: same here and most (not all) GAE requests over multiple apps seem really slow On Sep 15, 11:25 am, Francois Masurel fm2...@mably.com wrote: Yep, same problem here. On Sep 15, 12:50 pm, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Please Stop Throttling my App!
Interesting - earlier they said the magic number was 1000... On Sep 15, 7:18 am, bFlood bflood...@gmail.com wrote: not for nothing, but isn't we may not schedule additional servers for your app throttling? when did 700ms become a magic number? On Sep 15, 9:33 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi, We don't throttle apps. If your average latency is over 700 milliseconds for user-facing requests, we may not schedule additional servers for your app, however. What leads you to conclude that your app is being throttled? -Nick Johnson On Tue, Sep 14, 2010 at 9:47 PM, Coding Social codingsoc...@gmail.comwrote: Hi, I have had appid mapthislink for many months now. Recently my extensions that use this web service to unwind urls have been featured by Google Chrome and Apple Safari so usage is up substantially. Can someone turn off the throttle? Causing latency and 13% error rate. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Do we have an ETA for the resolution of ongoing performance issues.
Hi Ikai - Just to be clear the issues have NOT subsided since last night. I hope you guys are working on eliminating the root of the problem and not just monitoring the service closely as the latest App Engine Notify post suggests. http://groups.google.com/group/google-appengine-downtime-notify/browse_thread/thread/9cf3b0cafdd6c235 And even though the status page says this spike did not affect the performance or uptime of applications - every spike DOES in fact affect the performance of applications (mine at least - GQueues, but probably all apps). These red spikes make my app inaccessible. Even the yellow spikes cause many 500 errors. Basically this makes my app unusable, because users can't get any consistent work done with the frequent errors. http://code.google.com/status/appengine/detail/datastore/2010/09/15#ae-trust-detail-datastore-get-latency Most of all, the frequent errors make my app seem very brittle and deteriorates user confidence. Sales drop and my own forum gets lots of complaints. And then of course people start posting on Twitter. Anyway, I'm sure you guys are working very hard to fix the issues and want App Engine to be as reliable as possible. My suggestion is that you also look to improve communication during these times. I have to respond to my own users during these situations. This becomes very difficult when all I can tell them is Google thinks the issue is resolved and is just monitoring the situation when clearly the status graphs indicate otherwise and people can't access my app. Or Google says the issue didn't affect performance or uptime when clearly it has. -Cameron On Sep 15, 6:13 am, Arny arny...@googlemail.com wrote: We're still getting a lot of 500s (dashboard front end). Did you transferred our apps to lower-cost servers or why is everything working that bad since the maintenance? When are the REAL paid services coming? On Sep 15, 6:17 am, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hi Tim, You can track the progress here: http://groups.google.com/group/google-appengine-downtime-notify/brows... It's pretty hard to give an ETA, but we'd like to resolve this as soon as possible. We're seeing signs that the issues may have subsided, but we'd like a bit more confidence before giving the all clear. On Tue, Sep 14, 2010 at 6:49 PM, Tim Hoffman zutes...@gmail.com wrote: Hi http://groups.google.com.au/group/google-appengine-downtime-notify/br... was posted several hours ago, with no updates. I certainly am experiencing significant ongoing issues with taskqueues and datastore timeouts and half the time can't get to the dashboard. I know someone must be working hard on this, but a little more detail on progress, ie ETA to recovery would be really great Thanks Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 500 error trying to reach dashboard
We are just back from the dead. Our app was 100% down (dashboard too) for the last 15 minutes: It was showing the infamous: Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please report your problem and mention this error message and the query that caused it. And it was doing so even for the static content! Glad to be back, but these past few days have been super painful... Jerome On Sep 15, 6:04 pm, coltsith conla...@gmail.com wrote: issues here too. On Sep 15, 5:02 pm, Daniel danielshaneup...@gmail.com wrote: same here On Sep 15, 12:00 pm, dflorey daniel.flo...@gmail.com wrote: Some problem for our apps. Please help as our customers are already complaining... On Sep 15, 5:48 pm, bFlood bflood...@gmail.com wrote: same here and most (not all) GAE requests over multiple apps seem really slow On Sep 15, 11:25 am, Francois Masurel fm2...@mably.com wrote: Yep, same problem here. On Sep 15, 12:50 pm, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please Stop Throttling my App!
+1 On Wed, Sep 15, 2010 at 9:41 PM, Robert Kluin robert.kl...@gmail.comwrote: I am starting to get concerned. A few months ago this number was 1000ms, right? Then about a month or two ago it became 850ms; actually I have even saw the 850 number posted within the last week. Now it is 700ms? From my experience, getting or putting even a single entity can use a substantial portion of 700ms (20% to 40%). If you operate on multiple entities you'll easily use 1/2 of 700ms. Just the act of _running_ a query takes around 250ms -- when the datastore is actually functioning correctly. This trend is _really_ not good. Robert On Wed, Sep 15, 2010 at 10:18, bFlood bflood...@gmail.com wrote: not for nothing, but isn't we may not schedule additional servers for your app throttling? when did 700ms become a magic number? On Sep 15, 9:33 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi, We don't throttle apps. If your average latency is over 700 milliseconds for user-facing requests, we may not schedule additional servers for your app, however. What leads you to conclude that your app is being throttled? -Nick Johnson On Tue, Sep 14, 2010 at 9:47 PM, Coding Social codingsoc...@gmail.com wrote: Hi, I have had appid mapthislink for many months now. Recently my extensions that use this web service to unwind urls have been featured by Google Chrome and Apple Safari so usage is up substantially. Can someone turn off the throttle? Causing latency and 13% error rate. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please Stop Throttling my App!
I am starting to get concerned. A few months ago this number was 1000ms, right? Then about a month or two ago it became 850ms; actually I have even saw the 850 number posted within the last week. Now it is 700ms? From my experience, getting or putting even a single entity can use a substantial portion of 700ms (20% to 40%). If you operate on multiple entities you'll easily use 1/2 of 700ms. Just the act of _running_ a query takes around 250ms -- when the datastore is actually functioning correctly. This trend is _really_ not good. Robert On Wed, Sep 15, 2010 at 10:18, bFlood bflood...@gmail.com wrote: not for nothing, but isn't we may not schedule additional servers for your app throttling? when did 700ms become a magic number? On Sep 15, 9:33 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi, We don't throttle apps. If your average latency is over 700 milliseconds for user-facing requests, we may not schedule additional servers for your app, however. What leads you to conclude that your app is being throttled? -Nick Johnson On Tue, Sep 14, 2010 at 9:47 PM, Coding Social codingsoc...@gmail.comwrote: Hi, I have had appid mapthislink for many months now. Recently my extensions that use this web service to unwind urls have been featured by Google Chrome and Apple Safari so usage is up substantially. Can someone turn off the throttle? Causing latency and 13% error rate. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 500 error trying to reach dashboard
I love app engine and what they're trying to do, but am now getting doubts about using it for our next project. We have roughly 2000 paid users and growing, and this really isn't sustainable if it keeps having issues every other week. On Sep 15, 5:04 pm, coltsith conla...@gmail.com wrote: issues here too. On Sep 15, 5:02 pm, Daniel danielshaneup...@gmail.com wrote: same here On Sep 15, 12:00 pm, dflorey daniel.flo...@gmail.com wrote: Some problem for our apps. Please help as our customers are already complaining... On Sep 15, 5:48 pm, bFlood bflood...@gmail.com wrote: same here and most (not all) GAE requests over multiple apps seem really slow On Sep 15, 11:25 am, Francois Masurel fm2...@mably.com wrote: Yep, same problem here. On Sep 15, 12:50 pm, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 500 error trying to reach dashboard
OK, all our apps are dead now. This is why I was afraid of maintenance. On Sep 16, 12:09 am, Jerome jerome.mou...@gmail.com wrote: We are just back from the dead. Our app was 100% down (dashboard too) for the last 15 minutes: It was showing the infamous: Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please report your problem and mention this error message and the query that caused it. And it was doing so even for the static content! Glad to be back, but these past few days have been super painful... Jerome On Sep 15, 6:04 pm, coltsith conla...@gmail.com wrote: issues here too. On Sep 15, 5:02 pm, Daniel danielshaneup...@gmail.com wrote: same here On Sep 15, 12:00 pm, dflorey daniel.flo...@gmail.com wrote: Some problem for our apps. Please help as our customers are already complaining... On Sep 15, 5:48 pm, bFlood bflood...@gmail.com wrote: same here and most (not all) GAE requests over multiple apps seem really slow On Sep 15, 11:25 am, Francois Masurel fm2...@mably.com wrote: Yep, same problem here. On Sep 15, 12:50 pm, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 500 error trying to reach dashboard
Same here... latency is up and can't access the Dashboard. On Sep 15, 6:50 am, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Please Stop Throttling my App!
bothering, indeed.. On Sep 15, 6:11 pm, Robert Kluin robert.kl...@gmail.com wrote: I am starting to get concerned. A few months ago this number was 1000ms, right? Then about a month or two ago it became 850ms; actually I have even saw the 850 number posted within the last week. Now it is 700ms? From my experience, getting or putting even a single entity can use a substantial portion of 700ms (20% to 40%). If you operate on multiple entities you'll easily use 1/2 of 700ms. Just the act of _running_ a query takes around 250ms -- when the datastore is actually functioning correctly. This trend is _really_ not good. Robert On Wed, Sep 15, 2010 at 10:18, bFlood bflood...@gmail.com wrote: not for nothing, but isn't we may not schedule additional servers for your app throttling? when did 700ms become a magic number? On Sep 15, 9:33 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi, We don't throttle apps. If your average latency is over 700 milliseconds for user-facing requests, we may not schedule additional servers for your app, however. What leads you to conclude that your app is being throttled? -Nick Johnson On Tue, Sep 14, 2010 at 9:47 PM, Coding Social codingsoc...@gmail.comwrote: Hi, I have had appid mapthislink for many months now. Recently my extensions that use this web service to unwind urls have been featured by Google Chrome and Apple Safari so usage is up substantially. Can someone turn off the throttle? Causing latency and 13% error rate. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] XMPP
Hey all, My situation is that I have a client app that uses XMPP to communicate with other client apps using a MUC service. This works well, is efficient and doesn't require much more than basic XMPP support. When I heard that GAE had XMPP support I thought hooray! but looking into it, it seems that what is meant by this is client- side support, not server side. Yes, there is server-side support as far as basic infrastructure, but beyond message transport, there is nothing. In other words, you can write a bot, but you can't manage accounts, access or anything like that. At least as far as I can tell. I would like to avoid the situation where my users have to sign up for an additional service, so I'd like this to be as automated as possible. Right now, nothing actually requires them to create an account on my system, or google. Is there some way to get the functionality I am missing? It is possible for all my clients to use the same JID as far as my system is concerned, but I need too make sure that a malicious user can't do something like go in and change the password, which would be catastrophic, obviously. Many thanks! As a side note and comment for feedback, I think the XMPP bot architecture is totally broken. You are forcing bots to be asynchronous, and messages are converted into HTML-like call structure, as if each XMPP message were independent and stateless, like HTML! I know you can put data in the store and make this work, and, of course, in some abstract realm this is valid, but XMPP is not like HTML. HTML is usually about transferring state or data, or, in some contexts, performing some action. XMPP, though it can server that purpose, is often best thought of as a conversation, and a conversation has a flow and has context. By using the stateless interface, unless I am missing something, you really make that difficult. Really, you are sending the message to developers: you might as well use html for your bots. Really: with this implementation, you are saying, XMPP and HTML are the same, and sure you have a few extra bells and whistles, but philosophically, this is HTML over XMPP - you are making it hard for developers to leverage the real strength and power of XMPP. I realize that this implementation makes it easy to manage quotas and so on, but there has to be another way, and I have some suggestions, but I imagine you can come up with some things on your own. Imagine trying to implement a handshake or other simple conversation like this. No thank you! bjorn - Bjorn Roche XO Audio, LLC Audio Software Digital Audio Consulting http://www.xoaudio.com http://blog.bjornroche.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Please Stop Throttling my App!
+1 =( On Sep 15, 5:11 pm, Robert Kluin robert.kl...@gmail.com wrote: I am starting to get concerned. A few months ago this number was 1000ms, right? Then about a month or two ago it became 850ms; actually I have even saw the 850 number posted within the last week. Now it is 700ms? From my experience, getting or putting even a single entity can use a substantial portion of 700ms (20% to 40%). If you operate on multiple entities you'll easily use 1/2 of 700ms. Just the act of _running_ a query takes around 250ms -- when the datastore is actually functioning correctly. This trend is _really_ not good. Robert On Wed, Sep 15, 2010 at 10:18, bFlood bflood...@gmail.com wrote: not for nothing, but isn't we may not schedule additional servers for your app throttling? when did 700ms become a magic number? On Sep 15, 9:33 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi, We don't throttle apps. If your average latency is over 700 milliseconds for user-facing requests, we may not schedule additional servers for your app, however. What leads you to conclude that your app is being throttled? -Nick Johnson On Tue, Sep 14, 2010 at 9:47 PM, Coding Social codingsoc...@gmail.comwrote: Hi, I have had appid mapthislink for many months now. Recently my extensions that use this web service to unwind urls have been featured by Google Chrome and Apple Safari so usage is up substantially. Can someone turn off the throttle? Causing latency and 13% error rate. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please Stop Throttling my App!
+1 and a whole lot more :( While it is all our goals to produce efficient applications that can be scaled out, the platform itself has to be usable , might I add, enforce ceilings that don't choke the life out of even the simplest of processes. In that regard I'd be willing to give up a little bit of scalability for somewhat more relaxed quotas. But the real issue I believe is that of imposing unrealistic quotas. It is one thing to show an example of an efficient application built by Google and another to show how that relates to real world applications that though they employ all the same best practices still cannot function within the allowable quotas. Resiliency is also a major issue on App Engine, if 99% of our code is protect the app from what can go wrong and that eats up our quota, what is left for doing real work? It is my desire and I suppose that of many if not even most of the other developers that Google rethink their approach to providing scalability resiliency to the masses on App Engine. Jeff On Wed, Sep 15, 2010 at 12:41 PM, Gordon hall...@gmail.com wrote: bothering, indeed.. On Sep 15, 6:11 pm, Robert Kluin robert.kl...@gmail.com wrote: I am starting to get concerned. A few months ago this number was 1000ms, right? Then about a month or two ago it became 850ms; actually I have even saw the 850 number posted within the last week. Now it is 700ms? From my experience, getting or putting even a single entity can use a substantial portion of 700ms (20% to 40%). If you operate on multiple entities you'll easily use 1/2 of 700ms. Just the act of _running_ a query takes around 250ms -- when the datastore is actually functioning correctly. This trend is _really_ not good. Robert On Wed, Sep 15, 2010 at 10:18, bFlood bflood...@gmail.com wrote: not for nothing, but isn't we may not schedule additional servers for your app throttling? when did 700ms become a magic number? On Sep 15, 9:33 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi, We don't throttle apps. If your average latency is over 700 milliseconds for user-facing requests, we may not schedule additional servers for your app, however. What leads you to conclude that your app is being throttled? -Nick Johnson On Tue, Sep 14, 2010 at 9:47 PM, Coding Social codingsoc...@gmail.comwrote: Hi, I have had appid mapthislink for many months now. Recently my extensions that use this web service to unwind urls have been featured by Google Chrome and Apple Safari so usage is up substantially. Can someone turn off the throttle? Causing latency and 13% error rate. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group athttp:// groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- -- Jeff -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Going beyond 10 applications
Is there any way to get more then 10 applications in my account? I have billing enabled in a number of them and am paying for them weekly. Thank you advance, Lenny -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please Stop Throttling my App!
I am OK with Google introducing tiered pricing for handle this issue. Don't take these numbers at their face values, but you would get the point I am trying to make here. Avg. Requests CPU Charges 700ms $0.02/hr 1500ms$0.04/hr 2000ms$0.06/hr For all the requests Google provision new servers but if you requests take longer you pay higher. Not sure if it really makes sense, but the idea of totally not allowing any scaling up is not good enough motivation to write ever more complex apps. On Wed, Sep 15, 2010 at 10:51 PM, Jeff Schwartz jefftschwa...@gmail.comwrote: +1 and a whole lot more :( While it is all our goals to produce efficient applications that can be scaled out, the platform itself has to be usable , might I add, enforce ceilings that don't choke the life out of even the simplest of processes. In that regard I'd be willing to give up a little bit of scalability for somewhat more relaxed quotas. But the real issue I believe is that of imposing unrealistic quotas. It is one thing to show an example of an efficient application built by Google and another to show how that relates to real world applications that though they employ all the same best practices still cannot function within the allowable quotas. Resiliency is also a major issue on App Engine, if 99% of our code is protect the app from what can go wrong and that eats up our quota, what is left for doing real work? It is my desire and I suppose that of many if not even most of the other developers that Google rethink their approach to providing scalability resiliency to the masses on App Engine. Jeff On Wed, Sep 15, 2010 at 12:41 PM, Gordon hall...@gmail.com wrote: bothering, indeed.. On Sep 15, 6:11 pm, Robert Kluin robert.kl...@gmail.com wrote: I am starting to get concerned. A few months ago this number was 1000ms, right? Then about a month or two ago it became 850ms; actually I have even saw the 850 number posted within the last week. Now it is 700ms? From my experience, getting or putting even a single entity can use a substantial portion of 700ms (20% to 40%). If you operate on multiple entities you'll easily use 1/2 of 700ms. Just the act of _running_ a query takes around 250ms -- when the datastore is actually functioning correctly. This trend is _really_ not good. Robert On Wed, Sep 15, 2010 at 10:18, bFlood bflood...@gmail.com wrote: not for nothing, but isn't we may not schedule additional servers for your app throttling? when did 700ms become a magic number? On Sep 15, 9:33 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi, We don't throttle apps. If your average latency is over 700 milliseconds for user-facing requests, we may not schedule additional servers for your app, however. What leads you to conclude that your app is being throttled? -Nick Johnson On Tue, Sep 14, 2010 at 9:47 PM, Coding Social codingsoc...@gmail.comwrote: Hi, I have had appid mapthislink for many months now. Recently my extensions that use this web service to unwind urls have been featured by Google Chrome and Apple Safari so usage is up substantially. Can someone turn off the throttle? Causing latency and 13% error rate. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group athttp:// groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Going beyond 10 applications
You have to feel this form: http://code.google.com/support/bin/request.py?contact_type=AppEngineBillingSupport -Sebastian http://studio.livemade.com On Sep 15, 2:36 pm, Lenny Rachitsky lenny...@gmail.com wrote: Is there any way to get more then 10 applications in my account? I have billing enabled in a number of them and am paying for them weekly. Thank you advance, Lenny -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Going beyond 10 applications
Thank you sebastian, form submitted. On Sep 15, 12:03 pm, sserrano sebastian.serr...@gmail.com wrote: You have to feel this form:http://code.google.com/support/bin/request.py?contact_type=AppEngineB... -Sebastianhttp://studio.livemade.com On Sep 15, 2:36 pm, Lenny Rachitsky lenny...@gmail.com wrote: Is there any way to get more then 10 applications in my account? I have billing enabled in a number of them and am paying for them weekly. Thank you advance, Lenny -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Increased CPU Time/Request after yesterdays maintenance?
app id - bringit-pshb-test-1 python The error rates are significantly higher since the maintenance outage yesterday. URI Count % Errors last 14 hrs /work/pull_feeds 841 8.5% / 140 1.5% /work/push_events 60 0.9% /work/subscription_cleanup 11 1.3% /work/event_cleanup 70.8% /work/poll_bootstrap 31.7% -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Increased CPU Time/Request after yesterdays maintenance?
Error rates have increased since I last posted. bringit-pshb-test-1 python Warning in log: Request was aborted after waiting too long to attempt to service your request. This may happen sporadically when the App Engine serving cluster is under unexpectedly high or uneven load. If you see this message frequently, please contact the App Engine team. URI Count % Errors last 15 hrs /work/pull_feeds 1529 14% / 155 1.6% /work/push_events 61 0.9% /work/subscription_cleanup 12 1.4% /work/event_cleanup 80.9% /work/poll_bootstrap 31.6% -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] PHP Application
Hi! Iam newbie to GAE. Can some guide me how to deploy PHP+Mysql based application on GAE. And what changes should be made in application to run it smoothly on GAE. Thanks in advance -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Unable to add a developer to my app
Hi, I am hosting yyy.com with google apps. In addition, xxx.com is mapped to yyy.com as a domain alias so email to a...@xxx.com will show up in a...@yyy.com's email box. When I access my app engine apps, I go to appengine.google.com/a/yyy.com/ I want my app to send email from a...@xxx.com. So I invite a...@xxx.com as a developer for my app. However, after I complete the process, the developer that shows up is a...@yyy.com. This is fine except when I use the send mail service, I cannot send emails from a...@xxx.com. I must be able to send email from with xxx.com. How can I accomplish this? Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] server irc
Greetings! anyone knows how to implement an irc server in GAE using python. I have not much information on irc. there are free servers .. or nodes but I would like to implement your own to manage my taste -- Díaz Luis TSU Analisis de Sistemas Universidad de Carabobo -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Model.get_by_id performance
Hello, As we know, getting entity by the key is extremely fast. But what's about getting entity by ID (using Model.get_by_id)? As I understand, ID should be indexed separately, and getting by ID should be slower than getting by Key, right? And this one is related - are there any drawbacks of using ID's on client side if we only care about uniqueness of entity between entities of the same Kind? Thank you in advance. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Problems with App Engine today - Can we get an explanation?
We are seeing a bunch of TaskQueue timeouts and TransientErrors as
well.
Dashboard is also 500 erroring, and the last 5 attempts at deployment
have resulted in a 500 Internal Server Error.
The Investigation Complete - Issue Resolved. We have determined that
this spike did not affect the performance or uptime of applications.
If you feel we have incorrectly diagnosed this issue please inform us
by posting in our developer forum. messages are not particularly
reassuring.
...
File /base/python_runtime/python_lib/versions/1/google/appengine/
api/labs/taskqueue/taskqueue.py, line 805, in add
queue_name=queue_name, transactional=transactional)
File /base/python_runtime/python_lib/versions/1/google/appengine/
api/labs/taskqueue/taskqueue.py, line 563, in add
return Queue(queue_name).add(self, transactional=transactional)
File /base/python_runtime/python_lib/versions/1/google/appengine/
api/labs/taskqueue/taskqueue.py, line 617, in add
self.__AddTasks(tasks, transactional)
File /base/python_runtime/python_lib/versions/1/google/appengine/
api/labs/taskqueue/taskqueue.py, line 643, in __AddTasks
apiproxy_stub_map.MakeSyncCall('taskqueue', 'BulkAdd', request,
response)
File /base/python_runtime/python_lib/versions/1/google/appengine/
api/apiproxy_stub_map.py, line 78, in MakeSyncCall
return apiproxy.MakeSyncCall(service, call, request, response)
File /base/python_runtime/python_lib/versions/1/google/appengine/
api/apiproxy_stub_map.py, line 278, in MakeSyncCall
rpc.CheckSuccess()
File /base/python_runtime/python_lib/versions/1/google/appengine/
api/apiproxy_rpc.py, line 126, in CheckSuccess
raise self.exception
DeadlineExceededError: The API call taskqueue.BulkAdd() took too long
to respond and was cancelled.
...
File /base/python_runtime/python_lib/versions/1/google/appengine/
api/labs/taskqueue/taskqueue.py, line 805, in add
queue_name=queue_name, transactional=transactional)
File /base/python_runtime/python_lib/versions/1/google/appengine/
api/labs/taskqueue/taskqueue.py, line 563, in add
return Queue(queue_name).add(self, transactional=transactional)
File /base/python_runtime/python_lib/versions/1/google/appengine/
api/labs/taskqueue/taskqueue.py, line 617, in add
self.__AddTasks(tasks, transactional)
File /base/python_runtime/python_lib/versions/1/google/appengine/
api/labs/taskqueue/taskqueue.py, line 645, in __AddTasks
raise self.__TranslateError(e.application_error, e.error_detail)
TransientError
On Sep 14, 2:48 pm, Kenneth goo...@kmacleod.ie wrote:
Now the status site is just returning a blank page and the rate of 500
errors has gone up significantly.
I can't believe that downtime notice thinks this issue is over. My
app is barely usable.
Come on Google, give us something better. At least let us know you
know there's an ongoing serious problem.
On Sep 14, 8:16 pm, Michael Robellard m...@robellard.com wrote:
I am seeing thousands of errors(all timeouts of one type or another)
on requests that typically have less than 100 errors a day. My CPU
usage per second is up 20% since the failure this morning. These are
requests that usually take less than a second and they are reaching
the 30 second mark.
On Sep 14, 3:04 pm, mscwd01 mscw...@gmail.com wrote:
Hi,
Can we get an official word on why the App Engine has performed so
poorly today?
My app has seen hundreds of HTTP 500 errors, is running approximately
twice as slow (CPU time/request) as yesterday (PUTs are very slow),
had many HardDeadlineExceededError errors and stats tools such as
AppStats don't appear to be working for me (displays real time but
not cpu time).
It'd be reassuring to know why these problems are occurring and what
is being done to fix these and stop the happening again.
Thanks
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] PHP Application
On 14 September 2010 21:30, simpanoz wrote: Hi! Iam newbie to GAE. Can some guide me how to deploy PHP+Mysql based application on GAE. Firstly appengine doesnt have mysql - it has the datastore - still a database, but quite different technology. PHP doesnt run directly. Need to run PHP via Quercus which compiles it to java. First result from a web search http://www.webdigi.co.uk/blog/2009/run-php-on-the-google-app-engine/ And what changes should be made in application to run it smoothly on GAE. Probably a lot - too long to possibly list. So there isnt a generic list - the technolgy are just so different. Thanks in advance -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] PHP Application
PHP does not run on GAE, also there's no MySQL on GAE. This is as close as it gets: http://www.caucho.com/resin-3.0/quercus/ But maybe you should first ask yourself what do you expect from moving to GAE. On Tue, Sep 14, 2010 at 10:30 PM, simpanoz simpa...@gmail.com wrote: Hi! Iam newbie to GAE. Can some guide me how to deploy PHP+Mysql based application on GAE. And what changes should be made in application to run it smoothly on GAE. Thanks in advance -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Request was aborted after waiting too long
It's not a bug - it's something we've stated before. App Engine's infrastructure will favor lots of small requests over large requests for user facing requests. The reason your suggestion probably wouldn't work well is that the proportion of requests that must be fast must be high. This means that if the original poster already has a requirement for many long running requests, that he would need many multiples of that number to be auto-scaled up. It'd be a very costly way of doing something where an alternative solution exists using Task Queues or cron tasks. It's far more likely the issue is being caused by our latency spikes described here: http://groups.google.com/group/google-appengine-downtime-notify/browse_thread/thread/9cf3b0cafdd6c235 On Wed, Sep 15, 2010 at 4:32 AM, Jan Z/ Hapara jan.zawad...@gmail.comwrote: What is the average response time from your app for normal requests? If it is 1000 msec, the GAE appears to become reluctant to start up new VM's for you, the result being that requests queue up, and after some period in the queue, are deemed stale and get kicked with this error. Want to test this assumption? Flood your app with no-op requests that don't do anything (use a URL no one would normally use, and just return from the GET call). If you have enough of these (simplest no- op returns in 50 msec), the math shifts your average to below 1000 msec, and presto. It's a stupid solution to what's either an outright bug or an overzealous resource manager behind GAE, but it sure seems to cure these. J On Sep 15, 4:46 am, David s2kd...@gmail.com wrote: I am seeing the mesage below frequently on my application. The application ID is word-play. It seems to have started happening in the past day or two, but before that I never saw it. It looks like it waits for 10 seconds and then times out without using any cpu_ms. This is causing problems. It says to contact the App Engine team. Where/how do I do that? Thanks, David #0.0.0.0 - xyz [14/Sep/2010:09:04:06 -0700] GET /play? p=111g=407211m=e,13,6/d,13,7 HTTP/1.1 500 0 - Xxx/1.0(Android 2.2),gzip(gfe) word-play.appspot.com:80 ms=10158 cpu_ms=0 api_cpu_ms=0 cpm_usd=0.63 #W 09-14 09:04AM 06.828 Request was aborted after waiting too long to attempt to service your request. This may happen sporadically when the App Engine serving cluster is under unexpectedly high or uneven load. If you see this message frequently, please contact the App Engine team. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] server irc
I doubt it will as such. AppEngine is designed to respond to requests. The most common being a web-request. So a request comes in, a script runs for a short time and returns the responce. (it also responds to background tasks etc) A IRC server would pretty much need to run continouslly and read and possibly respond to messages. No of course it might be /possible/ with a some crafty hacking, but its not what appengine was designed for, so it wont be an easy fit. On 15 September 2010 15:09, Luis Díaz diazluis2...@gmail.com wrote: Greetings! anyone knows how to implement an irc server in GAE using python. I have not much information on irc. there are free servers .. or nodes but I would like to implement your own to manage my taste -- Díaz Luis TSU Analisis de Sistemas Universidad de Carabobo -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Annoyed with GAE System Status: Investigation Complete - Issue Resolved?
We're aware of the poor message that's in place. We'll be replacing this with, at the very least, a more accurate message soon. Our goal is transparency, and the new message will state that though it's not technically downtime, many users **are** experiencing downtime because the additional latency is significant enough such that web requests that make multiple datastore calls have a enough tax added to them that they trigger deadline exceeded exceptions. On Wed, Sep 15, 2010 at 6:31 AM, Jan Z/ Hapara jan.zawad...@gmail.comwrote: Star this: http://code.google.com/p/googleappengine/issues/detail?id=3726 The App Engine System Status frequently shows the following message: --- Investigation Complete - Issue Resolved We have determined that this spike did not affect the performance or uptime of applications. If you feel we have incorrectly diagnosed this issue please inform us by posting in our developer forum. --- We appreciate that this accurately conveys the diagnostics output on the back end, and that the tools that generate these are (presumably) largely automated, but the wording of this message really needs to be improved. The text is simply not appropriate at times when the key metric indicators are going red and apps are failing. The feature request asks that Google change the wording of this message. By clicking on and starring the issue we can help Google quantify the our collective frustration with this, and make it easier to prioritize. (There is a larger issue here relating to what triggers this message in the first place, and if it is appropriate to display this when the indicators are going red and apps are failing...) J -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: GAE downtime email marked as spam by gmail
This is strange - so appengine.notificati...@google.com are being marked as spam, but not appengine.nore...@gmail.com? Users have reported that appengine.nore...@gmail.com is usually the one that gets reported as spam. Can you confirm? We created the new @google.com address to circumvent this issue. On Wed, Sep 15, 2010 at 2:42 PM, l.denardo lorenzo.dena...@gmail.comwrote: BTW I checked, and looks like messages are marked as spam only if coming by the address appengine.notificati...@google.com In my inbox at least...appengine.noreply seems to go to inbox correctly. On Sep 15, 4:38 pm, l.denardo lorenzo.dena...@gmail.com wrote: Happens randomly to me too. Yesterday first announcement was spam, subsequent update not. Emails are marked as spam or phishing about 20% of times. Regards Lorenzo On Sep 15, 11:46 am, Raymond C. windz...@gmail.com wrote: same here On Sep 15, 3:41 pm, Kenneth goo...@kmacleod.ie wrote: Does anyone else get the downtime emails marked as spam pretty much always? The first one yesterday got through fine but the second got caught as a phishing email. http://imgur.com/HMrRL.png -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Do we have an ETA for the resolution of ongoing performance issues.
Hey guys, I understand your frustration. We have many Google services deployed on top of App Engine as well, and we get pressure from both sides anytime events impact production. There are several issues around communication being highlighted here: - App Engine Status page was being updated when we were having latency problems - Status page did not accurately describe the impact - Delay between when we recognized a production event and posting to downtime notify - Downtime-notify emails are being marked as spam We've attempted to take steps in the past to resolve the spam issue, though users are reporting that it hasn't worked. As far as the delay between us accurately identifying a production event and updating the groups - well, we'll have to figure out how we can minimize that. At the very least, there will be a communications post-mortem internally about what we plan on doing to address or at least minimizing the impact of these issues. The option to go into an unplanned maintenance period was on the table, but it was one of those situations where we assessed it as overkill, especially since there were period when the latency appeared to have died down, only to restart again. We don't want to be too trigger happy with unscheduled downtime, as degraded performance is usually preferable to a completely downtime state (many of you may disagree with me, but this is a bit of a judgment call depending on the level of degradation). We're cautiously optimistic at the moment about performance, but at this point, if the spikes begin appearing again, we may initiate another full downtime period. Stay tuned to the downtime-notify list. I'll let my team members know to post using their @google.com accounts to avoid being marked as spam. On Wed, Sep 15, 2010 at 4:10 PM, Cameron came...@gqueues.com wrote: Hi Ikai - Just to be clear the issues have NOT subsided since last night. I hope you guys are working on eliminating the root of the problem and not just monitoring the service closely as the latest App Engine Notify post suggests. http://groups.google.com/group/google-appengine-downtime-notify/browse_thread/thread/9cf3b0cafdd6c235 And even though the status page says this spike did not affect the performance or uptime of applications - every spike DOES in fact affect the performance of applications (mine at least - GQueues, but probably all apps). These red spikes make my app inaccessible. Even the yellow spikes cause many 500 errors. Basically this makes my app unusable, because users can't get any consistent work done with the frequent errors. http://code.google.com/status/appengine/detail/datastore/2010/09/15#ae-trust-detail-datastore-get-latency Most of all, the frequent errors make my app seem very brittle and deteriorates user confidence. Sales drop and my own forum gets lots of complaints. And then of course people start posting on Twitter. Anyway, I'm sure you guys are working very hard to fix the issues and want App Engine to be as reliable as possible. My suggestion is that you also look to improve communication during these times. I have to respond to my own users during these situations. This becomes very difficult when all I can tell them is Google thinks the issue is resolved and is just monitoring the situation when clearly the status graphs indicate otherwise and people can't access my app. Or Google says the issue didn't affect performance or uptime when clearly it has. -Cameron On Sep 15, 6:13 am, Arny arny...@googlemail.com wrote: We're still getting a lot of 500s (dashboard front end). Did you transferred our apps to lower-cost servers or why is everything working that bad since the maintenance? When are the REAL paid services coming? On Sep 15, 6:17 am, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: Hi Tim, You can track the progress here: http://groups.google.com/group/google-appengine-downtime-notify/brows. .. It's pretty hard to give an ETA, but we'd like to resolve this as soon as possible. We're seeing signs that the issues may have subsided, but we'd like a bit more confidence before giving the all clear. On Tue, Sep 14, 2010 at 6:49 PM, Tim Hoffman zutes...@gmail.com wrote: Hi http://groups.google.com.au/group/google-appengine-downtime-notify/br... was posted several hours ago, with no updates. I certainly am experiencing significant ongoing issues with taskqueues and datastore timeouts and half the time can't get to the dashboard. I know someone must be working hard on this, but a little more detail on progress, ie ETA to recovery would be really great Thanks Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send
Re: [google-appengine] Re: 500 error trying to reach dashboard
Is anyone still experience issues? We should be okay now, though we're watching this carefully. On Wed, Sep 15, 2010 at 4:20 PM, Amir amir.shim...@gmail.com wrote: Same here... latency is up and can't access the Dashboard. On Sep 15, 6:50 am, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please Stop Throttling my App!
If it scaled linearly like that, we probably wouldn't have problems with long running requests. Unfortunately, long running requests are bad for the ecosystem because they impose a non-linear cost. The number is officially 1000ms. We have been saying 800ms because we allow for some variance. If you tuned your requests to be 990ms and had a period of 10ms of latency, you'd be dead in the water. 800ms is a safe enough number that even if you experienced an additional spike of 100ms-150ms for whatever reason (datastore slowness, unusual usage patterns in your application causing Memcache misses, network latency via URLFetch), you can tolerate it and be fairly confident you will be autoscaled. On Wed, Sep 15, 2010 at 6:51 PM, Flips philip.mates...@driggle.com wrote: @Harshal Actually slower requests mostly consume more cpu time and are much more expensive by default.. On Sep 15, 8:28 pm, Harshal p.hars...@gmail.com wrote: I am OK with Google introducing tiered pricing for handle this issue. Don't take these numbers at their face values, but you would get the point I am trying to make here. Avg. Requests CPU Charges 700ms $0.02/hr 1500ms$0.04/hr 2000ms$0.06/hr For all the requests Google provision new servers but if you requests take longer you pay higher. Not sure if it really makes sense, but the idea of totally not allowing any scaling up is not good enough motivation to write ever more complex apps. On Wed, Sep 15, 2010 at 10:51 PM, Jeff Schwartz jefftschwa...@gmail.com wrote: +1 and a whole lot more :( While it is all our goals to produce efficient applications that can be scaled out, the platform itself has to be usable , might I add, enforce ceilings that don't choke the life out of even the simplest of processes. In that regard I'd be willing to give up a little bit of scalability for somewhat more relaxed quotas. But the real issue I believe is that of imposing unrealistic quotas. It is one thing to show an example of an efficient application built by Google and another to show how that relates to real world applications that though they employ all the same best practices still cannot function within the allowable quotas. Resiliency is also a major issue on App Engine, if 99% of our code is protect the app from what can go wrong and that eats up our quota, what is left for doing real work? It is my desire and I suppose that of many if not even most of the other developers that Google rethink their approach to providing scalability resiliency to the masses on App Engine. Jeff On Wed, Sep 15, 2010 at 12:41 PM, Gordon hall...@gmail.com wrote: bothering, indeed.. On Sep 15, 6:11 pm, Robert Kluin robert.kl...@gmail.com wrote: I am starting to get concerned. A few months ago this number was 1000ms, right? Then about a month or two ago it became 850ms; actually I have even saw the 850 number posted within the last week. Now it is 700ms? From my experience, getting or putting even a single entity can use a substantial portion of 700ms (20% to 40%). If you operate on multiple entities you'll easily use 1/2 of 700ms. Just the act of _running_ a query takes around 250ms -- when the datastore is actually functioning correctly. This trend is _really_ not good. Robert On Wed, Sep 15, 2010 at 10:18, bFlood bflood...@gmail.com wrote: not for nothing, but isn't we may not schedule additional servers for your app throttling? when did 700ms become a magic number? On Sep 15, 9:33 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi, We don't throttle apps. If your average latency is over 700 milliseconds for user-facing requests, we may not schedule additional servers for your app, however. What leads you to conclude that your app is being throttled? -Nick Johnson On Tue, Sep 14, 2010 at 9:47 PM, Coding Social codingsoc...@gmail.comwrote: Hi, I have had appid mapthislink for many months now. Recently my extensions that use this web service to unwind urls have been featured by Google Chrome and Apple Safari so usage is up substantially. Can someone turn off the throttle? Causing latency and 13% error rate. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For
[google-appengine] Re: Model.get_by_id performance
The id is converted to the key before the remote call so it is the same speed. On Sep 15, 5:48 pm, zygimantas zygimantas.berziu...@gmail.com wrote: Hello, As we know, getting entity by the key is extremely fast. But what's about getting entity by ID (using Model.get_by_id)? As I understand, ID should be indexed separately, and getting by ID should be slower than getting by Key, right? And this one is related - are there any drawbacks of using ID's on client side if we only care about uniqueness of entity between entities of the same Kind? Thank you in advance. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Please Stop Throttling my App!
does this count for the Task Queue as well? if so, how are we suppose to run tasks that span a couple of seconds? are you saying that if one task goes over 1000ms, you're not going to get any new instances? does this ban on new instances last for a certain time period? urlfetch - does one bad network hop (over 1000ms, for whatever reason) cause you not to scale as well (i'm guessing yes)? On Sep 15, 5:38 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: If it scaled linearly like that, we probably wouldn't have problems with long running requests. Unfortunately, long running requests are bad for the ecosystem because they impose a non-linear cost. The number is officially 1000ms. We have been saying 800ms because we allow for some variance. If you tuned your requests to be 990ms and had a period of 10ms of latency, you'd be dead in the water. 800ms is a safe enough number that even if you experienced an additional spike of 100ms-150ms for whatever reason (datastore slowness, unusual usage patterns in your application causing Memcache misses, network latency via URLFetch), you can tolerate it and be fairly confident you will be autoscaled. On Wed, Sep 15, 2010 at 6:51 PM, Flips philip.mates...@driggle.com wrote: @Harshal Actually slower requests mostly consume more cpu time and are much more expensive by default.. On Sep 15, 8:28 pm, Harshal p.hars...@gmail.com wrote: I am OK with Google introducing tiered pricing for handle this issue. Don't take these numbers at their face values, but you would get the point I am trying to make here. Avg. Requests CPU Charges 700ms $0.02/hr 1500ms $0.04/hr 2000ms $0.06/hr For all the requests Google provision new servers but if you requests take longer you pay higher. Not sure if it really makes sense, but the idea of totally not allowing any scaling up is not good enough motivation to write ever more complex apps. On Wed, Sep 15, 2010 at 10:51 PM, Jeff Schwartz jefftschwa...@gmail.com wrote: +1 and a whole lot more :( While it is all our goals to produce efficient applications that can be scaled out, the platform itself has to be usable , might I add, enforce ceilings that don't choke the life out of even the simplest of processes. In that regard I'd be willing to give up a little bit of scalability for somewhat more relaxed quotas. But the real issue I believe is that of imposing unrealistic quotas. It is one thing to show an example of an efficient application built by Google and another to show how that relates to real world applications that though they employ all the same best practices still cannot function within the allowable quotas. Resiliency is also a major issue on App Engine, if 99% of our code is protect the app from what can go wrong and that eats up our quota, what is left for doing real work? It is my desire and I suppose that of many if not even most of the other developers that Google rethink their approach to providing scalability resiliency to the masses on App Engine. Jeff On Wed, Sep 15, 2010 at 12:41 PM, Gordon hall...@gmail.com wrote: bothering, indeed.. On Sep 15, 6:11 pm, Robert Kluin robert.kl...@gmail.com wrote: I am starting to get concerned. A few months ago this number was 1000ms, right? Then about a month or two ago it became 850ms; actually I have even saw the 850 number posted within the last week. Now it is 700ms? From my experience, getting or putting even a single entity can use a substantial portion of 700ms (20% to 40%). If you operate on multiple entities you'll easily use 1/2 of 700ms. Just the act of _running_ a query takes around 250ms -- when the datastore is actually functioning correctly. This trend is _really_ not good. Robert On Wed, Sep 15, 2010 at 10:18, bFlood bflood...@gmail.com wrote: not for nothing, but isn't we may not schedule additional servers for your app throttling? when did 700ms become a magic number? On Sep 15, 9:33 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi, We don't throttle apps. If your average latency is over 700 milliseconds for user-facing requests, we may not schedule additional servers for your app, however. What leads you to conclude that your app is being throttled? -Nick Johnson On Tue, Sep 14, 2010 at 9:47 PM, Coding Social codingsoc...@gmail.comwrote: Hi, I have had appid mapthislink for many months now. Recently my extensions that use this web service to unwind urls have been featured by Google Chrome and Apple Safari so usage is up substantially. Can someone turn off the throttle? Causing
Re: [google-appengine] Re: Please Stop Throttling my App!
Apologize, I wasn't clear. The 1000ms limit is only for user facing requests. This does not apply to task queues or cron jobs. On Wed, Sep 15, 2010 at 9:44 PM, bFlood bflood...@gmail.com wrote: does this count for the Task Queue as well? if so, how are we suppose to run tasks that span a couple of seconds? are you saying that if one task goes over 1000ms, you're not going to get any new instances? does this ban on new instances last for a certain time period? urlfetch - does one bad network hop (over 1000ms, for whatever reason) cause you not to scale as well (i'm guessing yes)? On Sep 15, 5:38 pm, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: If it scaled linearly like that, we probably wouldn't have problems with long running requests. Unfortunately, long running requests are bad for the ecosystem because they impose a non-linear cost. The number is officially 1000ms. We have been saying 800ms because we allow for some variance. If you tuned your requests to be 990ms and had a period of 10ms of latency, you'd be dead in the water. 800ms is a safe enough number that even if you experienced an additional spike of 100ms-150ms for whatever reason (datastore slowness, unusual usage patterns in your application causing Memcache misses, network latency via URLFetch), you can tolerate it and be fairly confident you will be autoscaled. On Wed, Sep 15, 2010 at 6:51 PM, Flips philip.mates...@driggle.com wrote: @Harshal Actually slower requests mostly consume more cpu time and are much more expensive by default.. On Sep 15, 8:28 pm, Harshal p.hars...@gmail.com wrote: I am OK with Google introducing tiered pricing for handle this issue. Don't take these numbers at their face values, but you would get the point I am trying to make here. Avg. Requests CPU Charges 700ms $0.02/hr 1500ms$0.04/hr 2000ms$0.06/hr For all the requests Google provision new servers but if you requests take longer you pay higher. Not sure if it really makes sense, but the idea of totally not allowing any scaling up is not good enough motivation to write ever more complex apps. On Wed, Sep 15, 2010 at 10:51 PM, Jeff Schwartz jefftschwa...@gmail.com wrote: +1 and a whole lot more :( While it is all our goals to produce efficient applications that can be scaled out, the platform itself has to be usable , might I add, enforce ceilings that don't choke the life out of even the simplest of processes. In that regard I'd be willing to give up a little bit of scalability for somewhat more relaxed quotas. But the real issue I believe is that of imposing unrealistic quotas. It is one thing to show an example of an efficient application built by Google and another to show how that relates to real world applications that though they employ all the same best practices still cannot function within the allowable quotas. Resiliency is also a major issue on App Engine, if 99% of our code is protect the app from what can go wrong and that eats up our quota, what is left for doing real work? It is my desire and I suppose that of many if not even most of the other developers that Google rethink their approach to providing scalability resiliency to the masses on App Engine. Jeff On Wed, Sep 15, 2010 at 12:41 PM, Gordon hall...@gmail.com wrote: bothering, indeed.. On Sep 15, 6:11 pm, Robert Kluin robert.kl...@gmail.com wrote: I am starting to get concerned. A few months ago this number was 1000ms, right? Then about a month or two ago it became 850ms; actually I have even saw the 850 number posted within the last week. Now it is 700ms? From my experience, getting or putting even a single entity can use a substantial portion of 700ms (20% to 40%). If you operate on multiple entities you'll easily use 1/2 of 700ms. Just the act of _running_ a query takes around 250ms -- when the datastore is actually functioning correctly. This trend is _really_ not good. Robert On Wed, Sep 15, 2010 at 10:18, bFlood bflood...@gmail.com wrote: not for nothing, but isn't we may not schedule additional servers for your app throttling? when did 700ms become a magic number? On Sep 15, 9:33 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi, We don't throttle apps. If your average latency is over 700 milliseconds for user-facing requests, we may not schedule additional servers for your app, however. What leads you to conclude that your app is being throttled? -Nick Johnson
[google-appengine] Re: Can Google CDNs cache dynamically generated files ?
Sorry guys. But it doesn't seem to work in fact. Shit. My static files were certainly kept in Google CDNs even after having removed them from my web app. Has anybody succeeded ? On 14 sep, 22:17, Francois MASUREL masu...@mably.com wrote: Thanx Ikai, that was the final answer we were waiting for. We now have a good solution for serving more than 3000 GWT generated files efficiently :-) François On Tue, Sep 14, 2010 at 22:12, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: I wouldn't call it a CDN, but the caching infrastructure at Google may hold on to static assets with the correct headers set. One of the key benefits here is that you won't be charged CPU time for serving the asset, though bandwidth charges will still be applied. This is only a best effort caching and is not guaranteed, so in the worst case scenario the caching infrastructure will not hold on to your data and the requests will still be routed to your application instances. On Tue, Sep 14, 2010 at 12:57 PM, Francois MASUREL masu...@mably.comwrote: Full answer there : http://www.kyle-jensen.com/proxy-caching-on-google-appengine On Tue, Sep 14, 2010 at 21:47, Stephen sdea...@gmail.com wrote: On Sep 13, 5:25 pm, Francois Masurel fm2...@mably.com wrote: Let me explain : I have potentially too many ( 3000) GWT generated files in my java application. I've already packed all my java classes in a jar. So I made a zip of all these files and implemented a servlet to serve them dynamically. The servlet url-pattern matches an include path defined in my appengine-web.xml static-files block. The question is : will the files served by my servlet be cached on Google CDNs as supposed in this thread : http://groups.google.com/group/google-appengine/browse_thread/thread/. .. It doesn't seem to be the case as each time I purge my browser cache, the files are served again from my servlet. http://code.google.com/p/googleappengine/issues/detail?id=2258 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please Stop Throttling my App!
I think on this point one should also consider that whilst the mighty google can afford to invest time and money in building apps that run lightning quik. sadly most of us developers dont have the huge man power technology and needed cash to do the same. Google should remember that we are developers and most of us are developing for $nothing$. in hope that our ideas may reap reward. on that basis we have to all consider how much time we spend investing in lightning fast code - against getting the idea out their and get users. One of the key selling points of app engine is its platform and ability to do just that. Something that restrictions on code execution times and added costs will affect. Martin Webb The information contained in this email is confidential and may contain proprietary information. It is meant solely for the intended recipient. Access to this email by anyone else is unauthorised. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted in reliance on this, is prohibited and may be unlawful. No liability or responsibility is accepted if information or data is, for whatever reason corrupted or does not reach its intended recipient. No warranty is given that this email is free of viruses. The views expressed in this email are, unless otherwise stated, those of the author -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Can Google CDNs cache dynamically generated files ?
Geez, it seems to be a Java only problem : http://code.google.com/p/googleappengine/issues/detail?id=2070 On 15 sep, 23:51, Francois Masurel fm2...@mably.com wrote: Sorry guys. But it doesn't seem to work in fact. Shit. My static files were certainly kept in Google CDNs even after having removed them from my web app. Has anybody succeeded ? On 14 sep, 22:17, Francois MASUREL masu...@mably.com wrote: Thanx Ikai, that was the final answer we were waiting for. We now have a good solution for serving more than 3000 GWT generated files efficiently :-) François On Tue, Sep 14, 2010 at 22:12, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: I wouldn't call it a CDN, but the caching infrastructure at Google may hold on to static assets with the correct headers set. One of the key benefits here is that you won't be charged CPU time for serving the asset, though bandwidth charges will still be applied. This is only a best effort caching and is not guaranteed, so in the worst case scenario the caching infrastructure will not hold on to your data and the requests will still be routed to your application instances. On Tue, Sep 14, 2010 at 12:57 PM, Francois MASUREL masu...@mably.comwrote: Full answer there : http://www.kyle-jensen.com/proxy-caching-on-google-appengine On Tue, Sep 14, 2010 at 21:47, Stephen sdea...@gmail.com wrote: On Sep 13, 5:25 pm, Francois Masurel fm2...@mably.com wrote: Let me explain : I have potentially too many ( 3000) GWT generated files in my java application. I've already packed all my java classes in a jar. So I made a zip of all these files and implemented a servlet to serve them dynamically. The servlet url-pattern matches an include path defined in my appengine-web.xml static-files block. The question is : will the files served by my servlet be cached on Google CDNs as supposed in this thread : http://groups.google.com/group/google-appengine/browse_thread/thread/. .. It doesn't seem to be the case as each time I purge my browser cache, the files are served again from my servlet. http://code.google.com/p/googleappengine/issues/detail?id=2258 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please Stop Throttling my App!
Hi Ikai, I think we all appreciate your response and clarification of this issue. Could you also clarify one more point for us, the 100ms applies about the handler's actual response time and not the cpu_ms, is that correct? In other words it is the first ms number in my logs. The vast majority of my requests complete well under 800ms -- even some doing fairly intensive processing -- but the cpu_ms jumps all over the map (largely) depending on the cpu_api_ms. Thanks for the clarification. Robert On Wed, Sep 15, 2010 at 17:47, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Apologize, I wasn't clear. The 1000ms limit is only for user facing requests. This does not apply to task queues or cron jobs. On Wed, Sep 15, 2010 at 9:44 PM, bFlood bflood...@gmail.com wrote: does this count for the Task Queue as well? if so, how are we suppose to run tasks that span a couple of seconds? are you saying that if one task goes over 1000ms, you're not going to get any new instances? does this ban on new instances last for a certain time period? urlfetch - does one bad network hop (over 1000ms, for whatever reason) cause you not to scale as well (i'm guessing yes)? On Sep 15, 5:38 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: If it scaled linearly like that, we probably wouldn't have problems with long running requests. Unfortunately, long running requests are bad for the ecosystem because they impose a non-linear cost. The number is officially 1000ms. We have been saying 800ms because we allow for some variance. If you tuned your requests to be 990ms and had a period of 10ms of latency, you'd be dead in the water. 800ms is a safe enough number that even if you experienced an additional spike of 100ms-150ms for whatever reason (datastore slowness, unusual usage patterns in your application causing Memcache misses, network latency via URLFetch), you can tolerate it and be fairly confident you will be autoscaled. On Wed, Sep 15, 2010 at 6:51 PM, Flips philip.mates...@driggle.com wrote: @Harshal Actually slower requests mostly consume more cpu time and are much more expensive by default.. On Sep 15, 8:28 pm, Harshal p.hars...@gmail.com wrote: I am OK with Google introducing tiered pricing for handle this issue. Don't take these numbers at their face values, but you would get the point I am trying to make here. Avg. Requests CPU Charges 700ms $0.02/hr 1500ms $0.04/hr 2000ms $0.06/hr For all the requests Google provision new servers but if you requests take longer you pay higher. Not sure if it really makes sense, but the idea of totally not allowing any scaling up is not good enough motivation to write ever more complex apps. On Wed, Sep 15, 2010 at 10:51 PM, Jeff Schwartz jefftschwa...@gmail.com wrote: +1 and a whole lot more :( While it is all our goals to produce efficient applications that can be scaled out, the platform itself has to be usable , might I add, enforce ceilings that don't choke the life out of even the simplest of processes. In that regard I'd be willing to give up a little bit of scalability for somewhat more relaxed quotas. But the real issue I believe is that of imposing unrealistic quotas. It is one thing to show an example of an efficient application built by Google and another to show how that relates to real world applications that though they employ all the same best practices still cannot function within the allowable quotas. Resiliency is also a major issue on App Engine, if 99% of our code is protect the app from what can go wrong and that eats up our quota, what is left for doing real work? It is my desire and I suppose that of many if not even most of the other developers that Google rethink their approach to providing scalability resiliency to the masses on App Engine. Jeff On Wed, Sep 15, 2010 at 12:41 PM, Gordon hall...@gmail.com wrote: bothering, indeed.. On Sep 15, 6:11 pm, Robert Kluin robert.kl...@gmail.com wrote: I am starting to get concerned. A few months ago this number was 1000ms, right? Then about a month or two ago it became 850ms; actually I have even saw the 850 number posted within the last week. Now it is 700ms? From my experience, getting or putting even a single entity can use a substantial portion of 700ms (20% to 40%). If you operate on multiple entities you'll easily use 1/2 of 700ms. Just the act of _running_ a query takes around 250ms -- when the datastore is actually functioning correctly. This trend is _really_
Re: [google-appengine] server irc
Not to mention that AppEngine only speaks HTTP. Robert On Wed, Sep 15, 2010 at 16:58, Barry Hunter barrybhun...@gmail.com wrote: I doubt it will as such. AppEngine is designed to respond to requests. The most common being a web-request. So a request comes in, a script runs for a short time and returns the responce. (it also responds to background tasks etc) A IRC server would pretty much need to run continouslly and read and possibly respond to messages. No of course it might be /possible/ with a some crafty hacking, but its not what appengine was designed for, so it wont be an easy fit. On 15 September 2010 15:09, Luis Díaz diazluis2...@gmail.com wrote: Greetings! anyone knows how to implement an irc server in GAE using python. I have not much information on irc. there are free servers .. or nodes but I would like to implement your own to manage my taste -- Díaz Luis TSU Analisis de Sistemas Universidad de Carabobo -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] server irc
Hello all ;] On Thu, Sep 16, 2010 at 1:04 AM, Robert Kluin robert.kl...@gmail.comwrote: Not to mention that AppEngine only speaks HTTP. AppEngine can also do xmpp. You can relay IRC messages to AppEngine. My bot can be used to send events on an IRC bot over to AppEngine for example. It uses jabber (xmpp) send these events over. The other way around, web or xmpp from AppEngine to IRC is also possible. Take a look at http://jsonbot.googlecode.com if you are interested Greets, Bart On Wed, Sep 15, 2010 at 16:58, Barry Hunter barrybhun...@gmail.com wrote: I doubt it will as such. AppEngine is designed to respond to requests. The most common being a web-request. So a request comes in, a script runs for a short time and returns the responce. (it also responds to background tasks etc) A IRC server would pretty much need to run continouslly and read and possibly respond to messages. No of course it might be /possible/ with a some crafty hacking, but its not what appengine was designed for, so it wont be an easy fit. On 15 September 2010 15:09, Luis Díaz diazluis2...@gmail.com wrote: Greetings! anyone knows how to implement an irc server in GAE using python. I have not much information on irc. there are free servers .. or nodes but I would like to implement your own to manage my taste -- Díaz Luis TSU Analisis de Sistemas Universidad de Carabobo -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 500 error trying to reach dashboard
It's certainly a lot better than it was yesterday; however, it is still noticeably worse than before the maintenance took place. Latency is up, PUTs to the datastore take longer and the average CPU time for my main resource is about 200ms more. Also the error rate is a few % higher. On 15 Sep, 22:33, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Is anyone still experience issues? We should be okay now, though we're watching this carefully. On Wed, Sep 15, 2010 at 4:20 PM, Amir amir.shim...@gmail.com wrote: Same here... latency is up and can't access the Dashboard. On Sep 15, 6:50 am, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] server irc
in other words is not very efficient .. is how to implement a chat system using ajax my need is to create a site that manages multiple (hundreds) of chat rooms and I have in mind processes that should be automatic. I thought about being a platform irc chat .. but I'll settle for any alternative that is efficient and in which I can create a client using html / javascript / css -- Díaz Luis TSU Analisis de Sistemas Universidad de Carabobo -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 500 error trying to reach dashboard
Same here with mscwd01. Much better now but still not as good as before the maintenance. On Sep 16, 7:55 am, mscwd01 mscw...@gmail.com wrote: It's certainly a lot better than it was yesterday; however, it is still noticeably worse than before the maintenance took place. Latency is up, PUTs to the datastore take longer and the average CPU time for my main resource is about 200ms more. Also the error rate is a few % higher. On 15 Sep, 22:33, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Is anyone still experience issues? We should be okay now, though we're watching this carefully. On Wed, Sep 15, 2010 at 4:20 PM, Amir amir.shim...@gmail.com wrote: Same here... latency is up and can't access the Dashboard. On Sep 15, 6:50 am, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Unable to add a developer to my app
I'm having the same trouble with trying to send mail from my app as well. Every time I try to invite a developer (another email address in my Google Apps domain) it just defaults to my original email address for that domain. Does anybody have any ideas on how to solve this? Thanks! On Sep 14, 3:46 pm, KWaves lei2...@gmail.com wrote: Hi, I am hosting yyy.com with google apps. In addition, xxx.com is mapped to yyy.com as a domain alias so email to a...@xxx.com will show up in a...@yyy.com's email box. When I access my app engine apps, I go to appengine.google.com/a/yyy.com/ I want my app to send email from a...@xxx.com. So I invite a...@xxx.com as a developer for my app. However, after I complete the process, the developer that shows up is a...@yyy.com. This is fine except when I use the send mail service, I cannot send emails from a...@xxx.com. I must be able to send email from with xxx.com. How can I accomplish this? Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: 500 error trying to reach dashboard
Thanks for the feedback. I'll pass it along. Can you guys update this thread over the next day or so? It'd be extremely helpful if we also know a general % of how much latency was introduced and how many more errors you are seeing. On Thu, Sep 16, 2010 at 12:20 AM, Raymond C. windz...@gmail.com wrote: Same here with mscwd01. Much better now but still not as good as before the maintenance. On Sep 16, 7:55 am, mscwd01 mscw...@gmail.com wrote: It's certainly a lot better than it was yesterday; however, it is still noticeably worse than before the maintenance took place. Latency is up, PUTs to the datastore take longer and the average CPU time for my main resource is about 200ms more. Also the error rate is a few % higher. On 15 Sep, 22:33, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: Is anyone still experience issues? We should be okay now, though we're watching this carefully. On Wed, Sep 15, 2010 at 4:20 PM, Amir amir.shim...@gmail.com wrote: Same here... latency is up and can't access the Dashboard. On Sep 15, 6:50 am, Fredrik Bonander carl.fredrik.bonan...@gmail.com wrote: I've had problems with reaching the dashboard since yesterday with 2 different applications. Is this related to the problems with the datastore? ..fredrik -- Fredrik Bonander carl.fredrik.bonan...@gmail.com +46 70 943 5441 - the infinite power of the creative mind - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please Stop Throttling my App!
That should be the case, yes. If it's not, please let us know. The CPU ms can be greater than 1000ms in aggregate since it includes parallelized calls to the datastore. On Wed, Sep 15, 2010 at 11:02 PM, Robert Kluin robert.kl...@gmail.comwrote: Hi Ikai, I think we all appreciate your response and clarification of this issue. Could you also clarify one more point for us, the 100ms applies about the handler's actual response time and not the cpu_ms, is that correct? In other words it is the first ms number in my logs. The vast majority of my requests complete well under 800ms -- even some doing fairly intensive processing -- but the cpu_ms jumps all over the map (largely) depending on the cpu_api_ms. Thanks for the clarification. Robert On Wed, Sep 15, 2010 at 17:47, Ikai Lan (Google) ikai.l+gro...@google.com ikai.l%2bgro...@google.com wrote: Apologize, I wasn't clear. The 1000ms limit is only for user facing requests. This does not apply to task queues or cron jobs. On Wed, Sep 15, 2010 at 9:44 PM, bFlood bflood...@gmail.com wrote: does this count for the Task Queue as well? if so, how are we suppose to run tasks that span a couple of seconds? are you saying that if one task goes over 1000ms, you're not going to get any new instances? does this ban on new instances last for a certain time period? urlfetch - does one bad network hop (over 1000ms, for whatever reason) cause you not to scale as well (i'm guessing yes)? On Sep 15, 5:38 pm, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: If it scaled linearly like that, we probably wouldn't have problems with long running requests. Unfortunately, long running requests are bad for the ecosystem because they impose a non-linear cost. The number is officially 1000ms. We have been saying 800ms because we allow for some variance. If you tuned your requests to be 990ms and had a period of 10ms of latency, you'd be dead in the water. 800ms is a safe enough number that even if you experienced an additional spike of 100ms-150ms for whatever reason (datastore slowness, unusual usage patterns in your application causing Memcache misses, network latency via URLFetch), you can tolerate it and be fairly confident you will be autoscaled. On Wed, Sep 15, 2010 at 6:51 PM, Flips philip.mates...@driggle.com wrote: @Harshal Actually slower requests mostly consume more cpu time and are much more expensive by default.. On Sep 15, 8:28 pm, Harshal p.hars...@gmail.com wrote: I am OK with Google introducing tiered pricing for handle this issue. Don't take these numbers at their face values, but you would get the point I am trying to make here. Avg. Requests CPU Charges 700ms $0.02/hr 1500ms$0.04/hr 2000ms$0.06/hr For all the requests Google provision new servers but if you requests take longer you pay higher. Not sure if it really makes sense, but the idea of totally not allowing any scaling up is not good enough motivation to write ever more complex apps. On Wed, Sep 15, 2010 at 10:51 PM, Jeff Schwartz jefftschwa...@gmail.com wrote: +1 and a whole lot more :( While it is all our goals to produce efficient applications that can be scaled out, the platform itself has to be usable , might I add, enforce ceilings that don't choke the life out of even the simplest of processes. In that regard I'd be willing to give up a little bit of scalability for somewhat more relaxed quotas. But the real issue I believe is that of imposing unrealistic quotas. It is one thing to show an example of an efficient application built by Google and another to show how that relates to real world applications that though they employ all the same best practices still cannot function within the allowable quotas. Resiliency is also a major issue on App Engine, if 99% of our code is protect the app from what can go wrong and that eats up our quota, what is left for doing real work? It is my desire and I suppose that of many if not even most of the other developers that Google rethink their approach to providing scalability resiliency to the masses on App Engine. Jeff On Wed, Sep 15, 2010 at 12:41 PM, Gordon hall...@gmail.com wrote: bothering, indeed.. On Sep 15, 6:11 pm, Robert Kluin robert.kl...@gmail.com wrote: I am starting to get concerned. A few months ago this number was 1000ms, right? Then about a month or two ago it became 850ms; actually I have even saw the 850
[google-appengine] Re: Do we have an ETA for the resolution of ongoing performance issues.
Ikai, Thanks for listening to and considering our feedback. I saw several of the spike descriptions on the status page were already updated earlier today to be more accurate. I have full confidence that Google engineers work as quickly as possible to resolve the issues during these periods of disruptions. Having good communication from you guys acknowledging the severity of the problem and the efforts being taken to fix it goes a long way towards being able to handle the situation appropriately, both for myself and the users of my app. Thanks for your hard work. -Cameron On Sep 15, 4:32 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hey guys, I understand your frustration. We have many Google services deployed on top of App Engine as well, and we get pressure from both sides anytime events impact production. There are several issues around communication being highlighted here: - App Engine Status page was being updated when we were having latency problems - Status page did not accurately describe the impact - Delay between when we recognized a production event and posting to downtime notify - Downtime-notify emails are being marked as spam We've attempted to take steps in the past to resolve the spam issue, though users are reporting that it hasn't worked. As far as the delay between us accurately identifying a production event and updating the groups - well, we'll have to figure out how we can minimize that. At the very least, there will be a communications post-mortem internally about what we plan on doing to address or at least minimizing the impact of these issues. The option to go into an unplanned maintenance period was on the table, but it was one of those situations where we assessed it as overkill, especially since there were period when the latency appeared to have died down, only to restart again. We don't want to be too trigger happy with unscheduled downtime, as degraded performance is usually preferable to a completely downtime state (many of you may disagree with me, but this is a bit of a judgment call depending on the level of degradation). We're cautiously optimistic at the moment about performance, but at this point, if the spikes begin appearing again, we may initiate another full downtime period. Stay tuned to the downtime-notify list. I'll let my team members know to post using their @google.com accounts to avoid being marked as spam. On Wed, Sep 15, 2010 at 4:10 PM, Cameron came...@gqueues.com wrote: Hi Ikai - Just to be clear the issues have NOT subsided since last night. I hope you guys are working on eliminating the root of the problem and not just monitoring the service closely as the latest App Engine Notify post suggests. http://groups.google.com/group/google-appengine-downtime-notify/brows... And even though the status page says this spike did not affect the performance or uptime of applications - every spike DOES in fact affect the performance of applications (mine at least - GQueues, but probably all apps). These red spikes make my app inaccessible. Even the yellow spikes cause many 500 errors. Basically this makes my app unusable, because users can't get any consistent work done with the frequent errors. http://code.google.com/status/appengine/detail/datastore/2010/09/15#a... Most of all, the frequent errors make my app seem very brittle and deteriorates user confidence. Sales drop and my own forum gets lots of complaints. And then of course people start posting on Twitter. Anyway, I'm sure you guys are working very hard to fix the issues and want App Engine to be as reliable as possible. My suggestion is that you also look to improve communication during these times. I have to respond to my own users during these situations. This becomes very difficult when all I can tell them is Google thinks the issue is resolved and is just monitoring the situation when clearly the status graphs indicate otherwise and people can't access my app. Or Google says the issue didn't affect performance or uptime when clearly it has. -Cameron On Sep 15, 6:13 am, Arny arny...@googlemail.com wrote: We're still getting a lot of 500s (dashboard front end). Did you transferred our apps to lower-cost servers or why is everything working that bad since the maintenance? When are the REAL paid services coming? On Sep 15, 6:17 am, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: Hi Tim, You can track the progress here: http://groups.google.com/group/google-appengine-downtime-notify/brows. .. It's pretty hard to give an ETA, but we'd like to resolve this as soon as possible. We're seeing signs that the issues may have subsided, but we'd like a bit more confidence before giving the all clear. On Tue, Sep 14, 2010 at 6:49 PM, Tim Hoffman zutes...@gmail.com wrote: Hi
