[google-appengine] My datastore stored data size jumps from 28G to 5214G in one day!
Today my datastore stored data size jumps from 28G (yesterday's bill) to 5214G! How can I troubleshoot this issue? My datastore statistic is from 2 days ago and reports 27G. Is it just a reporting issue or a real issue? There is zero change to my application during the past couple days. My appid is aos-prod-1. Please help! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/N3TR1WHkGg4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Search API returns results twice when they meet more than one condition
I know that Search service is not stable enough, so this is just a kind of bug report. I've been playing with Search API. Looks amazing! But I noticed it return a record twice when it meet more than one search filter. For example: results = index.search( search.Query( query_string = '(name:Christopher AND lastname:Ramirez)', options = search.QueryOptions( limit=50, sort_options=search.SortOptions( expressions=[search.SortExpression( expression='name', default_value='')], limit=100) ) ) ) With th above code, records which match both filters (NAME and LASTNAME) will be returned twice. Also, Development SDK 1.6.6 throws an exception if a use a non ASCII char in the above filter string. The production enviroment didn't throw any error. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/5FDFHKjnAdEJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Search API returns results twice when they meet more than one condition
I know that Search service is not stable enough, so this is just a kind of bug report. I've been playing with Search API. Looks amazing! But I noticed it return a record twice when it meet more than one search filter. For example: results = index.search( search.Query( query_string = '*(name:Christopher OR lastname:Ramirez)*', options = search.QueryOptions( limit=50, sort_options=search.SortOptions( expressions=[search.SortExpression( expression='name', default_value='')], limit=100) ) ) ) With th above code, records which match both filters (NAME and LASTNAME) will be returned twice. Also, Development SDK 1.6.6 throws an exception if a use a non ASCII char in the above filter string. The production enviroment didn't throw any error. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/jzmKJ3u-z34J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 1.7.0 Prerelease Now Available
I'm a bit dissapointed. Why next version isn't 1.6.7? What's the big
improve?
On Jun 20, 9:00 pm, Christopher Ramírez blindedbythed...@gmail.com
wrote:
Thanks Guido!
I addressed the issue thank to Alfred Fuller and Timh.
https://groups.google.com/forum/?hl=enfromgroups#!topic/google-appen...
The origin of the problem seems to be that some properties included in the
proyection were not indexed. And yes, you are right, I'm using db.
On Tuesday, June 19, 2012 2:03:23 PM UTC-6, Guido van Rossum wrote:
On Tuesday, June 19, 2012 7:22:15 AM UTC-7, Christopher Ramírez wrote:
On Monday, June 18, 2012 6:00:23 PM UTC-6, Marce (Google) wrote:
- Projection queries are now supported in NDB.
I have problems with projection queries. If I use them with
.order('-__key__').fetch(limit=20) records returned seems to be only the
even or odd ones. I opened a new discussion in this group but it was never
publicised.
To be clear, is this with NDB or with db? (I'm guessing db, since NDB
doesn't support the syntax .order('-__key__') -- you'd have to use
.order(-MyClass._key).
Either way, can you please submit this to stackoverflow, with more details
about what your code looks like and so on, so someone can help you?
--Guido van Rossum
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Google App Engine SOAP call SocketTimeoutException
Yes I have the same issue, I cannot find a way to increase the connect timeout through JAX-WS that is allowed by Google... On Friday, June 1, 2012 11:32:20 AM UTC+2, Deepak Singh wrote: Hi Aljaz, I am still facing the same problem and app is running with problem. Let us do something out of the box so that google puts an attention over the issue. Thanks Deepak On Fri, Jun 1, 2012 at 2:35 PM, Aljaz Delakorda delako...@gmail.comwrote: Hi Deepak, Sorry to contact you in this way, but the Issue where you were discussing has been marked as obsolete. I am having exact same Problem as you described here: http://code.google.com/p/googleappengine/issues/detail?id=5927#c5 I am calling a soap service (via jax-ws) which uses UrlFetch internally. I become very often a SocketTimeotException while fetching the response... Did you find a way how to increase this Timeout? How did you solve the problem? I cannot find any solutions on the web... I hope you can take a second to help me out. Thank you for your time, Best regards, Aljaz Delakorda -- Deepak Singh -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/jcPWb--pZbkJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Task queues not running
All of my task queues have stopped processing about 20 minutes ago, general problem or just me? No changes to our settings. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/2yPYU2mKV2MJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] how to get all entities of one Model for ndb?
as db.Model.all() does. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/aPHU2eqM_3AJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Large text files from blobstore are not being gzipped (AppEngine Java)
Hi everyone, I'm serving a number of text files from the blobstore and while smaller ones are being gzipped by the frontend servers, larger ones are not. Not sure what the threshold is, it could be as low as 4MB. Couldn't find any mention of it anywhere. Our files are text/csv and application/json`. We serve them with a servlet, just like in the documentation: blobstoreService.serve( blobKey, res); That's a major problem for us in terms of customer experience. Has anyone seen that? Thank you -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/BrYdVnjOdJ4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Task queues not running
And they're back. On Thursday, June 21, 2012 10:49:50 AM UTC+1, Kenneth wrote: All of my task queues have stopped processing about 20 minutes ago, general problem or just me? No changes to our settings. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/WLPzYH6vLl0J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Large text files from blobstore are not being gzipped (AppEngine Java)
Probably http://code.google.com/p/googleappengine/issues/detail?id=2820 On Thursday, 21 June 2012 19:56:20 UTC+10, Emanuele Ziglioli wrote: Hi everyone, I'm serving a number of text files from the blobstore and while smaller ones are being gzipped by the frontend servers, larger ones are not. Not sure what the threshold is, it could be as low as 4MB. Couldn't find any mention of it anywhere. Our files are text/csv and application/json`. We serve them with a servlet, just like in the documentation: blobstoreService.serve( blobKey, res); That's a major problem for us in terms of customer experience. Has anyone seen that? Thank you -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/SZoA4fjsuZkJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] how to get all entities of one Model for ndb?
db.Model.query() On Thu, Jun 21, 2012 at 2:52 AM, saintthor saintt...@gmail.com wrote: as db.Model.all() does. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/aPHU2eqM_3AJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] App Engine IRC Chat Time
Hi rodrigo, Sorry abou the confusion. We're transitioning IRC office hours to Hangouts based one. We will create a schedule for the hangouts after I/O, and update the doc accordingly soon. For a time being, please use this forum for discussion. Thanks! -- Takashi On Wed, Jun 20, 2012 at 10:51 AM, coto rodrigo.augo...@gmail.com wrote: What's happening with the IRC Chat Time? I think it is not going anymore, why the information is still on the webpage? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/UgGe4dYi92oJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Takashi Matsuo | Developer Advocate | tmat...@google.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Highly increased number of instances and app over quota. PLEASE HELP!!!
Hi Alexandru, It's just a guess, but one possibility is that one of your task keeps adding another task and then fails, and as a result, you have lots of similar tasks in your queue. Here are few suggestions to prevent it from happening. * Use named task for preventing task bomb https://developers.google.com/appengine/docs/java/taskqueue/overview#Task_Names If you try to add a task with the same name as one of the recent tasks, it'll throw an error. You can just catch that error and ignore it in most cases. * Set appropriate retry count for that queue https://developers.google.com/appengine/docs/java/config/queue#Configuring_Retry_Attempts_for_Failed_Tasks Hope it helps! -- Takashi On Thu, Jun 21, 2012 at 5:33 AM, Alexandru Farcaş alex.far...@expert-group.biz wrote: We had a short period (~40 minutes) when the number of instances increased from 2-3 to ~30 which caused a very hugh increasion of frontend instance hour cost. There was also a problem with the datastore read operations (10 times higher for this period) I think that this happened because a task was multiplied 2000 times. This happened to me a long time ago (2, 3 times) when in a few seconds a single task multiplied more than 2000 times and make the same operation (in my case the read operation). I can't find anything from logs because the space is full with com.google.apphosting.api.ApiProxy$OverQuotaException because I had a budget limit on my app (which was reached). Another unusal thing is that my app has 8 idle instances (normally it has 1-2) My app id: ebashr (HR, AppEngine Java 1.6.3 sdk) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/rRDLKn95_tAJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Takashi Matsuo | Developer Advocate | tmat...@google.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 1.7.0 Prerelease Now Available
This is unfortunate: class HttpHeadersDict(validation.ValidatedDict): A dict that limits keys and values what http_headers allows. http_headers is an static handler key i.e. it applies to handlers with static_dir or static_files keys. An example of how http_headers is used is handlers: - url: /static static_dir: static http_headers: X-Foo-Header: foo value X-Bar-Header: bar value DISALLOWED_HEADERS = frozenset([ 'content-encoding', 'content-length', 'date', 'server' ]) Looks like I'm explicitly disallowed from setting content-encoding, which means I can't serve gzipped assets from a static directory. (Really, I don't understand why Google's CDN doesn't gzip them by default.) I've got some giant JSON files (14MB) to serve for a project I'm currently working on. I've tried putting them in my CherryPy app and letting it handle the gzipping and caching, but then I get out-of-memory errors within a few requests. I like App Engine. I'd rather not be pushed to Heroku or to S3, but not supporting gzip is just silly. According to the FAQ, gzipped content should be served to whoever requests it (https://developers.google.com/appengine/docs/python/runtime#Responses), but that's clearly not happening for static assets: Request URL: http://www.mapperino.com/scripts/routes/sanFrancisco.js Request Method:GET Status Code:200 OK Request Headers: Accept:*/* Accept-Charset:ISO-8859-1,utf-8;q=0.7,*;q=0.3 Accept-Encoding:gzip,deflate,sdch Accept-Language:en-US,en;q=0.8 Cache-Control:max-age=0 Connection:keep-alive Host:www.mapperino.com Referer:http://www.mapperino.com/?map=sanFrancisco User-Agent:Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_3) AppleWebKit/536.5 (KHTML, like Gecko) Chrome/19.0.1084.56 Safari/536.5 Response Headers: Cache-Control:public, max-age=600 Content-Length:14494473 Content-Type:application/javascript Date:Thu, 21 Jun 2012 15:11:05 GMT ETag:TQGJPQ Expires:Thu, 21 Jun 2012 15:21:05 GMT Server:Google Frontend Of course, if anyone has any advice on making gzip work, I'd be happy to hear it. =) Thanks! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/wvLxPt3hankJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Highly increased number of instances and app over quota. PLEASE HELP!!!
Hi Takashi, I will make this changes to my app (named tasks, set retry count to task queue) I have a task (Task1) which adds another task (Task2) but I am doing this in a transaction, with a retry limit of 10. (It is not self creating task). Task1 execution code si surrounding by try catch so if it fails it is not recreated (it just logs the error). In this case it shouldn't create so many tasks... Thanks for the answer, with your advices your situation shouldn't happen. joi, 21 iunie 2012, 16:31:14 UTC+3, Takashi Matsuo (Google) a scris: Hi Alexandru, It's just a guess, but one possibility is that one of your task keeps adding another task and then fails, and as a result, you have lots of similar tasks in your queue. Here are few suggestions to prevent it from happening. * Use named task for preventing task bomb https://developers.google.com/appengine/docs/java/taskqueue/overview#Task_Names If you try to add a task with the same name as one of the recent tasks, it'll throw an error. You can just catch that error and ignore it in most cases. * Set appropriate retry count for that queue https://developers.google.com/appengine/docs/java/config/queue#Configuring_Retry_Attempts_for_Failed_Tasks Hope it helps! -- Takashi On Thu, Jun 21, 2012 at 5:33 AM, Alexandru Farcaş alex.far...@expert-group.biz wrote: We had a short period (~40 minutes) when the number of instances increased from 2-3 to ~30 which caused a very hugh increasion of frontend instance hour cost. There was also a problem with the datastore read operations (10 times higher for this period) I think that this happened because a task was multiplied 2000 times. This happened to me a long time ago (2, 3 times) when in a few seconds a single task multiplied more than 2000 times and make the same operation (in my case the read operation). I can't find anything from logs because the space is full with com.google.apphosting.api.ApiProxy$OverQuotaException because I had a budget limit on my app (which was reached). Another unusal thing is that my app has 8 idle instances (normally it has 1-2) My app id: ebashr (HR, AppEngine Java 1.6.3 sdk) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/rRDLKn95_tAJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Takashi Matsuo | Developer Advocate | tmat...@google.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/t4I3UYvALT0J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] missing files in google-api-python-client-1.0c1.tar.gz?
Good day everyone! I'm just new to python and GAE. I've managed to code a site using python without problem, and now trying to intergrate some google services. I followed this tutorial http://code.google.com/p/google-api-python-client/wiki/Installation 1. downloaded google-api-python-client-1.0c1.tar.gz from http://code.google.com/p/google-api-python-client/downloads/list 2. easy_install --upgrade google-api-python-client 3. tested python plus.py. it starts up the browser, opens up the requesting permission page and then redirect back to my localhost and then I come to this tutorial: https://developers.google.com/appengine/articles/python/getting_started_with_tasks_api task 1 and 2 is cool but then the 3rd one... when I try google-api-python-client\bin\enable-app-engine-project mytasks Traceback (most recent call last): File enable-app-engine-project, line 138, in module main(sys.argv) File enable-app-engine-project, line 113, in main isdir, source_location = find_source(source) File enable-app-engine-project, line 71, in find_source m = __import__(module) ImportError: No module named oauth2 I'm not sure where I should look into but, in my folder, C:\Program Files\Google\google_appengine\lib\google-api-python-client apiclient bin oauth2client uritemplate *and other files and in the folder, ...\google-api-python-client-1.0c1 (folder extracted from google-api-python-client-1.0c1.tar.gz) apiclient bin google_api_python_client.egg-info oauth2client samples tests uritemplate *and other files is all I have. I did some research and heard people saying that, after enable-app-engine-project an app apiclient, httplib2, oauth2, oauth2client, uritemplate and some files for gflags will be copied to the app's directory. now, it seems that the google-api-python-client-1.0c1.tar.gz I've downloaded is missing a lot of files. I've checked the other files in the http://code.google.com/p/google-api-python-client/downloads/list but still couldn't find the missing ones. what should I do here? Regards, -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/Y-_2tK0Tha0J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: The API call search.IndexDocument() required more quota than is available
I have the same problem, com.google.apphosting.api.ApiProxy$OverQuotaException: The API call search.IndexDocument() required more quota than is available. at com.google.apphosting.runtime.ApiProxyImpl$AsyncApiFuture.success(ApiProxyImpl.java:479) at com.google.apphosting.runtime.ApiProxyImpl$AsyncApiFuture.success(ApiProxyImpl.java:382) at com.google.net.rpc3.client.RpcStub$RpcCallbackDispatcher$1.runInContext(RpcStub.java:782) at com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455) at com.google.tracing.TraceContext.runInContext(TraceContext.java:695) But the quota details there are only OKs. In the administration panel under Text Searchhttps://appengine.google.com/search/indexes?app_id=s~radioligenuversion_id=1.359764800228102422, when I select my search index, the response is Server Error A server error has occurred. I guess text search has problems. On Wednesday, June 20, 2012 4:13:33 PM UTC+2, maxie wrote: Hi, getting this error during document indexing, past 24 hours was able to add 499 docs, last 24 hours 294 what up with this? any related quota I see: SearchSearch API Calls [image: 1%] 1%294 of 20,000OkaySearch Stored Data [image: 0%] 0%0.00 of 0.25 GBytesOkay -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/lvQv0bsIjccJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Retrieving Authenticated Google Data Feeds with Google App Engine
Good day everyone!
I'm trying to integrate the gdata service into my app
I've followed this tutorial
https://developers.google.com/appengine/articles/gdata
the step1~3 is created by copy paste, and a step4, which is a snippet
that I found somewhere else
class step4(webapp.RequestHandler):
def get(self):
# Create a client class which will make HTTP requests with Google Docs
server.
client = gdata.docs.service.DocsService()
# Authenticate using your Google Docs email address and password.
client.ClientLogin('usern...@gmail.com', 'pass')
# Query the server for an Atom feed containing a list of your documents.
documents_feed = client.GetDocumentListFeed()
# Loop through the feed and extract each document entry.
for document_entry in documents_feed.entry:
# Display the title of the document on the command line.
print document_entry.title.text
the step4 worked fine locally, but I couldn't figured out what step3 is
about. so, I think maybe I'll need to upload to the server.
during the uploading, I've noticed the messages regarding to the ssl
thingy. and so I installed the pre-compiled ssl-1.15.win32-py2.5.exe that I
found on the web.
the ssl message is gone during the re-upload.
after some more digging, I had managed to pull out the feeds from the
Google services using step3.
I was happy! went to bed, woke up, had a lovely meal then booted up my
computer.
all the sudden the step4 locally, had stopped working.
the traceback looks like this
File ...google_appengine\google\appengine\ext\webapp\_webapp25.py, line
701, in __call__
handler.get(*groups)
File my_app\step1.py, line 35, in get
client.ClientLogin('usern...@gmail.com', 'pass')
File my_app\gdata\service.py, line 834, in ClientLogin
self.ProgrammaticLogin(captcha_token, captcha_response)
File my_app\gdata\service.py, line 771, in ProgrammaticLogin
headers={'Content-Type':'application/x-www-form-urlencoded'})
File my_app\atom\http.py, line 174, in request
return connection.getresponse()
File ...google_appengine\google\appengine\dist\httplib.py, line 222, in
getresponse
deadline=self.timeout)
File ...google_appengine\google\appengine\api\urlfetch.py, line 263, in
fetch
return rpc.get_result()
File ...google_appengine\google\appengine\api\apiproxy_stub_map.py, line
592, in get_result
return self.__get_result_hook(self)
File ...google_appengine\google\appengine\api\urlfetch.py, line 374, in
_get_fetch_result
raise SSLCertificateError(str(err))
SSLCertificateError: ApplicationError: 6 (1, '_ssl.c:491:
error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify
failed')
and here's the traceback from step3
File ...google_appengine\google\appengine\ext\webapp\_webapp25.py, line
701, in __call__
handler.get(*groups)
File my_app\step2.py, line 123, in get
session_token = client.upgrade_to_session_token(auth_token)
File my_app\gdata\service.py, line 903, in upgrade_to_session_token
headers={'Content-Type':'application/x-www-form-urlencoded'})
File my_app\gdata\auth.py, line 731, in perform_request
return http_client.request(operation, url, data=data, headers=headers)
File my_app\gdata\alt\appengine.py, line 151, in request
method=method, headers=all_headers, follow_redirects=False))
File ...google_appengine\google\appengine\api\urlfetch.py, line 263, in
fetch
return rpc.get_result()
File ...google_appengine\google\appengine\api\apiproxy_stub_map.py, line
592, in get_result
return self.__get_result_hook(self)
File ...google_appengine\google\appengine\api\urlfetch.py, line 374, in
_get_fetch_result
raise SSLCertificateError(str(err))
SSLCertificateError: ApplicationError: 6 (1, '_ssl.c:491:
error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify
failed')
they seem to be caused by the same problem.
I've Googled here and there for like 5 hours.
and heard people talking about setting the fetch()'s validate_certificate
variable to False, instead of None
fetch(url, payload=None, method=GET, headers={}, allow_truncated=False,
follow_redirects=True, deadline=None, validate_certificate=None)
Since I'm not using the fetch() directly and the function is in the
appengine's api.
changing the source code probably won't do anything.
is there's any workaround?
also I'm suspicious about the SSL... maybe the ssl library is what's
causing this?
Regards,
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/Sx8fP21iJnoJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] MightyClient
This is awesome.. I like how you kept the code succinct and terse -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/GkD9-qMeFyYJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Task Queue API: Pricing Risk?
I know there cannot be a definitive answer to this question, but I am looking for opinions (and perhaps some insight from a Googler). I currently make heavy use of the task queue, and every time I am faced with a design choice, the task queue presents a very attractive pattern for a number of reasons. One of those reasons is that it is effectively free, currently. This is by no means the primary factor, but it certainly has an impact on my decision process. The obvious question: what is the risk that Google changes its pricing model at some point and starts charging for Task Queue API calls? Were that to happen, I think it would be VERY painful for my app. I don't think it makes sense to design around a possible future pricing change, but it concerns me quite a bit. I would love to hear what the rest of the community thinks. Regards, Mike -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/ZdihbUzynk4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: MightyClient
Thanks! I tried to keep things as simple as possible in this first release. On Thursday, June 21, 2012 1:22:53 PM UTC-4, Gregory Nicholas wrote: This is awesome.. I like how you kept the code succinct and terse -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/ilwdW6nzv4IJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Task Queue API: Pricing Risk?
This is an interesting question, but I wouldn't exactly call tasks free: When a task executes, your instance is invoked. Tasks are really just a way of offsetting cost until later. Jeff On Thu, Jun 21, 2012 at 11:06 AM, Michael Hermus michael.her...@gmail.com wrote: I know there cannot be a definitive answer to this question, but I am looking for opinions (and perhaps some insight from a Googler). I currently make heavy use of the task queue, and every time I am faced with a design choice, the task queue presents a very attractive pattern for a number of reasons. One of those reasons is that it is effectively free, currently. This is by no means the primary factor, but it certainly has an impact on my decision process. The obvious question: what is the risk that Google changes its pricing model at some point and starts charging for Task Queue API calls? Were that to happen, I think it would be VERY painful for my app. I don't think it makes sense to design around a possible future pricing change, but it concerns me quite a bit. I would love to hear what the rest of the community thinks. Regards, Mike -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/ZdihbUzynk4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Task Queue API: Pricing Risk?
Of course, but there is a definitive resource cost to enqueue and dequeue the task (that is in addition to the instance time), and there is currently no charge for that. On the other hand, if I defer work by writing an entity to the datastore and processing it later, I have to pay both read and write costs. On Thursday, June 21, 2012 3:19:28 PM UTC-4, Jeff Schnitzer wrote: This is an interesting question, but I wouldn't exactly call tasks free: When a task executes, your instance is invoked. Tasks are really just a way of offsetting cost until later. Jeff -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/Y9-ZVYnTQP0J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Large text files from blobstore are not being gzipped (AppEngine Java)
Thanks Stuart, indeed it looks like the same issue. I'm gonna try loading the blob content in memory first. It's going to be slower but that's what I've been doing until yesterday: I was compressing large entities and storing them in up to 1MB sized entities. I switched to the blobstore in order to avoid compressing/decompressing and to reduce the delay when fetching them. Unfortunately the lack of Gzip compression is really biting us. On Thursday, 21 June 2012 23:37:08 UTC+12, Stuart Langley wrote: Probably http://code.google.com/p/googleappengine/issues/detail?id=2820 On Thursday, 21 June 2012 19:56:20 UTC+10, Emanuele Ziglioli wrote: Hi everyone, I'm serving a number of text files from the blobstore and while smaller ones are being gzipped by the frontend servers, larger ones are not. Not sure what the threshold is, it could be as low as 4MB. Couldn't find any mention of it anywhere. Our files are text/csv and application/json`. We serve them with a servlet, just like in the documentation: blobstoreService.serve( blobKey, res); That's a major problem for us in terms of customer experience. Has anyone seen that? Thank you -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/vFN1OM0ppXAJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 1.7.0 Prerelease Now Available
Of course, if anyone has any advice on making gzip work, I'd be happy to hear it. =) Hi! I've been fighting with the same issue: https://groups.google.com/forum/?fromgroups#!topic/google-appengine/hv7QOd0ZlKM I use 256MB instances in Java so haven't run into out of heap errors yet while serving entities (I think they're around 10MB max at this stage). So far I've been storing them using gz and had to decompress them in memory before the google frontend servers could serve them gzipped. Now I've switched to the blobstore in order to avoid that but I've discovered that gzip doesnt work, probably just above 1MB. So I'm back to having to load the blob in memory (that should work...) but it costs in terms of CPU time, memory requirements, delays... Emanuele -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/tMjK8vq42w8J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: 1.7.0 Prerelease Now Available
I hate to sound like the cloudflare shill, but why not use them as a frontend cache? One of their touted features is aggressive gzipping of content. Jeff On Thu, Jun 21, 2012 at 2:12 PM, Emanuele Ziglioli theb...@emanueleziglioli.it wrote: Of course, if anyone has any advice on making gzip work, I'd be happy to hear it. =) Hi! I've been fighting with the same issue: https://groups.google.com/forum/?fromgroups#!topic/google-appengine/hv7QOd0ZlKM I use 256MB instances in Java so haven't run into out of heap errors yet while serving entities (I think they're around 10MB max at this stage). So far I've been storing them using gz and had to decompress them in memory before the google frontend servers could serve them gzipped. Now I've switched to the blobstore in order to avoid that but I've discovered that gzip doesnt work, probably just above 1MB. So I'm back to having to load the blob in memory (that should work...) but it costs in terms of CPU time, memory requirements, delays... Emanuele -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/tMjK8vq42w8J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Task Queue API: Pricing Risk?
I have been using TaskQueue for a long time and this view makes no sense to me. You are paying the same price for your Instances and DS read/write when executing a task. To be fair there is a small leeway which GAE gives you on not charging for storing Task parameters. So you have to weight this advantage against unpredictable Task scheduling timing. On Thursday, June 21, 2012 12:33:17 PM UTC-7, Michael Hermus wrote: Of course, but there is a definitive resource cost to enqueue and dequeue the task (that is in addition to the instance time), and there is currently no charge for that. On the other hand, if I defer work by writing an entity to the datastore and processing it later, I have to pay both read and write costs. On Thursday, June 21, 2012 3:19:28 PM UTC-4, Jeff Schnitzer wrote: This is an interesting question, but I wouldn't exactly call tasks free: When a task executes, your instance is invoked. Tasks are really just a way of offsetting cost until later. Jeff -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/MBWO9_b8V2EJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 1.7.0 Prerelease Now Available
Number not matter - matter features.
Better is stable application than fireworks :)
On Jun 21, 9:30 am, Carlos Aguilar Moreno c.aguim...@gmail.com
wrote:
I'm a bit dissapointed. Why next version isn't 1.6.7? What's the big
improve?
On Jun 20, 9:00 pm, Christopher Ramírez blindedbythed...@gmail.com
wrote:
Thanks Guido!
I addressed the issue thank to Alfred Fuller and Timh.
https://groups.google.com/forum/?hl=enfromgroups#!topic/google-appen...
The origin of the problem seems to be that some properties included in the
proyection were not indexed. And yes, you are right, I'm using db.
On Tuesday, June 19, 2012 2:03:23 PM UTC-6, Guido van Rossum wrote:
On Tuesday, June 19, 2012 7:22:15 AM UTC-7, Christopher Ramírez wrote:
On Monday, June 18, 2012 6:00:23 PM UTC-6, Marce (Google) wrote:
- Projection queries are now supported in NDB.
I have problems with projection queries. If I use them with
.order('-__key__').fetch(limit=20) records returned seems to be only the
even or odd ones. I opened a new discussion in this group but it was
never
publicised.
To be clear, is this with NDB or with db? (I'm guessing db, since NDB
doesn't support the syntax .order('-__key__') -- you'd have to use
.order(-MyClass._key).
Either way, can you please submit this to stackoverflow, with more details
about what your code looks like and so on, so someone can help you?
--Guido van Rossum
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Cron jobs not running for production apps
Hi, We have many cron jobs that run as part of our application. Some crons run on FE instances and some hit our Backend instances for execution. Since this morning, teh crons are NOT running at regular intervals. I opened 2 production issues and attached screenshots. It's our production app and crons are very critical for us. We haven't made any changes to our production app in last 1 week. We redployed the app today but that didn't make a difference. Are there known issues in appengine with running cron jobs? Anyone sees similar issue? Thanks Neeli -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/Zl579CSFHe4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: google, FT Search quota API calls 20,000, cuts me off after 499
You're probably running into a burst quota (per minute quota) which limits you to adding ~100 documents/minute. More discussion here: http://stackoverflow.com/questions/10567267/quotas-on-appengine-search-api-for-java/ We'll likely remove this burst quota fairly soon. On Thursday, June 21, 2012 8:14:00 AM UTC+10, Savaş L. wrote: same here.. com.google.apphosting.api.ApiProxy$OverQuotaException: The API call search.IndexDocument() required more quota than is available. appid: pnfmunju On Jun 20, 8:05 pm, Christina Ilvento cilve...@google.com wrote: Hi, Can you provide the app-id for the app that's having the problem? Feel free to send it to me directly (cilvento@). Thanks, Christina On Tue, Jun 19, 2012 at 11:33 PM, maxie likha...@gmail.com wrote: Getting The API call search.IndexDocument() required more quota than is available. Quota page: SearchSearch API Calls [image: 2%] 2%499 of 20,000OkaySearch Stored Data [image: 0%] 0%0.00 of 0.25 GBytes Okay [image: 2%] aparently this is not ok, hope this is bug, 499 api search calls sounds like a joke. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/46pcgfVh4RcJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/CB72Zx6Qb7kJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Java instance startup time out of control
I have updated http://code.google.com/p/googleappengine/issues/detail?id=7706 with this information. On Monday, 18 June 2012 11:44:29 UTC+8, Takashi Matsuo (Google) wrote: On Mon, Jun 18, 2012 at 9:57 AM, Thomas Wiradikusuma wiradikus...@gmail.com wrote: Just my 2 cents, If indeed our app needs to be single-JARred and obfuscaticated (at least removing unused code), IMO that feature should be baked in the tool. Probably triggered with extra flag. I think this is also a good feedback especially if creating the single JAR contributes the performance. I'd appreciate it if you could file an issue. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/xuDU5X1KmnwJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: how to get all entities of one Model for ndb?
On Thursday, June 21, 2012 2:52:01 AM UTC-7, saintthor wrote: as db.Model.all() does. Let me remind people of the NDB cheat sheet which answers every conceivable question about how to spell db's patterns in NDB: https://docs.google.com/a/google.com/document/d/1AefylbadN456_Z7BZOpZEXDq8cR8LYu7QgI7bt5V0Iw/edit --Guido van Rossum -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/bJ7f0jQC9WAJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
