Re: [google-appengine] Re: Increased CPU Time/Request after yesterdays maintenance?

2010-09-14 Thread Alan Xing
DeadlineExceededError throughout all day today and and last night on app id 'snsanalytics' running Python. Frequently, even the admin console is not accessible today. On Tue, Sep 14, 2010 at 3:04 PM, Darien Caldwell wrote: > I had a large cluster of failures around 8PM to 8:30 PM yesterday > (PS

[google-appengine] i'm eating my words on praising GAE team yesterday

2010-09-14 Thread Alan Xing
see what i said yesterday: http://twitter.com/snsanalytics/statuses/24426274831 should i apologize to my 20k+ followers? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com

[google-appengine] datastore object state could not be changed, even through admin console

2010-09-18 Thread Alan Xing
This problem happens since at least Friday 9/17 6pm. A group of data store entries become completely not update-able. This is causing serious ongoing transaction failures in our app (id: snsanalytics). Try this object key: "agxzbnNhbmFseXRpY3NyRgsSB2RiX3VzZXIiHnVzZXI6UmFqbW9oYW4uc2luZGh1QGdtYWlsL

[google-appengine] Re: datastore object state could not be changed, even through admin console

2010-09-18 Thread Alan Xing
In addition, overall transaction conflicts across all entity groups are becoming at least 10 times or even higher, comparing to one day ago. While, our site traffic is actually much lower, as is a weekend norm. On Sat, Sep 18, 2010 at 1:07 AM, Alan Xing wrote: > This problem happens since

[google-appengine] API for updating blacklist

2010-09-23 Thread Alan Xing
Hi GAE Team, To manually maintain the file dos.yaml and update_dos looks a pretty tedious job. I wonder if there is API to update the blacklist. If not yet, what is the roadmap to add the API support? Best, Alan -- http://twitter.com/alanxing http://twitter.com/xinghailiang http://facebook.com/a

[google-appengine] CPU burn rate 10 times higher today on this error: The API call datastore_v3.Get() was explicitly cancelled.

2010-10-12 Thread Alan Xing
Hi GAE Team, Our app 'snsanalytics' is experiencing the following error frequently: "CancelledError: The API call datastore_v3.Get() was explicitly cancelled." Whenever this error happens, a deferred job eats up 50,000+ cpu_ms. This causes our app is burning CPU at 10+ times higher than normal ra

[google-appengine] Re: CPU burn rate 10 times higher today on this error: The API call datastore_v3.Get() was explicitly cancelled.

2010-10-12 Thread Alan Xing
The problem doesn't happen all the time though. To help you better diagnose, we have kept the version 2 of the app 'snsanalytics' unchanged. You can see the problem clearly from the most recent log of version 2. On Tue, Oct 12, 2010 at 6:36 PM, Alan Xing wrote: > Hi GAE

[google-appengine] Billing status is pending since Nov 11

2011-11-15 Thread Alan Xing
This is for the app id 'snsanalytics'. I guess the app is pretty big among all GAE apps. The app could exceed its daily budget ANY TIME. Could anyone in the GAE team help take a look? I emailed appengine_updated_pric...@google.com a couple of days ago, not yet receiving a response. Regards, Alan

[google-appengine] 40%+ increase of frontend instance hours over previous day

2011-12-14 Thread Alan Xing
Dear there, Our app 'snsanalytics' experienced more than 40% front end CPU hours usages on Dec 13, comparing to Dec 12. Our traffic level on Dec 13 is actually flat to less comparing to that of Dec 12. Except for the abnormal increase of front end CPU hours, there is no any noticeable change on ot

Re: [google-appengine] 40%+ increase of frontend instance hours over previous day

2011-12-14 Thread Alan Xing
gt; day. > > ** ** > > ** ** > > ** ** > > *From:* google-appengine@googlegroups.com [mailto: > google-appengine@googlegroups.com] *On Behalf Of *Alan Xing > *Sent:* Wednesday, December 14, 2011 12:16 AM > *To:* google-appengine@googlegroups.com > *S

Re: [google-appengine] 40%+ increase of frontend instance hours over previous day

2011-12-14 Thread Alan Xing
Yes, we are still using the M/S datastore. We feel that we are not offering mission critical services. These services don't require the HRD level availability. HRD db read/write/store all costs more. I know we could save some CPU hours by using Python 2.7 concurrency feature if we move over to HRD.

Re: [google-appengine] Re: 40%+ increase of frontend instance hours over previous day

2011-12-14 Thread Alan Xing
Greg, thanks for offering reference on your HRD experience. Now that HRD is not costing more, we sure will move over soon. I hope GAE team has more of such consideration for the dev community. As far as I can tell, the GAE dev community is still considerably small and fragile, especially comparing

[google-appengine] How long will HRD migration take for 240GB data?

2011-12-26 Thread Alan Xing
I have tried the migration tool on quite a few small apps. The tool ran pretty handy and fast. Each migration took a few minutes to finish. Only for one app, the migration process was stuck. After I reverted and restarted, the migration was completed in a few minutes as well. (Note: the app that ha

Re: [google-appengine] How long will HRD migration take for 240GB data?

2011-12-26 Thread Alan Xing
; google-appengine@googlegroups.com] *On Behalf Of *Alan Xing > *Sent:* Monday, December 26, 2011 5:20 PM > *To:* google-appengine@googlegroups.com > *Subject:* [google-appengine] How long will HRD migration take for 240GB > data? > > ** ** > > I have tried the migration tool

[google-appengine] How long will HRD migration take for 240GB data?

2011-12-27 Thread Alan Xing
I have tried the migration tool on quite a few small apps. The tool ran pretty handy and fast. Each migration took a few minutes to finish. Only for one app, the migration process was stuck. After I reverted and restarted, the migration was completed in a few minutes as well. (Note: the app that ha

Re: [google-appengine] How long will HRD migration take for 240GB data?

2011-12-28 Thread Alan Xing
Just an update. After 32 hours, the migration is still at the very first step 'Catch Up'. If 'Catch Up' takes over 32 hours, I wonder how long the 'Copy' step takes. Shouldn't there be any indicator of progress or time estimation? On Mon, Dec 26, 2011 at 5:3

Re: [google-appengine] How long will HRD migration take for 240GB data?

2011-12-28 Thread Alan Xing
writes to the data? I’m not sure this will ever finish > if the data is changing. > > ** ** > > *From:* google-appengine@googlegroups.com [mailto: > google-appengine@googlegroups.com] *On Behalf Of *Alan Xing > *Sent:* Wednesday, December 28, 2011 12:32 AM > *To:* google-

Re: [google-appengine] How long will HRD migration take for 240GB data?

2011-12-28 Thread Alan Xing
Finally, our migration went to the real 'Copy' step, after over 50 hours. Brandon, your estimate is very accurate! On Wed, Dec 28, 2011 at 9:33 AM, Alan Xing wrote: > Setting to read-only is some later step, right? My migration is still > running at the very first step. >

[google-appengine] deferred tasks not scheduled or executed

2012-08-31 Thread Alan Xing
In a for loop, we schedule around 10 deferred tasks to a dedicated queue. Often times around 50% of the tasks are missing. The tasks are either not added to the queue or not executed. Could some body help explain why? The task parameters are very simple and small. Here is the call. deferred.defer(

[google-appengine] No implementation for kind 'ext_model'

2009-12-18 Thread Alan Xing
Hi folks, Any one know how to resolve this issue. This problem started to happen on one of our test app-id, after we utilized more of the deferred queue capability. The problem doesn't happen on another test app-id with the same code deployed. Thanks, Alan 1. 12-18 07:55AM 15.290 /_ah/queue

[google-appengine] Task Queue problem: Permanent failure attempting to execute task

2009-12-20 Thread Alan Xing
Hi friends, The following error keeps repeating every few minutes on our app. It seems all these errors are from the version 1 code, while our app has been running on version 3 for hours. I wonder: 1. Are these errors really from version 1 code? 2. If so, how do I clean the old queued tasks for

Re: [google-appengine] GAE Python Chinese feed url fetch problem

2009-12-20 Thread Alan Xing
entity" > http://feed.feedsky.com/qiushi > blah > % Total% Received % Xferd Average Speed TimeTime Time > Current > Dload Upload Total SpentLeft > Speed > 100 180k 100 180k0 0 99141 0 0:00:01 0

[google-appengine] Why no implementation for kind 'ext_model'?

2010-01-15 Thread Alan Xing
We have been running into this problem from time to time since we started to actively use the deferred queue. The problem suddenly came back this morning, repeating around 10 times every minute. The Datastore Viewer shows the model 'ext_model' is there. It seems like nobody else ran into this iss

[google-appengine] GAE should learn from Saleforce.com

2010-02-17 Thread Alan Xing
GAE is still having serious post-maintenance hiccup. My cron jobs and deferred tasks essentially stopped executing since 6:20pm, the time maintenance was supposed to be done. Plus, we can not do deployment at this moment. These kind of maintenance nightmare should not happen again. This should be

[google-appengine] users.get_current_user() returns None

2010-03-26 Thread Alan Xing
We have noticed this happening for a few app IDs we have since yesterday. It is getting less frequent for now, but still happening. Wondering if the GAE team is aware of this. -- http://twitter.com/alanxing http://twitter.com/xinghailiang http://facebook.com/alanxing http://www.linkedin.com/in/al

Re: [google-appengine] users.get_current_user() returns None

2010-04-04 Thread Alan Xing
Wesley, The problem still exists, although it doesn't seem causing real harm. You can take a look at app id 'sa-beta'. Login is required on that page in my app. The following is our code that logs the error entry. The page was displayed correctly when the error was logged. *user = users.get_

Re: [google-appengine] users.get_current_user() returns None

2010-04-07 Thread Alan Xing
Wesley, Sure there are robot clicks. The IP addresses you mentioned are indeed bots. However, there were quite many real human clicks that caused the problem. For instance, in the app id 'sa-beta' error log, there is the following entry: 03-15 03:07PM 52.148 /channel/ 500 949ms 330cpu_ms 9kb Mozi

[google-appengine] Re: CRON, big bug today

2009-07-03 Thread Alan Xing
i have two simple per minute crons. It looks like they stopped doing anything since 1:40am PDT July 3rd, even though the admin console updates the cron status timely and reports the crons are running successfully. On Fri, Jul 3, 2009 at 2:49 AM, Sylvain wrote: > > Sorry to insist but there is no

[google-appengine] GAE production error at this moment? : Class-key is a derived property and cannot be set.

2009-10-12 Thread Alan Xing
E 10-12 03:02PM 22.599 Class-key is a derived property and cannot be set. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.c

[google-appengine] Re: GAE production error at this moment? : Class-key is a derived property and cannot be set.

2009-10-12 Thread Alan Xing
class' attribute on a > PolyModel instance. Have you been doing anything like this (maybe > created your own 'class' property) or is this something that started > happening with the new API release? > > On Oct 12, 3:18 pm, Alan Xing wrote: > > E 10-12 03:02PM

[google-appengine] Re: GAE production error at this moment? : Class-key is a derived property and cannot be set.

2009-10-12 Thread Alan Xing
is problem before. Please help not just our current users and customers. I'm counting it on to do live demo tomorrow morning as well. On Mon, Oct 12, 2009 at 10:59 PM, Alan Xing wrote: > Again my app-id is snsanalytics. this started happening only this > afternoon. and it is still happen

[google-appengine] Re: GAE production error at this moment? : Class-key is a derived property and cannot be set.

2009-10-13 Thread Alan Xing
d you please help share? Note: We actually resolved the 'Class-key is a derived property and cannot be set.' problem by some hack. But there are more problems with 'appenginepatch' after that. Thanks, Alan On Mon, Oct 12, 2009 at 11:15 PM, Alan Xing wrote: > It is v

[google-appengine] Re: GAE production error at this moment? : Class-key is a derived property and cannot be set.

2009-10-13 Thread Alan Xing
the Model > constructor that it is loading from the datastore and can ignore > errors that occur when assigning to derived (read-only) properties. > > Thanks for bringing this issue to our attention. Let me know if > there is anything else I can do to help. > > - Rafe Kaplan

[google-appengine] GAE Python Chinese feed url fetch problem

2009-11-18 Thread Alan Xing
Hi there, We have run into this feed fetch problem, with GAE Python code throwing DownloadError. This problem seems to happen to a lot of feeds with Chinese characters inside. Almost any feed from feedsky.com causes such problem. http://feed.feedsky.com/qiushi http://feed.feedsky.com/ihero http:/

[google-appengine] Interim GAE failures happening right now

2009-12-02 Thread Alan Xing
Hi folks, The app-id snsanalytics is running this interim problems at this moment. It seems a file node failure inside GAE? Alan File "/base/data/home/apps/snsanalytics/1.338147245967300836/common/zip-packages/django-1.1.zip/django/template/loader.py", line 108, in render_to_string File "/b

[google-appengine] How to get the current user's Name and TZ Info?

2009-07-02 Thread Alan Xing
In our application, we want to say a friendly welcome msg to a logged in user as 'Welcome, First Name', instead of 'Welcome, x...@gmail.com'. Could any one help point out what is the API to read those basic Google Account info? From the official Google Data API doc, it doesn't look like there is a

[google-appengine] Indexes in 'Error' status for more than 24 hrs

2009-07-02 Thread Alan Xing
Hi Google team, Could any of you give a hint on it? I tried to deploy the same app to two app ids. One is showing the error, and not showing quite a few other indexes. The other is perfectly fine. One difference I can think of is the bad one has a little bit more data (storage quota shows 40MB).