Re: [google-appengine] Re: GAE / Datastore issues right now?

2018-02-15 Thread Waleed Abdulla
Same here. Affecting all our apps. Seems like a global issue. On Thu, Feb 15, 2018 at 12:16 PM, Patrick Tessier < patrick.tess...@bookedin.net> wrote: > Yes, I am seeing the same thing. Just in the last 10 minutes... Datastore > timeouts etc. > > > On Thursday, February 15, 2018 at 2:07:48 PM

[google-appengine] Re: twitter API suddenly returning error 32 “Could not authenticate you.” only in prod GAE

2015-05-01 Thread Waleed
My app was also rolled back to 1.9.19 yesterday. Then later it was back on 1.9.20, but the error seems to have been fixed. I also got email confirmations from customers that they're not seeing this problem any more. Great team work. -- You received this message because you are subscribed to

[google-appengine] Re: twitter API suddenly returning error 32 “Could not authenticate you.” only in prod GAE

2015-04-30 Thread Waleed
Another update. It seems that the issue is happening in App Engine release 1.9.20. Some of the instances in my app are on this release, and others are on the previous 1.9.19. We didn't a full scan, but based on manual inspection it seems that all the errors are happening on requests that are

[google-appengine] Re: twitter API suddenly returning error 32 “Could not authenticate you.” only in prod GAE

2015-04-29 Thread Waleed
Thanks, Dave. I did a similar test but I got different results. I used an ssh tunnel and tcpdump to monitor the request coming from App Engine production and dev server. In both cases, my tweet text was: Test!'*. This is what I got: *Request coming from App Engine Production:* POST

[google-appengine] Re: twitter API suddenly returning error 32 “Could not authenticate you.” only in prod GAE

2015-04-29 Thread Waleed
I simplified the test to one line: *urlfetch.fetch(http://173.203.209.168/home/wizards?status=Test%27;, method=POST)* On production, I receive: *POST /home/wizards?status=Test' HTTP/1.1* And in local dev server, I receive: *POST /home/wizards?status=Test%27 HTTP/1.1* -- You received this

Re: [google-appengine] Re: The API call taskqueue.BulkAdd() took too long to respond and was cancelled

2014-07-15 Thread Waleed Abdulla
+1 Seeing a lot of those errors recently. On Mon, Jul 14, 2014 at 9:55 AM, DB do...@hubmanity.com wrote: Same here. Mainly happens with taskqueue.BulkAdd(), but we've had a few for urlfetch.Fetch() and mail.Send(). We also didn't have any problem like this before, it suddenly started

[google-appengine] Email feedback loop notifications when emails are marked as spam

2014-04-23 Thread Waleed Abdulla
The top email APIs (like Sendgrid and Amazon SES) notify applications when an email bounces or is marked as spam. They know when an email is marked as spam through email feedback loop agreements with major email client providers. App Engine notifies

Re: [google-appengine] Problems with ImageUrls served from Blob Store of image files uploaded to Google Cloud Storage

2013-09-26 Thread Waleed Abdulla
I started noticing something that might be related today. I store images in the Blob Store as well, and the generated serving URL works when I open it in a browser. But that same URL returns 404 when I fetch it from inside the app with urlfetch. It wasn't working for a few hours, but now it is.

Re: [google-appengine] blobstoreservice serve with google storage - unreliable behavior

2013-09-25 Thread Waleed Abdulla
I noticed something similar today in one of my apps which I uploaded today. The other app (an exact copy, one is dev and the other is production) works okay. I store images in the Blob Store, and at some point I fetch them with urlfetch.fetch(). These calls are now returning a 404 error. For

Re: [google-appengine] blobstoreservice serve with google storage - unreliable behavior

2013-09-25 Thread Waleed Abdulla
Oh, and the same urlfetch call returns 500 error when done in the local dev server. Which used to work before I downloaded the recent update. On Wed, Sep 25, 2013 at 7:14 PM, Waleed Abdulla wal...@ninua.com wrote: I noticed something similar today in one of my apps which I uploaded today

Re: [google-appengine] Re: Has anyone received a warning email like this?

2013-07-17 Thread Waleed Abdulla
been resolved and everything is back to normal. Waleed On Tue, Jul 16, 2013 at 8:25 PM, John Wheeler j...@highvolumeseller.comwrote: Hi - Can you post an update on your situation? It troubles me to hear what Google sent you and I'd like to know if it was resolved properly. Thanks, John

Re: [google-appengine] Re: Has anyone received a warning email like this?

2013-07-12 Thread Waleed Abdulla
-a-to-b.com wrote: Hi Waleed, Have you received a response from Google? If you would like us to help you understand that unusual activity, please reply directly to this email. It is indeed puzzling that they send a link to Bulk Email Sender guidelines if your app does not send emails. Regards

[google-appengine] Has anyone received a warning email like this?

2013-07-11 Thread Waleed Abdulla
what to fix. Has anyone received such email? How did you handle it? Regards, Waleed -- Forwarded message -- From: google-cloud-complia...@google.com Date: Thu, Jul 11, 2013 at 3:14 PM Subject: [5-749501307] Your Google App Engine Application To: nore...@google.com Hello

Re: [google-appengine] Re: Has anyone received a warning email like this?

2013-07-11 Thread Waleed Abdulla
On Thu, Jul 11, 2013 at 8:04 PM, Lawrence Mok lawre...@a4support.comwrote: so what have you done to get this email? That's exactly what I'm trying to figure out. This is the site, in case someone can point out something wrong about it. http://www.symphonytools.com -- You received this

Re: [google-appengine] Re: DKIM - not clear why not working

2012-10-02 Thread Waleed Abdulla
You seem to be doing better than I am. I'm not even able to get Google Apps dashboard to verify my DKIM DNS records for over a week now and I've tried every possible thing I can think of. On Tue, Oct 2, 2012 at 11:28 AM, johnP j...@thinkwave.com wrote: Wanted to 'bump' this issue - almost a

Re: [google-appengine] Re: DKIM - not clear why not working

2012-10-02 Thread Waleed Abdulla
Confirmed there is a problem on Google side: https://productforums.google.com/forum/#!category-topic/apps/verification-and-mx-records/FOsrXULt66Y On Tue, Oct 2, 2012 at 3:19 PM, Waleed Abdulla wal...@ninua.com wrote: You seem to be doing better than I am. I'm not even able to get Google

Re: [google-appengine] Re: NDB ImportError!

2012-09-25 Thread Waleed Abdulla
, Sep 24, 2012 at 10:41 PM, Anand Mistry amis...@google.com wrote: Is a DeadlineExceededError exception raised on the first request to the instance? On Tuesday, 25 September 2012 13:00:00 UTC+10, Waleed wrote: Hi all, I'm getting random import errors from time to time. They start on one

Re: [google-appengine] Naked https (SSL) domain?

2012-09-24 Thread Waleed Abdulla
time! Waleed On Sun, Jul 22, 2012 at 10:22 AM, Drake drak...@digerat.com wrote: Talk to the Apps For Domains guys. If you get a good answer share it with the list. Currently I think this is the biggest limitation of GAE/GAFD. You pretty much have to have a redirect server out in the world

[google-appengine] NDB ImportError!

2012-09-24 Thread Waleed Abdulla
* But that doesn't seem to solve the problem. What am I missing? I'm including the stack trace below. Thanks Waleed 2012-09-24 13:28:32.968 /panorama/blogger?stream_suffix=__bloggerlast_visit_date=1348495705view=manageoffset=0limit=5parent_page_name=panorama 500 291ms 0kb Mozilla/5.0

[google-appengine] Anyone else having difficulty deploying to GAE in the last two days?

2012-08-22 Thread Waleed Abdulla
Usually when I deploy to GAE (using appcfg.py) it takes less than a minute. Occasionally, it might takes a couple of minutes. But in the last two days, it's been consistently taking 5 to 10 minutes each time! I'm deploying to our dev app, which has very little traffic. Sometimes it even fails

Re: [google-appengine] Re: Backend performance, compared

2012-08-08 Thread Waleed Abdulla
Thanks, Jeff. Is it possible to repeat the test with qps 10 to rule out the limit that Johan pointed out? In other words, how big is the performance difference if you had less requests that do more work? On Wed, Aug 8, 2012 at 10:48 AM, Jeff Schnitzer j...@infohazard.org wrote: On Wed, Aug

Re: [google-appengine] Re: ArgumentError: An error occurred parsing (locally or remotely) the arguments to datastore_v3.Put().

2012-08-01 Thread Waleed Abdulla
I'm getting this error as well, a lot. Did you find a work-around? I opened an issue, but a quick search shows that the app engine team thinks this is fixed already! http://code.google.com/p/googleappengine/issues/detail?id=7917 On Mon, May 21, 2012 at 1:40 PM, jay kyburz@gmail.com

Re: [google-appengine] HRD migration tool hangs for hours - how to find a root cause?

2012-07-04 Thread Waleed Abdulla
, and the second 6 hours. On the last sync it stayed on 99% too long so I stopped it and jumped to the last stage (read-only mode) and that made it much faster. Waleed On Tue, Jul 3, 2012 at 12:58 AM, Alexander Trakhimenok alexander.trakhime...@gmail.com wrote: We are migrating our app to an HRD version

[google-appengine] Is GAE down for anyone else?

2012-06-27 Thread Waleed Abdulla
Our app went down and started showing the Server Error page for all URLs, but the dashboard doesn't show any new requests hitting the app as of 10 minutes ago. We're on HRD (migrated two weeks ago). Anyone else noticing a similar problem? Waleed App id: networkedblogshr. -- You received

[google-appengine] Re: Is GAE down for anyone else?

2012-06-27 Thread Waleed Abdulla
I managed to fix the problem by uploading the app again. This is the first time I encountered an issue like this where the dashboard works but requests never reach my instances (or maybe they do but the instances are not capable of logging them). On Wed, Jun 27, 2012 at 1:55 AM, Waleed Abdulla

[google-appengine] Sort Orders Are Ignored on Multi-ValuedProperties?

2012-06-22 Thread Waleed Abdulla
I have a model with a multi-valued property, events, and I want to filter by a specific range of events and sort by them at the same time: class MyModel(db.Model): events = db.StringListProperty(indexed=True) print MyModel.all().filter(events =, x).filter(events =, y).order(events).fetch(100)

Re: [google-appengine] Re: Task Queue API: Pricing Risk?

2012-06-22 Thread Waleed Abdulla
I wonder if the task queue is using the datastore behind the scenes and the cost of those calls are included in the datastore quota? Have you checked to see if using the task queue increases your datastore calls? If so, then it's not exactly free. On Fri, Jun 22, 2012 at 3:33 PM, Jason Collins

Re: [google-appengine] App engine app spinning up instances out of control

2012-06-08 Thread Waleed Abdulla
Johan, Thanks for letting us know. I just filed a production issue for this before reading your response: http://code.google.com/p/googleappengine/issues/detail?id=7664 On Fri, Jun 8, 2012 at 7:47 AM, Johan Euphrosine pro...@google.com wrote: The Master Slave infrastructure is

Re: [google-appengine] Re: Appengine down (M/S Datastore)

2012-06-08 Thread Waleed Abdulla
Please add your app details to this issue: http://code.google.com/p/googleappengine/issues/detail?id=7664 On Fri, Jun 8, 2012 at 8:26 AM, Nikhil Jain nikhil.jaint...@gmail.comwrote: Dear Doug, Here in India also we'r promising to our customer about 99.9% up-time servers. but this is truly

Re: [google-appengine] Re: Problem with mail quota

2012-06-08 Thread Waleed Abdulla
I'm hit by this problem as well. Trying to migrate an app from M/S to HRD, but can't because the new app can't handle the email load. We sends thousands of emails a day right now from the M/S app, and if we make the switch to HRD we'll not be able to send emails for a while. Even worse, the new

Re: [google-appengine] Re: Unusually high memcache latencies

2012-05-22 Thread Waleed Abdulla
I'm noticing excessive datastore delays today (M/S), and generally a lot of API calls timing out. Might be related. Errors like: *DeadlineExceededError: The API call logservice.Flush() took too long to respond and was cancelled.* Also: *class

Re: [google-appengine] Re: Unusually high memcache latencies

2012-05-22 Thread Waleed Abdulla
attention: code.google.com/p/googleappengine/issues/detail?id=7554 On Tue, May 22, 2012 at 3:27 PM, Waleed Abdulla wal...@ninua.com wrote: I'm noticing excessive datastore delays today (M/S), and generally a lot of API calls timing out. Might be related. Errors like

Re: [google-appengine] Re: Seeing huge delays on task queue execution - 13sec+ per task

2012-03-28 Thread Waleed Abdulla
Agreed. More control over priority of tasks would be nice. I'd like to be able to designate a queue as high-priority so it's tasks execute at the same priority as user requests, or low-priority so they only execute when there are free instances and no other pending requests. On Tue, Mar 27,

Re: [google-appengine] In your opinion what are the most complex web applications built on top of google app engine ?

2012-03-27 Thread Waleed Abdulla
Waleed is the sleeping giant on this list. Every so often he steps out of the shadow says something like “I made this change and it cut my instances by about 450” or ... Haha. Having a huge monthly bill is *not* something to celebrate :) Waleed, we'd love to hear some war stories if you

Re: [google-appengine] Re: equivalent for is_saved() with ndb

2012-03-27 Thread Waleed Abdulla
I've been looking for a good way to do something similar as well. I load (or create) an entity, do some operations on it (that may or may not change the entity), and then at the end I need to save it or skip saving it if nothing has changed. It would be nice to have something like is_dirty() which

Re: [google-appengine] In your opinion what are the most complex web applications built on top of google app engine ?

2012-03-26 Thread Waleed Abdulla
current app, NetworkedBlogs, is a big app as well: 1TB of data, 60~ front-end instances + 28 backend instances, 37 entity types (many of which contain a lot of data in JSON format, as Jeff said, they would expand to several tables each on a relational database). Waleed On Mon, Mar 26, 2012 at 1

Re: [google-appengine] Sharp increase in instance count starting two days ago!

2012-03-17 Thread Waleed Abdulla
types, and we use the blobstore as well. Also, it worries me that if something goes wrong after I flip the switch, I have no way to contact anyone to get help. Good point about the reserve of goodwill, Jeff. I've definitely been tapping into my goodwill savings recently. Waleed On Fri, Mar 16, 2012

Re: [google-appengine] Python2.7 Port: My 10x one line of code

2012-03-17 Thread Waleed Abdulla
Try with threadsafe:False and see if it affects the delay. It shouldn't, but it's worth a try. When I switched one of my apps to 2.7 a few months ago, enabling threadsafe caused 10x increase in response time so I disabled it right away. On Sat, Mar 17, 2012 at 11:59 AM, Brandon Wirtz

Re: [google-appengine] Re: Switched to HRD - So far not impressed

2012-03-17 Thread Waleed Abdulla
I thought HRD was supposed to solve the bad neighbor problem. As I read somewhere (don't have the reference handy right now), when your app issues a read request, it's sent to multiple datastore replicas in parallel and the app takes the data from whichever datastore replies first. On Fri,

[google-appengine] Sharp increase in instance count starting two days ago!

2012-03-16 Thread Waleed Abdulla
on Py2.5 master/slave datastore. Waleed -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr

Re: [google-appengine] Need more backend instances!

2012-01-31 Thread Waleed Abdulla
Robert, I don't have a link to the request now, but it was a form to request quota increases. And, no, I don't have premier support. Someone from the App Engine team was kind enough to reach out to help, so I'm hoping I'll get the extra instances I need soon. Waleed On Mon, Jan 30, 2012

[google-appengine] Need more backend instances!

2012-01-30 Thread Waleed Abdulla
that GAE allows me to scale, but we're not able to scale now due to artificial limitations. Can anyone from Google help with this? app id is networkedblogs. Regards, Waleed -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post

Re: [google-appengine] Re: 1.6.2 Pre-Release SDKs Out

2012-01-26 Thread Waleed Abdulla
It would be super cool if the backup feature allows me to backup my data to Google's Cloud SQL so it's a backup and, as the same time, a good place to run reports that require the complex queries that SQL is good at. On Wed, Jan 25, 2012 at 9:39 AM, someone1 someo...@gmail.com wrote: Strike

Re: [google-appengine] speed up fetching of larger data set

2012-01-26 Thread Waleed Abdulla
You didn't mention if you're fetching the entities using their keys or with a query. If you can fetch with keys, it's faster. And, also, increase your batch size: db.get([list of 1000 keys]) Another thing you might want to try is using async operations so you trigger the fetches one after

Re: [google-appengine] Budget changes not taking effect!!

2012-01-21 Thread Waleed Abdulla
-appengine@googlegroups.com] *On Behalf Of *Waleed Abdulla *Sent:* Friday, January 20, 2012 9:51 PM *To:* google-appengine *Subject:* [google-appengine] Budget changes not taking effect!! ** ** I ran a big mapreduce job today and now my app is close to reaching it's max daily budget, so I'm

[google-appengine] Budget changes not taking effect!!

2012-01-20 Thread Waleed Abdulla
I ran a big mapreduce job today and now my app is close to reaching it's max daily budget, so I'm trying to increase the budget to avoid a downtime. I went to the billing settings page, changed the budget, went through the Google Checkout successfully, and it took me back to the billing settings

Re: [google-appengine] Re: SSL on Custom domains before 2014 ?

2012-01-17 Thread Waleed Abdulla
I filled the form a couple of months ago and haven't heard back! On Tue, Jan 17, 2012 at 6:48 AM, objectuser kevin.k.le...@gmail.com wrote: Cayden, I signed up for the Trusted Tester Program over a week ago and have not heard back. Is there something else I need to do? Thanks! -- You

Re: [google-appengine] Re: App Engine 1.6.1 Released!

2011-12-13 Thread Waleed Abdulla
? WARNING: Starting with the 1.6.2 release of the experimental Python 2.7 runtime, the mapreduce and datastore_admin builtins will not be supported. Regards, Waleed On Tue, Dec 13, 2011 at 11:46 AM, Vivek Puri v...@vivekpuri.com wrote: Ikai, Looking at my Application setting, i see

[google-appengine] How to catch Out of Memory errors?

2011-12-05 Thread Waleed Abdulla
() statements in the code, but the problem is that nothing is logged when the instance is killed this way. I also tried using logservice.flush(), but that doesn't seem to help. I cannot get any data out of that instance to help me debug the problem. Any tips? Waleed -- You received this message

[google-appengine] Why am I not allowed to reserve backend instance hours?

2011-12-05 Thread Waleed Abdulla
the discounted price! Am I missing something? Waleed -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr

Re: [google-appengine] How to catch Out of Memory errors?

2011-12-05 Thread Waleed Abdulla
. Along the way you will likely find you have a loop until the end of time statement somewhere ** ** ** ** ** ** ** ** *From:* google-appengine@googlegroups.com [mailto: google-appengine@googlegroups.com] *On Behalf Of *Waleed Abdulla *Sent:* Monday, December 05, 2011 7:17 PM

Re: [google-appengine] Why am I not allowed to reserve backend instance hours?

2011-12-05 Thread Waleed Abdulla
it matter if the free hours are for front or back? ** ** ** ** *From:* google-appengine@googlegroups.com [mailto: google-appengine@googlegroups.com] *On Behalf Of *Waleed Abdulla *Sent:* Monday, December 05, 2011 7:28 PM *To:* google-appengine *Subject:* [google-appengine] Why am I not allowed

Re: [google-appengine] Help resolve massive performance regression in 2.7 vs 2.5 runtime

2011-11-15 Thread Waleed Abdulla
the problem (and, of course, raised my instance count to it's original level). Like the original poster, I was hoping that multithreading will reduce my instance cost, but that plan failed. Am I doing something wrong? Or is multi-threading not ready for live traffic yet? Waleed app id: bitpixelshr

Re: [google-appengine] new billing policy and fan-out

2011-11-09 Thread Waleed Abdulla
reduce read ops. - You can use a backend instance with a lot of memory to store big parts of recent updates so that for most users you can generate the stream in memory. Waleed On Tue, Nov 8, 2011 at 9:52 PM, Herbert herber...@gmail.com wrote: I'm building a system with news feed style

Re: [google-appengine] Early experimental release of Yaac! Which allows you execute query with aggregation functions / multiple inequality filters etc.

2011-10-31 Thread Waleed Abdulla
features that no one wants to use. Good luck, Waleed On Mon, Oct 31, 2011 at 9:24 AM, Max thebb...@gmail.com wrote: As we all know we can not use join, aggregation functions, group by or multiple inequalities in datastore query. Google's argument is these relational feature are not scalable

Re: [google-appengine] Re: Announcing SSL for Custom Domains Trusted Tester Program

2011-10-20 Thread Waleed Abdulla
Which of the options allows using naked domain? I'm guessing VIP, right? Waleed On Thu, Oct 20, 2011 at 9:00 AM, Anton Novopashin antonev...@gmail.comwrote: I have filled form allready -- You received this message because you are subscribed to the Google Groups Google App Engine group

Re: [google-appengine] New pricing scheme and concerns about abuse

2011-09-11 Thread Waleed Abdulla
. If you want to write your own code, you might find Brett's dos.py module useful. Brett wrote this for the PubSubHubbub project, but you can take it and use it in your project. http://code.google.com/p/pubsubhubbub/source/browse/trunk/hub/dos.py Waleed On Sun, Sep 11, 2011 at 2:27 AM, Bay troels

Re: [google-appengine] Re: Python library for uploading to AppEngine

2011-09-11 Thread Waleed Abdulla
I've done something close in the past where I have a GAE app that pulls Python script from another location and executes it. Not sure if that helps you, but here it is. Make sure the script is safe, though, because it'll be running against your own datastore. try:

Re: [google-appengine] Re: Instances + Memcache + Users

2011-09-09 Thread Waleed Abdulla
There is a function, get_stats(), that gives you some data about your memcache usage, including the total size of stored data. You might want to run a test by starting as much as you can in memcache while watching the total stored data and when that hits a ceiling, you'll know how much is

Re: [google-appengine] Changing max idle instances affects task queues?

2011-09-08 Thread Waleed Abdulla
that control the rate of queue execution? Waleed On Wed, Sep 7, 2011 at 10:35 PM, Robert Kluin robert.kl...@gmail.comwrote: When I adjusted those settings my performance was abismal. I like Vivek's suggestion of moving one-at-a-time. Most likely your requests in that queue are taking over

Re: [google-appengine] Re: Built-in indexes are costing me $200/day

2011-09-07 Thread Waleed Abdulla
. How do you fix that? Run a map-reduce job to read/write the whole table. It's not as clean and manageable as having everything in one index.yaml file. Waleed P.S. same posted on issue page as well. On Tue, Sep 6, 2011 at 11:53 PM, renderpaz kev...@gmail.com wrote: Thanks for pointing

Re: [google-appengine] Best practice to save entity avoiding duplicate

2011-09-07 Thread Waleed Abdulla
Works, unless you want to allow users to edit their entries. If a user changes the address after submitting then the new key is now different and you'll end up saving a second entity. I wouldn't use any user editable data in the key. Instead, I'd add a separate column to include your hash. On

[google-appengine] Changing max idle instances affects task queues?

2011-09-07 Thread Waleed Abdulla
I noticed today that the performance of my task queue has dropped considerably (see image). The highlighted queue is set to run 8 tasks/second (i.e. ~ 480 per minute) but it's running at 25% of that rate, and a backlog is building up. The only thing I changed recently is reducing my max idle

Re: [google-appengine] Re: Porting App Engine app to other provider - ideas and discussion

2011-09-03 Thread Waleed Abdulla
RackSpace and Softlayer, and they're both really good. I hope this helps. I have a huge amount of code which makes re-writing my apps almost impossible. If your code base is still small, you might have other options as well. Waleed On Sat, Sep 3, 2011 at 6:06 AM, Raymond C. windz...@gmail.com wrote

Re: [google-appengine] Re: Data Transfer to AWS

2011-09-01 Thread Waleed Abdulla
Another tool I used in the past to move my data into GAE (it works both ways) is App Rocket. It uses timestamps to do real-time replication between GAE and mysql. You might need to tweak it a little bit to fit your need exactly, but it gets you most of the way there.

Re: [google-appengine] A comparison of your current bill against the new pricing model is now available in the Billing History page.

2011-08-31 Thread Waleed Abdulla
It's 300% for me (3x what I pay now). Most of the cost is datastore writes and reads, followed by instance hours. On Wed, Aug 31, 2011 at 1:26 PM, pdknsk pdk...@googlemail.com wrote: It's an about 50% increase for me, because of datastore writes. -- You received this message because you

Re: [google-appengine] Increaded DeadlineExceeded / Timeout exceptions

2011-08-09 Thread Waleed Abdulla
user complains. Will On Mon, Aug 8, 2011 at 1:35 AM, Waleed Abdulla wal...@ninua.com wrote: Yes, that's been going on for weeks. Some times the error rate is so high the app is basically non-functional. On Fri, Aug 5, 2011 at 10:50 AM, Christopher cspeckrun@gmail.com wrote

Re: [google-appengine] Re: Is there any outage at appengine.. please respond if you feel the same

2011-08-09 Thread Waleed Abdulla
I also experienced an outage on two of my apps about an hour ago. It started with a considerable slowing down of requests, and then it went completely down, including the app engine dashboard. 15 minutes later it came back online, and it's still okay so far. During that outage period, the app

Re: [google-appengine] Re: Is there any outage at appengine.. please respond if you feel the same

2011-08-09 Thread Waleed Abdulla
Johan, It's back to normal now. My app ids are networkedblogs and networkedhub. I'm attaching my errors/second graph during the outage period. Waleed On Tue, Aug 9, 2011 at 12:22 AM, Johan Euphrosine pro...@google.com wrote: Please open a production issue with your appid: http

Re: [google-appengine] Re: Is there any outage at appengine.. please respond if you feel the same

2011-08-09 Thread Waleed Abdulla
couldn't access the other app's dashboard at the time. I stared the issue and I'll try to add more details if I can. Thanks, Waleed On Tue, Aug 9, 2011 at 12:59 AM, Johan Euphrosine pro...@google.com wrote: After taking a closer look it seems that only networkedblogs has been impacted. Do

Re: [google-appengine] Increaded DeadlineExceeded / Timeout exceptions

2011-08-08 Thread Waleed Abdulla
Yes, that's been going on for weeks. Some times the error rate is so high the app is basically non-functional. On Fri, Aug 5, 2011 at 10:50 AM, Christopher cspeckrun@gmail.comwrote: Within the past week or so we've noticed an increased amount of DeadlineExceeded / Timeout Exceptions on

Re: [google-appengine] Re: 1.5.2 is out!

2011-07-21 Thread Waleed Abdulla
Will there be a max pending latency option later? My problem is usually that the pending latency is too high. Waleed On Thu, Jul 21, 2011 at 3:37 PM, Brandon Donnelson branflake2...@gmail.comwrote: Why is the eclipse repository always delayed about a day? Brandon Donnelson http://gwt

Re: [google-appengine] HardDeadlineExceptions after the maintenance

2011-07-16 Thread Waleed Abdulla
to be responsive and fix serious problems quickly. On Sat, Jul 16, 2011 at 7:05 AM, Robert Kluin robert.kl...@gmail.comwrote: Hey Waleed, Posting to the list is always good, but for this type of thing I'd also submit a prod issue (and ideally include a link to it in your groups post). http

Re: [google-appengine] Re: HardDeadlineExceptions after the maintenance

2011-07-15 Thread Waleed Abdulla
Confirming that the issue on the GAE's side. Some requests take a very long time and then timeout. App is completely down now for several hours. On Thu, Jul 14, 2011 at 10:44 PM, Black Snapper ja...@jecahill.com wrote: My users are extremely angry as well. We are getting negative reviews in

Re: [google-appengine] Re: HardDeadlineExceptions after the maintenance

2011-07-15 Thread Waleed Abdulla
Anyone know of a way to alert the GAE team? The status page doesn't show any problems so it's possible that they don't know that there is a problem. On Thu, Jul 14, 2011 at 11:04 PM, Waleed Abdulla wal...@ninua.com wrote: Confirming that the issue on the GAE's side. Some requests take a very

Re: [google-appengine] Re: HardDeadlineExceptions after the maintenance

2011-07-15 Thread Waleed Abdulla
Update. Our apps are back to normal now, and the dashboard is accessible again. On Thu, Jul 14, 2011 at 11:32 PM, Waleed Abdulla wal...@ninua.com wrote: Anyone know of a way to alert the GAE team? The status page doesn't show any problems so it's possible that they don't know

Re: [google-appengine] Re: HardDeadlineExceptions after the maintenance

2011-07-14 Thread Waleed Abdulla
I'm noticing strange behavior as well. Cannot pinpoint it yet, but my app has been up and down since the maintenance. Will post more if I manage to pinpoint the issue. Waleed On Thu, Jul 14, 2011 at 9:30 PM, nischalshetty nischalshett...@gmail.comwrote: Is anyone from the appengine team

Re: [google-appengine] Re: My master/slave to high replication datastore migration experience

2011-07-13 Thread Waleed Abdulla
I agree with Joshua. That's a very bad experience to force us to go through to migrate. My migration is probably going to be much worse because I have a lot of data, which means that it'll take a very long time (days?) to copy the data across, and by that time the data would have changed on the

Re: [google-appengine] Re: high latency

2011-07-06 Thread Waleed Abdulla
I noticed a spike in memcache latency earlier today as well. It's also now showing on the GAE status page: http://code.google.com/status/appengine/detail/serving/2011/07/06#ae-trust-detail-helloworld-get-latency On Wed, Jul 6, 2011 at 1:17 PM, Felippe Bueno felippe.bu...@gmail.comwrote:

Re: [google-appengine] Do I really need to switch to HR?

2011-07-06 Thread Waleed Abdulla
Please star this issue if you agree that Google should make the migration process easier rather than putting the burdon on the developers. After all, most developers signed up to GAE to avoid having to deal with issues like that. http://code.google.com/p/googleappengine/issues/detail?id=5250

Re: [google-appengine] Re: The price of Scalability

2011-07-05 Thread Waleed Abdulla
and AppScale. Even if I end up moving some of my apps somewhere else, I'll probably continue to use GAE for smaller projects simply because of the easy setup and no hassle hosting. Waleed On Tue, Jul 5, 2011 at 3:49 PM, Brandon Wirtz drak...@digerat.com wrote: Support for a system with 100 users

Re: [google-appengine] Python VS Java

2011-07-02 Thread Waleed Abdulla
I'm curious why your Java version costs more currently! Can you share more details? I would've expected the Java version to cost less since Java has JIT compilation so the code should run faster. As for your questions, I'd say that the price difference will likely be small compared to the cost of

Re: [google-appengine] What's the difference between static and cached requests in the dashboard?

2011-07-01 Thread Waleed Abdulla
, 2011 at 6:35 PM, Waleed Abdulla wal...@ninua.com wrote: I noticed a big increase in requests today, and it looks like it's due to a sharp increase in cached requests (see image). I know that dynamic requests refer to those that reach a request handler, and static are those that are delivered

Re: [google-appengine] Google DNS hosting service

2011-06-30 Thread Waleed Abdulla
I starred your feature request. But since naked domains are on the roadmap and since the only way to make them work for GAE is for Google to host the DNS server, then I'm guessing they're already working on it. On Thu, Jun 30, 2011 at 11:34 AM, Alexander Konovalenko alex...@gmail.comwrote:

Re: [google-appengine] Re: What's the difference between static and cached requests in the dashboard?

2011-06-30 Thread Waleed Abdulla
Along with the sharp increase in cached requests I'm also noticing a sharp increase in Outgoing Bandwidth (see image). It contradicts my original guess that cached requests are those that return code 304 because those don't send much data, while I'm noticing a 300% increase in Bytes Sent per

[google-appengine] What's the difference between static and cached requests in the dashboard?

2011-06-29 Thread Waleed Abdulla
I noticed a big increase in requests today, and it looks like it's due to a sharp increase in cached requests (see image). I know that dynamic requests refer to those that reach a request handler, and static are those that are delivered through the CDN. Does anyone know what cached requests are? I

Re: [google-appengine] Re: Updated App Engine Pricing FAQ!

2011-06-28 Thread Waleed Abdulla
Another point is support. Most hosting companies give you phone support if you pay $100/month (or less). How come GAE charges $500 per month for it? It's understandable not to offer it for free users, or even below a certain pay limit. But how about customers who already pay thousands of dollars a

Re: [google-appengine] Re: Is AppEngine Down ??

2011-06-27 Thread Waleed Abdulla
Same here. A lot of writes are timing out for several hours now (m/s datastore), even though the app engine status page doesn't show anything out of the ordinary. On Sun, Jun 26, 2011 at 10:43 PM, Robert Kluin robert.kl...@gmail.comwrote: Yeah also seeing huge spike in deadline exceeded

Re: [google-appengine] Re: Switching to HR datastore without migrating to new app id

2011-06-27 Thread Waleed Abdulla
I posted another feature request asking for the ability to switch to HR without losing the data. It seem reasonable that the GAE team should provide such option. Please star it: http://code.google.com/p/googleappengine/issues/detail?id=5250 On Mon, Jun 27, 2011 at 7:33 AM, Heiko Roth

Re: [google-appengine] Where is the extra latency coming from?

2011-06-27 Thread Waleed Abdulla
Check to see if there is a pending_ms value in the logs. If so, then that indicates that your request was put in a queue to wait for it's turn to run. I had a long thread about a similar question a week or so ago (just search for pending_ms in the archives to find it). Waleed On Mon, Jun 27

Re: [google-appengine] Updated App Engine Pricing FAQ!

2011-06-25 Thread Waleed Abdulla
On Sat, Jun 25, 2011 at 12:17 AM, Gregory D'alesandre gr...@google.comwrote: Interesting idea. Could you use backends for non-urgent tasks? Then the scheduler wouldn't need to be involved at all. I could use resident backends, but then I have to adjust the number of instances up and down as

Re: [google-appengine] Updated App Engine Pricing FAQ!

2011-06-25 Thread Waleed Abdulla
comparison to help us understand the value we're getting. Waleed On Sat, Jun 25, 2011 at 12:24 AM, Gregory D'alesandre gr...@google.comwrote: On Sat, Jun 25, 2011 at 12:24 AM, Waleed Abdulla wal...@ninua.com wrote: A: Many customers have optimized for low CPU usage to keep bills low

Re: [google-appengine] What's the syntax to schedule a cron every 100 minutes?

2011-06-24 Thread Waleed Abdulla
might want to search the issue tracker for a similar issue, or file a bug report if you can't find one. Robert On Thu, Jun 23, 2011 at 00:39, Waleed Abdulla wal...@ninua.com wrote: I tried this: - description: My Cron Job url: /work/cronjob schedule: every 100 minutes

Re: [google-appengine] Updated App Engine Pricing FAQ!

2011-06-24 Thread Waleed Abdulla
probably want to set my max pending latency to 50ms for UI requests and 5 seconds for some non-urgent tasks. Waleed On Fri, Jun 24, 2011 at 4:04 PM, Jeff Schnitzer j...@infohazard.org wrote: Thanks, this clarifies much! Questions below: On Thu, Jun 23, 2011 at 11:49 PM, Gregory D'alesandre gr

Re: [google-appengine] Updated App Engine Pricing FAQ!

2011-06-24 Thread Waleed Abdulla
and rewrite my code to handle threading, I can't help but feel that I'm losing that one big advantage. Waleed On Fri, Jun 24, 2011 at 4:55 PM, Waleed Abdulla wal...@ninua.com wrote: Gregory, Thanks for the update. I think the scheduler min max pending latency should be per url (i.e

Re: [google-appengine] Re: Why a big difference between execution time and response time?

2011-06-23 Thread Waleed Abdulla
changed my code to run several chains of tasks in parallel. That seems to help. The hard part is not knowing how the scaling algorithm works, so I end up re-writing my code many times to figure out which arrangement of tasks gets GAE to give me enough resources. Waleed On Tue, Jun 21, 2011 at 10:34

Re: [google-appengine] Running a task on a backend?

2011-06-22 Thread Waleed Abdulla
Thank you, Greg. That was the issue. Waleed On Tue, Jun 21, 2011 at 9:54 PM, Greg Darke (Google) darke+goo...@google.com wrote: Are you using the taskqueue labs api? The taskqueue labs api (google.appengine.api.labs.taskqueue) was deprecated in 1.4.0, and thus new features will no longer

Re: [google-appengine] Simple query times out repeatedly for hours!

2011-06-22 Thread Waleed Abdulla
* and changed my query to this: *SELECT * FROM KnownFeed where eta datetime(2011, 06, 22, 17, 20, 0) order by eta, polling_period desc* * * * * 4. Two weeks later (now), the timeouts are happening again! It looks like an index is good for two weeks and then it starts failing. Any ideas? Waleed

Re: [google-appengine] Re: Google blocks traffic to appengine application

2011-06-22 Thread Waleed Abdulla
that the issue happens before the request hits GAE, and that's why you don't see anything in your logs. Waleed On Wed, Jun 22, 2011 at 10:03 AM, Brandon Wirtz drak...@digerat.com wrote: As an SEO, not as an app developer. I have billed more money to clients fixing issues caused by cloudflare than

Re: [google-appengine] Simple query times out repeatedly for hours!

2011-06-22 Thread Waleed Abdulla
around it. Much appreciated. I can finally sleep at night. Waleed On Wed, Jun 22, 2011 at 1:54 PM, Alfred Fuller arfuller+appeng...@google.com wrote: Ya, this sounds exactly like a 'churn' issue. See: http://ikaisays.com/2011/01/25/app-engine-datastore-tip-monotonically-increasing-values

  1   2   >