Hi,
I tried to start a backend on an app (id: "butterpool") 1d7h ago, but
I have been consistently getting the "service you requested is not
available yet" error. I tried both dynamic and resident backends.
I see that other people have had this problem, and that in at least
one case it was solved
Same problems here. And even worse, the app seems to be stuck in a
state of non-responsiveness. Regular URL requests are returning 404:
404 Not Found
Error: Not Found
The requested URL / was not found on this server.
eg: http://butterpool.appspot.com
Terrible timing for me, as it's the
I have several app engine apps that uses the following URL structure:
/:object/:key
eg:
/player/:key
/contest/:key
/team/:key
etc.
The "Current Load" section of the dashboard is not useful with this
URL structure. App Engine expects that the URLs will be parametrized
(eg /:object?key=:key ).
I reduced the number of shards to 1, and it uses an ascending index,
but still only 44399 out of 500k+ entities are processed. Confused!
Ben
On Jul 7, 1:02 pm, Ben Nevile wrote:
> Just found the thread that talks about needing the descending index
> for __key__ --- definitely seem
Just found the thread that talks about needing the descending index
for __key__ --- definitely seems like something that should be added
to the documentation!
Ben
On Jul 7, 12:56 pm, Ben Nevile wrote:
> I have a job with 8 shards but only one of the shards is processing
> any entities.
I have a job with 8 shards but only one of the shards is processing
any entities. Think this is related?
mapreduce_id=159013376839436
Ben
On Jun 16, 8:28 am, "Nick Johnson (Google)"
wrote:
> Hi Jason,
>
> It's possible to do that right now. You simply need to define your own
> InputReader -
No, this is wrong. Your GQL query wasn't working because you didn't
get() or fetch() a result.
uProfile = PROFILES.gql('...').get()
On Sep 12, 4:13 pm, Larkin2 wrote:
> I think I answered my own question - I'm retrieving a result set
> with .gql - to update an entity I need to specifically g
Hi,
Is there any way to get Google Checkout to stop sending me "Rate your
shopping experience" emails? I've answered them, but they keep
coming. I have a handful of apps and each of them generates a
checkout charge once a day, which means I get a handful of "rate your
shopping experience" email
I second Jeff's call for some transparency here.
Ben
On Aug 18, 10:17 am, Jeff wrote:
> Sometimes more warning isn't possible if maintenance is necessary to
> avoid the system tipping over because of a problem. But of course, if
> it wasn't an emergency maintenance, then 22 hours of warning is
+1 for more advance warning, please.
Ben
On Aug 17, 11:52 am, Joshua Smith wrote:
> I really appreciate that you are warning us about the maintenance.
> However, next time, I'd ask:
>
> 1) More warning, if possible; and,
>
> 2) Do it sometime other than the middle of the day in the United
> S
Plugged in to DSL I get ~150ms.
Ben
On Aug 14, 10:13 am, Martyn wrote:
> Hi Ben,
>
> Clearly all parts of the network add latency. The bit that adds the
> most is the most significant - wherever it may be. The claimed
> AppEngine latency in the status figures (for Java and Python) is based
>
Am I stupid, or does this test depend as much or more on the "last
mile" and its transport as it does on the underlying network
topology? I'm in Vancouver, Canada, and I'm getting results between
300ms and 600ms, but I'm also using a cellular modem right now.
Ben
On Aug 14, 7:09 am, ajacks504
Hi Nick,
Hooks are cool! Thanks for bringing my attention to them.
Can you expand a bit on how one might handle a multi-account scenario
using hooks? All I can imagine is a datastore hook that is smart
enough to insert the proper filter on a query before it is executed --
is that what you had
done. here's the link:
http://code.google.com/p/googleappengine/issues/detail?id=1912
On Jul 27, 7:02 pm, jonathan wrote:
> I also have the same problem. I remember asking about it a while ago
> and was told that it was a known shortcoming. I forgot to log it at
> the time as a defect. If yo
Hi,
I have an app where users create an account, and then can access the
service through www.mywebsite.com/account_id. Awesome! But not so
awesome for the Current Load table that's on my dashboard, since
having the account_id as part of the URI and not a parameter means
that it doesn't aggregat
So I finally decided I needed to figure out how to make it happen.
Here's a recipe for anyone else who wants to be able to access
memcache via remote_api:
1. copy the contents of /google/appengine/ext/remote_api/handler.py
into a new local file. i called mine remote_api_handler.py. then
change
SIGH.
I was just messing around in the console, and by accident I deleted
about 15,000 important user records.
Clearly I'm an idiot who doesn't deserve any sympathy. But out of
desperation I ask: given the application and Model class, is it
possible that the good people at Google have backup of
Seconded. For the queues to be useful for some of the applications I
currently use client-side polling to accomplish, the daily number of
tasks would have to be several orders of magnitude larger (100M).
Ben
On Jun 24, 10:33 am, vivpuri wrote:
> Right now the Task Queue quota is set to 10k tas
help me
understand why this is happening.
Ben
On Jun 17, 8:29 am, "Nick Johnson (Google)"
wrote:
> Hi Ben,
>
> We've taken another look; _now_ it should be fixed. :)
>
> -Nick Johnson
>
>
>
>
>
> On Tue, Jun 16, 2009 at 1:02 AM, Ben Nevile wrote:
We've taken another look; _now_ it should be fixed. :)
>
> -Nick Johnson
>
>
>
>
>
> On Tue, Jun 16, 2009 at 1:02 AM, Ben Nevile wrote:
>
> > Hi Nick,
>
> > Sadly it is NOT fixed. Here is the URL again:
>
> >http://appengine.google.com/datas
(Google)"
wrote:
> Hi Ben,
>
> Thanks for your patience, and for your consideration in leaving the app
> as-is. We have all the data we need, and your index should now be fixed.
>
> -Nick Johnson
>
>
>
> On Mon, Jun 15, 2009 at 4:21 PM, Ben Nevile wrote:
>
&g
bumping. app still in a broken state, but I need some resolution wrt
this fundamental problem.
Ben
On Jun 11, 10:23 pm, Ben Nevile wrote:
> Okay, I'm just going to leave my app in a broken state so that someone
> from Google can look at this. I've been dealing with these brok
Okay, I'm just going to leave my app in a broken state so that someone
from Google can look at this. I've been dealing with these broken
indices for a long time. Shouldn't we be able to trust the indices?
Here's a link in the datastore explorer to the GQL query that's messed
up. Hopefully a Go
he yes, but the timeouts always came
from datastore operations.
Ben
On Jun 2, 11:58 am, "Brett (Google)"
wrote:
> Hi Ben,
>
> On Jun 1, 9:35 pm, Ben Nevile wrote:
>
> > About 90 minutes ago one of my applications began failing on somewhere
> > close to 100% of its
looks like the problem corrected itself about an hour ago. Please
will someone from Goog let me know what's up? I want to be able to
trust this platform!
Ben
On Jun 2, 1:08 am, Ben Nevile wrote:
> tick tock. four and a half hours of these failures now. I've had to
> take t
tick tock. four and a half hours of these failures now. I've had to
take the site down and put up a "sorry!" message.
ben
On Jun 1, 9:35 pm, Ben Nevile wrote:
> About 90 minutes ago one of my applications began failing on somewhere
> close to 100% of its datastore A
About 90 minutes ago one of my applications began failing on somewhere
close to 100% of its datastore API calls. The app is nowhere close to
exceeding any quotas, and I haven't made any changes in the code in
the last ... I don't know, at least 12 hours.
Que pasa Googlito? The app id is "butter
ps. was never able to get any consistent behaviour here. have
resorted to using Firefox with just one single google account and
using Safari for everything else. (I jump between three google
accounts all day - 2 related to an apps domain, one a regular
gmail.com.)
Ben
On May 5, 7:54 am, Ben
Hi Nick,
Thanks for your reply.
Here's a typical use case for me. I often have methods like this:
def facebook_user_cache_key(uid):
return str(uid) + "_fbuser"
def get_facebook_user(uid):
u = memcache.get(facebook_user_cache_key(uid))
if u == None:
uid = int(uid)
u = FacebookUs
hey there,
the other night I added a couple of indexes to an model that has
hundreds of thousands of entities. I was pleasantly surprised when I
woke up the next morning to find the magic "serving" beside the new
indexes! hooray!
this afternoon I was debugging some code and I discovered that t
Just wanted to mention that I created a new issue requesting support
for memcache in the remote api console. I searched but didn't find
any existing similar requests.
http://code.google.com/p/googleappengine/issues/detail?id=1596
Would be a big help. If this is of interest to you, please give
I am getting the same bug. 950 times, so almost 0% of the 323.35k
requests for that handler served since midnight. but a bug
nonetheless.
Nothing too complicated is happening. An entity is being loaded into
memory, through a standard memcache call that falls back to a
datastore call. The values
when you're able to work in the Admin Console and when
> you're being redirected to the standard sign-in? Or is it just one click
> you're fine and the next you're redirected? How many minutes on average
> before this happens?
>
> - Jason
>
>
>
> On Sa
bumpty bump. i have the same quota error message coming up now. app
seems to be working jes fine. i created and vacuumed indexes today as
well.
Ben
On Apr 13, 11:45 am, Paul Kinlan wrote:
> Hi,
>
> I am just curious as to what the following message in the dashboard means:
> Your application
I administer most of my apps through a Google Apps account:
b...@mainsocial.com. Recently the application console started asking
me FREQUENTLY to log in. It bounces me to the regular "sign in with
your google account" page. If I just go directly back to
http://appengine.google.com/a/mainsocial.
it is
> doing, but it looks like there's a line like this in there:
>
> datastore_file_stub.DatastoreFileStub('GAEUnitDataStore', None, None)
>
> It should create the stub using the correct app id (e.g.
> 'butterpool'), which may be os.environ['
since updating to SDK 1.2.1, GAEUnit is not able to access the
datastore. I was using GAEunit 1.2.2 before - just updated to 1.2.6,
but no love. Below is the error I get. Any tips?
Ben
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents
more info about this issue: if I am logged into my google apps account
I am not able to successfully add my regular gmail account as a
developer. If I fire up another browser it works. I guess it's hard
to program around all these account edge cases.
Ben
On Apr 20, 4:40 pm, Ben Nevile
Hi Nick - yes, this is the problem. I suspected this, and yesterday I
tried to add ben.nev...@gmail.com as a developer. I went through the
whole song and dance, and then after agreeing to the terms of service
it took me to the newbie page ("create an app!"), and the pending
developer account of
Hi Matthew,
Thanks for these great ideas!
Ben
On Apr 15, 8:30 pm, Matthew Blain wrote:
> Hi Ben,
> One possible way to handle this is to retrieve the top 10 items in
> your 'queue', then loop through them in a transaction until you find
> one which is not recent.
>
> Better yet, you can cache
Hi Ryan,
So I guess what you're saying here is that a put() is not atomic with
respect to all indices. I will keep that in mind for sure, but it's
unfortunate - adds a lot of code if you have to check all the time to
actually see if an index is correct!
Ben
On Apr 16, 9:08 am, ryan wrote:
>
I was able to get appengine_console.py to launch in OS X with the help
of this message:
http://groups.google.com/group/google-appengine/browse_thread/thread/6bc2f759188476b2/967e636458681da0?lnk=gst&q=interactive+console+remote+api#967e636458681da0
When I try and fetch data, it asks for my name
File "/base/python_lib/versions/1/google/appengine/api/
urlfetch.py", line 267, in fetch
raise DownloadError(str(e))
DownloadError: ApplicationError: 2
How about BadUrlError or something like that?
Ben
On Apr 16, 10:21 pm, Ben Nevile wrote:
> So I'm aware that Google
So I'm aware that Google is aware that there are urlfetch issues
tonight. At least, that's what I'm lead to believe at the GAE System
Status page, where the problem has been marked as "Anomaly" for the
last 5 hours or so. But I have no feedback other than that.
Please Google, I'm sorry to whine
I'm looking at the dashboard page for one of my apps. I have $40 of
daily budget allocated towards CPU Time. Currently, at 12:45pm PST,
it is showing that I've used 205.96 of 1233.33 CPU hours for today -
about 17%. However, the amount it's showing as cost to me is $15.97,
which is almost 40% o
ed to you, but now know it's not something
> I did.
>
> Bah!
>
> Help Google!
>
> Barry
>
> On Apr 15, 3:38 pm, Ben Nevile wrote:
>
>
>
> > It's not just you. One of my apps is down too. I was getting errors
> > deploying, and now it has co
It's not just you. One of my apps is down too. I was getting errors
deploying, and now it has completely shut off.
The timing of this is TERRIBLE for me. Biggest few hours of the year
for my particular application are about to happen between 4pm and 10pm
PST tonight. PLEASE Google help!
Ben
r very long. But I would like to work with Google to get this
sorted out.
Ben
On Apr 15, 8:04 am, Ben Nevile wrote:
> To add another twist, now I have an entity at the top of the stack
> that is found using
>
> q = FacebookUser.all()
> q.filter('authori
Say, I sure would like to be able to catch all the weird historical
urls that come into my application and redirect them to my home page.
Does anyone know how to specify a "if it doesn't match any of the
others, use this handler" mapping?
Ben <3 GAE
--~--~-~--~~~---~--
Hi Joe,
I use GAE to host a variety of Facebook Apps.
When you say the app is showing an average HTTP response time of
1300ms, where are you getting that number from?
Ben
On Apr 14, 4:44 pm, Joe wrote:
> I recently launched a Facebook application using Google AE as the
> backend (http://app
transaction, you get None back. Trying to access that entity's
record in the Data Viewer also threw an exception. I was, however,
able to delete it from the top of that index listing using the Data
Viewer's GQL option.
Ben
On Apr 14, 3:38 pm, Ben Nevile wrote:
> Hi Jeff,
&
property is not changed
> and an entity tends to stay at the top of the stack. Do you see
> datastore timeout errors in these cases (I imagine the exception may
> be hidden somewhere in the JavaScript <--> server exchange)?
>
> Thank you,
>
> Jeff
>
> On Apr 14, 11
bump. I have observed this many times over the past few days. Maybe
has to do with transactions and/or write contention, since there is a
lot of that in my app.
Ben
On Apr 1, 8:23 pm, Ben Nevile wrote:
> Hi GAE team and devotees,
>
> I have a entity that looks like
>
> cla
> Indeed there is, and it's even on our roadmap. We're not done with
> offline processing, not by a long shot.
That's great Jon, because I've not yet eliminated all the silly
javascript polling I'm doing, not by a long shot!
Ben <3 GAE
--~--~-~--~~~---~--~~
You
big sloppy wet kisses to the GAE team for your lovely cron feature.
much javascript polling has been saved.
HOWEVER, since it is always beholden on the user to make a new feature
request immediately after the launch of a new feature, it would be
really great if either
1. requests made by a cron
Hi Marcel,
the SQL join world saves you the hassle of thinking about all of this
stuff at write-time, but would not scale beyond a few thousand users.
if you implement everything in SQL and then end up with a very busy
site, you end up re-implementing all of your data access to work in
the BigTab
Hi GAE team and devotees,
I have a entity that looks like
class FacebookUser(db.Model):
expired_fotm = db.BooleanProperty()
last_nudged_at =db.DateTimeProperty()
and an index that looks like
- kind: FacebookUser
properties:
- name: expired_fotm
- name: last_nudged_a
Hi Matt,
> A simple counter probably works best here as I'm storing an event for
> each user (low contention) but if I wanted to see the aggreations
> across all users a sharded counter would be required due to
> contention. Could this be done? How would this be done for the
> diferent type/level
Hi Marzia,
Just want to add my voice to the chorus of people looking for a little
more transparency in terms of data storage and entities. In my ideal
fantasy world I'd be able to see a pie chart that would break down the
percentage of storage that each of my entities was using as a fraction
of
Hi GAE team,
I'm writing to express frustration about the scheduled maintenances of
March 2 and March 9. I'm using GAE to host several time-dependent
games being played by tens of thousands of people. Having datastore
writes unavailable for 30 minutes during the peak traffic time is
frustrating
Hi - I have been using GAE for a few months now and really love it. I
am porting my collection of Ruby apps over.
Of course I'm running up against the 10-application limit. I have
transferred some of my apps over so that the only developer is now at
a different email account. I seem to still b
really fun game!! Nice work.
Ben
On Feb 25, 4:08 pm, indra wrote:
> Hello everyone,
>
> Play the wikipedia game at
>
> http://www.wikiaata.com
>
> The app is powered by AppEngine and GWT was used for building the UI.
> Any feedback is very welcome.
>
> Cheers.
--~--~-~--~~---
I love GAE!
I know it has been discussed in the past, but I bring it up again
because I keep running into it over and over: please can we have a way
to access the key for a ReferenceProperty without loading the entity?
It's my understanding that currently the only way to do this is create
a separ
I'm using v1.18 of the app engine launcher on OS X 10.5.4. It seems
to me that the launcher used to pick up every change that I made in a
source file, so if I were running unit tests I didn't have to stop and
start the running of the application with every change. Something has
changed. Possibl
Dave,
When dealing with Facebook and FBML you can't do a 304 redirect.
Facebook is making the request to your server on behalf of the user.
Ben
On Jan 6, 1:35 am, "David Symonds" wrote:
> On Tue, Jan 6, 2009 at 10:15 AM, Ben Nevile wrote:
> > Sadly I cannot redi
> However, it would be _very_ easy to check for that parameter yourself in a
> request and redirect the request to the appropriate version number if it the
> version listed is not the default.
>
> -Marzia
>
> On Mon, Jan 5, 2009 at 12:13 PM, Ben Nevile wrote:
>
> &g
Hi,
Much of my work with App Engine is on Facebook applications. Facebook
acts as a proxy through which all requests flow. Every application
registers a callback URL that Facebook directs traffic at. So for
instance
http://apps.facebook.com/my_application/foo
becomes
http://my_application.ap
or file a quota request for additional bandwidth if
> you are consistently using your quota.
>
> Please let me know if you have any questions.
>
> Thanks,
> Marzia
>
> On Tue, Dec 16, 2008 at 10:42 PM, Ben Nevile wrote:
>
> > I should also mention that when I la
Agree completely Amir. I'm hopeful that more APIs will be released
soon that will make the process even lighter for developers. Next
hurdles to come down significantly will be identity (Google Friend
Connect, FB Connect) and micropayments (?) .
Ben
On Dec 16, 2:42 pm, Amir Michail wrote:
>
I should also mention that when I last checked the dashboard at about
7-7:30pm PST the outgoing bandwidth was at 56%.
Ben
On Dec 16, 10:40 pm, Ben Nevile wrote:
> the new quota details dashboard looks very nice. thanks for your hard
> work on this mr. and ms. googs.
>
> but h
the new quota details dashboard looks very nice. thanks for your hard
work on this mr. and ms. googs.
but hey, how come i've never had a problem with outgoing bandwidth
before, and tonight my app is stuck in the red zone? the graph beside
"outgoing bandwidth" is in the red (10.00 of 10.00 GByte
Hi Dennis -
I am using an architecture similar to what you describe. Rather than
use a separate server to do the pinging, I use client-side JS to do
this dirty work. You need to have a fairly steady stream of users for
this technique to be reliable. :)
Ben
On Dec 9, 9:27 pm, Dennis <[EMAIL
Cool app Bonstio - my quick suggestion would be to re-organize the
page so that the image is at the top rather than below your
explanatory paragraph. I have to scroll down to see it on my small
laptop screen (1280x800).
Ben
On Nov 27, 2:07 am, Bonstio <[EMAIL PROTECTED]> wrote:
> Oh dear - ho
Great article, thanks GAE team!
On Nov 25, 1:30 pm, Marzia Niccolai <[EMAIL PROTECTED]> wrote:
> Hi,
>
> There have been a lot of questions on this group about index building and
> Ryan Barrett, the tech lead for the datastore, took some time to write an
> article on how index building
> works
asti-Georg" <[EMAIL PROTECTED]>
wrote:
> How long are you waiting between requests? I add a 2 second delay in the
> non-gae loop code when I do things like this.
>
> On Fri, Nov 21, 2008 at 12:10 PM, Ben Nevile <[EMAIL PROTECTED]> wrote:
>
> > Greetings fell
Greetings fellow GAE dorks,
So I'm trying to clean up an existing app. I want to delete all the
entities of a certain class. Since there's no automagic way to do
this, I made a handler that deletes them a block at a time. Here it
is:
class DeleteHandler(BaseRequestHandler):
def get(self):
Hi Anders,
In my experience with standard RMDBS, memcache is more useful for
caching arbitrary data and less useful for caching model objects. If
you have a really tuned database layer a lot of your queries will
already be resident in the database's cache, and memcache provides
only a modest eff
command, so its necessary to implement a
> cross-entity group transaction layer on top of the GAE datastore, but
> its currently unclear to me that this can actually be done while
> staying under GAEs quotas.
>
> On Nov 16, 11:52 am, Ben Nevile <[EMAIL PROTECTED]> wrote:
>
Hi Ross,
> Well, Google App Engine would be a terrible place to serve most
> massively multiplayer games. I hope that's not what got you
> interested in GAE.
Pretend I'm dumb... no, it's okay, I *am* dumb when it comes to MMOG.
Why would GAE be a terrible place to serve these? The type of
comm
Yikes - "serving unaffected" for me is exactly wrong! The way I've
architected one of my apps, without memcache my requests will pretty
much all timeout. I will need to put the app "offline" for the
duration of the maintenance.
"We will be taking memcache offline tomorrow morning from 9-10am PST
Howdy pardners,
I have a busy (40 req/sec) app that is occasionally throwing Timeout
errors on datastore operations. I'm not sure what the cause of these
errors is - contention perhaps? - but in an effort to reduce the
amount of data being written, I want to confirm my understanding of
the put()
Hi,
Yesterday I vaccumed an index. It started off in the "deleting"
state, then moved to the "error" state. I have tried to vacuum it
again and I get error 500s.
Any ideas? Marzia?
Ben
ps. app is called "n3xt".
--~--~-~--~~~---~--~~
You received this message
Hi - I have a request that's sometimes taking more than 1000 mcycles,
and I'd like to use the profiler to figure out what's taking so long.
I implemented the profiling successfully, but the output doesn't help
me too much because I can't match a lot of the function names up with
parts of the API.
Hi,
Say model X has a ReferenceProperty to model Y. I have an instance x
loaded into memory. I want to know the key for model object y, but I
don't want to load y from the datastore. From what I can tell in the
documentation, accessing the attribute y, which holds a key,
automatically loads th
; % point)
>
> > > It will create a lot of of "counter" but it will works fine.
>
> > > Then if you want to count for points > 100
> > > You will have to do many any times : get_count("point_%i" % point) for
> > > point from x to y
> &
owse_frm/thread/e13...
>
> and code here :http://paste.blixt.org/1581
>
> On 24 oct, 08:52, Ben Nevile <[EMAIL PROTECTED]> wrote:
>
> > Hi,
>
> > I have recently started using GAE for components of a large sports-
> > related Facebook app. One of the contests
Hi,
I have recently started using GAE for components of a large sports-
related Facebook app. One of the contests has hundreds of thousands
of participants, and I need to be able to tell a user at any given
time what place they're in. eg, you are 34,728th out of 234,829
participants.
After spe
he FAQ
> (http://code.google.com/appengine/kb/sms.html) rather than posting the
> same question to the list repeatedly.
>
> On Sep 12, 1:38 pm, Ben Nevile <[EMAIL PROTECTED]> wrote:
>
> > Anyone out there had problems receiving the SMS verification on Rogers
> > in Canada? I have
Anyone out there had problems receiving the SMS verification on Rogers
in Canada? I have tried several times without success.
Ben
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to
Anyone using Rogers in Canada had trouble getting an SMS code sent?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To
90 matches
Mail list logo
