http://code.google.com/p/googleappengine/issues/detail?id=240 is an
issue related to the issue you raised in your post.
On Jan 16, 1:31 pm, boson wrote:
> After a URL in the request log are the following fields (example):
> 200 1584ms 2571ms-cpu 4kb
> Am I correct in believing these are: HTTP re
:
> Yes, it should be well suited... do you have specific things I should
> consider?
>
> Thx!
>
> On Dec 5, 5:30 pm, Josh Heitzman <[EMAIL PROTECTED]> wrote:
>
> > Are you certain that your app is well suited to app engine? If not,
> > you may want to first hire
Are you certain that your app is well suited to app engine? If not,
you may want to first hire a consultant to evaluate your apps
suitability to app engine.
On Dec 5, 3:59 pm, mytemp <[EMAIL PROTECTED]> wrote:
> I want to implement a website on Google App engine, front end is AJAX
> with some we
I think the answer really depends on how much Google is willing to
invest in GAE. Eventually could be two years from now or ten years
from now, but if its the later they may miss the boat considering
there are numerous big names and no names all moving into this space.
One of those big names is M
Apparently GAE's infrastructure will just continue to spawn more
processes as needed, so your app actually should continue to scale
even if it waits 1 minute instead of 10 seconds for URLFetches, but
operating your app will be more costly as memory usage time will be
increased by a factor of 6. C
Like Jon McAlister said either use a random number or create a new
entity when one of your modules is loaded and treat that entity's key
as the globally unique process ID (i.e. MAC address + pid). The later
solution only requires one put during any given processes lifetime so
it shouldn't be a pe
I've noticed that the the instance of python that is running the GAE
local server seems to just keep growing in size with use. With just
manual web browsing (i.e. not using the bulk loader) I've observed it
grow to consume over 100MB or RAM and noted that performance dropped
off quite a bit as we
The lack of any long running server side process also precludes doing
any real time MMOGs. With many turn based web based MMOGs there is no
way to partition the game state into entities such that executing all
player commands only requires updating entities in one entity group
during the executio
Good call. Looks like there scheduled maintenance now per
http://groups.google.com/group/google-appengine-downtime-notify/browse_frm/thread/455b69c7bf3b0de
Josh
On Nov 15, 2:24 pm, "russ.au" <[EMAIL PROTECTED]> wrote:
> I'm getting this exception in my app engine app :
> "CapabilityDisabledErro
Just started seeing this exception thrown from any attempt to write to
the datastore.
Anyone else seeing this at present, or is it just me?
Thanks,
Josh Heitzman
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
Its useful in so far as having something to compare GAE against (i.e.
can a single commodity machine serve up more requests per second then
an app deployed on GAE's infrastructure).
On Nov 7, 5:49 pm, Ross Ridge <[EMAIL PROTECTED]> wrote:
> I don't see why you think testing the scalability of a s
mcycle consumption
value shown in the per request logs the runtime mcycles or the runtime
and datastore mcycles?
If the mcycle value shown in the per request logs is only the runtime
mcycles then issue 786 is not a duplicate of 814 as the values listed
in 786 were taken from the per request logs
is not using very much runtime CPU (in code outside of the
> datastore). The CPU megacycles for datastore operations do not
> currently count against the per-request ("High CPU Request") limits.
> We're working on ways to make this clearer in the Admin Console.
>
> Happ
If you can't reduce the number of entities, then all you have left is
to reduce the number of indexed fields on the entities and the number
of elements in any list fields on the entities. That said you can't
put two entities with only a single non-indexed property each in less
then 1000 mcycles.
As I understand it loaded modules are cached, so if your have two
scripts importing the same modules for the handling of two different
requests the modules will only get loaded once so long as that
particular process instance is running.
On Oct 21, 2:22 pm, Adam <[EMAIL PROTECTED]> wrote:
> So gi
It is not just you. An issue has be opened
http://code.google.com/p/googleappengine/issues/detail?id=786 but the
GAE team has yet to acknowledge it or response to other posts on the
subject on this discussion group.
On Oct 19, 10:18 pm, MajorProgamming <[EMAIL PROTECTED]> wrote:
> Is it just me
pens as little as possible (hopefully,
> never).
>
> Cheers,
> Jon
>
> On Oct 7, 11:00 pm, Josh Heitzman <[EMAIL PROTECTED]> wrote:
>
> > Regarding "Should we design our system so that if the datacenters
> > where an app is deployed are vaporized, then the ap
Not at present. Currently only Python is supported.
On Oct 17, 11:54 pm, amshuhu <[EMAIL PROTECTED]> wrote:
> Its possible Ruby coding in Google App Engine ?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Google A
Model abstraction. Was there
> any noted performance differences with that test (eg. Are the *Property
> bits using a lot of time)
>
> Josh Heitzman wrote:
> > Seehttp://groups.google.com/group/google-appengine/browse_thread/thread/...
> > regarding the mcycle consumption impact
I wouldn't want the item deleted until I had done whatever processing
I needed to do with its data to ensure it didn't get lost due to a
raised exception or crashed machine.
On Oct 17, 9:18 am, "Ethan Post" <[EMAIL PROTECTED]> wrote:
> A common task (queueing) is "fetchitem...delete the item once
See
http://groups.google.com/group/google-appengine/browse_thread/thread/a29a4b1dd606f52e
regarding the mcycle consumption impact of having lots of fields.
On Oct 16, 9:11 pm, David koblas <[EMAIL PROTECTED]> wrote:
> I'm storing application preferences in the datastore, they come in a
> variety
Just opened http://code.google.com/p/googleappengine/issues/detail?id=789
- API to get current mcycle consumption during request processing.
On Oct 16, 9:04 am, "Ethan Post" <[EMAIL PROTECTED]> wrote:
> I would like to include the # of mcycles consumed in some of my logging. At
> the moment it a
I'm not aware of anyway to get the mcycle in code either. As a result
I've been breaking out little chunks of my processing and testing how
long each on takes and I've found that updating an existing entity
consumes no less then an average of 718 mcycles. And that's for an
entity with an empty S
t;
> def make_value_from_datastore(self, value):
> v = super(PickleProperty,
> self).make_value_from_datastore(value)
> r = pickle.loads(str(v))
> return r
>
> class XX(db.Model):
> data = PickleProperty(default={})
>
> xx = XX()
> xx.data[
Oh, and:
756 - one StringListProperty with 1 element with 490 characters.
So each of the three trials had just one property was under 800
mcycles regardless of the size of the property.
On Oct 15, 9:17 pm, Josh Heitzman <[EMAIL PROTECTED]> wrote:
> As we didn't see anyone fro
Opened http://code.google.com/p/googleappengine/issues/detail?id=786
regarding this issue.
On Oct 15, 12:25 am, Josh Heitzman <[EMAIL PROTECTED]> wrote:
> There are no indexes in index.yaml for these entity kinds and not very
> many of the properties are being changed at one time
As we didn't see anyone from the GAE team confirm or deny that the
excessive mcycle consumption for doing an entity update was due to the
number of properties on the entity (see this thread
http://groups.google.com/group/google-appengine/browse_thread/thread/2901a4ddd1f671d9
) I decided to do a li
The "sometimes takes 15000 mcycles" doesn't sound dissimilar to an
issue I'm having with a strategy game. I frequently mcycles for
processing user commands up around 15000 mcycles. I've dug into and
found that its taking 1500 mcycles just to update one entity and about
another 1000 mcycles to up
-index-update-limit
> ('exploding' index).
>
> Are the index updates counted in the mcycles used?
>
> 2008/10/15 Josh Heitzman <[EMAIL PROTECTED]>:
>
>
>
> > Regarding the first question, those mcycle numbers are from logs on
> > GAE, not from lo
fline processing (there are many issues for
> this listed in the Issue Tracker). With that infrastructure in place
> we may be able to adjust the limits. Offline processing is orthogonal
> to billing.
>
> Jon
>
> On Oct 13, 9:32 am, Josh Heitzman <[EMAIL PROTECTED]> wr
involved, as the data is user specific and I
was the only user with data when I did the test.
On Oct 14, 8:31 pm, "David Symonds" <[EMAIL PROTECTED]> wrote:
> On Wed, Oct 15, 2008 at 1:50 PM, Josh Heitzman <[EMAIL PROTECTED]> wrote:
> > Actually, I'm it take about
Actually, I'm it take about 1500 mcycle to update one entity and then
an about an additional 1000 mcycle per additional entity (each a
different kind in this case) that is updated via the same db.put call.
On Oct 14, 7:24 pm, Josh Heitzman <[EMAIL PROTECTED]> wrote:
> I'v
I've been digging into where may app is spending its mcycles. By
using memcache I've gotten all of my requests that only read data down
well under the 1000 mcycle overall average request processing limit;
however, I'm seeing that it takes about 1000 mcycles to update a
single entity (not indexed,
Timeouts can happen on even the simplest of datastore operations. As
I understand it when a timeout does occur on a transaction (including
a single put as there is a transaction there underneath) there is a
lot of extra processing due to retry attempts.
On Oct 13, 11:40 pm, Roy Leban <[EMAIL PRO
I've been wondering the same thing. When they start letting us pay
for this, will our apps still have to stay under some arbitrary
average number of CPU cycles?
On Oct 13, 3:21 am, Matija <[EMAIL PROTECTED]> wrote:
> Hi,
> I have some init stage imports to app-engine application and
> combining
Yeah, my requests seem to be taking about 4-6k megacycles longer to
process today then they were two days ago. In some cases this is 100%
longer and in others its only about 35% Interestingly my root page is
still down around 30 megacycles, so it seems that the code needs to do
certain things to
Just tried my app and I'm seeing changes show up immediately as
expected. I was having some issue with page caching until I added:
to the head element of my pages. If you can reproduce the problem
yourself, you can check your logs right after seeing the problem to
see if the request actua
Indeed. A key should be though of as a UUID/GUID rather then a SQL
key.
On Oct 11, 4:33 pm, "David Symonds" <[EMAIL PROTECTED]> wrote:
> On Sun, Oct 12, 2008 at 6:30 AM, Roy Leban <[EMAIL PROTECTED]> wrote:
>
> > On Aug 22, 9:55 am, "Marzia Niccolai" <[EMAIL PROTECTED]> wrote:
> >> You can't qu
It isn't impossible to use pkg_resources and setuptools with GAE.
Pylons makes use of these and appengine-monkey (
http://code.google.com/p/appengine-monkey/
) was created to get Pylons working on GAE. If you aren't using
Pylons appengine-monkey still may prove useful to you.
On Oct 11, 10:51 a
n test for one occurrence and the key
string looks legitimate:
Exception: FGBeingRootInterface.__FreshenEntities _ranking was none
after being gotten from DS using key
ag53ZWJnYW1lc2J5am9zaHIjCxIMRkcwUmFua0dyb3VwGOoHDAsSCkZHMFJhbmtpbmcYAQw
Anyone encount
Python has been around for over decade so I really wouldn't call it a
new style of grammar. There are numerous programming languages out
there that don't use c-like grammar, so Python is hardly unique in
that respect. Python started life without objects and none of its
procedural aspects were re
ote:
> Why not simply have the reference in the Thing, pointing to the
> User? Then use the idiom: x = user.thing_set.fetch(1000) to get the
> User's Things? Update both the User and the Thing using a single
> db.put([thing, user])
>
> johnP
>
> On Oct 9, 2:19 pm, Jo
I ran into a similar problem with the strategy game I'm working on.
The game world is divided up into areas and each area can have a more
then one player's troops in it at a time. I've modeled these with
three entities, player, area, and areaplayer. When a player has his
troops do something in a
y data outside
its domain).
On Oct 8, 9:27 pm, pr3d4t0r <[EMAIL PROTECTED]> wrote:
> On Oct 8, 6:03 pm, Josh Heitzman <[EMAIL PROTECTED]> wrote:
>
> > As os.getpid is not supported by GAE, is there another API that
> > provides a unique (preferably across all of GAE) i
As os.getpid is not supported by GAE, is there another API that
provides a unique (preferably across all of GAE) identifier for the
process? I'd like to use this to identify if an incomplete update
sequence (spanning entity groups, so no it can't be done in a
transaction) was left hanging by the
Is there no backup of an app and its datastore entities now?
On Oct 8, 8:47 am, ctran <[EMAIL PROTECTED]> wrote:
> Please voice your support if you find this is necessary for your
> applications:
>
> http://code.google.com/p/googleappengine/issues/detail?id=776
--~--~-~--~~--
Regarding "Should we design our system so that if the datacenters
where an app is deployed are vaporized, then the app keeps serving?
No, this is a much thornier issue." does this mean that an app's data
is stored in one and only one data center with no off-site backups?
I could understand that t
It seems to me that to avoid the problem you are describing
> that it would be a good idea to do so. I have a feeling that the number of
> cases where you would need to update more than one user's data in a single
> transaction would be limited.
>
> 2008/10/8 Josh Heitzman <[EMA
Assuming you can actually work around all of the limitation
simultaneously, considering the more things you work around the close
you come to the CPU time quota.
It also is not completely accurate to state that the limitations are
there to make apps safe and scalable. For example transactions be
What would be really nice is if there was an API that could be called
to determine how close you were to the CPU quota so you could stop
processing, persist the current state, and return a "Server busy,
please try again." type of page to the user that has a link to a URL
that would pickup were the
Can't speak for Mac or this specific SDK, but on Windows when I
upgraded to an earlier SDK release, I couldn't get my app working
again on the new release until I re-imaged my hard disk to GAE SDK
free image. This was after having uninstalled the older SDK before
installing the new one.
The prob
You would need to do the data mining and machine learning as either a
side task processed a little bit at a time with each page request or
you would need a URL whose only purpose in being requested is to allow
your algorithm to process to for a bit and then you would need to have
a client that jus
This is a good point. This isn't something I care about for the web
app I writing at the moment, but I've already there are other apps
I've though about doing that I definitely would not want be willing
upload non-obfuscated source code for, and I was figuring I'd just
have to host those elsewher
to be mirrored around to
actually scale, so it seems likely to me there is already coordination
between the nodes mirroring the same entity group.
On Oct 4, 2:53 am, "David Symonds" <[EMAIL PROTECTED]> wrote:
> On Sat, Oct 4, 2008 at 6:00 PM, Josh Heitzman <[EMAIL PROTECTED]> wro
ansactions need be
eliminated. Leave it the application developer to choose the
appropriate transaction type as needed.
Josh
On Oct 3, 11:25 pm, "David Symonds" <[EMAIL PROTECTED]> wrote:
> On Sat, Oct 4, 2008 at 4:06 PM, Josh Heitzman <[EMAIL PROTECTED]> wrote:
> &
tly serialize collections of small data
structures associated with another entity for which I have need to
query.
Josh Heitzman
On Oct 3, 11:52 am, Aral Balkan <[EMAIL PROTECTED]> wrote:
> I just wrote up a blog post summarizing the biggest issues I have with
> App Engine:http://aralb
Your understanding is correct based on my experience. As far as
determining entity group I think you'll just have to examine the
ancestry of each entity in your transaction to see if they actually
have a common instance.
On Sep 25, 11:33 pm, Jamesz <[EMAIL PROTECTED]> wrote:
> Hi everyone,
>
>
I don't know what exactly the problem is but I upgraded from the 1.1.1
SDK to 1.1.3 SDK today. I uninstalled 1.1.1 first before installed
1.1.3, but when I tried starting my app after installing 1.1.3 SDK it
failed extremely early on in the Pylons loading code. I put up a
couple of messages on t
58 matches
Mail list logo
