Hi!
We're in the process of learning GAE, and over the last two days have
hit a wall. Before going too far into the description, here's the
versions of things we're using:
* Django 1.0 beta 2
* app-engine-django-helper r58
It started yesterday; we were getting strange import errors, and only
o
Hi!
Right now my app has 4 different Entity kinds that get stored in the
Datastore. In the Admin Console Data Viewer, I can see 3 of them, but
not the 4th. The only thing that's different (other than the fact
that they have different fields) is that the missing one uses a custom
key_name.
If t
key name shouldn't matter. Does the missing Kind have any
> entities stored in it? I believe empty Kinds, even if they are
> defined in index.yaml, won't show up in the console until there are
> stored entities.
>
> On Sep 11, 12:56 pm, Tony Arkles <[EMAIL PROTECTED]
n console up in App Engine? I would check
> your index.yaml and make sure the missing Kind is listed. If local,
> I'd restart the server.
>
> On Sep 11, 1:07 pm, Tony Arkles <[EMAIL PROTECTED]> wrote:
>
> > It definitely has Entities in it. If I do a Feed.all(), I ge
Properties or TextProperties).
>
> -Marzia
>
> On Thu, Sep 11, 2008 at 1:31 PM, Tony Arkles <[EMAIL PROTECTED]> wrote:
>
> > It's on the admin console in the App Engine. The Feed Kind doesn't
> > show up in either the "Query the datastore" or "C
How are you identifying that it's reloading?
If the load is really light, the instance might just be timing out and
getting killed before a 2nd request comes in.
On Sep 16, 4:55 am, Микола <[EMAIL PROTECTED]> wrote:
> Yes, we have main() function.
>
> On 15 Вер, 22:56,
oad is really light, the instance might just be timing out and
> > getting killed before a 2nd request comes in.
>
> First load is very hard (imports are done from big archive (with zope)
> that splited to 24 archives (500kb each)). Further requests are light.
>
> On 16 Вер, 17
What does your path look like locally & on appengine?
On Sep 15, 9:53 am, Tony Arkles <[EMAIL PROTECTED]> wrote:
> Does this happen all the time, or only occasionally?
>
> I've been having random import failures recently, although I don't
> think I've got
And... I have a solution.
It appears that GAE resets sys.path before every invocation of
main(). We were modifying the sys.path (adding a lib directory to it)
at the module-level, so this would only take effect for the first
request on a given Python instance.
On Sep 15, 9:55 am, Tony Arkles
This is purely for curiosity sake... what framework are you using that
is 12MB zipped up?
On Sep 17, 7:57 am, Микола <[EMAIL PROTECTED]> wrote:
> Yes, maybe you are right.
>
> On Sep 17, 4:18 pm, Wooble <[EMAIL PROTECTED]> wrote:
>
> > On Sep 17, 6:04 am, Микола <[EMAIL PROTECTED]> wrote:
>
> >
It should be distributed. Could you post some code that exhibits the
behaviour you're describing?
On Sep 22, 6:04 pm, djidjadji <[EMAIL PROTECTED]> wrote:
> To speed up the response for most queries I use memchache to store
> part of the generated html.
> When the objects change that are used f
Thomas, I think that solution will only work if the items are being
returned such that their keys will be in ascending order (which in the
general case seems like a very poor assumption).
Did I miss something?
On Sep 25, 1:14 am, Thomas Johansson <[EMAIL PROTECTED]> wrote:
> Entities always have
25, 10:41 am, "Venkatesh Rangarajan"
<[EMAIL PROTECTED]> wrote:
> Exactly my thought... One cannot assume that the keys are in ascending order
> or Can we ?
>
> On Thu, Sep 25, 2008 at 7:42 AM, Tony Arkles <[EMAIL PROTECTED]> wrote:
>
> > Thomas, I t
http://code.google.com/appengine/docs/datastore/keysandentitygroups.html
rather.
On Sep 25, 2:20 pm, Tony Arkles <[EMAIL PROTECTED]> wrote:
> You definitely can not.
>
> Fromhttp://code.google.com/appengine/docs/datastore/keysandentitygroups.h...
>
> "An application
Can you please post the directory structure and the goal?
On Oct 2, 1:48 am, James <[EMAIL PROTECTED]> wrote:
> From a child directory, why can't a module in a parent or sibling
> directory be imported?
>
> Am I mistaken, or is this prohibited? (not using Django, just
> webapp)
--~--~
Hi everyone,
I'm running into a bit of a snag, and I'm hoping that someone might be
able to offer some suggestions.
I've got a Kind that is keeping track of information about URLs
(ratings, summary, etc). At first glance, it seems natural to key
Entities based on the full URL -- this will ensur
that allows you to take a long URL
> > such as:
>
> >http://www.harleyquine.com/downloads/php-scripts/somefile.zip
>
> > and turn it into:
> >http://www.harleyquine.com/u/1
>
> there are lots of this kind of services.
>
> 在 2008-10-2,下午11:55, Tony Ark
Ahhh... sigh. :)
I was hoping to avoid doing that. It certainly adds a layer of
complexity that I was hoping to avoid.
On Oct 2, 10:49 am, "José Oliver Segura" <[EMAIL PROTECTED]> wrote:
> 2008/10/2 Tony Arkles <[EMAIL PROTECTED]>:
>
>
>
> > I don'
Yeah, it's tough either way.
I'm fine with just discarding urls that exceed 500 characters (that
was my first solution), although I agree that the key space is
probably large enough that hash collisions would be highly unlikely.
On Oct 2, 12:31 pm, Bill <[EMAIL PROTECTED]> wrote:
> > Th
I don't think a *secure* hash function is necessary here (nor do I
think it desirable, due to speed). By the pigeonhole principle, *all*
hashes have collisions; it's just a matter of a) how likely it is to
happen, and b) how much of an impact will it have.
For doing a hashtable implementation (w
written python hash function not likely
> outperform secure hash function implemented in c.
> This kind attack actually happened once on amazon's s3 service, which
> caused about 2 hours partial service interruption.
>
> On Oct 2, 4:43 pm, Tony Arkles <[EMAIL PROTECTED]> wr
The real goal is to figure out how *not* to do that. :)
What are you trying to accomplish?
On Oct 2, 6:15 pm, "Venkatesh Rangarajan"
<[EMAIL PROTECTED]> wrote:
> Is it possible to retrieve more than 1000 entities ?
>
> Has anyone figured a way to do this ?
--~--~-~--~~
ime
>
> On Oct 2, 6:42 pm, Tony Arkles <[EMAIL PROTECTED]> wrote:
>
> > The real goal is to figure out how *not* to do that. :)
>
> > What are you trying to accomplish?
>
> > On Oct 2, 6:15 pm, "Venkatesh Rangarajan"
>
> > <[EMAIL PROTEC
For a summary of the C-based modules that are available, check out
http://code.google.com/appengine/kb/libraries.html
On Oct 2, 6:14 pm, ryan <[EMAIL PROTECTED]> wrote:
> unfortunately, app engine doesn't support native (ie C-based) python
> modules:
>
> http://code.google.com/appengine/docs/py
Hmmm... that would probably run into CPU usage timeouts.
>From the pyDES page:
"The code below is not written for speed or performance, so not for
those needing a fast des implementation, but rather a handy portable
solution ideal for small usage. It takes my AMD2000+ machine 1 second
per 2.5 ki
I just used a random number within an import (since imports only
happen once per instance, it should persist for the lifetime of the
process)
On Oct 9, 12:56 am, Josh Heitzman <[EMAIL PROTECTED]> wrote:
> The state of the process is not of interest, just which instance of
> many processes it is
I think the question is whether or not there's a convenient way to
retrieve the url from google's cache, instead of pushing the request
out onto the (potentially slow) internet.
On Oct 16, 3:24 pm, Jon McAlister <[EMAIL PROTECTED]> wrote:
> http://code.google.com/appengine/docs/urlfetch/
>
> On
I'm seeing this too.
On Oct 17, 8:31 am, Anthony <[EMAIL PROTECTED]> wrote:
> I'm getting an error when I try to update my apps today it gets as far
> as uploading the indexes then fails...
>
> Initiating update.
> Cloning 78 static files.
> Cloning 22 application files.
> Closing update.
> Uploa
Ryan, do you mean the PATH, or the PYTHONPATH? It doesn't have to be
in your PATH, just the PYTHONPATH (which you can view by doing "import
sys; print sys.path")
On Nov 2, 3:39 pm, ryan baldwin <[EMAIL PROTECTED]> wrote:
> K, I double checked and tried it all out and Alok's proposed solution
> j
file contains
> "PIL". If I run the app under shell ("python manage.py shell") and do> from
> PIL import Image
>
> it works fine. If I runt the app via runserver and try to import
> Image, it fails a horrible death. Makes no sense.
>
> - ryan.
>
>
It seems like a pretty good approach to me.
One thing to watch out for is that things can vanish from the memcache
(due to memory pressure). Don't assume it's going to be a reliable
storage mechanism! If you're OK with possibly losing events, then
it's OK, but if you require all events to for s
Hi all. Maybe I'm missing something obvious here. In the Admin
Console (on the production servers), I get log lines like:
12-30 12:39PM 36.208 /x 500 552ms 1713ms-cpu 7kb
(with a "CPU warning" icon next to the 1713ms-cpu).
When I retrieve the log files from app engine, I can't seem to fin
On Dec 30, 6:13 pm, "James Leskovar" wrote:
> If you don't specify an expiry time, they'll persist
> forever, until
> there's significant load on the cache.
This is really important to note: if you're using the memcache for
your application settings, you probably want it to be backed by a
da
I don't mean to be pessimistic, but in my experience so far, using
"relational ideas" with the datastore pretty much results in queries
that consume way too much CPU time (because it involves too many
datastore hits). Data modelling using the datastore is quite
different than normal relational mo
Bump? I posted this over the holidays, maybe someone who knows the
answer might have missed it?
On Dec 30 2008, 9:54 pm, Tony Arkles wrote:
> Hi all. Maybe I'm missing something obvious here. In the Admin
> Console (on the production servers), I get log lines like:
>
> 12-
information over time
> would be to save the daily graph of 'CPU Seconds Used/Second' available on
> the dashboard.
>
> Not an ideal solution, and it seems like this would be a good feature
> request.
>
> -Marzia
>
> On Mon, Jan 5, 2009 at 10:19 AM, Tony A
We saw this error yesterday too, but only for one of our users. The
query succeeds for everyone else...
(We were doing a fetch instead of a count, but otherwise it seems
pretty similar)
On Jan 8, 11:48 am, Ryan W wrote:
> All of a sudden this morning, I began getting this error in my app,
> wh
On Jan 12, 9:18 am, Cesium wrote:
> > Marzia in this thread has already said they dont offer any guarantees.
>
> Is Marzia a primary source?
Yes, Marzia is part of the app engine team.
--~--~-~--~~~---~--~~
You received this message because you are subscribed
I thought I would post our findings and solution. Our issue seems
slightly different.
We had entities similar to the following:
class Account(db.Model):
...
class AccountEntry(db.Model):
account = db.ReferenceProperty(Account)
tags = db.StringListProperty()
utime = db.DateTimeProperty()
Hi everyone!
In a thread [1], and in the documentation [2], it says that setting
ancestors doesn't affect performance, but I'm not sure that this is
the case.
I set up two queries, one using "WHERE locationKey = :1" (locationKey
is a db.StringProperty), and one using "WHERE ANCESTOR IS :1" (the
Oops, missed the second reference:
[2] Section "Tips for using entity groups: " in
http://code.google.com/appengine/docs/python/datastore/keysandentitygroups.html
On Jan 19, 9:10 am, Tony Arkles wrote:
> Hi everyone!
>
> In a thread [1], and in the documentation [2], i
On Jan 19, 5:42 pm, Alexander Kojevnikov
wrote:
> From your second link:
>
> All entities in a group are stored in the same datastore node.
>
> I guess this means that entities from the same group are stored close
> to each other. When your query uses "ANCESTOR IS", the query engine
> can tak
Thanks for the excellent reply Ryan!
On Jan 20, 3:54 pm, ryan wrote:
> On Jan 19, 7:10 am, TonyArkles wrote:
>
>
>
> > In a thread [1], and in the documentation [2], it says that setting
> > ancestors doesn't affect performance, but I'm not sure that this is
> > the case.
> ...
> > The measure
You could star my issue :)
http://code.google.com/p/googleappengine/issues/detail?id=972&can=4&colspec=ID%20Type%20Status%20Priority%20Stars%20Owner%20Summary%20Log%20Component
On Jan 19, 1:48 pm, Kerio wrote:
> I double that
> I'm not sure if there's some way to access the dashboard, but in t
The big difference between in-memory caching and memcache caching is
that memcache data is shared between all of your running instances,
but in-memory caching is on a per-instance basis.
On Jan 22, 9:52 am, Blixt wrote:
> Hi there,
>
> I've been playing with caching using global variables
> (s
Hi,
We're using urlfetch to access Yahoo Boss, which requires "Accept-
Encoding: gzip" in the HTTP headers.
The documentation doesn't indicate that this is a "forbidden" header:
http://code.google.com/appengine/docs/python/urlfetch/fetchfunction.html
The code works great on the live server, bu
The quick answer is 5 :)
You're absolutely correct in looking for listen(), but you're looking
in the wrong place.
The dev_appserver runs the BaseHTTPServer from the Python standard
library. The BaseHTTPServer from the stdlib runs the
SocketServer.TCPServer from the SocketServer in the stdlib.
Khai, I recently posted a bit on my blog about this:
http://blog.chilly.ca/?p=238
You'll probably be pretty hard-pressed to run it on anything but the
dev_appserver, and it's not very likely that you'll get it working
multi-threaded. Sorry :(
On Apr 6, 5:59 pm, Khai wrote:
> Perhaps I didn't
Me too
app id: steprep
app id: steprep-demo
On Mar 2, 9:09 pm, Gee wrote:
> me too
>
> app id: rotzy
>
> On Mar 2, 7:06 pm, Bill wrote:
>
> > Anyone else having trouble with their apps? I'm getting 502 Server
> > Errors and even looking at logs in the console are glacially slow.
--~--~--
Profile profile profile! Use the profiler, on the live app engine.
On Mar 4, 8:42 am, ltcstyle wrote:
> Hi All,
>
> When we developing an app, or implementing an idea, it's very likely we
> focus on the features and functionalities first.
> However, at some point, the performance could become
50 matches
Mail list logo