[google-appengine] Re: Google maps custom tile hosting on GAE

2008-09-02 Thread Brian Clapper
On 9/2/08 11:29 AM, Fred wrote: Hi, I'm developing a google maps app, hosted on GAE, for which I've developed a custom tile overlay, consisting of thousands of png images, at about 4 - 8k each in size. I've tried uploading about 15mb worth of tiles (just over 3,500 tiles), and have hit the

[google-appengine] Re: Google maps custom tile hosting on GAE

2008-09-02 Thread Fred
but An app can read files, but only files uploaded with the application code from http://code.google.com/appengine/docs/whatisgoogleappengine.html So should the zip file would be imported into the datastore? On Sep 2, 4:37 pm, Brian Clapper [EMAIL PROTECTED] wrote: On 9/2/08 11:29 AM, Fred

[google-appengine] Re: Google maps custom tile hosting on GAE

2008-09-02 Thread Brian Clapper
On 9/2/08 11:45 AM, Fred wrote: but An app can read files, but only files uploaded with the application code from http://code.google.com/appengine/docs/whatisgoogleappengine.html So should the zip file would be imported into the datastore? Your first paragraph should give you the answer.

[google-appengine] Re: Google maps custom tile hosting on GAE

2008-09-02 Thread Tim Hoffman
why aren't you storing your tiles as entities in the store rather than as files? T On Sep 2, 11:29 pm, Fred [EMAIL PROTECTED] wrote: Hi, I'm developing a google maps app, hosted on GAE, for which I've developed a custom tile overlay, consisting of thousands of png images, at about 4 - 8k

[google-appengine] Re: Google maps custom tile hosting on GAE

2008-09-02 Thread Fred
OK, thanks Brian. Final question - any pointers for reading from zip files on the fly? On Sep 2, 5:02 pm, Brian Clapper [EMAIL PROTECTED] wrote: On 9/2/08 11:45 AM, Fred wrote: but An app can read files, but only files uploaded with the application code

[google-appengine] Re: Google maps custom tile hosting on GAE

2008-09-02 Thread Fred
Tim: why aren't you storing your tiles as entities in the store rather than as files? I was concerned about CPU quotas - each tile request would hit the datastore. On Sep 2, 5:03 pm, Tim Hoffman [EMAIL PROTECTED] wrote: why aren't you storing your tiles as entities in the store rather than

[google-appengine] Re: Google maps custom tile hosting on GAE

2008-09-02 Thread bFlood
1) put them in the datastore and memcache the mostly commonly used (like the tiles at the startup level) 2) set client side cache headers for the tiles if they don't change often 3) use alternative storage like Amazon S3 personally, i would not try the datastore method first. I have not seen an

[google-appengine] Re: Google maps custom tile hosting on GAE

2008-09-02 Thread Fred
Hi Brian, personally, i would not try the datastore method first. I have not seen an issue yet with storing tiles as blobs do you mean you *would* try the datastore method first? How many tiles are you typically storing in the datastore? On Sep 2, 5:42 pm, bFlood [EMAIL PROTECTED] wrote: 1)

[google-appengine] Re: Google maps custom tile hosting on GAE

2008-09-02 Thread Brian Clapper
On 9/2/08 12:06 PM, Fred wrote: OK, thanks Brian. Final question - any pointers for reading from zip files on the fly? See the standard Python zipfile module. http://docs.python.org/lib/module-zipfile.html Brian Clapper, http://www.clapper.org/bmc/ Variables won't. Constants aren't.

[google-appengine] Re: Google maps custom tile hosting on GAE

2008-09-02 Thread bFlood
whoops, little typo: I would not try should be I would try. there's no limit on the number of blobs you can store but you will hit the storage quota in the preview. I have thousands in there right now for testing purposes It might be cheaper to store them on Amazon S3 but I have not worked out

[google-appengine] Re: Google maps custom tile hosting on GAE

2008-09-02 Thread Fred
Thanks all, the verdict then is to try the datastore first. The tiles will be refreshed on a regular basis (probably every 24 hours) using an application outside the GAE, so the reliability and speed of the bulk uploader will be an important factor. The last time I tried the bulk uploader I found