Re: [google-appengine] Re: Sync Google Cloud Storage to Instance Cluster

['Dennis Yurkevich' via Google App Engine]

Cloud storage being accessed by a Cloud VM is quite general in my view.

On Sun, Sep 2, 2018 at 5:26 PM, 'Katayoon (Cloud Platform Support)' via
Google App Engine  wrote:

> I should add that Google Groups are reserved for general product
> discussions. We cannot provide you any advice on your system’s
> architecture. If you have a Premium support package
> ,
> the architecture advisory service is available on best-effort basis or you
> may refer to the Google Cloud Partners .
>
>
> Furthermore, you can send your feature request via the Issue Tracker
>  if any so that the
> product team will evaluate your request.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/cb9f302d-3a99-495e-aac9-
> 98a6e16c3c66%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B4W%2B9gvWYXPTEi%3DwwFU1VOQx2Y9r-p%2B%2BavXDi84vpDtNw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Migation from standard datastore to Firebase native

['Dennis Yurkevich' via Google App Engine]

Thank you Jordan, but the question remains - if I activated Cloud Datastore
but have never used the APIs, can I shut it down and create a Firestore in
that same project?

On Fri, Aug 24, 2018 at 7:49 PM, 'Jordan (Cloud Platform Support)' via
Google App Engine  wrote:

> You can find all of the answers to your questions in the Automatic
> Upgrade to Cloud Firestore
>  documentation
> and provided video
> . As noted
> in blue on that page: "You cannot manually upgrade an existing Cloud
> Datastore database to Cloud Firestore in Datastore mode.". This will be
> done automatically for you once Firestore is out of Beta.
>
> - If you are looking to use native Cloud Firestore (by following the Get
> started with Cloud Firestore
>  steps), you are
> required to create a new project that does not have a Cloud Datastore
> created. This is because Cloud Datastore and native Cloud Firestore are not
> compatible, since Cloud Firestore is the next generation of Cloud
> Datastore. They therefore cannot exists together in the same project, and
> you can only use one or the other.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/a73894f6-5039-405f-abb6-
> 0a1f90cbd75d%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B5aZVvFucjzvafhvueyb9Nvyzt0D7zf-Y8oVEvfk%2B8mRg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Sync Google Cloud Storage to Instance Cluster

['Dennis Yurkevich' via Google App Engine]

Hello Amit,

I am capable of locating the documentation myself. I was under the
impression that this mailing list is to discuss GAE as a product.

I have a use case which I do not feel is well satisfied by what is
available in the docs/product itself.

Dennis

On Mon, Aug 27, 2018 at 3:24 PM, 'Amit (Google Cloud Support)' via Google
App Engine  wrote:

> Hello Dennis,
>
> Yes, you are right. The Memcache service is not available for App Engine
> flexible environment at this moment. However, an alpha version will be
> available soon, you can fill-out the early access form here
> <https://cloud.google.com/appengine/docs/flexible/nodejs/upgrading#memcache_service>.
> Currently , you can use Redis Labs Memcache
> <https://cloud.google.com/appengine/docs/flexible/nodejs/using-redislabs-memcache>
> , a third party fully managed service, to cache application data. This
> will allow you to use Memcached in order to achieve the persistence and
> in-memory replication of your data.
>
> Alternatively, you can use Node.JS Cloud Storage client library
> <https://cloud.google.com/storage/docs/reference/libraries#client-libraries-install-nodejs>
> to access your files on Cloud Storage.
>
> I hope that the provided will helps you to find a resolution for your
> issue.
>
>
> On Thursday, August 23, 2018 at 6:04:41 AM UTC-4, Dennis Yurkevich wrote:
>>
>> Hello Amit,
>>
>> Appreciate the reply, and thank you for the resource.
>>
>> However - my question is still open, at the very basic level I would like
>> to read an external data source and load an object to be available in
>> memory on all of my instances.
>>
>> I am using nodejs flexible and memcache is not available, or ideal as I
>> need the data to persist.
>>
>> Ideally I could maybe mount the google cloud bucket as a filesystem, and
>> run a CRON job / task to load any new files from that bucket into memory.
>>
>> Would be great if you can suggest an approach here.
>>
>> Best,
>> Dennis
>>
>>
>>
>> On Wed, Aug 22, 2018 at 9:34 PM, 'Amit (Google Cloud Support)' via Google
>> App Engine  wrote:
>>
>>> Hello Dennis,
>>>
>>> App Engine instances are computing units that App Engine uses to
>>> automatically scale the running application. Each instance has its own
>>> security layer to ensure that instances cannot unintentionally affect each
>>> other. In this similar standpoint, the files written to the file system on
>>> one instance will not be replicated across all other available instances.
>>> For more information about how instances are managed on App Engine, please
>>> go through this [1] article.
>>>
>>> I hope this answers your question.
>>>
>>> [1] https://cloud.google.com/appengine/docs/standard/python/how-
>>> instances-are-managed
>>>
>>>
>>> On Wednesday, August 22, 2018 at 4:37:31 AM UTC-4, Dennis Yurkevich
>>> wrote:
>>>>
>>>> Hello,
>>>>
>>>> If I write a cron job to fetch data from Cloud Storage and write it to
>>>> the instance file system - will this be replicated across all of my
>>>> instances?
>>>>
>>>> Thanks,
>>>> Dennis
>>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Google App Engine" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to google-appengine+unsubscr...@googlegroups.com.
>>> To post to this group, send email to google-appengine@googlegroups.com.
>>> Visit this group at https://groups.google.com/group/google-appengine.
>>> To view this discussion on the web visit https://groups.google.com/d/ms
>>> gid/google-appengine/d2c09cca-f7d5-4810-9b7e-d59e047c0cfd%
>>> 40googlegroups.com
>>> <https://groups.google.com/d/msgid/google-appengine/d2c09cca-f7d5-4810-9b7e-d59e047c0cfd%40googlegroups.com?utm_medium=email_source=footer>
>>> .
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/

Re: [google-appengine] Re: Sync Google Cloud Storage to Instance Cluster

['Dennis Yurkevich' via Google App Engine]

This answer does not help much.

I am trying to understand what the mechanics are for adding data to memory
where the data originates from does not matter - I am able to see the
various google products available.

Why does pub/sub load data into both instances and cron job only into one?

On Fri, Aug 24, 2018 at 6:25 AM, Attila-Mihaly Balazs 
wrote:

> You can take a look at Google Datastore
>  or Google Cloud Storage
>  (perhaps with some Pub/Sub
>  thrown in to notify live
> instances that they need to load/reload their data).
>
> Attila
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/a3945ade-d570-49f1-b009-
> 91721732f7d6%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B6wP-8r11ofvKJHFbaQDj1boicMUoGkJnUViy-RFax0rA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Migation from standard datastore to Firebase native

['Dennis Yurkevich' via Google App Engine]

+1

When I try and access firestore - I am greeted by a message that datastore
is activated and therefore I should use that, however my project is not
using any datastore APIs.

On Thu, Aug 23, 2018 at 11:34 AM, Richard Cheesmar 
wrote:

>
> *"Migation from standard datastore to Firebase native" *
>
> Are there any docs on this topic?
>
> Thanks
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/71f4baea-11ca-45be-b4c0-
> 3d91788b5894%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B5agDW9cGEKKTJBNvirpf2gPSGKjt8AnsDyF3xyDt3%2BOg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Sync Google Cloud Storage to Instance Cluster

['Dennis Yurkevich' via Google App Engine]

Hello Amit,

Appreciate the reply, and thank you for the resource.

However - my question is still open, at the very basic level I would like
to read an external data source and load an object to be available in
memory on all of my instances.

I am using nodejs flexible and memcache is not available, or ideal as I
need the data to persist.

Ideally I could maybe mount the google cloud bucket as a filesystem, and
run a CRON job / task to load any new files from that bucket into memory.

Would be great if you can suggest an approach here.

Best,
Dennis



On Wed, Aug 22, 2018 at 9:34 PM, 'Amit (Google Cloud Support)' via Google
App Engine  wrote:

> Hello Dennis,
>
> App Engine instances are computing units that App Engine uses to
> automatically scale the running application. Each instance has its own
> security layer to ensure that instances cannot unintentionally affect each
> other. In this similar standpoint, the files written to the file system on
> one instance will not be replicated across all other available instances.
> For more information about how instances are managed on App Engine, please
> go through this [1] article.
>
> I hope this answers your question.
>
> [1] https://cloud.google.com/appengine/docs/standard/
> python/how-instances-are-managed
>
>
> On Wednesday, August 22, 2018 at 4:37:31 AM UTC-4, Dennis Yurkevich wrote:
>>
>> Hello,
>>
>> If I write a cron job to fetch data from Cloud Storage and write it to
>> the instance file system - will this be replicated across all of my
>> instances?
>>
>> Thanks,
>> Dennis
>>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/d2c09cca-f7d5-4810-9b7e-
> d59e047c0cfd%40googlegroups.com
> <https://groups.google.com/d/msgid/google-appengine/d2c09cca-f7d5-4810-9b7e-d59e047c0cfd%40googlegroups.com?utm_medium=email_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B6AfjBo6nRK1Fe%2Bh8Fhe4BrPpQBZkzHx8GiH_1UUnnNQw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Sync Google Cloud Storage to Instance Cluster

['Dennis Yurkevich' via Google App Engine]

Hello,

If I write a cron job to fetch data from Cloud Storage and write it to the
instance file system - will this be replicated across all of my instances?

Thanks,
Dennis

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B4pzrq4MvwuXXu4PXkkktCYW7EmohWuBS9btcadrT1oWg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Writing Files to Server

['Dennis Yurkevich' via Google App Engine]

Thank you Katayoon.

On Mon, 20 Aug 2018 at 18:27, 'Katayoon (Cloud Platform Support)' via
Google App Engine  wrote:

> My assumption is that you mean to update and read a hard-coded file in
> your app? If so, and if you have more than one instance of your app, there
> is no guarantee if you could fetch the same data (means your assumption is
> correct).
>
> Note that the cache
>  is
> global and is shared across the application's frontend, backend, and all of
> its services and versions. Session data
> 
> is a good candidates for caching, however values can expire from the
> memcache at any time.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/b66c830b-395c-4e66-b0be-2dea4e3bca45%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B6WM4Gws2hdbhhmipVkdzP56UsFjjUky10bLqZm7D6mZg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Writing Files to Server

['Dennis Yurkevich' via Google App Engine]

Thanks you Katayoon.

Just to confirm, if I write a file to my app, which is running on 2
instances using a POST requests to an express endpoint.

And in another request I try and fetch the same file - there is a 50%
chance that the file will be found as it will reside on a single instance?

re-memcache, you mention transient, so the data here is stored just for a
single user session?

On Fri, Aug 17, 2018 at 11:23 PM, 'Katayoon (Cloud Platform Support)' via
Google App Engine  wrote:

> Hi Dennis,
>
> Each request will be routed to an instance and the data will be
> transmitted/addressed via the request, however you may use memcache
> <https://cloud.google.com/appengine/articles/scaling/memcache> which is a
> distributed RAM cache in which you can store transient data using a
> key-value model. For storing resident data, you may choose a storage
> option <https://cloud.google.com/storage-options/> based on your
> use-case.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/9414102a-3e0f-4366-a208-
> 079377d19e1b%40googlegroups.com
> <https://groups.google.com/d/msgid/google-appengine/9414102a-3e0f-4366-a208-079377d19e1b%40googlegroups.com?utm_medium=email_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B50X%3D9CBMv_N-Z9FkrFsPcmBwcp%3DqqBCdL_ejhLfcB5Xg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Writing Files to Server

['Dennis Yurkevich' via Google App Engine]

Hello,

How does the scaling and distributed system work, for example if my server
has and endpoint which I can hit to write a file with the data sent to it,
my app is running on 2 instances, so my assumption is that the request hits
just one instance and the file exists only on one?

Thanks!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B56aoORM69mx4OVgo9ugFRLvO4Y4-ShkN%2B1pU88JZbY4Q%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Using Process Managers

['Dennis Yurkevich' via Google App Engine]

Thanks Kenworth so does the default docker context of GAE set any of these.

The default for docker is NO restart, which looking at my logs does not
match as I can see the process restart on error. Not sure what is
triggering this...

On Fri, 27 Jul 2018 at 17:58, 'Kenworth (Google Cloud Platform)' via Google
App Engine  wrote:

>
>> So GAE env itself or the Docker env provides nothing of this sort?
>>
>
> Not on GAE. For Docker, you can try look at restart policies
>  
> and
> see if it fits your use-case.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/5147a8c8-622c-42ed-b575-5ba7d96826bb%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B4StaDKSYBi60XjyGhmJ7V7_g2ngocGsUPRVCqcWntJZg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Using Process Managers

['Dennis Yurkevich' via Google App Engine]

Thank you Julie and Kenworth.

I will add one and measure the overhead.

However from my testing it seems GAE keeps the app running. Not sure if
there is anything which does that or the code is awesome 

Thank you for your help!
Dennis

On Thu, 26 Jul 2018 at 21:15, 'Julie (cloud platform support)' via Google
App Engine  wrote:

> The decision on whether or not to include a process manager really depends
> on your application and if it is critical that it avoids/minimizes
> downtime. As mentioned by Kenworth, including one would likely improve user
> experience but may increase resource usage and therefore cost.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/a7aba032-962d-4f8b-9ae0-d163c2203491%40googlegroups.com
> <https://groups.google.com/d/msgid/google-appengine/a7aba032-962d-4f8b-9ae0-d163c2203491%40googlegroups.com?utm_medium=email_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B6ONjxbuCkdG3bD0c9SPcOG3mXGWFU17qj3rrim2dtcFw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Using Process Managers

['Dennis Yurkevich' via Google App Engine]

A process manager is something which at the very basic level restarts the
app if it crashes - most popular for node is http://pm2.keymetrics.io/

@Julie, if you feel it is needed I would install PM2 and use it to start
the server script instead of using node.

On Wed, Jul 25, 2018 at 2:20 PM, gnome rock 
wrote:

> Excuse me, What is Process Manager ?
> I never used it.
>
>
> On 25 Jul BE 2561, at 20:15, 'Julie (cloud platform support)' via Google
> App Engine  wrote:
>
> How you are planning to use the Process Manager? I can check to see if
> that functionality is supported.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/0cd76932-9ab8-4ebf-ac0c-
> 3f3d1b2f3c19%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/1DC0BDF2-16AE-4622-832A-3D38597675D4%40gmail.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B4JXSmzoL5Sg00PtihUfZ0BHVPUn-jOhB41kY%2BwK%3D9onw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Stability problems on GAE standard Node.js app - no apparent clues in the logs

['Dennis Yurkevich' via Google App Engine]

Hello Richard,

I am sorry I am not able to help with your question and likely you may be
asked to post this on SO.

However interested to hear why you are moving from Flex to Standard.

Thanks
D

On Mon, 23 Jul 2018 at 14:00, Richard Marr  wrote:

>
> Hi,
>
> I'm hoping someone can shed a little light or give me some pointers on
> this...
>
> We're trying to migrate our Node.js app to GAE Standard (after a year or
> so on GAE Flexible) and are having problems.
>
> The app deploys without any apparent error, but when we try to visit the
> app the web browser just spins and spins and eventually returns a 502 error.
>
> Looking at the logs, the app starts to boot but then fails silently, with
> no errors logged, seemingly at an arbitrary point during boot... it doesn't
> seem to be consistent... sometimes it gets all the way to serving the first
> HTTP request correctly but then dies immediately afterwards.
>
> Any suggestions appreciated.
>
> Rich
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/8c2f6a39-0022-40d3-af35-505e0ee6f94a%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B5Na3N2Gms_NOU%2B-xNm4RGNjxpuciK6wzSkgb%2BN%2BJFKuA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Using Process Managers

['Dennis Yurkevich' via Google App Engine]

Thanks Kenworth.

So GAE env itself or the Docker env provides nothing of this sort?

On Thu, Jul 19, 2018 at 5:32 PM, 'Kenworth (Google Cloud Platform)' via
Google App Engine  wrote:

> It comes down to preference. It always makes sense to have a process
> manager running in Node.js production. It would be a better user experience
> to have an application restart after being down for example. Note that having
> a process manager will impact resources / performance.  However, if you
> have mission critical apps, then it would be worth the performance hit to
> have a PM running.
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/28b57b11-fec9-48b3-a9bc-
> fa95bb7de91d%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B6HuBybHP_G6eAChfVU2rWOVtrFyEe%3DWDwtWTo1k%3DXcoA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Using Process Managers

['Dennis Yurkevich' via Google App Engine]

Hello All!

When deploying apps using GAE - is a process manager needed?

Right now I am using the Nodejs Flexible environment, and in my npm run
start command -> simply running node app.js

The application seems to be live most of the time, but not sure on what the
best practice is. When I was using Compute engine I also used PM2.

If the answer is that no process manager is needed it would be great to
understand why also!

Any help would be great.

Thanks!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B5K%3DXkZbxo1WwKDAUR5UYgN4KcE6WnXxC5jrRirnSg%2Bvg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Using VS Code in the Cloud!

['Dennis Yurkevich' via Google App Engine]

Why do you mean by fire it up, deploy the app?

Yes this could work, but then it raises the question of why are Google
making the online editor? It’s very far away from modern editors.

On Wed, 18 Jul 2018 at 23:38, 'Katayoon (Cloud Platform Support)' via
Google App Engine  wrote:

> The easiest way could be doing coding in your local Visual Studio Code and
> then fire it up by gcloud commands via the Command Line Interface. Hope
> this works for you?
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/f9020f82-b125-4459-9432-0f821ad09443%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B5Qq5SGcejSeXUoXtHAEtSqOQ805Od3efk12Mo0zZ4cbg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Using VS Code in the Cloud!

['Dennis Yurkevich' via Google App Engine]

Thank you Katayoon.

However I was thinking there could be a third party system to do this?

Is it possible to virtually mount the file system to my local machine?

Or some other option users have invented?

On Wed, 18 Jul 2018 at 03:27, 'Katayoon (Cloud Platform Support)' via
Google App Engine  wrote:

> I should note that we only support Google Cloud Tools for Visual Studio on
> Windows at the moment. So you may raise a feature request via the Issue
> Tracker  so that
> the Cloud Tools product team may evaluate it, however there is no ETA or
> guarantee of implementation.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/4bd2003b-c72f-4033-8377-3bcafc3705cc%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B4HptJe2qnuqKeA2_7n9Kg9bnMuJtzo2LG-v_XNXVb2WA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Using VS Code in the Cloud!

['Dennis Yurkevich' via Google App Engine]

Thank you Katayoon. But I am developing Nodejs apps and not on Windows.

On Mon, 16 Jul 2018 at 22:14, 'Katayoon (Cloud Platform Support)' via
Google App Engine  wrote:

> Hi Dennis,
>
> You may use Cloud Tools for Visual Studio
> <https://cloud.google.com/visual-studio/> which is a powerful environment
> to build Windows and .NET applications and deploy them to Cloud Platform
> directly from your favorite IDE. You may also follow this Quickstart
> <https://cloud.google.com/tools/visual-studio/docs/quickstart> or this one
> <https://cloud.google.com/appengine/docs/flexible/dotnet/quickstart>
> showing you how to configure Microsoft Visual Studio and create and deploy
> a .NET application on Google Cloud Platform.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/ecd7f462-4acb-479e-bbf1-9d4270a210c5%40googlegroups.com
> <https://groups.google.com/d/msgid/google-appengine/ecd7f462-4acb-479e-bbf1-9d4270a210c5%40googlegroups.com?utm_medium=email_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B4cN28LkYiHK3Fb_%2BykiYGYJJd-nr_R-U10iJEKUF_n9Q%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Using VS Code in the Cloud!

['Dennis Yurkevich' via Google App Engine]

Hello All,

I love the ease of the in browser editor which GAE provides, but the Editor
itself is very poor and does not offer the pleasent and flexible
environment which VS code or similar does.

Is there a way to connect my VS code editor directly to the GAE provisioned
editor / shell?

Thanks!
D

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B63j0frJ6D0Q_DhSwW_B3pZf28UhoC0mP5%2B5h4q7GPisw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Static File Hosting - Performance & Logging

['Dennis Yurkevich' via Google App Engine]

Hello Yasser,

Today I am serving static files using Express and without having specified
the handlers in app.yaml.



On Sat, Jul 14, 2018 at 12:31 AM, 'Yasser Karout (Cloud Platform Support)'
via Google App Engine  wrote:

> Just for clarity, to serve static files using express.static(), you still
> need to specify the static URL handlers in your app.yaml file. So the first
> and second method you listed are the same method.
>
>
> On Wednesday, July 11, 2018 at 4:55:57 AM UTC-4, Dennis Yurkevich wrote:
>>
>> Hello All,
>>
>> When using the various static file hosting options on GAE Nodejs Flex
>> Environment, I see the below three as the main options:
>> 1. have the app serve on a route e.g app.use(express.static())
>> 2. use the app.yaml config
>> 3. use google bucket / cdn
>>
>> My first question is which should be most performant? I am serving a
>> 400kb SPA bundle.
>>
>> Second, I need some flexibility which I am using the routing for, such as
>> deciding which bundle to serve based on geo, reading the cookie header and
>> logging. Would these things be possible with option 2 & 3?
>>
>> My final question, is that the app.yaml option is this just using nginx
>> to serve behind the scenes?
>>
>> Thanks,
>> Dennis
>>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/0465fce3-fd28-447b-a371-
> 43898c49130d%40googlegroups.com
> <https://groups.google.com/d/msgid/google-appengine/0465fce3-fd28-447b-a371-43898c49130d%40googlegroups.com?utm_medium=email_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B42c358wOGf1JnPUyw5d3gu2T_P3k_M9c3RJHYv5S7z4Q%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Static File Hosting - Performance & Logging

['Dennis Yurkevich' via Google App Engine]

Hello All,

When using the various static file hosting options on GAE Nodejs Flex
Environment, I see the below three as the main options:
1. have the app serve on a route e.g app.use(express.static())
2. use the app.yaml config
3. use google bucket / cdn

My first question is which should be most performant? I am serving a 400kb
SPA bundle.

Second, I need some flexibility which I am using the routing for, such as
deciding which bundle to serve based on geo, reading the cookie header and
logging. Would these things be possible with option 2 & 3?

My final question, is that the app.yaml option is this just using nginx to
serve behind the scenes?

Thanks,
Dennis

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B5MxWdAwVLNt6q%2B2y0SBAEeDdztFvN%2B50yPmxoOCM02%3DA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Flex vs Standard - Feature Comparison

['Dennis Yurkevich' via Google App Engine]

Hello All,

Is there a detailed doc which shows the comparison of Flex vs Standard?

I am not far into my GAE journey and have opted for flex, but reading some
of the threads in this group I feel that quite a few nice features are
lost. It would be great to get the full picture.

I am specifically interested in Nodejs

Best,
Dennis

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B6heTdb713V6_oe%3DhxFdtwr2kiz6gYVB5DqEamnjCva7A%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Serving Static Files, Issue with Content Security Policy

['Dennis Yurkevich' via Google App Engine]

Hello Kenworth,

I do not think the solution is a good one. It is a workaround.

At the very least we need to have documentation explaining any additional
headers being set in the dev environment.

In an ideal scenario they should not be there.


On Wed, 27 Jun 2018 at 23:15, 'Kenworth (Google Cloud Platform)' via Google
App Engine  wrote:

> It seems you also rightfully posted this issue to StackOverflow
> 
> on tags we monitor, and provided your solution. For users experiencing the
> same issue, please follow the thread below:
>
>
> https://stackoverflow.com/questions/51040045/google-app-engine-content-security-policy-issues
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/ed29efca-2ee5-4a8c-a33c-90036701542f%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B59sJUuBreOKw0u0P5YtGPWqL75hZEkwbayk-Qmt8D8rA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Serving Static Files, Issue with Content Security Policy

['Dennis Yurkevich' via Google App Engine]

Hello All,

I am serving static files from my app (for now) using express.

When app engine sends the response it attaches the following header:

content-security-policy: default-src 'self' frame-ancestors 'self' 
https://console.cloud.google.com https://*.corp.google.com:* 
http://*.corp.google.com:*


Which causes the following error:

The Content Security Policy directive 'default-src' contains 'frame-ancestors' 
as a source expression. Did you mean 'default-src ...; frame-ancestors...' 
(note the semicolon)?


I have no idea on how to amend this header unless I start playing with the 
Nginx config, which means I am may as well revert to using compute engine.

Can anyone provide any ideas on how I can solve this?

Stack: node, express, webpack4, vuejs.


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/c9f9405d-53a8-41d3-bebb-28e36e0e8287%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Problem: Can not get TinyWebDB connected to Google Cloud Platform

[Dennis Pike]

Ani ... many thanks.  After 2 days of following so many outdated procedures 
for connecting tinywebDB to Google Cloud Platform, after you showed me the 
cloud shell, and with a little more searching the web ... I got it all done 
and working in 20 minutes.  My mobile app (developed in App Inventor 2) is 
now talking to the Google Cloud Platform via TinyWebDB.  Could not wait to 
get back here and tell you ...many thanks.   After a coffee and a break I 
will document this process THAT WORKS so I have it for future reference!  
Thank you again. 

On Wednesday, June 13, 2018 at 11:05:43 AM UTC-4, Ani Hatzis wrote:
>
> Hi Dennis,
>
> I haven't looked into App Inventor for a long time. But luckily you don't 
> need a Windows machine today, just a browser.
>
> You can use Google Cloud Shell <https://cloud.google.com/shell/docs/>, 
> which is a shell environment for managing your resources hosted on GCP and 
> it runs in your browser (and so on your Chromebook, too). Among many other 
> useful things it also comes with Cloud SDK pre-installed. It is just your 
> own small virtual machine. And it's free for GCP customers.
>
> As a new GCP customer also make sure to take advantage of the free starter 
> credits that you might get offered in the Cloud Console. In order to avoid 
> unnecessary costs, I recommend that you also set a daily budget for your 
> App Engine app 
> <https://cloud.google.com/appengine/docs/standard/python/console/#setting_a_spending_limit>
>  
> (once you enabled billing for it) and/or also setup billing alerts 
> <https://cloud.google.com/appengine/docs/standard/python/console/#managing_billing>
>  
> which also works outside of standard environment apps.
>
> Cheerio,
> Ani
>
> On Wed, Jun 13, 2018 at 4:41 PM Dennis Pike  > wrote:
>
>> Hi New to this forum. If not posted in proper place, someone move it. ...
>> Problem: Can not get TinyWebDB connected to Google Cloud Platform
>> History: Discovered, invested much time into learning App Inventor 2 (
>> http://ai2.appinventor.mit.edu).  Learned to use TinyDB. Learned how to 
>> replace TinyDB with TInyWebDB using their default cloud storage for 
>> development. (http://appinvtinywebdb.appspot.com/)... understanding this 
>> is not for a finished deployed production environment mobile app. Created a 
>> Google Cloud Platform Account. Then a Project. Everything I find / read 
>> regarding making the TinyWebDB connect to the Google Cloud Platform 
>> involves downloading Python 2.7.x  ... and Google Cloud SDK. (most of this 
>> documentation seems out of date). 
>> Problem: I only have a Chromebook and these downloads are for Mac, 
>> Windows or Linux.  
>> More History: Installed Linux on Chrombook via GIThub.com (Chromium OS 
>> Universal Chroot Environment https://goo.gl/fd3zc). Downloaded Google 
>> Cloud SDK and Python 2.7.x.  None of the commands I issue work..inside the 
>> Crouton Environment. Alway say bad command.
>> Questions: Why is it necessary for me to download and configure all this 
>> stuff just to get a simple URL for the tinywebDB SourceURL? Do I REALLY 
>> need to go out an buy a windows machine (ugh) just to get this connection?
>>
>> Thanks for any feedback. 
>>
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to google-appengi...@googlegroups.com .
>> To post to this group, send email to google-a...@googlegroups.com 
>> .
>> Visit this group at https://groups.google.com/group/google-appengine.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/google-appengine/d2052ec8-7d10-4b15-9001-b37686cfdae7%40googlegroups.com
>>  
>> <https://groups.google.com/d/msgid/google-appengine/d2052ec8-7d10-4b15-9001-b37686cfdae7%40googlegroups.com?utm_medium=email_source=footer>
>> .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
> -- 
> Ani Hatzis
> Google Cloud consultant and developer
>
> <https://www.credential.net/ukfxy03s> 
> <https://www.credential.net/b0y6kwie>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/b3fa443f-324f-4685-b09d-77d629b94c1a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Problem: Can not get TinyWebDB connected to Google Cloud Platform

[Dennis Pike]

Hi New to this forum. If not posted in proper place, someone move it. ...
Problem: Can not get TinyWebDB connected to Google Cloud Platform
History: Discovered, invested much time into learning App Inventor 2 
(http://ai2.appinventor.mit.edu).  Learned to use TinyDB. Learned how to 
replace TinyDB with TInyWebDB using their default cloud storage for 
development. (http://appinvtinywebdb.appspot.com/)... understanding this is 
not for a finished deployed production environment mobile app. Created a 
Google Cloud Platform Account. Then a Project. Everything I find / read 
regarding making the TinyWebDB connect to the Google Cloud Platform 
involves downloading Python 2.7.x  ... and Google Cloud SDK. (most of this 
documentation seems out of date). 
Problem: I only have a Chromebook and these downloads are for Mac, Windows 
or Linux.  
More History: Installed Linux on Chrombook via GIThub.com (Chromium OS 
Universal Chroot Environment https://goo.gl/fd3zc). Downloaded Google Cloud 
SDK and Python 2.7.x.  None of the commands I issue work..inside the 
Crouton Environment. Alway say bad command.
Questions: Why is it necessary for me to download and configure all this 
stuff just to get a simple URL for the tinywebDB SourceURL? Do I REALLY 
need to go out an buy a windows machine (ugh) just to get this connection?

Thanks for any feedback. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/d2052ec8-7d10-4b15-9001-b37686cfdae7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Blank Page / HTTP 500

[Lee Dennis]

I started a Wordpress on Google Cloud and it was ok.

When I was editing the css in the Editor, the webpage suddenly became a 
webpage with HTTP 500 error.
I've followed some tutorials and the HTTP 500 is gone, but now it becomes a 
blank page.

If i go to http://my-ip/wp-login.php, it takes 1 mintue to load and the 
interface is broken. I can't go to my admin panel.


















I've tried to re-upload a new wordpress to my instance but it doesn't solve 
the problem.
I've tried to turn define ('WP_DEBUG', false);  to 
true, but the webpage still doesn't show what error it is.

Could it be a problem about the cache file? I can't get to the admin panel 
, so how can I manually delete the cache file? 

Thanks!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/11f74e4d-405f-4dd7-b8cf-7541bdcd18a2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Anyone Encountered this error: PHP Fatal error: The request was aborted because it exceeded the maximum execution time.

[Dennis Rothenbächer]

Hi,

It's only an assumption. 
Try to provoke an output, like an log. For example write in a .logfile 
Startet at xx.xx
no errors xx.xx
no errors xx.xx

kind regards 
Dennis


Am Donnerstag, 1. September 2016 02:46:08 UTC+2 schrieb Romel Emperado:
>
> Hi 
>
> I have a script that is working for about 6 months but it suddenly stopped 
> working now without any change made. The script is just sending message to 
> AWS SQS.
> I can run the script on any machine locally or in other VPS but NOT in 
> Appengine.. I wonder why this just stopped working now.. I have no idea..
>
>
>
> ERROR ON THE LOGS:
>
> PHP Fatal error: The request was aborted because it exceeded the maximum 
> execution time. in 
> /base/data/home/apps/s~projectxx/1.395123110059231766/aws/GuzzleHttp/Handler/StreamHandler.php
>  
> on line 208 
> <https://console.cloud.google.com/debug/fromlog?appModule=default=1=%2Fbase%2Fdata%2Fhome%2Fapps%2Fs~fsmsapi02%2F1.395123110059231766%2Faws%2FGuzzleHttp%2FHandler%2FStreamHandler.php=208=2016-08-31%7C16%3A29%3A02.019098-07%7C10.106.178.131%7C-804792116=1472686078987613000=1=fsmsapi02>
>
>
>
> Anyone have thoughts on this?
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a44f434e-25a5-408b-9676-df07126e862e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: ImportError: No module named webapp2

[Dennis van Velzen]

My first introduction with GAE started with webapp2 module import error.

I (also) needed to uninstall 3 modules.

sudo pip uninstall gcloud
sudo pip uninstall googleapis-common-protos
sudo pip uninstall protobuf



Op maandag 9 mei 2016 22:23:45 UTC+2 schreef Ted Roden:
>
> I just upgraded to 1.9.37 and now when I start the app I'm getting this 
> error:
>
> > ImportError: No module named webapp2
>
> Nothing else has changed. 
>
> I thought perhaps Google stopped bundling it, so I did a "pip install 
> webapp2," but that didn't help (I've since removed that). 
>
> Any ideas on what's going on?
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/9b8fadcd-3221-4e77-b715-58994b3bbb2c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] My python app is down

[Dennis]

My python app is down.

I just get a blank page back as a response (not an error message).
Logs were recording my request, but after i restated my instance they don't 
seem to be recording that any more.

No code change for weeks.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: My python app is down

[Dennis]

back up and running now.


On Saturday, May 24, 2014 6:49:54 PM UTC+8, Dennis wrote:

 My python app is down.

 I just get a blank page back as a response (not an error message).
 Logs were recording my request, but after i restated my instance they 
 don't seem to be recording that any more.

 No code change for weeks.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Quota Miscalculation causing app stoppage and Over Quota error

[Dennis]

Well, it's gone now.  Oddly, it's not a consistent miscalculation.
On that day, it ran out of quota just before the reset.
On other days, it's several hours before the reset.
I live in Asia so the reset is in the middle of the day so I can feel the 
effect of the quota running out hours before the reset and then the reset 
fixing things --  N America people may not notice...



On Thursday, March 20, 2014 3:38:36 PM UTC+8, Vinny P wrote:

 On Wed, Mar 19, 2014 at 2:00 AM, Dennis denni...@gmail.com javascript:
  wrote:

 I have a minimal prototype app where I added a credit card and enabled 
 billing with $0 daily limit.

 I use a minimal resource allocation:
 F1 instance
 1-1 (exactly 1) instance 
 and very little traffic

 Today (right now) and a few days in the past, I've run out of  Frontend 
 Instance Hours  even though I have 28 hours and can only use 24 hours.
 Thus, there must be some miscalculation in the quota calculation.




 Can you post a picture of the Instances graph, located on the console's 
 dashboard?
   
  
 -
 -Vinny P
 Technology  Media Advisor
 Chicago, IL

 App Engine Code Samples: http://www.learntogoogleit.com
  
  

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Quota Miscalculation causing app stoppage and Over Quota error

[Dennis]

I have a minimal prototype app where I added a credit card and enabled 
billing with $0 daily limit.

I use a minimal resource allocation:
F1 instance
1-1 (exactly 1) instance 
and very little traffic

Today (right now) and a few days in the past, I've run out of  Frontend 
Instance Hours  even though I have 28 hours and can only use 24 hours.
Thus, there must be some miscalculation in the quota calculation.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Dev datastore disappears when upgrading to new version

[Dennis Janssen]

I set the datastore path to a path inside my project folder using 
the --datastore_path option for dev_appserver, this way if i upgrade the 
SDK the datastore isn't overwritten.

I'm using the SDK for Go on OSX but i'm pretty sure it would work the same 
for all versions of GAE SDK.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: Google App Engine, Library PIL, Image, The _imaging C module is not installed

[Dennis Hafemann]

Hey Scott,

actually not... The Python-Version on Google App Engine seems to be
compiled without necessary libraries ... I guess because of memory-leaking
and security issues... I don't know... I tried the hell everthing

To solve my problem I forked PyPNG on GitHub, changed it to make it work
with streams, used it as a submodule, worked pretty fine, so that's why I
didn't do any further researches ... Take a look on my project, maybe it
helps you out to solve your problem.

https://github.com/dennishafemann/text-source-picture

Regards,
Dennis

--
www http://dennishafemann.de pgp http://pgp.dennishafemann.de


2013/12/6 sco...@referabuyer.com

 Hey Dennis,

 Did you find a solution to this issue?  I'm having the same problem...

 On Monday, August 26, 2013 12:11:46 PM UTC-4, Dennis Hafemann wrote:


 Hi there,

 I am on project using Google App Engine and third party library *PIL*.

 Currently I am trying to just create a new image, via *PIL*'s submodule
 *Image*.

 So my local installation with *Python 2.7.4* running works just finde
 with *PIL*:

 $ python
 Python 2.7.4 (default, Apr 19 2013, 18:28:01)
 [GCC 4.7.3] on linux2
 Type help, copyright, credits or license for more information.
  from PIL import Image
  img=Image.new(RGBA, (100, 100))
  if img: print True
 ...
 True
 

 My *app.yaml*, includes following *libraries-information*:

 ...
 runtime: python27
 ...
 libraries:
 - name: PIL
   version: latest
 I deployed my application being convident having it running. ... but ...
 the online-version of Google App Engine logged some errors:

 ...
 img=Image.new(RGBA, (width, height))
   File /base/data/home/runtimes/python27/python27_lib/
 versions/third_party/PIL-1.1.7/PIL/Image.py, line 1763, in new
 return Image()._new(core.fill(mode, size, color))
   File /base/data/home/runtimes/python27/python27_lib/
 versions/third_party/PIL-1.1.7/PIL/Image.py, line 37, in __getattr__
 raise ImportError(The _imaging C module is not installed)
 ImportError: The _imaging C module is not installed

 (... and to make sure, I tried version: 1.1.7 in my app.yaml).

 I also tried importing *_imaging* from my local python-installation, but
 didn't get it running. I neither find anything helpful about this.

 Does anyone have a helpful tipp to solve this problem ?

 Thanks in advance.

  --
 You received this message because you are subscribed to a topic in the
 Google Groups Google App Engine group.
 To unsubscribe from this topic, visit
 https://groups.google.com/d/topic/google-appengine/oAZT_ZUpPi0/unsubscribe
 .
 To unsubscribe from this group and all its topics, send an email to
 google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine.
 For more options, visit https://groups.google.com/groups/opt_out.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] GAE Datastore is FAST today!

[Dennis]

Users can feel the difference!   Thanks and hope this is the new normal!

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: App engine is down on some apps

[Dennis]

I'm trying to upload a new version of my code, but the upload process has 
been stuck for a 10 minutes now.
Interestingly, however, the old version of my code (python) is still 
running and is even quite responsive.



On Wednesday, October 16, 2013 3:54:16 PM UTC+8, timh wrote:

 Though the dashboard is very slow at the moment.

 T

 On Wednesday, October 16, 2013 3:52:37 PM UTC+8, timh wrote:

 No..  I am on python and am finding it's running particularly well at the 
 moment. This morning memecache was being purged rapidly now it's settled 
 down and response times are good.

 T

 On Wednesday, October 16, 2013 3:24:50 PM UTC+8, ZeroCool wrote:

 Anyone else seeing the same problem?
 My app pe-server7 (java) is down, and others are experiencing lag issues.

 Can any Googler look into the problem?



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Google App Engine, Library PIL, Image, The _imaging C module is not installed

[Dennis Hafemann]

Hi there,

I am on project using Google App Engine and third party library *PIL*.

Currently I am trying to just create a new image, via *PIL*'s submodule *
Image*. 

So my local installation with *Python 2.7.4* running works just finde with *
PIL*:

$ python
Python 2.7.4 (default, Apr 19 2013, 18:28:01) 
[GCC 4.7.3] on linux2
Type help, copyright, credits or license for more information.
 from PIL import Image
 img=Image.new(RGBA, (100, 100))
 if img: print True
... 
True
 

My *app.yaml*, includes following *libraries-information*:

...
runtime: python27
...
libraries:
- name: PIL
  version: latest
I deployed my application being convident having it running. ... but ... 
the online-version of Google App Engine logged some errors:

...
img=Image.new(RGBA, (width, height))
  File 
/base/data/home/runtimes/python27/python27_lib/versions/third_party/PIL-1.1.7/PIL/Image.py,
 
line 1763, in new
return Image()._new(core.fill(mode, size, color))
  File 
/base/data/home/runtimes/python27/python27_lib/versions/third_party/PIL-1.1.7/PIL/Image.py,
 
line 37, in __getattr__
raise ImportError(The _imaging C module is not installed)
ImportError: The _imaging C module is not installed

(... and to make sure, I tried version: 1.1.7 in my app.yaml).

I also tried importing *_imaging* from my local python-installation, but 
didn't get it running. I neither find anything helpful about this.

Does anyone have a helpful tipp to solve this problem ?

Thanks in advance.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Google App Engine, Library PIL, Image, The _imaging C module is not installed

[Dennis Hafemann]

 I see you've tested your code using the Python interpreter and the App 
 Engine production environment. But have you tried running your app on the 
 dev appserver in the GAE Python SDK? Try it and see what errors crop up. 
  


I did. I developed the whole Application within a local installation of GAE 
SDK ...

release: 1.8.0
timestamp: 1367368689
...

Enviroment is Ubuntu 12.10 and Ubuntu 13.04 with raw OS Python installation 
from repositories... I installed *python-imaging* to have PIL locally 
available. All works fine. ... The online-GAE throws this* The _imaging C 
module is not installed-e*rror.

 

  
 Can you try using *version: 1.1.7* (include the quotation marks)?
  

 
I did ...  I tried ...

version: latest
version: latest
version: 1.1.7
version: 1.1.7

Nothing changed after each variant.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] ImagesService.getServingUrl fails with IllegalArgumentException and no error message for Cloud Storage object

[dennis]

Here's the code:

public static String getNotFoundUrl(int size) {
try {
  BlobKey blob_key = 
BLOB_STORE.createGsBlobKey(/gs/web_content/placeholder_img.png);

  // Simple Test to make sure blob_key points at the right thing.
  byte[] image_data = BLOB_STORE.fetchData(blob_key, 0, 100);
  Application.getLogger().warning(new String(image_data));
  // This parts works and gets the first 100 bytes.

  ServingUrlOptions opts = 
ServingUrlOptions.Builder.withBlobKey(blob_key);
  if(size  0) opts.imageSize(size);
  return IMAGES_SERVICE.getServingUrl(opts);
} catch(IllegalArgumentException e) {
  Application.getLogger().warning(Unable to serve placeholder image 
from Cloud Storage.);
  Application.getLogger().warning(e.getMessage());
  Application.logException(e);
  return /placeholder_img.png;
}
  }

The fetchData call succeeds and I successfully read the first 100 bytes of 
the file that way. But the getServingUrl fails with 
IllegalArgumentException.

java.lang.IllegalArgumentException: 
at 
com.google.appengine.api.images.ImagesServiceImpl.getServingUrl(ImagesServiceImpl.java:282)


Any ideas on why this happens will be much appreciated.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] ImagesService.getServingUrl fails with IllegalArgumentException and no error message for Cloud Storage object

[dennis]

Thanks for the fast response Vinny,

Here are the definitions for the BLOB_STORE and IMAGES_SERVICE variables.

  private static final BlobstoreService BLOB_STORE = 
BlobstoreServiceFactory.getBlobstoreService();
  private static final ImagesService IMAGES_SERVICE = 
ImagesServiceFactory.getImagesService();

I have also tried using ServingUrlOptions.Builder.withGoogleStorageFileName 
with the same result of IllegalArgumentException with no error message.

  public static String getNotFoundUrl(int size) {
try {
//  BlobKey blob_key = 
BLOB_STORE.createGsBlobKey(/gs/web_content/placeholder_img.png);
//  byte[] image_data = BLOB_STORE.fetchData(blob_key, 0, 100);
//  Application.getLogger().warning(new String(image_data));
  ServingUrlOptions opts = 
ServingUrlOptions.Builder.withGoogleStorageFileName(/gs/web_content/placeholder_img.png);
  if(size  0) opts.imageSize(size);
  return IMAGES_SERVICE.getServingUrl(opts);
} catch(IllegalArgumentException e) {
  Application.getLogger().warning(Unable to serve placeholder image 
from Cloud Storage.);
  Application.getLogger().warning(e.getMessage());
  Application.logException(e);
  return /placeholder_img.png;
}
  }

One interesting thing to note is that the file was uploaded using the Cloud 
Console Web UI and not through app engine sdk. Could that be what's causing 
the problem?

On Monday, June 17, 2013 2:20:01 PM UTC-6, Vinny P wrote:

 Hello Dennis,
   
 Just to be clear the variable BLOB_STORE in your code represents the Files 
 API accessing Google Cloud Storage, correct? Can you post that code as 
 well? 
  
 Secondly, if you are using Google Cloud Storage to save your images in, 
 then you need to use a different function to create your ServingUrlOptions. 
 Instead of using ServingUrlOptions.Builder.withBlobKey (which is reserved 
 for images coming from AppEngine's Blobstore), you need to use 
 ServingUrlOptions.Builder.withGoogleStorageFileName (files from GCS). 
 Here's the relevant documentation:  
 https://developers.google.com/appengine/docs/java/javadoc/com/google/appengine/api/images/ServingUrlOptions.Builder.
   
   
 -
 -Vinny P
 Technology  Media Advisor
 Chicago, IL

 My Go side project: http://invalidmail.com/
   
  
 On Mon, Jun 17, 2013 at 3:02 PM, dennis wrote:

 Here's the code:

 public static String getNotFoundUrl(int size) {
 try {
   BlobKey blob_key = 
 BLOB_STORE.createGsBlobKey(/gs/web_content/placeholder_img.png);

   // Simple Test to make sure blob_key points at the right thing.
   byte[] image_data = BLOB_STORE.fetchData(blob_key, 0, 100);
   Application.getLogger().warning(new String(image_data));
   // This parts works and gets the first 100 bytes.

   ServingUrlOptions opts = 
 ServingUrlOptions.Builder.withBlobKey(blob_key);
   if(size  0) opts.imageSize(size);
   return IMAGES_SERVICE.getServingUrl(opts);
 } catch(IllegalArgumentException e) {
   Application.getLogger().warning(Unable to serve placeholder image 
 from Cloud Storage.);
   Application.getLogger().warning(e.getMessage());
   Application.logException(e);
   return /placeholder_img.png;
 }
   }

 The fetchData call succeeds and I successfully read the first 100 bytes 
 of the file that way. But the getServingUrl fails with 
 IllegalArgumentException.

 java.lang.IllegalArgumentException: 
 at 
 com.google.appengine.api.images.ImagesServiceImpl.getServingUrl(ImagesServiceImpl.java:282)


 Any ideas on why this happens will be much appreciated.





-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] ImagesService.getServingUrl fails with IllegalArgumentException and no error message for Cloud Storage object

[dennis]

Thanks Vinny!

Permissions were the culprit. 

On Monday, June 17, 2013 11:19:17 PM UTC-6, Vinny P wrote:

 Hello again Dennis,
  
 On Mon, Jun 17, 2013 at 3:36 PM, dennis wrote:

 One interesting thing to note is that the file was uploaded using the 
 Cloud Console Web UI and not through app engine sdk. Could that be what's 
 causing the problem?

  
 Amusingly enough, that might be the problem. I configured my app to have 
 Owner permissions over my Cloud Storage bucket - I noticed that when my app 
 wrote an object in, it had full permissions to that object. If I uploaded 
 an object via the Cloud Console, sometimes my app had difficulty accessing 
 the object (even though my app had permissions to the bucket!).
  
 I'm interested now - I'll have to investigate more. If you need it, here's 
 a simplified version of the code I used to save to Cloud Storage:
  
   String bucket = bucket name here
   String object = the filename here, including file extension
   
   GcsFilename gcs_filename = new GcsFilename(bucket, object);
   
   GcsFileOptions.Builder options_builder = new GcsFileOptions.Builder();
   options_builder = options_builder.mimeType(mime);
 //erased some options here
   GcsFileOptions options = options_builder.build();
   
   GcsOutputChannel output = 
 GcsServiceFactory.createGcsService().createOrReplace(gcs_filename, options);
   output.write(ByteBuffer.wrap(data));
   output.close();  
  
  
 On Mon, Jun 17, 2013 at 3:36 PM, dennis wrote:

 Thanks for the fast response Vinny,

 I have also tried using 
 ServingUrlOptions.Builder.**withGoogleStorageFileName 
 with the same result of IllegalArgumentException with no error message.

   public static String getNotFoundUrl(int size) {
 try {
 //  BlobKey blob_key = 
 BLOB_STORE.createGsBlobKey(/gs/web_content/placeholder_img.png);
 //  byte[] image_data = BLOB_STORE.fetchData(blob_key, 0, 100);
 //  Application.getLogger().warning(new String(image_data));
   ServingUrlOptions opts = 
 ServingUrlOptions.Builder.withGoogleStorageFileName(/gs/web_content/placeholder_img.png);
   if(size  0) opts.imageSize(size);
   return IMAGES_SERVICE.getServingUrl(opts);
 } catch(IllegalArgumentException e) {
   Application.getLogger().warning(Unable to serve placeholder image 
 from Cloud Storage.);
   Application.getLogger().warning(e.getMessage());
   Application.logException(e);
   return /placeholder_img.png;
 }
   }

  
  
 I built a test project to verify for myself, and the following code works 
 for me on production GAE. 
  
   String bucket = bucket name (so web_content for your example)
   String object = object name (placeholder_img.png for your example)
   
   //Get serving url
   String gs_blob_key = /gs/ + bucket + / + object;
   BlobKey blob_key = 
 BlobstoreServiceFactory.getBlobstoreService().createGsBlobKey(gs_blob_key);
   ServingUrlOptions serving_options = 
 ServingUrlOptions.Builder.withBlobKey(blob_key);
   String serving_url = 
 ImagesServiceFactory.getImagesService().getServingUrl(serving_options);
   System.out.println(Serving URL:  + serving_url);
   resp.getWriter().println(serving_url);
  
  
  
 It's also worth double checking to see if you have permissions set 
 correctly. Here's an image album showing my settings: 
 http://imgur.com/a/FBhFN 
   
 -
 -Vinny P
 Technology  Media Advisor
 Chicago, IL

 My Go side project: http://invalidmail.com/
   
  


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: App Engine console really slow lately?

[Dennis]

my unchanged app is getting 500 Server Errors
from google.appengine.runtime.DeadlineExceededError
starting today.




On Thursday, June 6, 2013 3:44:28 PM UTC+8, doright wrote:

 yes, agree, seems to be getting slower and slower in my experience.

 On Tuesday, June 4, 2013 4:22:27 PM UTC+2, Jason Collins wrote:

 Has anyone else found the App Engine dashboard/console really, really 
 slow lately (perhaps the past week)?

 It's painful to use for me.

 j



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: HRD migration process - needs better explanation of steps and user processes

[Dennis]

my data is back to being unaccessible even on HRD -- i get a 
DeadlineExceededError 
after trying for 60 seconds.

it could be a program bug (even though the code has not changed), but just 
thought i would mention it in case others have this problem.




On Wednesday, January 16, 2013 6:11:13 PM UTC+8, Dennis wrote:

 The differences turned out to be caused by my initialization of the new 
 app, so the hrd migration did not introduce any problems in my case.

 However, another point that would be good to document: you will end up 
 creating a new local dev app that matches the hrd app.  And it will start 
 with no data.  
 For my website, it's a non-trivial process to initialize the website from 
 an empty datastore.
 Thus, make sure you can do this before you start the migration.

 Unrelated but interesting: there was data in my master-slave app that was 
 inaccessible before ... lost data.  Now, after the migration, the same 
 code can now access that lost data.  I'm glad it was transferred ok and 
 is now accessible!



 On Wednesday, January 16, 2013 3:27:53 AM UTC+8, Dennis wrote:

 I'm testing my new hrd version of the app now.
 I have found some differences that need to be debugged.
 One thing I wish I had done before migrating (not mentioned in docs): 
 upgraded my appengine SDK to the latest version before starting the 
 migration...

 On the other hand, I'm still using appengine patch (aepatch) so even 
 upgrading the sdk is risky.
 My sdk is: release: 1.5.2




 On Tuesday, January 15, 2013 7:44:15 AM UTC+8, Takashi Matsuo (Google) 
 wrote:


 Hi Dennis,

 On Mon, Jan 14, 2013 at 11:00 AM, Dennis denni...@gmail.com wrote:

 oh, now i see the instructions: they are not in the docs but only 
 appear on the migration webpage when the migration reaches the last phase:


 The data copy is now complete. You can validate the destination app's 
 performance on the High Replication datastore before redirecting traffic 
 to 
 the new app.
 You may set the destination to read-write mode and redirect traffic to 
 there now. This step can not be reverted.



 my app is just a prototype.  so, i'm assuming that if I enable 
 read-write mode on both the source and destination at this point,
 then i have a working backup of my original source app + a working HRD 
 version of my app that i can start writing to and validating with my code 
 (not just by looking at the datastore values).
 the HRD version can't be reverted, but the source master-slave app can 
 be re-migrated if there turn out to be problems with the hrd version, 
 right?


 Unfortunately, there is no easy way for re-migrating the old app once if 
 you go beyond the last step of the migration.
  



 On Monday, January 14, 2013 11:50:32 PM UTC+8, Dennis wrote:


 I'm in the process of migrating from master-slave datastore to hrd.

 I followed the instructions, blindly, because there is little 
 explanation of what is happening in each phase.
 Now, i'm just before the last phase of finish migration.
 But I test my hrd app: it does not work.
 the logs say that writes have been disabled.  there was no mention of 
 that in the docs.

 what should I do?
 enable writes in my hrd and test the app?
 if it has problems then abort the migration?
 there is no mention of enabling writes in the hrd migration docs.

  -- 
 You received this message because you are subscribed to the Google 
 Groups Google App Engine group.
 To view this discussion on the web visit 
 https://groups.google.com/d/msg/google-appengine/-/VZG5VyMlEH4J.

 To post to this group, send email to google-a...@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengi...@googlegroups.com.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.




 -- 
 Takashi Matsuo | Developers Advocate | tma...@google.com
  


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: HRD migration process - needs better explanation of steps and user processes

[Dennis]

The differences turned out to be caused by my initialization of the new 
app, so the hrd migration did not introduce any problems in my case.

However, another point that would be good to document: you will end up 
creating a new local dev app that matches the hrd app.  And it will start 
with no data.  
For my website, it's a non-trivial process to initialize the website from 
an empty datastore.
Thus, make sure you can do this before you start the migration.

Unrelated but interesting: there was data in my master-slave app that was 
inaccessible before ... lost data.  Now, after the migration, the same 
code can now access that lost data.  I'm glad it was transferred ok and 
is now accessible!



On Wednesday, January 16, 2013 3:27:53 AM UTC+8, Dennis wrote:

 I'm testing my new hrd version of the app now.
 I have found some differences that need to be debugged.
 One thing I wish I had done before migrating (not mentioned in docs): 
 upgraded my appengine SDK to the latest version before starting the 
 migration...

 On the other hand, I'm still using appengine patch (aepatch) so even 
 upgrading the sdk is risky.
 My sdk is: release: 1.5.2




 On Tuesday, January 15, 2013 7:44:15 AM UTC+8, Takashi Matsuo (Google) 
 wrote:


 Hi Dennis,

 On Mon, Jan 14, 2013 at 11:00 AM, Dennis denni...@gmail.com wrote:

 oh, now i see the instructions: they are not in the docs but only appear 
 on the migration webpage when the migration reaches the last phase:


 The data copy is now complete. You can validate the destination app's 
 performance on the High Replication datastore before redirecting traffic 
 to 
 the new app.
 You may set the destination to read-write mode and redirect traffic to 
 there now. This step can not be reverted.



 my app is just a prototype.  so, i'm assuming that if I enable 
 read-write mode on both the source and destination at this point,
 then i have a working backup of my original source app + a working HRD 
 version of my app that i can start writing to and validating with my code 
 (not just by looking at the datastore values).
 the HRD version can't be reverted, but the source master-slave app can 
 be re-migrated if there turn out to be problems with the hrd version, right?


 Unfortunately, there is no easy way for re-migrating the old app once if 
 you go beyond the last step of the migration.
  



 On Monday, January 14, 2013 11:50:32 PM UTC+8, Dennis wrote:


 I'm in the process of migrating from master-slave datastore to hrd.

 I followed the instructions, blindly, because there is little 
 explanation of what is happening in each phase.
 Now, i'm just before the last phase of finish migration.
 But I test my hrd app: it does not work.
 the logs say that writes have been disabled.  there was no mention of 
 that in the docs.

 what should I do?
 enable writes in my hrd and test the app?
 if it has problems then abort the migration?
 there is no mention of enabling writes in the hrd migration docs.

  -- 
 You received this message because you are subscribed to the Google 
 Groups Google App Engine group.
 To view this discussion on the web visit 
 https://groups.google.com/d/msg/google-appengine/-/VZG5VyMlEH4J.

 To post to this group, send email to google-a...@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengi...@googlegroups.com.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.




 -- 
 Takashi Matsuo | Developers Advocate | tma...@google.com
  


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/GiFxIfkeGSYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: HRD migration process - needs better explanation of steps and user processes

[Dennis]

I'm testing my new hrd version of the app now.
I have found some differences that need to be debugged.
One thing I wish I had done before migrating (not mentioned in docs): 
upgraded my appengine SDK to the latest version before starting the 
migration...

On the other hand, I'm still using appengine patch (aepatch) so even 
upgrading the sdk is risky.
My sdk is: release: 1.5.2




On Tuesday, January 15, 2013 7:44:15 AM UTC+8, Takashi Matsuo (Google) 
wrote:


 Hi Dennis,

 On Mon, Jan 14, 2013 at 11:00 AM, Dennis denni...@gmail.com javascript:
  wrote:

 oh, now i see the instructions: they are not in the docs but only appear 
 on the migration webpage when the migration reaches the last phase:


 The data copy is now complete. You can validate the destination app's 
 performance on the High Replication datastore before redirecting traffic to 
 the new app.
 You may set the destination to read-write mode and redirect traffic to 
 there now. This step can not be reverted.



 my app is just a prototype.  so, i'm assuming that if I enable read-write 
 mode on both the source and destination at this point,
 then i have a working backup of my original source app + a working HRD 
 version of my app that i can start writing to and validating with my code 
 (not just by looking at the datastore values).
 the HRD version can't be reverted, but the source master-slave app can be 
 re-migrated if there turn out to be problems with the hrd version, right?


 Unfortunately, there is no easy way for re-migrating the old app once if 
 you go beyond the last step of the migration.
  



 On Monday, January 14, 2013 11:50:32 PM UTC+8, Dennis wrote:


 I'm in the process of migrating from master-slave datastore to hrd.

 I followed the instructions, blindly, because there is little 
 explanation of what is happening in each phase.
 Now, i'm just before the last phase of finish migration.
 But I test my hrd app: it does not work.
 the logs say that writes have been disabled.  there was no mention of 
 that in the docs.

 what should I do?
 enable writes in my hrd and test the app?
 if it has problems then abort the migration?
 there is no mention of enabling writes in the hrd migration docs.

  -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To view this discussion on the web visit 
 https://groups.google.com/d/msg/google-appengine/-/VZG5VyMlEH4J.

 To post to this group, send email to 
 google-a...@googlegroups.comjavascript:
 .
 To unsubscribe from this group, send email to 
 google-appengi...@googlegroups.com javascript:.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.




 -- 
 Takashi Matsuo | Developers Advocate | tma...@google.com javascript:
  

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/iujfNPROH7QJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] HRD migration process - needs better explanation of steps and user processes

[Dennis]

I'm in the process of migrating from master-slave datastore to hrd.

I followed the instructions, blindly, because there is little explanation 
of what is happening in each phase.
Now, i'm just before the last phase of finish migration.
But I test my hrd app: it does not work.
the logs say that writes have been disabled.  there was no mention of that 
in the docs.

what should I do?
enable writes in my hrd and test the app?
if it has problems then abort the migration?
there is no mention of enabling writes in the hrd migration docs.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/TSCG7hN1tdQJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: HRD migration process - needs better explanation of steps and user processes

[Dennis]

oh, now i see the instructions: they are not in the docs but only appear on 
the migration webpage when the migration reaches the last phase:


The data copy is now complete. You can validate the destination app's 
 performance on the High Replication datastore before redirecting traffic to 
 the new app.
 You may set the destination to read-write mode and redirect traffic to 
 there now. This step can not be reverted.



my app is just a prototype.  so, i'm assuming that if I enable read-write 
mode on both the source and destination at this point,
then i have a working backup of my original source app + a working HRD 
version of my app that i can start writing to and validating with my code 
(not just by looking at the datastore values).
the HRD version can't be reverted, but the source master-slave app can be 
re-migrated if there turn out to be problems with the hrd version, right?




On Monday, January 14, 2013 11:50:32 PM UTC+8, Dennis wrote:


 I'm in the process of migrating from master-slave datastore to hrd.

 I followed the instructions, blindly, because there is little explanation 
 of what is happening in each phase.
 Now, i'm just before the last phase of finish migration.
 But I test my hrd app: it does not work.
 the logs say that writes have been disabled.  there was no mention of that 
 in the docs.

 what should I do?
 enable writes in my hrd and test the app?
 if it has problems then abort the migration?
 there is no mention of enabling writes in the hrd migration docs.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/VZG5VyMlEH4J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Search API Question

[dennis]

Have to admit I was very excited about this when I first saw the
experimental release.

Sadly I ran into a problem right away with partial word matching. Yes
I know this is not supposed to work and I have code that executes
datastore starts with queries when we get 0 results for a short
single word query.

The more interesting problem occurs at one fully matched word and a
partial match on the second word of a query.

Example:
I have a document with a name field set to foo bar and about 999
other documents with the name field set to foo any word that
doesn't contain bar in it

When I do a query for foo ba I get 0 results from the Search API.
and when I do a query for foo I get 1000 results. Out of those 1000
results I really want foo bar to be at the top but since it's only a
partial match it can end up anywhere in the result set.

The only way I've come up to get around this is do result merging that
breaks up the query into individual words and if still not finding
much then uses datastore starts with queries.

If anyone has suggestions/ideas for other ways this can be implemented
I'm all ears.

- Dennis.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: More then 100 complains and no feedback from Google. Was: Outages?

[Dennis]

I'm planning to do the same (migrate to HRD), but now my expectation have 
been lowered...

Any tips on doing the migration??  The docs make it look pretty automatic, 
but it sounds like you spent a more realistic amount of time doing the 
migration

Dennis



On Tuesday, March 20, 2012 2:28:00 AM UTC+8, toonetown wrote:

 So - spent the weekend and this morning migrating to HRD...took all of 12 
 minutes before I started getting the same HardDeadlineExceeded exceptions. 
 :(

 BOO!

 -Nathan

 On Thursday, March 15, 2012 5:49:02 PM UTC-6, Jeff Schnitzer wrote:

 On Thu, Mar 15, 2012 at 7:36 PM, toonetown nathan.to...@gmail.com 
 wrote:
  So, explain this to me...is this only a master/slave issue, and those 
 with high replication data store aren't seeing the harddeadlinexceeded 
 exceptions? That wouldn't make sense in our case, as we use absolutely no 
 data store functionality.
 
  I'd be willing to migrate my app if it would make any difference...but 
 I can't see how it would be any different.

 The difference is that Google actually cares about uptime on the HRD.

 Jeff



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/uXyyhklSK58J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: DeadlineExceeded errors haunting every now and then

[Dennis Fogg]

Since the migration tool is still experimental, I want to try making copies
of my data before migrating.
Thus, I need to enable the datastore admin.



On Fri, Dec 23, 2011 at 2:35 AM, Ikai Lan (Google) ika...@google.comwrote:

 Don't use that tool. Use the migration tool that's available when you
 click Application Settings and View Migration Tool on that page.

 --
 Ikai Lan
 Developer Programs Engineer, Google App Engine
 plus.ikailan.com | twitter.com/ikai



 On Wed, Dec 21, 2011 at 8:54 PM, Dennis dennisf...@gmail.com wrote:

 I'm looking into converting to HRD.
 But as part of the process to explore that option,
 I've problems with the datastore admin page:


 http://groups.google.com/group/google-appengine/browse_frm/thread/640d7f7392e22f22#



 On Dec 22, 3:44 am, Ikai Lan (Google) ika...@google.com wrote:
  Do you guys have any application IDs of High Replication applications
 that
  are experiencing datastore timeouts? What are you doing with these
 calls?
  Could these be contention related?
 
  --
  Ikai Lan
  Developer Programs Engineer, Google App Engine
  plus.ikailan.com | twitter.com/ikai
 
  On Wed, Dec 21, 2011 at 11:31 AM, blackpawn pharmapsycho...@gmail.com
 wrote:
 
 
 
 
 
 
 
   Currently seeing this DeadlineExceededError bad weather again on app
   id sketch-club if it's of any use to you Googlers for diagnosing this
   problem.
 
   --
   You received this message because you are subscribed to the Google
 Groups
   Google App Engine group.
   To post to this group, send email to
 google-appengine@googlegroups.com.
   To unsubscribe from this group, send email to
   google-appengine+unsubscr...@googlegroups.com.
   For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] test post (I'm having problems replying to other posts)

[Dennis]

this is a test post

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/V3KaxPti8x0J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Datastore Admin page: enabling page failed

[Dennis]

I'm having problems enabling the datastore admin page.
I tried to enable it yesterday and got a login error message.
After waiting a day (and logging out and back in) I still get this login 
error message:


Server error
Sorry, you've reached a login page for a domain that isn't using Google 
Apps. Please check the web address and try again. Learn more


There was a proposed fix by Greg Darke in this post:
https://groups.google.com/group/google-appengine/tree/browse_frm/thread/1def08a1142d3c63/a201f46143f60366?rnum=1q=admin+enable_done=%2Fgroup%2Fgoogle-appengine%2Fbrowse_frm%2Fthread%2F1def08a1142d3c63%3Ftvc%3D1%26q%3Dadmin%2Benable%26pli%3D1%26#doc_3f636d9501b02ae5
 


but when I tried the url I get a 404 error.

What's the current fix for this bug??


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/qSTAxvwhNz0J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: DeadlineExceeded errors haunting every now and then

[Dennis]

I'm looking into converting to HRD.
But as part of the process to explore that option,
I've problems with the datastore admin page:

http://groups.google.com/group/google-appengine/browse_frm/thread/640d7f7392e22f22#



On Dec 22, 3:44 am, Ikai Lan (Google) ika...@google.com wrote:
 Do you guys have any application IDs of High Replication applications that
 are experiencing datastore timeouts? What are you doing with these calls?
 Could these be contention related?

 --
 Ikai Lan
 Developer Programs Engineer, Google App Engine
 plus.ikailan.com | twitter.com/ikai

 On Wed, Dec 21, 2011 at 11:31 AM, blackpawn pharmapsycho...@gmail.comwrote:







  Currently seeing this DeadlineExceededError bad weather again on app
  id sketch-club if it's of any use to you Googlers for diagnosing this
  problem.

  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: 500 Server Error for over 24 hours: python 2.5, django, appenginepatch

[Dennis]

I filed production issue 6525.

current status: now i have the majority requests taking a very long time 
(over 20 seconds) and a still get some 500 server errors.
For the 500 errors: i think it depends on the time of day.  i'm in asia and 
when the US wakes up i seem to have more problems.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/hZZvsScYSWUJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: 500 Server Error for over 24 hours: python 2.5, django, appenginepatch

[Dennis]

Example of current state: Six 500 server error responses (each one takes 
1 minute) before i could get 1 response that worked.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/ceDxuflchE8J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: HRD migration tool now available!

[Dennis]

Will this tool move from experimental to production?   Any ETA for the 
production version?
It seems that the migration is a 1-way process and cannot be undone.
Thus, I would like a solid migration process before using it.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/tUX7CcxHOrUJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: 500 Server Error for over 24 hours: python 2.5, django, appenginepatch

[Dennis]

I'm using M/S datastore.
My app started to work again this morning (in hong kong time), but now it's 
unusable again.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/a1S8aA_Idy8J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] 500 Server Error for over 24 hours: python 2.5, django, appenginepatch

[Dennis]

I have not changed my code in weeks, but in the past few days my app has 
been unusable because I'm getting 500 Server Error after 60 seconds of 
instance loading.
The logs say gae is initializing django appenginepatch files when it's 
terminated (Error code 104)
Appengine system status says things are normal (of course), and I only see 
a few I'm having an issue with my app posts in this google group.

So, i'm wondering if others are having problems or is it just me...

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/9hocZbPII-oJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Designing data model and caching strategy for new pricing model

[dennis]

The legality issues that Brandon brings up might be a problem but I
don't think you're going to have a billing problem until you have a
lot of schools using the application.

The current free quota for writes is 50,000/day that's a lot of grades
to enter in a single 24 hour period. Obviously this won't be your only
write to the Datastore but should be most of them.

I would also recommend doing your puts in batches from JavaScript and
implementing a hook for window close that checks if everything has
been written to the Datastore. If it hasn't you can show a friendly
dialog saying We're still saving your data Please wait a couple
seconds to close the window. or you can even try to send the ajax
request in your hook for any unsaved data and only return from the
hook once you have received a confirmation that your ajax post to the
server has succeeded.

After that is all done and you set your Idle Instances to 1 you should
be running free without a problem.

In theory the following should work but I haven't tested it:

script type=text/javascript
  var pending_writes = [];
  window.onbeforeunload = function() {
if(pending_writes.length  0) {
  // do whatever you have to do before returning from this hook.
  // my understanding is that if you return a string here it will
  // show that string in a dialog to the user giving them an
option
  // to either stay on the page or navigate away from it.
}
  }
/script

I'm sure there's browser compatibility issues with the JavaScript I
put in here and it will take some hackery to make sure it works
everywhere, but I hope this helps you out.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: DeadlineExceededError in the mail API

[Dennis]

yes, i have been getting this error consistently for over 24 hours on my 
app.

i assumed it would be fixed by google quickly, but i guess not.
my app has not changed for weeks so it's something in the appengine 
infrastructure.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/1dTvL0LDZkUJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Does datastore pricing prevent pubsub?

[Dennis Peterson]

Here's an interesting pair of blog posts covering the new datastore read
costs and some tips on minimizing them:
http://point7.wordpress.com/

http://point7.wordpress.com/2011/09/03/the-amazing-story-of-appengine-and-the-two-orders-of-magnitude/

http://point7.wordpress.com/2011/09/04/appengine-tuning-1/

This
guy's costs went up two orders of magnitude according to comparative
bulling, and datastore reads were a big part of it.


On Fri, Sep 2, 2011 at 4:36 PM, Strom xxst...@gmail.com wrote:

 There's this FAQ
 http://code.google.com/appengine/kb/postpreviewpricing.html
 And then there's also the sample bills under Billing History on your
 app dashboard.

 On Sep 2, 11:01 pm, Dennis Peterson dennisbpeter...@gmail.com wrote:
  Ahh, good, much better. Thanks.
 
  I'm having trouble finding the official final details on the new pricing.
 
 
 
 
 
 
 
  On Fri, Sep 2, 2011 at 3:25 PM, Strom xxst...@gmail.com wrote:
   Read operations cost $0.07 per 100k ops.
   100 pageviews containing 100 posts would be ((100 * 100) / 10) *
   $0.07 = $0.007.
 
   On Sep 2, 4:31 pm, Dennis Peterson dennisbpeter...@gmail.com wrote:
Maybe I should explain...the details don't matter, the key point here
 is
that the design in the GoogleIO talk involves a separate entity for
 each
post. Google charges a buck per 10K ops, so if each post returned is
 an
   op,
then a hundred pageviews showing a hundred posts each is a buck.
 
That seems pretty outlandish. Is it really correct or am I missing
something?
 
On Thu, Sep 1, 2011 at 1:03 PM, DennisP dennisbpeter...@gmail.com
   wrote:
 Last I saw Google was defining each entity returned as an
 operation..
 
 If you were building a social network or twitter clone using the
 techniques Google recommends in this talk:
 

 http://www.google.com/events/io/2009/sessions/BuildingScalableComplex.
   ..
 
 ...you could easily pull back a hundred entities each time you pull
 someone's feed. It'd cost you a buck for every hundred pageviews or
 so.
 
 Do I have that right?
 
 --
 You received this message because you are subscribed to the Google
   Groups
 Google App Engine group.
 To post to this group, send email to
 google-appengine@googlegroups.com
   .
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
 
   --
   You received this message because you are subscribed to the Google
 Groups
   Google App Engine group.
   To post to this group, send email to google-appengine@googlegroups.com
 .
   To unsubscribe from this group, send email to
   google-appengine+unsubscr...@googlegroups.com.
   For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Does datastore pricing prevent pubsub?

[Dennis Peterson]

Maybe I should explain...the details don't matter, the key point here is
that the design in the GoogleIO talk involves a separate entity for each
post. Google charges a buck per 10K ops, so if each post returned is an op,
then a hundred pageviews showing a hundred posts each is a buck.

That seems pretty outlandish. Is it really correct or am I missing
something?


On Thu, Sep 1, 2011 at 1:03 PM, DennisP dennisbpeter...@gmail.com wrote:

 Last I saw Google was defining each entity returned as an operation..

 If you were building a social network or twitter clone using the
 techniques Google recommends in this talk:

 http://www.google.com/events/io/2009/sessions/BuildingScalableComplexApps.html

 ...you could easily pull back a hundred entities each time you pull
 someone's feed. It'd cost you a buck for every hundred pageviews or
 so.

 Do I have that right?

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Does datastore pricing prevent pubsub?

[Dennis Peterson]

So what's most efficient and scalable, and what's financially ruinous may be
the same thing.

Everybody's talking about instance costs but it seems to me that charging
for the datastore this way may end up being even worse. At least for the
instances, multithreading can help you.


On Fri, Sep 2, 2011 at 9:42 AM, Mike Wesner mbwes...@gmail.com wrote:

 I am guessing Brett doesn't have to foot the bill for this.  Uncle
 Google picks up the tab since he works for them.



 On Sep 2, 8:31 am, Dennis Peterson dennisbpeter...@gmail.com wrote:
  Maybe I should explain...the details don't matter, the key point here is
  that the design in the GoogleIO talk involves a separate entity for each
  post. Google charges a buck per 10K ops, so if each post returned is an
 op,
  then a hundred pageviews showing a hundred posts each is a buck.
 
  That seems pretty outlandish. Is it really correct or am I missing
  something?
 
 
 
 
 
 
 
  On Thu, Sep 1, 2011 at 1:03 PM, DennisP dennisbpeter...@gmail.com
 wrote:
   Last I saw Google was defining each entity returned as an operation..
 
   If you were building a social network or twitter clone using the
   techniques Google recommends in this talk:
 
  http://www.google.com/events/io/2009/sessions/BuildingScalableComplex.
 ..
 
   ...you could easily pull back a hundred entities each time you pull
   someone's feed. It'd cost you a buck for every hundred pageviews or
   so.
 
   Do I have that right?
 
   --
   You received this message because you are subscribed to the Google
 Groups
   Google App Engine group.
   To post to this group, send email to google-appengine@googlegroups.com
 .
   To unsubscribe from this group, send email to
   google-appengine+unsubscr...@googlegroups.com.
   For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Does datastore pricing prevent pubsub?

[Dennis Peterson]

Ahh, good, much better. Thanks.

I'm having trouble finding the official final details on the new pricing.

On Fri, Sep 2, 2011 at 3:25 PM, Strom xxst...@gmail.com wrote:

 Read operations cost $0.07 per 100k ops.
 100 pageviews containing 100 posts would be ((100 * 100) / 10) *
 $0.07 = $0.007.

 On Sep 2, 4:31 pm, Dennis Peterson dennisbpeter...@gmail.com wrote:
  Maybe I should explain...the details don't matter, the key point here is
  that the design in the GoogleIO talk involves a separate entity for each
  post. Google charges a buck per 10K ops, so if each post returned is an
 op,
  then a hundred pageviews showing a hundred posts each is a buck.
 
  That seems pretty outlandish. Is it really correct or am I missing
  something?
 
 
 
 
 
 
 
  On Thu, Sep 1, 2011 at 1:03 PM, DennisP dennisbpeter...@gmail.com
 wrote:
   Last I saw Google was defining each entity returned as an operation..
 
   If you were building a social network or twitter clone using the
   techniques Google recommends in this talk:
 
  http://www.google.com/events/io/2009/sessions/BuildingScalableComplex.
 ..
 
   ...you could easily pull back a hundred entities each time you pull
   someone's feed. It'd cost you a buck for every hundred pageviews or
   so.
 
   Do I have that right?
 
   --
   You received this message because you are subscribed to the Google
 Groups
   Google App Engine group.
   To post to this group, send email to google-appengine@googlegroups.com
 .
   To unsubscribe from this group, send email to
   google-appengine+unsubscr...@googlegroups.com.
   For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[appengine-java] Re: Java Google App Engine bulk loader upload error “OverflowError: date value out of range”

[Dennis Lo]

I found a solution to this problem. Check it out here:

http://stackoverflow.com/questions/6316096/java-google-app-engine-bulk-loader-upload-error-overflowerror-date-value-out-of

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/UzEXY9I4roQJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

Re: [google-appengine] [Java] Google App Engine bulk loader upload error “OverflowError: date value out of range”

[Dennis Lo]

Thanks Robert!

You comments really helped me find my solution this problem. It got me 
thinking outside the box to find which row(s) were causing this issues.

Check out my solution here: 
http://stackoverflow.com/questions/6316096/java-google-app-engine-bulk-loader-upload-error-overflowerror-date-value-out-of

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/6tJ6rYkC3LgJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[appengine-java] Java Google App Engine bulk loader upload error “OverflowError: date value out of range”

[Dennis Lo]

I'm using the bulk loader to download my *Review* kind from one GAE server 
and upload to another GAE server. This *Review* kind contains about 30,000 
entities. 

I use the command to upload:

appcfg.py upload_data --kind=Review --filename=review.csv 
--application=MY_APP_ID --url=http://MY_APP_ID.appspot.com/remote_api 
--rps_limit=500 --bandwidth_limit=250 --batch_size=100

*NOTE: The entire error is pretty long. So I've included it at the bottom of 
this question.*

The upload doesn't start at all and stops at the line: [INFO ] Opening 
database: bulkloader-progress-20110611.222101.sql3

I see at the bottom of the entire trace: lambda val: _EPOCH + 
datetime.timedelta(microseconds=val), OverflowError: date value out of range

I suspect that this is caused by badly formated date's found in my *
publisheddate* column (see below for entire *Review* kind). 
--
What I've already tried to fix it 

I ran the GQL: SELECT * FROM Review where publisheddate = null in the GAE 
admin portal and found around 15 entities with *null* values for the *
publisheddate* column. So I deleted those, redownloaded and tried 
reuploading the *Review* kind. I still get the same error.

I'm thinking, since I'm using the upload command without a config file 
parameter e.g. --config_file=bulkloader.yaml (see above upload that I'm not 
specifying the --config_file)

I'm relying on the datastore statistics to determine what is downloaded to 
my *review.csv* file. 

Now since I just deleted the entities with *null publisheddate* this 
redownloading and then reuploading immediately is not doing anything 
different from my initial download and upload. Since the datastore 
statistics aren't updated yet.
--
My Questions 
   
   1. 
   
   As there are 30, 000 entities I'm unsure as to how I can locate entities 
   with badly formated dates. Is there a quick away to locate entities with bad 
   *publisheddate* values?
   2. 
   
   Does anyone know how to fix this issue? I'm not sure from the error trace 
   what the real problem is.
   
--
Review kind 

I'm using the objectify3.0.jar to manipulate my GAE datastore. So my *Review
* kind looks like this:

public class Review {
@Id private Long id; //This is my key property, auto generated by objectify 
 
private String reviewlink;  
private Date publisheddate;
private double rating;  
private Long gameid;//to make querying easier

//ommitting getters and setters 
}

--
Entire error 

10:20:48appcfg.py upload_data --kind=Review --filename=review.csv 
--application=MY_APP_ID --url=http://MY_APP_ID.appspot.com/remote_api 
--rps_limit=500 --bandwidth_limit=250 --batch_size=100
Uploading data records.
[INFO] Logging to bulkloader-log-20110611.222101
[INFO] Throttling transfers:
[INFO] Bandwidth: 250 bytes/second
[INFO] HTTP connections: 8/second
[INFO] Entities inserted/fetched/modified: 500/second
[INFO] Batch Size: 100
[INFO] Opening database: bulkloader-progress-20110611.222101.sql3
Traceback (most recent call last):
  File /usr/local/bin/appcfg.py, line 76, in module
run_file(__file__, globals())
  File /usr/local/bin/appcfg.py, line 72, in run_file
execfile(script_path, globals_)
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appcfg.py,
 line 3592, in module
main(sys.argv)
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appcfg.py,
 line 3583, in main
result = AppCfgApp(argv).Run()
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appcfg.py,
 line 2229, in Run
self.action(self)
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appcfg.py,
 line 3368, in __call__
return method()
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appcfg.py,
 line 3195, in PerformUpload
run_fn(args)
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appcfg.py,
 line 3087, in RunBulkloader
sys.exit(bulkloader.Run(arg_dict))
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py,
 line 4360, in Run
return _PerformBulkload(arg_dict)
  File 

[google-appengine] [Java] Google App Engine bulk loader upload error “OverflowError: date value out of range”

[Dennis Lo]

I'm using the bulk loader to download my *Review* kind from one GAE server 
and upload to another GAE server. This *Review* kind contains about 30,000 
entities. 

I use the command to upload:

appcfg.py upload_data --kind=Review --filename=review.csv 
--application=MY_APP_ID --url=http://MY_APP_ID.appspot.com/remote_api 
--rps_limit=500 --bandwidth_limit=250 --batch_size=100

*NOTE: The entire error is pretty long. So I've included it at the bottom of 
this question.*

The upload doesn't start at all and stops at the line: [INFO ] Opening 
database: bulkloader-progress-20110611.222101.sql3

I see at the bottom of the entire trace: lambda val: _EPOCH + 
datetime.timedelta(microseconds=val), OverflowError: date value out of range

I suspect that this is caused by badly formated date's found in my *
publisheddate* column (see below for entire *Review* kind). 
--
What I've already tried to fix it 

I ran the GQL: SELECT * FROM Review where publisheddate = null in the GAE 
admin portal and found around 15 entities with *null* values for the *
publisheddate* column. So I deleted those, redownloaded and tried 
reuploading the *Review* kind. I still get the same error.

I'm thinking, since I'm using the upload command without a config file 
parameter e.g. --config_file=bulkloader.yaml (see above upload that I'm not 
specifying the --config_file)

I'm relying on the datastore statistics to determine what is downloaded to 
my *review.csv* file. 

Now since I just deleted the entities with *null publisheddate* this 
redownloading and then reuploading immediately is not doing anything 
different from my initial download and upload. Since the datastore 
statistics aren't updated yet.
--
My Questions 
   
   1. 
   
   As there are 30, 000 entities I'm unsure as to how I can locate entities 
   with badly formated dates. Is there a quick away to locate entities with bad 
   *publisheddate* values?
   2. 
   
   Does anyone know how to fix this issue? I'm not sure from the error trace 
   what the real problem is.
   
--
Review kind 

I'm using the objectify3.0.jar to manipulate my GAE datastore. So my *Review
* kind looks like this:

public class Review {
@Id private Long id; //This is my key property, auto generated by objectify 
 
private String reviewlink;  
private Date publisheddate;
private double rating;  
private Long gameid;//to make querying easier

//ommitting getters and setters 
}

--
Entire error 

10:20:48appcfg.py upload_data --kind=Review --filename=review.csv 
--application=MY_APP_ID --url=http://MY_APP_ID.appspot.com/remote_api 
--rps_limit=500 --bandwidth_limit=250 --batch_size=100
Uploading data records.
[INFO] Logging to bulkloader-log-20110611.222101
[INFO] Throttling transfers:
[INFO] Bandwidth: 250 bytes/second
[INFO] HTTP connections: 8/second
[INFO] Entities inserted/fetched/modified: 500/second
[INFO] Batch Size: 100
[INFO] Opening database: bulkloader-progress-20110611.222101.sql3
Traceback (most recent call last):
  File /usr/local/bin/appcfg.py, line 76, in module
run_file(__file__, globals())
  File /usr/local/bin/appcfg.py, line 72, in run_file
execfile(script_path, globals_)
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appcfg.py,
 line 3592, in module
main(sys.argv)
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appcfg.py,
 line 3583, in main
result = AppCfgApp(argv).Run()
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appcfg.py,
 line 2229, in Run
self.action(self)
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appcfg.py,
 line 3368, in __call__
return method()
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appcfg.py,
 line 3195, in PerformUpload
run_fn(args)
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appcfg.py,
 line 3087, in RunBulkloader
sys.exit(bulkloader.Run(arg_dict))
  File 
/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py,
 line 4360, in Run
return _PerformBulkload(arg_dict)
  File 

Re: [appengine-java] Re: Is the native API really so much faster than JDO and slim3?

[Dennis Peterson]

Haha, excellent. I studied cargo cults a bit in anthropology classes, long
ago, and never suspected how relevant they would be.

You would probably enjoy this:

http://www.fanfiction.net/s/5782108/1/Harry_Potter_and_the_Methods_of_Rationality


Until Google makes a change, maybe the other frameworks should try the same
trick?



On Thu, Jun 9, 2011 at 8:31 AM, Jeff Schnitzer j...@infohazard.org wrote:

 On Thu, Jun 9, 2011 at 1:32 AM, Gal Dolber gal.dol...@gmail.com wrote:
  I am not comparing reflexion vs byte-code generation or anything like
 that,
  apt generates code, is not a runtime technology.
  Like or not reflexion is known to be slower than actually writing the
 code.

 This is entirely irrelevant.  We've now established that the issue at
 hand is a strange quirk in the Low-Level API and has nothing to do
 with reflection.  100% (or close to it) of the performance gain of
 Slim3 is because it calls .size() on a List before iterating it.

  Slim3 generates the minimal possible code you need to talk with the low
  level api, if the low level bench is faster is just because its not
  converting the Entity to the Pojo.

 You missed the point - in the benchmark, Slim3 was *faster* than the
 Low-Level API.  This clearly indicated something was amiss, and now
 we've uncovered the actual cause.  It turns out to be something quite
 interesting indeed.

 This is a classic case of what Feynman called Cargo Cult Science.  You
 all believed that Slim3 should be faster than other APIs because code
 generation is faster than reflection, so when someone produced an
 ill-conceived benchmark that seemed to confirm your preconceived
 notion, you just accepted the entire narrative:  Slim3 is fast
 because it doesn't use reflection!  This is sloppy thinking (see:
 Confirmation Bias).

 If you haven't read this, it's a gem (I make a habit of re-reading it
 at least once a year):

 http://www.lhup.edu/~DSIMANEK/cargocul.htm

 Jeff

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine for Java group.
 To post to this group, send email to
 google-appengine-java@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine-java+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine-java?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

Re: [appengine-java] Re: Is the native API really so much faster than JDO and slim3?

[Dennis Peterson]

It's not my benchmark, it's Slim3's :) ...but you're right, it's bogus. I
asked on the main appengine group too, and it turns out the low-level
benchmark is doing lazy loading. With that fixed, their numbers come out
like yours.

I found this one too, which also gets results like yours:
http://gaejava.appspot.com/

On Wed, Jun 8, 2011 at 4:44 AM, Erwin Streur erwin.str...@gmail.com wrote:

 Indeed Dennis's measurements are very suspicious. First you should do
 a couple of warming ups on each of the implementations to prevent
 pollution like the JDO classpath scan for enhanced classes (which is
 one of the reasons for the high initial run). Then do a couple of run
 to determine a range of measurements to spot outlyers. your low-level
 API 2millis is definately one.

 When I did the measurements I got the following results
 low-level: 1150-1550
 Slim3: 1150-1600
 Objectify: 1950-2400
 JDO: 2100-2700

 These measurements confirm that GAE designed implementations are
 faster then the GAE implementation of a generic data access layer
 (JDO), but not so extrem as initially posted.

 The initial response using JDO is a known issue and especially low
 trafic website should not use it or use the always on feature (maybe
 this will change in the new pricing model)

 Regards,

 Erwin

 On Jun 7, 11:00 am, Ian Marshall ianmarshall...@gmail.com wrote:
  The low-level API does indeed look very fast.
 
  Just a comment on JDO: repeat runs roughly halve the JDO run time. I
  presume that this is because for repeat runs the JDO persistence
  manager factory has already been constructed.
 
  On Jun 6, 8:44 pm, DennisP dennisbpeter...@gmail.com wrote:
 
   I'm looking at this online demo:
 http://slim3demo.appspot.com/performance/
 
   Sample run:
   The number of entities: 1
   low-level API:get: 2 millis
   Slim3: 2490 millis
   JDO: 6030 millis
 
   Is the low-level API really that much faster?

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine for Java group.
 To post to this group, send email to
 google-appengine-java@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine-java+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine-java?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

Re: [appengine-java] Re: Is the native API really so much faster than JDO and slim3?

[Dennis Peterson]

Apologies, no offense meant. My impression was that if you wanted to, say,
display all that data, it's going to take around 1000 ms to get it, not 1
ms.

On Wed, Jun 8, 2011 at 10:55 AM, Yasuo Higa higaya...@gmail.com wrote:

 It is not bogus.
 LazyList#size() fetches all data as follows:
 public int size() {
resolveAllData();
return results.size();
 }

 Yasuo Higa

 On Wed, Jun 8, 2011 at 11:32 PM, Dennis Peterson
 dennisbpeter...@gmail.com wrote:
  It's not my benchmark, it's Slim3's :) ...but you're right, it's bogus. I
  asked on the main appengine group too, and it turns out the low-level
  benchmark is doing lazy loading. With that fixed, their numbers come out
  like yours.
  I found this one too, which also gets results like yours:
  http://gaejava.appspot.com/
 
  On Wed, Jun 8, 2011 at 4:44 AM, Erwin Streur erwin.str...@gmail.com
 wrote:
 
  Indeed Dennis's measurements are very suspicious. First you should do
  a couple of warming ups on each of the implementations to prevent
  pollution like the JDO classpath scan for enhanced classes (which is
  one of the reasons for the high initial run). Then do a couple of run
  to determine a range of measurements to spot outlyers. your low-level
  API 2millis is definately one.
 
  When I did the measurements I got the following results
  low-level: 1150-1550
  Slim3: 1150-1600
  Objectify: 1950-2400
  JDO: 2100-2700
 
  These measurements confirm that GAE designed implementations are
  faster then the GAE implementation of a generic data access layer
  (JDO), but not so extrem as initially posted.
 
  The initial response using JDO is a known issue and especially low
  trafic website should not use it or use the always on feature (maybe
  this will change in the new pricing model)
 
  Regards,
 
  Erwin
 
  On Jun 7, 11:00 am, Ian Marshall ianmarshall...@gmail.com wrote:
   The low-level API does indeed look very fast.
  
   Just a comment on JDO: repeat runs roughly halve the JDO run time. I
   presume that this is because for repeat runs the JDO persistence
   manager factory has already been constructed.
  
   On Jun 6, 8:44 pm, DennisP dennisbpeter...@gmail.com wrote:
  
I'm looking at this online
demo:http://slim3demo.appspot.com/performance/
  
Sample run:
The number of entities: 1
low-level API:get: 2 millis
Slim3: 2490 millis
JDO: 6030 millis
  
Is the low-level API really that much faster?
 
  --
  You received this message because you are subscribed to the Google
 Groups
  Google App Engine for Java group.
  To post to this group, send email to
  google-appengine-java@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine-java+unsubscr...@googlegroups.com.
  For more options, visit this group at
  http://groups.google.com/group/google-appengine-java?hl=en.
 
 
  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine for Java group.
  To post to this group, send email to
 google-appengine-java@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine-java+unsubscr...@googlegroups.com.
  For more options, visit this group at
  http://groups.google.com/group/google-appengine-java?hl=en.
 

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine for Java group.
 To post to this group, send email to
 google-appengine-java@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine-java+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine-java?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

Re: [appengine-java] Re: Is the native API really so much faster than JDO and slim3?

[Dennis Peterson]

Those multi-entity transactions are definitely interesting to me. There's
some overhead but no getting around that.

A while back I was playing around with some adhoc  methods to do it in a
specific case, but I suspect Slim3 is more solid and maybe faster than what
I was doing. Definitely easier. When I get a chance I want to dig in and
find out how it works.

On Wed, Jun 8, 2011 at 10:26 AM, Mike Lawrence m...@systemsplanet.comwrote:

 I get...

 The number of entities: 1
 low level 1717 millis
 slim3 1502 millis
 objectify 2970 millis
 jdo 3485 millis

 probably should modify this example
 to do an average of several runs

 one important thing to note, is slim3 allows you
 to update multiple entity types
 in a single transaction.
 not possible with the other 3 APIs



 On Jun 7, 4:00 am, Ian Marshall ianmarshall...@gmail.com wrote:
  The low-level API does indeed look very fast.
 
  Just a comment on JDO: repeat runs roughly halve the JDO run time. I
  presume that this is because for repeat runs the JDO persistence
  manager factory has already been constructed.
 
  On Jun 6, 8:44 pm, DennisP dennisbpeter...@gmail.com wrote: I'm
 looking at this online demo:http://slim3demo.appspot.com/performance/
 
   Sample run:
   The number of entities: 1
   low-level API:get: 2 millis
   Slim3: 2490 millis
   JDO: 6030 millis
 
   Is the low-level API really that much faster?

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine for Java group.
 To post to this group, send email to
 google-appengine-java@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine-java+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine-java?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

Re: [appengine-java] Re: Is the native API really so much faster than JDO and slim3?

[Dennis Peterson]

No I agree, and slim3 looks very interesting to me. It was just the very
fast low-level times I was wondering about, but it looks like normally slim3
and low-level will be about the same speed.

On Wed, Jun 8, 2011 at 11:42 AM, Yasuo Higa higaya...@gmail.com wrote:

 Hi Dennis,

 You can see all sources.
 http://slim3demo.appspot.com/performance/

 Java runtime reflections are very very slow.
 If you don't think so, please try it by you.

 Yasuo Higa

 On Thu, Jun 9, 2011 at 12:00 AM, Dennis Peterson
 dennisbpeter...@gmail.com wrote:
  Apologies, no offense meant. My impression was that if you wanted to,
 say,
  display all that data, it's going to take around 1000 ms to get it, not 1
  ms.
 
  On Wed, Jun 8, 2011 at 10:55 AM, Yasuo Higa higaya...@gmail.com wrote:
 
  It is not bogus.
  LazyList#size() fetches all data as follows:
  public int size() {
 resolveAllData();
 return results.size();
  }
 
  Yasuo Higa
 
  On Wed, Jun 8, 2011 at 11:32 PM, Dennis Peterson
  dennisbpeter...@gmail.com wrote:
   It's not my benchmark, it's Slim3's :) ...but you're right, it's
 bogus.
   I
   asked on the main appengine group too, and it turns out the low-level
   benchmark is doing lazy loading. With that fixed, their numbers come
 out
   like yours.
   I found this one too, which also gets results like yours:
   http://gaejava.appspot.com/
  
   On Wed, Jun 8, 2011 at 4:44 AM, Erwin Streur erwin.str...@gmail.com
   wrote:
  
   Indeed Dennis's measurements are very suspicious. First you should do
   a couple of warming ups on each of the implementations to prevent
   pollution like the JDO classpath scan for enhanced classes (which is
   one of the reasons for the high initial run). Then do a couple of run
   to determine a range of measurements to spot outlyers. your low-level
   API 2millis is definately one.
  
   When I did the measurements I got the following results
   low-level: 1150-1550
   Slim3: 1150-1600
   Objectify: 1950-2400
   JDO: 2100-2700
  
   These measurements confirm that GAE designed implementations are
   faster then the GAE implementation of a generic data access layer
   (JDO), but not so extrem as initially posted.
  
   The initial response using JDO is a known issue and especially low
   trafic website should not use it or use the always on feature (maybe
   this will change in the new pricing model)
  
   Regards,
  
   Erwin
  
   On Jun 7, 11:00 am, Ian Marshall ianmarshall...@gmail.com wrote:
The low-level API does indeed look very fast.
   
Just a comment on JDO: repeat runs roughly halve the JDO run time.
 I
presume that this is because for repeat runs the JDO persistence
manager factory has already been constructed.
   
On Jun 6, 8:44 pm, DennisP dennisbpeter...@gmail.com wrote:
   
 I'm looking at this online
 demo:http://slim3demo.appspot.com/performance/
   
 Sample run:
 The number of entities: 1
 low-level API:get: 2 millis
 Slim3: 2490 millis
 JDO: 6030 millis
   
 Is the low-level API really that much faster?
  
   --
   You received this message because you are subscribed to the Google
   Groups
   Google App Engine for Java group.
   To post to this group, send email to
   google-appengine-java@googlegroups.com.
   To unsubscribe from this group, send email to
   google-appengine-java+unsubscr...@googlegroups.com.
   For more options, visit this group at
   http://groups.google.com/group/google-appengine-java?hl=en.
  
  
   --
   You received this message because you are subscribed to the Google
   Groups
   Google App Engine for Java group.
   To post to this group, send email to
   google-appengine-java@googlegroups.com.
   To unsubscribe from this group, send email to
   google-appengine-java+unsubscr...@googlegroups.com.
   For more options, visit this group at
   http://groups.google.com/group/google-appengine-java?hl=en.
  
 
  --
  You received this message because you are subscribed to the Google
 Groups
  Google App Engine for Java group.
  To post to this group, send email to
  google-appengine-java@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine-java+unsubscr...@googlegroups.com.
  For more options, visit this group at
  http://groups.google.com/group/google-appengine-java?hl=en.
 
 
  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine for Java group.
  To post to this group, send email to
 google-appengine-java@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine-java+unsubscr...@googlegroups.com.
  For more options, visit this group at
  http://groups.google.com/group/google-appengine-java?hl=en.
 

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine for Java group.
 To post to this group, send email to
 google-appengine-java@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine-java+unsubscr

Re: [google-appengine] Re: Is the native API really so much faster than JDO and slim3?

[Dennis Peterson]

That makes more sense, thanks.

I also found this online benchmark of JDO and LL, which has similar results:
http://gaejava.appspot.com/

On Tue, Jun 7, 2011 at 8:03 PM, Anders blabl...@gmail.com wrote:

 Yeah, that's what I suspected. Lazy loading. With the modification Slim3 is
 almost as fast as the native API. Strange that JDO is so slow. I thought
 most of the time was for accessing the datastore, not for running the Java
 bytecode.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To view this discussion on the web visit
 https://groups.google.com/d/msg/google-appengine/-/dHRvXzBkWVNkUndK.

 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: What do you want to see answered in Greg's pricing FAQ?

[Dennis]

Although I was ignoring the $9/app discussion before, now I realize that* I 
want N environments as I develop my app: development, production, test, 
beta,* etc.
And, I would like* all those environments to be identical to my production 
environment (ie: all be paid apps)*.  
Thus, to develop properly the cost is N x $9/month.
I'm not enthusiastic about paying for paid app service level when most of 
these environments don't need that level of service.
Yet, I don't want to discover that there is a difference between 'free' 
and 'paid' when I finally upload to my production environment.

Paying a little to keep spammy apps away is ok, but I think the payment 
policy should be focused on the person paying the bill and not the apps that 
they generate.  

In fact, I would go further and say that google should really* encourage 
developers to get on the highest service level early in the development 
process. * In particular, always-on and high replication data should be 
encouraged at the prototype stage so developers can feel how fast their apps 
will be and ... and so* we can imagine what we can do with that enhanced 
capability!!Appengine developers that pay* is a market niche that 
google should really give incentives to so we can build and evangelize the 
platform!In contrast, right now with the current fee structure, I'm on 
the free tier and waiting each time my prototype is called as the instance 
is loaded ... I could pay for always-on but I feel a little silly doing that 
when the prototype is just for me -- the incentives are not aligned 
correctly...  

Dennis

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: FAQ for out of preview pricing changes

[Dennis]

Amount of concurrency / instance is critical for deciding whether to
use AppEngine as a platform.

Although AppEngine has it's disadvantages (vendor lock-in, restricted
architecture, etc),
the key reason to choose AppEngine is scalability.

The datastore scales.
Now we need to focus the other component of scalability:
Does the frontend processing scale?  Does it scale ECONOMICALLY?

We are on AppEngine for scalability, so give us information on what
needs to be done
to get economical, end-to-end scalability.

Is Java more economical than python at scale?
What is the python solution for frontend scalability?
How much better is it than the current python solution and how does it
compare to Java?
Tell us so we can make the tradeoffs for our own situation and
preferences.
It's better for us to know now so we can do our planning with plenty
of lead time and being well informed of what the tradeoffs are.



On May 19, 3:30 am, Dennis dennisf...@gmail.com wrote:
 I looked into python multi-threading / multi-processing a bit more,
 especially with your tip that it requires python 2.7.

 The python multiprocessing module was introduced in python 
 2.6http://docs.python.org/library/multiprocessing.htmlhttp://www.ibm.com/developerworks/aix/library/au-multiprocessing/inde...
 so this is probably what will be used for python appengine to get
 concurrency above 1 request / instance.
 This solution copies and spawns processes which are heavier than threads.
 I'm assuming that most of the concurrency will be achieved because processes
 are datastore bound:
 they are just waiting around for the datastore to return a result.

 Given this type of solution (or whatever solution is used), some important
 questions are:

    - How many concurrent requests can a single instance handle (for python)?
     If the process is waiting for the datastore, is the number of processes
    (and thus concurrency) dependent mainly on the number of processes that can
    fit in memory?
    - Will heavy python frameworks (like django) have a lower concurrency
    ability because they use more memory?  If so, what will their concurrent
    requests / instance be (for the simplest django app, then we can add in our
    own app's memory usage)?
    - For those considering switching to java, what is the estimated
    concurrent requests / instance for java apps?  Java uses threads instead of
    processes.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: RE: [google-appengine] Re: FAQ for out of preview pricing changes

[Dennis]

Thanks, Brandon, this is great info!

This plus Stephen's info shows how to get scalability without concurrency:

No, the way it currently works is if your apps latency  1000ms
(figures of 800-900ms have also been mentioned) it won't scale. The
lower the latency the more they scale it. So the incentive has always
been to write low latency apps.




On Friday, May 20, 2011 1:44:22 AM UTC+8, Brandon Wirtz wrote:

 The 50k free database operations is a bit more nebulous since Google are 
 still scratching their heads over it. With correct memcache usage it really 
 should be enough, although that might be a bit of wishful thinking and 
 obviously depends significantly on your use case.

  

  

 As reference… 

  

 Datastore API Calls

 [image: Description: 0%]

 0%

 183,470 of Unlimited

 Okay

 Memcache API Calls

 [image: Description: 0%]

 0%

 323,702 of Unlimited

 Okay

  

 Twice as many memcache calls as data store.  This is pretty consistent 
 across my apps. 

  

 My average Entity is about 5k… (this says a little lower)

  

 **

 *Entity Kind*

 *# Entities*

 *Avg. Size/Entity*

 *Total Size*

 Kind1

 627,354

 4 Kbytes

 2 GBytes

  

  

 Every request I have uses potentially:

  

 Configuration load: 1 memcache read   OR 1 datastore read and 1 memcache 
 write

  

 Get Content: 1 memcache Read, OR 1 datastore Read, 1 Memcache Write, OR 1 
 DataStore Write, 1 Memcache write

  

  

 I don’t know if this helps anyone, but I’m always interested in how apps 
 use their quotas, so I thought I would share.

  


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: RE: [google-appengine] Re: FAQ for out of preview pricing changes

[Dennis]

Q: how big is AppEngine?

A: 4 x tumblr.com:

GAE reached 1 billion page views at the end of last year:  
http://www.onebigfluke.com/2010/12/nuff-said.html
and tumblr.com reached 250 M page views this month:  
http://staff.tumblr.com/post/5578802048/whoa-yesterday-we-jumped-past-250m-pageviews-a

Q: how much would it cost to run tumblr.com on AppEngine?

A: a nice back-of-the-envelope estimate worked out for us GAE developers 
would make very good PR for this price change (if the estimated price turns 
out to be relatively low...)

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: RE: [google-appengine] Re: FAQ for out of preview pricing changes

[Dennis Fogg]

yes, it's a google interview question ... for google!   ;-)



On Fri, May 20, 2011 at 2:45 AM, Dennis dennisf...@gmail.com wrote:

 Q: how big is AppEngine?

 A: 4 x tumblr.com:

 GAE reached 1 billion page views at the end of last year:
 http://www.onebigfluke.com/2010/12/nuff-said.html
 and tumblr.com reached 250 M page views this month:
 http://staff.tumblr.com/post/5578802048/whoa-yesterday-we-jumped-past-250m-pageviews-a

 Q: how much would it cost to run tumblr.com on AppEngine?

 A: a nice back-of-the-envelope estimate worked out for us GAE developers
 would make very good PR for this price change (if the estimated price turns
 out to be relatively low...)

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: FAQ for out of preview pricing changes

[Dennis]

  Q: Will there be a solution for Python concurrency?  Will this require any
  code changes?
  Python concurrency will be handled by our release of Python 2.7 on App
  Engine.  We’ve heard a lot of feedback from our Python users who are worried
  that the incentive is to move to Java because of its support for concurrent
  requests, so we’ve made a change to the new pricing to account for that.
   While Python 2.7 support is currently in progress it is not yet done so we
  will be providing a half-sized instance for Python (at half the price) until
  Python 2.7 is released.

The current answer for this question does not address the 2nd question
about code change for concurrency.
If code change is not needed, that would be great and well worth
mentioning.
If code change is needed, what changes are needed and what can we do
now to start preparing for those changes?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: FAQ for out of preview pricing changes

[Dennis]

PS: will django apps automatically get the benefits of the python
concurrency solution?


On May 18, 9:23 pm, Dennis dennisf...@gmail.com wrote:
   Q: Will there be a solution for Python concurrency?  Will this require any
   code changes?
   Python concurrency will be handled by our release of Python 2.7 on App
   Engine.  We’ve heard a lot of feedback from our Python users who are 
   worried
   that the incentive is to move to Java because of its support for 
   concurrent
   requests, so we’ve made a change to the new pricing to account for that.
    While Python 2.7 support is currently in progress it is not yet done so 
   we
   will be providing a half-sized instance for Python (at half the price) 
   until
   Python 2.7 is released.

 The current answer for this question does not address the 2nd question
 about code change for concurrency.
 If code change is not needed, that would be great and well worth
 mentioning.
 If code change is needed, what changes are needed and what can we do
 now to start preparing for those changes?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: FAQ for out of preview pricing changes

[Dennis]

I looked into python multi-threading / multi-processing a bit more, 
especially with your tip that it requires python 2.7.

The python multiprocessing module was introduced in python 2.6
http://docs.python.org/library/multiprocessing.html
http://www.ibm.com/developerworks/aix/library/au-multiprocessing/index.html
so this is probably what will be used for python appengine to get 
concurrency above 1 request / instance.
This solution copies and spawns processes which are heavier than threads.
I'm assuming that most of the concurrency will be achieved because processes 
are datastore bound: 
they are just waiting around for the datastore to return a result.

Given this type of solution (or whatever solution is used), some important 
questions are:

   - How many concurrent requests can a single instance handle (for python)? 
If the process is waiting for the datastore, is the number of processes 
   (and thus concurrency) dependent mainly on the number of processes that can 
   fit in memory?
   - Will heavy python frameworks (like django) have a lower concurrency 
   ability because they use more memory?  If so, what will their concurrent 
   requests / instance be (for the simplest django app, then we can add in our 
   own app's memory usage)?
   - For those considering switching to java, what is the estimated 
   concurrent requests / instance for java apps?  Java uses threads instead of 
   processes.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[appengine-java] Re: Backends.xml ERROR when deploying

[Dennis Lo]

Hi Jake,

Thanks for you example on how to use the appcfg with backends.

I think the documentation really needs to include some solid examples on how 
to use appcfg.

I found this to be lacking in alot of parts through the Google App Engine 
documentation. 

Now, for the apppcfg parameters:

   - dir  needs to point to your app's war directory
   - [updates] you can leave blank or you can specify which once to deploy. 
   Other wise if it is black it will deploy all your backends defined in 
   backends.xml
   

For others reading this that are trying to figure out how to get your 
backends.xml to appear in the Admin UI you need to ensure you have the 
following:

1. A valid backends.xml file. This means the class elements and correct 
nesting of elements. Be care of using lower case b's in your class elements.
For example, a lower case b will cause the deploy to fail as it does not 
validate against the backends.xsd:
?xml version=1.0 encoding=UTF-8?
backends
backend name=spider
classb2/class
instances1/instances
/backend
/backends

You need to have something like

?xml version=1.0 encoding=UTF-8?
backends
backend name=spider
classB2/class
instances1/instances
/backend
/backends

2. Until a is fixes made, you'll probably need to use appcfg to make your 
backends appear in the admin UI.
Find your appcfg.sh and run '*chmod 755*' incase it doesn't have the 
permissions to execute. Then type:
*
*
*./appcfg.sh backends ~/pathToYourApp/AppFoldr/war/ update*

This will deploy your app to Google. It will ask for your email and 
password.

I left the parameter after update blank because I deploy the app with all my 
backends defined in my backends.xml.

You can alternatively use:
*./appcfg.sh backends ~/pathToYourApp/AppFoldr/war/ update spider*

This will target the 'sortgames' backend (as shown above)

I hope this helps!

Cheers!


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

[appengine-java] Re: Backends.xml ERROR when deploying

[Dennis Lo]

Hi Jake,

Thanks for you example on how to use the appcfg with backends.

I think the documentation really needs to include some solid examples on how 
to use appcfg.

I found this to be lacking in alot of parts through the Google App Engine 
documentation. 

Now, for the apppcfg parameters:

   - dir  needs to point to your app's war directory
   - [updates] you can leave blank or you can specify which once to deploy. 
   Other wise if it is black it will deploy all your backends defined in 
   backends.xml
   

For others reading this that are trying to figure out how to get your 
backends.xml to appear in the Admin UI you need to ensure you have the 
following:

1. A valid backends.xml file. This means the class elements and correct 
nesting of elements. Be care of using lower case b's in your class elements.
For example, a lower case b will cause the deploy to fail as it does not 
validate against the backends.xsd:
?xml version=1.0 encoding=UTF-8?
backends
backend name=spider
classb2/class
instances1/instances
/backend
/backends

You need to have something like

?xml version=1.0 encoding=UTF-8?
backends
backend name=spider
classB2/class
instances1/instances
/backend
/backends

2. Until a is fixes made, you'll probably need to use appcfg to make your 
backends appear in the admin UI.
Find your appcfg.sh and run '*chmod 755*' incase it doesn't have the 
permissions to execute. Then type:
*
*
*./appcfg.sh backends ~/pathToYourApp/AppFoldr/war/ update*

This will deploy your app to Google. It will ask for your email and 
password.

I left the parameter after update blank because I deploy the app with all my 
backends defined in my backends.xml.

You can alternatively use:
*./appcfg.sh backends ~/pathToYourApp/AppFoldr/war/ update spider*

This will target the 'spider' backend (as shown above)

I hope this helps!

Cheers!

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

[appengine-java] Re: Backends.xml ERROR when deploying

[Dennis Lo]

Hi Jake,

So I finally got the backends to apper in the Admin UI.

Here is my backends.xml

backends
backend name=sortgame
classB2/class
instances5/instances
options
dynamictrue/dynamic
/options
/backend
/backends

But I don't know how to call them.

I read this blog: 
http://pdjamez.com/2011/05/google-app-engine-backends/comment-page-1/

It looks like you just make servlert e.g. LongrunServlet.java and add an 
entry to you web.xml like so:

servlet
servlet-nameLongRun/servlet-name
servlet-classcom.example.app.longrunServlet/servlet-class
/servlet
servlet-mapping
servlet-nameLongRun/servlet-name
url-pattern/longrun/url-pattern
/servlet-mapping

But when I try to execute it like:

http://spider.myapp.appspot.com/longrun

Error: Forbidden
Your client does not have permission to get URL / from this server.

Any help?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

[appengine-java] Re: Backends.xml ERROR when deploying

[Dennis Lo]

Hi Jake,

So I finally got the backends to apper in the Admin UI.

Here is my backends.xml

backends
backend name=spider
classB2/class
instances5/instances
options
dynamictrue/dynamic
/options
/backend
/backends

But I don't know how to call them.

I read this blog: 
http://pdjamez.com/2011/05/google-app-engine-backends/comment-page-1/

It looks like you just make servlert e.g. LongrunServlet.java and add an 
entry to you web.xml like so:

servlet
servlet-nameLongRun/
servlet-name
servlet-classcom.example.app.longrunServlet/servlet-class
/servlet
servlet-mapping
servlet-nameLongRun/servlet-name
url-pattern/longrun/url-pattern
/servlet-mapping

But when I try to execute it like:

http://spider.myapp.appspot.com/longrun

Error: Forbidden
Your client does not have permission to get URL / from this server.

Any help?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

Re: [appengine-java] Re: Backends.xml ERROR when deploying

[Dennis Lo]

Hi,

I see.

So a public backend would be:

backends
backend name=spider
classB2/class
instances5/instances
options
dynamictrue/dynamic
publictrue/public
/options
/backend
/backends

Also, what is urlfetch?
I haven't used these before.
Do you have any blogs, tutorials with a great example which illustrates how
I could use it to call a backend.

Alternatively, if you don't have any blogs,tutorials etc, could you explain
with some examples?


On Tue, May 17, 2011 at 3:49 AM, JakeP jake.pier...@gmail.com wrote:

 Dennis,

 I'm still trying to figure out the best way to call the backend
 programmatically from within GAE. The simplest way I know of is with
 urlfetch.

 Your backend has to be marked public for you to be able to access it
 via 'spider' from outside of GAE - i.e. your browser.

 Thanks for the link.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine for Java group.
 To post to this group, send email to
 google-appengine-java@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine-java+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine-java?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

Re: RE: [google-appengine] Re: 1.5 improvements Make me less scared of Pricing

[Dennis]

Thanks for the tips, Brandon!

A quick question: those scratchpad datastores are python dicts, right?   
We need to be aware that the dicts are not coordinated across instances so 
they may have stale data (which might be ok depending on the app).  Just 
want to make sure I understand your suggestion.  

Thanks,
Dennis

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[appengine-java] Re: Backends.xml ERROR when deploying

[Dennis Lo]

I think you need to use a uppercase B for the classes.

When I tried deploying using a lowercase b1 eclipse was complating about a 
volidation with the backends.xsd.

Try this:
backends 
  backend name=tastBackend 
classB1/class 
instances1/instances 
  /backend 
/backends 

However, I can get it to deploy. But it still says: You have not created 
any backends for this application.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

Re: [appengine-java] Re: Backends.xml ERROR when deploying

[Dennis Lo]

Hi Jake,

Can you give me the exact command you used?
I'm not sure how to use appcfg.sh for the backend features. I'm actually
planning to use the affcfg.py (which I believe is the same but just the
python version)

So what are the dir and [update] values supposed to be to make these
backends.xml appear in the admin UI?

My best guess is:
appcfg.py ~/myapp/war/WEB-INF/appengine-web.xml backends update

I dont think that's correct and want to know what you typed to get it to
appear in the admin UI.

Thanks!

On Mon, May 16, 2011 at 3:29 AM, JakeP jake.pier...@gmail.com wrote:

 Dennis,

 You're half-way there :)

 GAE won't create a backend for you until you use the appcfg.sh
 'update' command to update the backends.
 Check out the docs here:
 http://code.google.com/appengine/docs/java/backends/overview.html#Commands


 I also was really expecting the backends.xml file backends to show up
 in the admin UI - because all the other xml config files (cron.xml
 web.xml queue.xml) take effect as soon as you deploy. My guess is that
 the GAE team didn't intend it to be this way or that it's necessary to
 do that appcfg.sh step one reason or another.

 As soon as you get the backend running, you may have a hard time
 calling URLs on the backend. I got a not ready message a lot but
 that seems to go away after a little while.

 I'm having a hard time figuring out how to get the backend to run cron
 scheduled tasks. If you figure out a good way to do that, let me know.
 Thanks.

 -jake

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine for Java group.
 To post to this group, send email to
 google-appengine-java@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine-java+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine-java?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

Re: [google-appengine] No descending index on __key__, performing serial download

[Dennis Lo]

Hi Ikai,

I hope you can help me out even though this is such an old thread.

I've been looking around the internet and I can't seem to figure out why my 
appcfg.py download_data (backup to my csv) is performing so slowly.

I see the No descending index on __key__, performing serial download and 
the dot's indicating progress just keep going. It
is downloading quite slowly. I'm looking at my mac's Activity Monitor and 
it's download it at around 23kb/sec. By the way, I'm from Australia, so 
maybe that might be one cause.

To give you some context, my GAE app is in Java and the kind I'm downloading 
has about 25, entries.

I'm also following your blog entry: 
http://ikaisays.com/2010/06/10/using-the-bulkloader-with-java-app-engine/
the closet but I'm also read this to help me get a better understand of how 
to edit bulkloader.yaml files: 
http://code.google.com/appengine/docs/python/tools/uploadingdata.html

My questions are:
1) How to I speed up this backup and eventually the restore process?

2) How do I make a descending index on __Key__, I've already got some 
custom indices inside my datastore-indexes-auto.xml and 
datastore-indexes.xml but nothing for the key.

In fact I'm not even sure how to make a desc index on the key property 
inside my datastore-indexes.xml with desc direction. Would it be like 
(assuming the name of the key is id):

datastore-index kind=Game ancestor=false source=manual
property name=id direction=desc/
/datastore-index

Thanks

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] No descending index on __key__, performing serial download

[Dennis Lo]

Just and update the download for this kind with the 25,000 entries took 390 
seconds (about 6.50minutes).
Is that normal?

I've got a 5 more kinds around that size. So essentially, the appcfg.py 
download_data would take 32.5 minutes.

I've also checked the datastore and its just 9% of the 1GB capacity. That's 
not lot of data, but it just feels so slow the backup for such little data.

Regards,
Dennis

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] No descending index on __key__, performing serial download

[Dennis Lo]

Just an update: The download for this kind with 25,000 entries took 390 
seconds (about 6.50minutes).
Is that normal?

I've got 5 more kinds around that size. So essentially, the appcfg.py 
download_data would take 32.5 minutes to back everything up.

I've also checked the datastore and its just 9% of the 1GB capacity. That's 
not lot of data, but it just feels so slow the backup for such little data.

Regards,
Dennis

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Experiencing major timeout issues right now

[Dennis]

My reads are serial because there is some dependency on earlier reads.
But the main point is that it was working fine before.
The allowed capability of the current appengine platform is different from 
the allowed capabilities of, say, last week's platform.
To have the platform's capabilities change is very dramatic and affects 
apps.
That's why it seems like the appengine platform is currently up and running, 
but not at it's normal' level.

By the way, it would be desirable to be able to test my app when the 
appengine platform is running at this 
lower level of capability. 

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Object Persistence Methodology - suggestions?

[Dennis]

yes, I think datastore frameworks is a reasonable name for these services.

Objectify looks good for appengine/java.
Do you know of any datastore frameworks for appengine/python?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Experiencing major timeout issues right now

[Dennis]

My app is still not running normally.

Before, I could do 30-40 datastore reads (in a particular section of
my code) without timeouts.
Now, I can't.  It consistently gets timeout errors.
I changed my code to reduce the number of datastore reads to about 5
reads in that section of code, and the modified code is running
without timeout errors now.
It's working ok in this in limited mode now, but I'm hoping this is
not the new normal...



On Feb 24, 11:35 pm, David Mora dla.m...@gmail.com wrote:
 So i left 2 monitors running doing random inserts and 5 others doing location 
 queries (geobox). After 6 hours has been an steady line with only 1 error.

 Im going to keep it running 2 more days and post the results ( im also 
 running out of cpu since is a free acount)

 Sent from my iPhone

 On Feb 24, 2011, at 6:47 AM, Jeff Schwartz jefftschwa...@gmail.com wrote:







  No, I'm not using HR.

  On Thu, Feb 24, 2011 at 2:50 AM, Kaan Soral kaanso...@gmail.com wrote:
  It wasn't clear that Jeff is using HR, I wish he doesn't

  On Feb 24, 5:24 am, Raymond C. windz...@gmail.com wrote:
   So switching from M/S to HR would not help?

  --
  You received this message because you are subscribed to the Google Groups 
  Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group 
  athttp://groups.google.com/group/google-appengine?hl=en.

  --
  Jeff Schwartz
 http://jefftschwartz.appspot.com/
 http://www.linkedin.com/in/jefftschwartz
  follow me on twitter: @jefftschwartz

  --
  You received this message because you are subscribed to the Google Groups 
  Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group 
  athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Object Persistence Methodology - suggestions?

[Dennis]

Thanks for the link.

My post is an open-ended question about how to code object persistence under 
appengine.
It would be nice to have a layer above the get/put primitives that provides 
some services for me --
what does that layer look like?

I'm looking for a coding methodology (or even just coding tips) or a 
software framework (like you posted).
This feature list http://borglin.net/gwt-project/?page_id=690from your 
link was helpful to list some of the issues to consider: 

   - lazy loading
   - managing entity references (unowned relationships from the feature 
   list)
  - might have to manage 1:1 vs 1:N vs M:N relationships differently
  - avoiding copies of the same entity to be read in
   - writing out changed entities
   - caching

I currently have my own hacked up layer but it's showing it's problems.
I'm wondering if others have their own layer or framework or if they have 
pointers to some.
This seems like an issue that every appengine app needs to deal with, but I 
don't even know the right name to use to refer to this set of services 
(maybe data access layer but that yields 0 search results so it's not very 
helpful)

Dennis

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] creating new GAE project in Eclipse Helios requires changing default name in GAE package

[Dennis G Daniels]

I noticed that Eclipse Helios will not take GAE directory until you change 
the django directory name. Thought I would pass it on.

http://www.youtube.com/watch?v=eAv5HEbeXX8

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.