[google-appengine] Search disappearing in new Google App Engine Python 3 environment?

2020-08-17 Thread Steve Sauder
Hi all!  Just wanted to ask a quick question!  I've been using GAE for 
several years now, and am looking at moving my code from Python 2.7 to the 
new Python 3 structure, and have been working my way through the 
documentation on updating, and have run into something that I think is a 
blocker, and a really big question mark for me.  This is the apparent lack 
of full text search support in the new Python 3 environment.  I make fairly 
heavy use of full text searching in my project and the existing Search API 
is completely and utterly perfect for what I need.  Is there any plans for 
supporting full text capabilities in Python 3 moving forward, without 
having to call of to some third party implementation like  Elastic Search?  
I mean, COME ON!  You're GOOGLE!!  You INVENTED full text search, and now 
you're pushing your developers off to third party search tools?!?  This 
makes no sense.

Please tell me this is a temporary issue, and that the Search API will be 
updated to work with Google App Engine moving forward.  For now, I'm going 
to have to stay with Python 2.7, because I need that functionality.
Thanks!
Steve. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/2c69ef8d-c26a-4581-ad16-133e70c197e5n%40googlegroups.com.


[google-appengine] Re: Naked https (SSL) domain?

2020-03-25 Thread Steve Verbeek
You basically need to have a separate server be able to handle the root 
(naked) domain and serve up a SSL certificate. A lot of services, such as 
Google App Engine do not do this for you, so you need something else 
capable of doing it.

You could also use https://redirectssl.com it has free redirects up to a 
certain amount.

*Disclaimer: I am the developer behind the service, I understand self 
promotion is wrong and that is not my intention, this thread has been 
referenced a lot by people and I want to offer a modern alternative.*

On Sunday, 22 July 2012 14:13:23 UTC-3, Thomas Wiradikusuma wrote:
>
>
> Hi guys,
>
> I'm using GAE's official SSL SNI support in my app. Opening 
> https://www.temanmudik.com is fine. But opening https://temanmudik.com 
> (naked domain) gives warning (in Chrome) that essentially says, "Hey, the 
> cert is not for temanmudik.com, it's Google's". Non-SSL (
> http://temanmudik.com) properly redirects to www. My appid is "neytap".
>
> So I got creative, I logged in to enom (from Google Apps) then removed all 
> A mappings (@ -> google IPs) and replaced them with one URL Redirect (@ -> 
> http://www.temanmudik.com). Non-SSL naked domain is still working, but 
> now Chrome gives me "This webpage is not available. Google Chrome's 
> connection attempt to temanmudik.com was rejected. The website may be 
> down, or your network may not be properly configured." when I try to access 
> https://temanmudik.com.
>
> Anyone know how to properly redirect naked https domain in GAE? I notice 
> there is similar question in this forum (
> https://groups.google.com/forum/?fromgroups#!newtopic/google-appengine/google-appengine/A-8I1X9vouk),
>  
> but it's 2009 and uses unofficial SSL support.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/c53eb090-44ee-4b98-aa89-c38db24dbe5d%40googlegroups.com.


[google-appengine] Re: Node 8 Standard (Express) not gzipping content

2018-11-16 Thread Steve Geer
Thank you for the update, Jason.  I'll keep an eye on it.

On Monday, October 29, 2018 at 2:03:47 PM UTC-7, Jason Collins wrote:
>
> Today, we are not passing through the `Accept-Encoding` header, so it is 
> not possible for your middleware to decide that it should compress. 
>
> We will roll out a fix for this in the new few weeks.
>
>
> On Monday, 29 October 2018 06:12:50 UTC-7, Steve Geer wrote:
>>
>> I have run into an issue where app engine standard is not gzipping 
>> responses.  It's a basic express universal application based on the docs at 
>> angular.io <https://angular.io/guide/universal>, with the addition of 
>> the compression middleware recommended by the express documentation.
>>
>> It's a very simple Angular 7 universal project, which can been seen here 
>> <https://ng-universal-test-220902.appspot.com/>.
>>
>> If you open the network tab you'll notice none of the assets are gzipped.
>>
>> Github <https://github.com/itsthesteve/ng-universal-app-engine>
>> Stackoverflow 
>> <https://stackoverflow.com/questions/52752100/deployed-app-engine-isnt-gzipping-my-content>
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/4314a885-afc7-4beb-b4c7-bcc29ad1bef8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Node 8 Standard (Express) not gzipping content

2018-10-29 Thread Steve Geer
I have run into an issue where app engine standard is not gzipping 
responses.  It's a basic express universal application based on the docs at 
angular.io , with the addition of the 
compression middleware recommended by the express documentation.

It's a very simple Angular 7 universal project, which can been seen here 
.

If you open the network tab you'll notice none of the assets are gzipped.

Github 
Stackoverflow 


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/ad47ddba-079e-4d5d-84ab-427fa4969e74%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Server Sent Events in GAE Standard

2018-08-06 Thread Steve Neal

Thanks for the advice - I'll add a comment to this pwhen I've had a chance 
to try Server Side Events.


On Monday, 6 August 2018 17:19:28 UTC+2, Steren Giannini wrote:
>
> You are correct. 
> And because App Engine in automatic scaling mode has a 60 sec request 
> timeout, this probably means that your events cannot be separated by more 
> than 60sec.
>
> Give it a try, let us know.
>
> On Mon, Aug 6, 2018 at 7:39 AM Barry Hunter  > wrote:
>
>> Well as such Server Sent Events IS long-polling!
>>
>> .. it's just wrapping it up in a 'multi-part' message, but as noted its 
>> still HTTP, using Chunked encoding. 
>>
>> ... and a browser provided trigger mechanism to catch each new 'event' 
>> message. 
>>
>>
>>
>>
>> On Mon, Aug 6, 2018 at 2:07 PM Steve Neal > > wrote:
>>
>>>
>>> I need to send messages from the Web server to a browser based 
>>> application.
>>>
>>> Server Sent Events are an obvious choice but I cannot see any supporting 
>>> documentation. Is it possible to do this with GAE standard using Java 8 ?
>>>
>>> If not, is there a way to run web sockets, or some other technology that 
>>> will allow messages to be sent to the browser. I don't want to resort to 
>>> polling from the browser.
>>>
>>> Thanks, Steve.
>>>
>>> -- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "Google App Engine" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to google-appengi...@googlegroups.com .
>>> To post to this group, send email to google-a...@googlegroups.com 
>>> .
>>> Visit this group at https://groups.google.com/group/google-appengine.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/google-appengine/da54131c-b8dc-44c6-ab36-bbb918ad3125%40googlegroups.com
>>>  
>>> <https://groups.google.com/d/msgid/google-appengine/da54131c-b8dc-44c6-ab36-bbb918ad3125%40googlegroups.com?utm_medium=email_source=footer>
>>> .
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to google-appengi...@googlegroups.com .
>> To post to this group, send email to google-a...@googlegroups.com 
>> .
>> Visit this group at https://groups.google.com/group/google-appengine.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/google-appengine/CAJCAUu%2BXN547NFR_jdaSQnggiwVij%2Bm9M6hUDm073tFGcqMe8g%40mail.gmail.com
>>  
>> <https://groups.google.com/d/msgid/google-appengine/CAJCAUu%2BXN547NFR_jdaSQnggiwVij%2Bm9M6hUDm073tFGcqMe8g%40mail.gmail.com?utm_medium=email_source=footer>
>> .
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/d48fe73e-dac7-4b20-84c0-272da94716b9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Server Sent Events in GAE standard environment - ADVICE PLEASE

2018-08-06 Thread Steve Neal
Yes it is a duplicate - I hadn't realised the group was moderated and 
didn't see my first attempt to post a question listed and tried again.

There doesn't seem to be a way to delete this post either.

If someone has privileges to delete it, then please do.





On Monday, 6 August 2018 19:32:33 UTC+2, Kamran (Google Cloud Support) 
wrote:
>
> Hello Steve,
>
> This looks like a duplicate post of this 
> <https://groups.google.com/forum/#!topic/google-appengine/mXxBe_WJ4Ok>. 
> Please visit that thread 
> <https://groups.google.com/forum/#!topic/google-appengine/mXxBe_WJ4Ok>, 
> my colleague provided answers to your questions.
>
> Thanks
>
>
> On Monday, August 6, 2018 at 9:07:30 AM UTC-4, Steve Neal wrote:
>>
>>
>> I need to be able send notifications to a web application from the app 
>> engine server. For me Server Sent Events seem to be the best option. 
>> However, I cannot find any supporting docs for this in GAE standard 
>> environment (Java 8). 
>>
>> Is this feature implemented at all in GAE?
>>
>> Is there something else I should be looking for? web sockets are another 
>> possibility for me, but from what I can tell, they aren't supported.
>>
>> Thanks.
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/9128fe94-5e11-4331-aa20-36a9f7a60090%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Server Sent Events in GAE standard environment - ADVICE PLEASE

2018-08-06 Thread Steve Neal

I need to be able send notifications to a web application from the app 
engine server. For me Server Sent Events seem to be the best option. 
However, I cannot find any supporting docs for this in GAE standard 
environment (Java 8). 

Is this feature implemented at all in GAE?

Is there something else I should be looking for? web sockets are another 
possibility for me, but from what I can tell, they aren't supported.

Thanks.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/501f4c6c-513e-48e7-8b28-82ee99220261%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Server Sent Events in GAE Standard

2018-08-06 Thread Steve Neal

I need to send messages from the Web server to a browser based application.

Server Sent Events are an obvious choice but I cannot see any supporting 
documentation. Is it possible to do this with GAE standard using Java 8 ?

If not, is there a way to run web sockets, or some other technology that 
will allow messages to be sent to the browser. I don't want to resort to 
polling from the browser.

Thanks, Steve.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/da54131c-b8dc-44c6-ab36-bbb918ad3125%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Google App Engine group

2018-08-06 Thread Steve Neal
Hi,

Can you tell me if this group is moderated please?

I've tried twice to post a question and it's not visible.

Thanks, Steve.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAGw%2BpadXaYAj326cwHnWG8e6h%2BkBbdQga93iOKFCXAh8%3DLEuvA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] 502 "failed_to_pick_backend" errors, seems like both workers died at the same time

2017-09-23 Thread Steve Anderson
Project ID: firebase-lessthan3
Service: Action

At 8:08PM PDT tonight we experienced about one minute of 503s from our data 
pipeline ingenstion services on google app engine. No one at our company 
triggered a restart, and the logs didn't show much besides *502 
failed_to_pick_backend.*

What was the cause of this? And how could we prevent this in the future? 
This app handles our data ingestion pipeline for our analytics, and its of 
the upmost priority that we don't this service doesn't go down.

Thank you.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/2981fcbd-67e6-4a6e-98f8-43a85152df0c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: Help in mapping my domain to google app engine I mistyped the registrar password

2015-09-22 Thread Steve Lewis
I have tried to reassign www.erlandanderson.com to my application
erland_anderson2.appspot.com - used to be erland_anderson.appspot.com but I
needed to rebuild the app because the data model was deprecated
I did the reassianment but it did not seem to work

ping www.erlandanderson.com

Pinging ghs.googlehosted.com [74.125.28.121] with 32 bytes of data:

ping erland_anderson2.appspot.com

Pinging appspot.l.google.com [74.125.28.141] with 32 bytes of data:

On Thu, Sep 3, 2015 at 10:54 AM, Nick (Cloud Platform Support) <
pay...@google.com> wrote:

> Hey Lord Joe,
>
> I'm really glad that you got it figured out, nonetheless. Do you think it
> might be possible for you to make a public issue tracker
>  report of the
> issue you experienced? If possible, you could attach a HAR recording of
> your browser's activity during the failed GoDaddy sign-in flow? This would
> help make sure that this gets fixed, as without a report and some data, no
> work can proceed on this. At the very least this thread will exist as a
> reference to any future user, but that's obviously sub-optimal. Anyways,
> it's up to you.
>
> Feel free to consult the docs or post to stackoverflow if you encounter
> any issues at all migrating from Master-Slave to High-Replication
> Datastore. We monitor their as well and you'll be in good hands with the
> community of developers, many of whom have also made this transition.
>
> Best wishes,
>
> Nick
>
>
>
> On Tuesday, September 1, 2015 at 1:29:08 PM UTC-4, lordjoe wrote:
>>
>> That is EXACTLY what happened
>>
>> On Tue, Sep 1, 2015 at 10:01 AM, pdknsk  wrote:
>>
>>> I think the issue is as follows. He initially tried to use the automated
>>> setup, where you login to your registrar OAuth-style, and all the necessary
>>> changes are then made automatically. He mistyped the password, and was not
>>> offered this automated setup again, but had to go through the manual TXT
>>> process.
>>>
>>> --
>>> You received this message because you are subscribed to a topic in the
>>> Google Groups "Google App Engine" group.
>>> To unsubscribe from this topic, visit
>>> https://groups.google.com/d/topic/google-appengine/CmB9utpH63U/unsubscribe
>>> .
>>> To unsubscribe from this group and all its topics, send an email to
>>> google-appengine+unsubscr...@googlegroups.com.
>>> To post to this group, send email to google-appengine@googlegroups.com.
>>> Visit this group at http://groups.google.com/group/google-appengine.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/google-appengine/750f10f5-cb89-452e-b410-f9c2d0bc67fe%40googlegroups.com
>>> 
>>> .
>>>
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>
>>
>> --
>> Steven M. Lewis PhD
>> 4221 105th Ave NE
>> Kirkland, WA 98033
>> 206-384-1340 (cell)
>> Skype lordjoe_com
>>
>> --
> You received this message because you are subscribed to a topic in the
> Google Groups "Google App Engine" group.
> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/google-appengine/CmB9utpH63U/unsubscribe
> .
> To unsubscribe from this group and all its topics, send an email to
> google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/6c97cf17-9098-4520-a69d-4fa087d82053%40googlegroups.com
> 
> .
>
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CALEj8ePn%2B_A0%3Dc6eZCY9-%2BsWRd-YERh%2BzZVLhqv01GzzKOv66w%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: Help in mapping my domain to google app engine I mistyped the registrar password

2015-09-01 Thread Steve Lewis
That is EXACTLY what happened

On Tue, Sep 1, 2015 at 10:01 AM, pdknsk  wrote:

> I think the issue is as follows. He initially tried to use the automated
> setup, where you login to your registrar OAuth-style, and all the necessary
> changes are then made automatically. He mistyped the password, and was not
> offered this automated setup again, but had to go through the manual TXT
> process.
>
> --
> You received this message because you are subscribed to a topic in the
> Google Groups "Google App Engine" group.
> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/google-appengine/CmB9utpH63U/unsubscribe
> .
> To unsubscribe from this group and all its topics, send an email to
> google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/750f10f5-cb89-452e-b410-f9c2d0bc67fe%40googlegroups.com
> 
> .
>
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CALEj8eO_EVcOMFZdimK4ERtoRJABSx4cYLnHv5jYi6JPOtqx9Q%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: Help in mapping my domain to google app engine I mistyped the registrar password

2015-08-31 Thread Steve Lewis
Yes but then I did this for the erlandanderson.com account I did not NEED
to put in the txt record - the txt record was an alternative to verify
after I could not get into godaddy.com I really want to not use the TXT
record - seems to be optional and go back to validating with godaddy as I
did successfully with erland-anderson2.

The REAL issue is that I need to move these because google has deprecated
master-slave storage for the lordjoe and erlandanderson domains forcing me
to copy and rebuild them - I see no way to say OK just use the new storage
not master slave and keep the accounts

On Mon, Aug 31, 2015 at 4:00 PM, Nick (Cloud Platform Support) <
pay...@google.com> wrote:

> Hi Lord Joe,
>
> It appears as though the issue isn't with your username / password for
> GoDaddy, which should be handled properly by GoDaddy in the event of a
> wrong password, but lies in the fact that you haven't put the required TXT
> record on your domain's zone file. You'll notice that a special text token
> is being supplied in the page for you to put in a TXT record on your
> domain's zone file. This allows our servers to check with your domain and
> determine that it's owned by the same person going through the flow on the
> Developers Console side of things.
>
> As an additional note, I think you might be using the subdomain feature
> incorrectly in VerifyLordjoe.png. It looks like you're trying to set up
> www.lordjoe.com.erlandanderson.com as a domain, which doesn't seem right.
> Perhaps this is what you intend, though, in which case disregard this.
>
> Best wishes,
>
> Nick
>
>
> On Saturday, August 29, 2015 at 8:16:51 PM UTC-4, lordjoe wrote:
>>
>> Here are 3 shots
>> several from a successful link of www.erlandAnderson.com to an app
>> engine application
>> several from an unsuccessful link of www.lordjoe.com - the problem is
>> that I signed onto godaddy.com with
>> the wrong password and it NEVER lets me go back and try again
>> Yes I  did request alternate verification but it should NEVER be the case
>> that a user cannot step back and
>> repeat a failed step resetting what seems to be remembered state
>>
>> The ones with lordjoe are the failures the ones with just verify appeared
>> to work
>>
>>
>> On Fri, Aug 28, 2015 at 2:08 PM, Nick (Cloud Platform Support) <
>> pay...@google.com> wrote:
>>
>>> Hi Lord Joe,
>>>
>>> Could you possibly provide some screenshots for context? It's unclear to
>>> me what part of the flow you're referring to.
>>>
>>> Best wishes,
>>>
>>> Nick
>>>
>>> On Thursday, August 27, 2015 at 4:36:56 PM UTC-4, lordjoe wrote:

 Now it does not ask - just goes straight to the registrar and fails -
 how can I reset the domain registrar password so it will as k again (and
 incidentally keep asking until I succeed

 --
>>> You received this message because you are subscribed to a topic in the
>>> Google Groups "Google App Engine" group.
>>> To unsubscribe from this topic, visit
>>> https://groups.google.com/d/topic/google-appengine/CmB9utpH63U/unsubscribe
>>> .
>>> To unsubscribe from this group and all its topics, send an email to
>>> google-appengine+unsubscr...@googlegroups.com.
>>> To post to this group, send email to google-appengine@googlegroups.com.
>>> Visit this group at http://groups.google.com/group/google-appengine.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/google-appengine/d72201c3-890a-4b28-946a-9cfb444c235e%40googlegroups.com
>>> 
>>> .
>>>
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>
>>
>> --
>> Steven M. Lewis PhD
>> 4221 105th Ave NE
>> Kirkland, WA 98033
>> 206-384-1340 (cell)
>> Skype lordjoe_com
>>
>> --
> You received this message because you are subscribed to a topic in the
> Google Groups "Google App Engine" group.
> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/google-appengine/CmB9utpH63U/unsubscribe
> .
> To unsubscribe from this group and all its topics, send an email to
> google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/ba17372a-c2bc-46c3-a14a-de81617e2c3d%40googlegroups.com
> 
> .
>
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to 

[google-appengine] Endpoints work fine in local server, not when deployed

2015-01-31 Thread Steve P


Note: I'll use the terms back end and front end as practical concepts, 
as I don't profess know the subtleties of the definitions. I'm an advanced 
hobbyist programmer, not a professional. I'm using Eclipse Juno for 
development. Minimum Target is Android 2.3.3

I built a android app which I collect data on. I've deployed the android 
app to my phone and it's worked fine for a few years.

I generated an app-engine back end so I could store the data externally, as 
well as request the data from the datastore from time to time. All that 
works fine in the local development app engine environment. 

I built a Google web app separately with which I access the web, google 
tools, etc and generate data which I store in datastore. Couple servlets, 
couple jsp pages. This application works fine. It is deployed to Google App 
Engine. 

Next I wanted to get the data that the web app generated to my phone. After 
researching, experimenting with, and glazing over with Maven, modules, and 
more documentation overload to wade through and not understand, I found 
that if I just copied the endpoints from my originally generated app-engine 
back end to the Google web application, I could communicate with the web 
app from the android app in the local development server environment - 
running the android app on the emulator.

I then deployed the web application updated with the cloud endpoints to 
Google App Engine. The front end works as before.  I've tried to 
communicate with the deployed Web app from the android app running in the 
emulator and get the below error stream in the log.

It looks to me like the android app tries to connect and the app engine 
refuses the connection.

I realize there's not much concrete stuff to look at here, what should I 
post?

Thanks for your time and interest.

Steve

01-31 11:07:30.488: W/System.err(370): at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:581) 
01-31 11:07:30.498: W/System.err(370): at 
java.lang.Thread.run(Thread.java:1019) 01-31 11:07:37.328: 
W/System.err(370): javax.net.ssl.SSLException: Connection closed by peer 
01-31 11:07:37.338: W/System.err(370): at 
org.apache.harmony.xnet.provider.jsse.NativeCrypto.SSL_do_handshake(Native 
Method) 01-31 11:07:37.347: W/System.err(370): at 
org.apache.harmony.xnet.provider.jsse.OpenSSLSocketImpl.startHandshake(OpenSSLSocketImpl.java:474)
 
01-31 11:07:37.347: W/System.err(370): at 
org.apache.harmony.xnet.provider.jsse.OpenSSLSocketImpl.startHandshake(OpenSSLSocketImpl.java:328)
 
01-31 11:07:37.358: W/System.err(370): at 
org.apache.harmony.luni.internal.net.www.protocol.http.HttpConnection.setupSecureSocket(HttpConnection.java:185)
 
01-31 11:07:37.368: W/System.err(370): at 
org.apache.harmony.luni.internal.net.www.protocol.https.HttpsURLConnectionImpl$HttpsEngine.makeSslConnection(HttpsURLConnectionImpl.java:433)
 
01-31 11:07:37.378: W/System.err(370): at 
org.apache.harmony.luni.internal.net.www.protocol.https.HttpsURLConnectionImpl$HttpsEngine.makeConnection(HttpsURLConnectionImpl.java:387)
 
01-31 11:07:37.378: W/System.err(370): at 
org.apache.harmony.luni.internal.net.www.protocol.http.HttpURLConnectionImpl.connect(HttpURLConnectionImpl.java:205)
 
01-31 11:07:37.387: W/System.err(370): at 
org.apache.harmony.luni.internal.net.www.protocol.https.HttpsURLConnectionImpl.connect(HttpsURLConnectionImpl.java:152)
 
01-31 11:07:37.399: W/System.err(370): at 
com.google.api.client.http.javanet.NetHttpRequest.execute(NetHttpRequest.java:93)
 
01-31 11:07:37.399: W/System.err(370): at 
com.google.api.client.http.HttpRequest.execute(HttpRequest.java:965) 01-31 
11:07:37.417: W/System.err(370): at 
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:410)
 
01-31 11:07:37.417: W/System.err(370): at 
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:343)
 
01-31 11:07:37.428: W/System.err(370): at 
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:460)
 
01-31 11:07:37.468: W/System.err(370): at 
com.topcaddiemobile.CourseGAEWebActivity$CheckListTask.doInBackground(CourseGAEWebActivity.java:181)
 
01-31 11:07:37.468: W/System.err(370): at 
com.topcaddiemobile.CourseGAEWebActivity$CheckListTask.doInBackground(CourseGAEWebActivity.java:1)
 
01-31 11:07:37.468: W/System.err(370): at 
android.os.AsyncTask$2.call(AsyncTask.java:185) 01-31 11:07:37.478: 
W/System.err(370): at 
Tags

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https

Re: [google-appengine] Re: Redirect loop on sign-up page

2014-06-07 Thread Steve Vangasse
Hi Takashi,
This thread is pretty old, but I'm experiencing the redirect loop problem 
on my app engine account (I've tried incognito window - everything). Are 
you still able to help? Or do you know who could?

Thanks,

Steve

On Thursday, 6 September 2012 10:03:36 UTC+1, Takashi Matsuo (Google) wrote:

 hi pdknsk,

 I assume you still have a problem. Which e-mail address do you want me to 
 fix?

 -- Takashi


 On Wed, Sep 5, 2012 at 9:17 PM, pdknsk pdk...@gmail.com javascript: 
 wrote:

 http://code.google.com/p/googleappengine/issues/detail?id=5507

 --
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To post to this group, send email to google-a...@googlegroups.com 
 javascript:.
 To unsubscribe from this group, send email to 
 google-appengi...@googlegroups.com javascript:.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.




 -- 
 Takashi Matsuo | Developers Advocate | tma...@google.com javascript:

  

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Zeer veel calls naar

2014-05-31 Thread Steve Geudens


Hi,

Today my application started to create a very high number of calls to 
/_ah/warmuphttps://appengine.google.com/logs?version_id=1.375791635043826645app_id=s%7Ethefriendlywagersfilter_type=labelsfilter=path%3A%22%2F_ah%2Fwarmup%22severity_level_override=1view=Search
 
allthough I have not so many requests to explain it ... This way my 
application created one instance for every request done to my application 
... This caused my quota limit to be reached ... 

When you look at the below log, you can see, requests were done within 
mili-seconds from eachother ...

Does anybody has an idea why this happened ?

Thank you


   1. 
  1. 2014-05-22 05:08:21.841 /_ah/warmup 200 7106ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:21.838 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   2. 
  1.  2014-05-22 05:08:21.780 /_ah/warmup 200 6904ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:21.779 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   3. 
  1.  2014-05-22 05:08:21.481 /_ah/warmup 200 6880ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:21.481 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   4. 
  1.  2014-05-22 05:08:21.287 /_ah/warmup 200 6556ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:21.287 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   5. 
  1.  2014-05-22 05:08:21.052 /_ah/warmup 200 6295ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:21.052 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   6. 
  1.  2014-05-22 05:08:21.038 /_ah/warmup 200 6365ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:21.037 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   7. 
  1.  2014-05-22 05:08:20.997 /_ah/warmup 200 6651ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:20.997 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   8. 
  1.  2014-05-22 05:08:20.936 /_ah/warmup 200 6055ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:20.935 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   9. 
  1.  2014-05-22 05:08:20.745 /_ah/warmup 200 5856ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:20.744 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   10. 
  1.  2014-05-22 05:08:20.701 /_ah/warmup 200 6005ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:20.701 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   11. 
  1.  2014-05-22 05:08:20.686 /_ah/warmup 200 5990ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:20.685 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   12. 
  1.  2014-05-22 05:08:20.675 /_ah/warmup 200 5972ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:20.675 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   13. 
  1.  2014-05-22 05:08:20.615 /_ah/warmup 200 6036ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:20.614 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   14. 
  1.  2014-05-22 05:08:20.487 /_ah/warmup 200 5793ms 0kb module=default 
  version=1 
  2.  I 2014-05-22 05:08:20.487 This request caused a new process to be 
  started for your application, and thus caused your application code to be 
  loaded for the first time. This requ 
   15. 
  1.  2014-05-22 05:08:20.433 /_ah/warmup 200 5811ms 0kb module=default 
  version=1 
  2.  I 

Re: [google-appengine] I need help getting Wordpress running locally under GAE on Windows

2013-09-24 Thread Steve Lewis
I have already tried with tried with
extension=php_mysql.dll
uncommented
and also with both
extension=php_mysqli.dll
and
extension=php_mysql.dll

Neither way works


On Mon, Sep 23, 2013 at 5:41 PM, Vinny P vinny...@gmail.com wrote:

 On Mon, Sep 23, 2013 at 2:02 PM, lordjoe smle...@lordjoe.com wrote:

 OK I am stuck - someone has gotten this running on windows but I see no
 troubleshooting information and am a newbie on PHP and Wordpress



 If you're new to PHP and Wordpress, you can use the WAMP installer:
 http://codex.wordpress.org/Installing_WordPress#WAMP


 On Mon, Sep 23, 2013 at 2:02 PM, lordjoe smle...@lordjoe.com wrote:

  in php,ini in my php installation I uncommented the lines
 extension=php_mysql.dll

 When I run as described and hit localhost:8080 I get Your PHP
 installation appears to be missing the MySQL extension which is required by
 WordPress. extension=php_mysqli.dll



 This error occurs because PHP has deprecated all the mysql_* functions,
 moving instead to mysqli_*


 On Mon, Sep 23, 2013 at 2:02 PM, lordjoe smle...@lordjoe.com wrote:

  in php,ini in my php installation I uncommented the lines
 extension=php_mysql.dll



 You need to uncomment php_mysql*i*.dll (notice the *i* at the end).


 -
 -Vinny P
 Technology  Media Advisor
 Chicago, IL

 App Engine Code Samples: http://www.learntogoogleit.com


  --
 You received this message because you are subscribed to a topic in the
 Google Groups Google App Engine group.
 To unsubscribe from this topic, visit
 https://groups.google.com/d/topic/google-appengine/9cA_S8OZo4s/unsubscribe
 .
 To unsubscribe from this group and all its topics, send an email to
 google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine.
 For more options, visit https://groups.google.com/groups/opt_out.




-- 
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.


Re: [google-appengine] I need help getting Wordpress running locally under GAE on Windows

2013-09-24 Thread Steve Lewis
I meant
extension=php_mysqli.dll alone and

extension=php_mysqli.dll alone
extension=php_mysq i.dll alone together



On Tue, Sep 24, 2013 at 7:37 AM, Steve Lewis lordjoe2...@gmail.com wrote:

 I have already tried with tried with
 extension=php_mysql.dll
 uncommented
 and also with both
 extension=php_mysqli.dll
 and
 extension=php_mysql.dll

 Neither way works


 On Mon, Sep 23, 2013 at 5:41 PM, Vinny P vinny...@gmail.com wrote:

 On Mon, Sep 23, 2013 at 2:02 PM, lordjoe smle...@lordjoe.com wrote:

 OK I am stuck - someone has gotten this running on windows but I see no
 troubleshooting information and am a newbie on PHP and Wordpress



 If you're new to PHP and Wordpress, you can use the WAMP installer:
 http://codex.wordpress.org/Installing_WordPress#WAMP


 On Mon, Sep 23, 2013 at 2:02 PM, lordjoe smle...@lordjoe.com wrote:

  in php,ini in my php installation I uncommented the lines
 extension=php_mysql.dll

 When I run as described and hit localhost:8080 I get Your PHP
 installation appears to be missing the MySQL extension which is required by
 WordPress. extension=php_mysqli.dll



  This error occurs because PHP has deprecated all the mysql_* functions,
 moving instead to mysqli_*


 On Mon, Sep 23, 2013 at 2:02 PM, lordjoe smle...@lordjoe.com wrote:

  in php,ini in my php installation I uncommented the lines
 extension=php_mysql.dll



 You need to uncomment php_mysql*i*.dll (notice the *i* at the end).


 -
 -Vinny P
 Technology  Media Advisor
 Chicago, IL

 App Engine Code Samples: http://www.learntogoogleit.com


  --
 You received this message because you are subscribed to a topic in the
 Google Groups Google App Engine group.
 To unsubscribe from this topic, visit
 https://groups.google.com/d/topic/google-appengine/9cA_S8OZo4s/unsubscribe
 .
 To unsubscribe from this group and all its topics, send an email to
 google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine.
 For more options, visit https://groups.google.com/groups/opt_out.




 --
 Steven M. Lewis PhD
 4221 105th Ave NE
 Kirkland, WA 98033
 206-384-1340 (cell)
 Skype lordjoe_com




-- 
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.


[google-appengine] Re: Google Apps No Longer Free

2012-12-07 Thread Steve Daniels
Hi Thomas,

I don't mean to show disrespect, but if your startup can't afford $50 to 
send email from a Google Apps address, then you've probably got bigger 
issues.

Yours Respectfully,

Steve

On Friday, 7 December 2012 07:11:24 UTC, Thomas Wiradikusuma wrote:

 Hi Greg (of Google),

 I agree of what the other Greg said. It's very common to send 
 transactional emails from a dedicated address (e.g. noreply). It's not 
 professional (and even raise suspicion) if the Click here to reset your 
 password email comes from j...@startupname.com javascript: for example.

 If it's not possible to increase the account from 1 to n, at least please 
 allow the use of alias.


 On Friday, 7 December 2012 10:42:42 UTC+8, Greg wrote:

 Just saw that Google Apps is no longer free for 
 businesseshttp://googleenterprise.blogspot.co.nz/2012/12/changes-to-google-apps-for-businesses.html
 . 

 I have no problem paying for a Google Apps account where I actually use 
 Google apps, but at the moment you have to have a Google Apps account to 
 link a domain to an Appengine app. Some of our apps have two or three 
 domains showing the same app, and because you need to have an account for 
 each email address that Appengine sends email from, we have three or four 
 accounts per domain. So this is potentially going to add $600 per year to 
 our costs - all for virtual accounts that don't actually use Google Apps at 
 all.

 Can someone from Google comment please? Either Google Apps accounts need 
 to remain free if they are associated with Appengine apps, or there needs 
 to be another way to link domains (and authorise email addresses) for 
 Appengine.




-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/5OU0IBLPmCEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Warning: This application is hidden by an alias.

2012-10-05 Thread Steve Viens
I'm seeing this error now too.  Was there ever a fix/resolution?


On Tuesday, February 14, 2012 2:24:35 PM UTC-5, Ikai Lan (Google) wrote:

 Laurentiu,

 Good detective work. Let me try to reproduce this bug and look into it.

 --
 Ikai Lan 
 Developer Programs Engineer, Google App Engine
 plus.ikailan.com



 On Thu, Feb 9, 2012 at 2:05 PM, Laurentiu Florin Moisa 
 florin...@gmail.com javascript: wrote:

 found the bug.

 version should not have . (dots) like 1.0.1 - should be only integer 
 numbers!

 hope it helps!.

 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To view this discussion on the web visit 
 https://groups.google.com/d/msg/google-appengine/-/wTTk2b6B2M0J.

 To post to this group, send email to 
 google-a...@googlegroups.comjavascript:
 .
 To unsubscribe from this group, send email to 
 google-appengi...@googlegroups.com javascript:.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.




-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/KoOgb-LRj0gJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: does bulk upload work of dev webserver with Python 2.7

2012-09-26 Thread steve olechowski
sjh -  you need to add --application=dev~myapp to your command line


On Tuesday, July 3, 2012 10:42:16 AM UTC-5, sjh wrote:

 Hi,

 I am unable to do a bulk upload with Python 2.7 to the dev webserver. I am 
 able to do a bulk upload to the production server. I was able to do this in 
 the past with Python 2.5. My questions:

 1. Does bulk upload work on the dev webserver with Python 2.7?
 2. Is there something else I should be using instead of bulk upload 
 (different datastore, different approach). I notice there is lots of info 
 about changes to the datastore but the information is confusing and out of 
 date and mixed in the online help pages.

 Below is my original post which has the details of the problem I was 
 having. I tried a post but did not get any responses, possibly because the 
 title was confusing so I am trying again. 

 Help much appreciated.

 S.

 -original post

 Hi,

 I wrote an application a while back that did a bulk upload. It worked with 
 dev_appserver and on my domain. Now the dev_appserver crashes when I try 
 and upload a few entries. I remember the dev store was a nightmare because 
 of authentication. You had to first open the location of the remote_api in 
 your browser, put in a username and pw and then it would work. I managed to 
 remember all of that again but I cannot upload the values into the 
 dev_appserver -- it just keeps crashing. Note I am using 64-bit and python 
 2.7 (before I was using 32-bit and python 2.5). Here is the code to upload 
 to the local server:

 appcfg.py upload_data --config_file=spectrum_loader.py 
 --filename=spectrum_data.csv --kind=Spectrum --url=
 http://localhost:8080/theremote_api ./

 and this is the error that comes back from the from the application also 
 running on 8080.

 Uploading data records.
 [INFO] Logging to bulkloader-log-20120701.224621
 [INFO] Throttling transfers:
 [INFO] Bandwidth: 25 bytes/second
 [INFO] HTTP connections: 8/second
 [INFO] Entities inserted/fetched/modified: 20/second
 [INFO] Batch Size: 10
 [INFO] Opening database: bulkloader-progress-20120701.224621.sql3
 Please enter login credentials for localhost
 Email: ju...@appengine.com javascript:
 Password for ju...@appengine.com javascript::
 [INFO] Connecting to localhost:8080/theremote_api
 [INFO] Starting import; maximum 10 entities per post
 [ERROR   ] [WorkerThread-4] WorkerThread:
 Traceback (most recent call last):
   File C:\Program Files 
 (x86)\Google\google_appengine\google\appengine\tools\ad
 aptive_thread_pool.py, line 176, in WorkOnItems
 status, instruction = item.PerformWork(self.__thread_pool)
   File C:\Program Files 
 (x86)\Google\google_appengine\google\appengine\tools\bu
 lkloader.py, line 764, in PerformWork
 transfer_time = self._TransferItem(thread_pool)
   File C:\Program Files 
 (x86)\Google\google_appengine\google\appengine\tools\bu
 lkloader.py, line 935, in _TransferItem
 self.request_manager.PostEntities(self.content)
   File C:\Program Files 
 (x86)\Google\google_appengine\google\appengine\tools\bu
 lkloader.py, line 1420, in PostEntities
 datastore.Put(entities)
   File C:\Program Files 
 (x86)\Google\google_appengine\google\appengine\api\data
 store.py, line 579, in Put
 return PutAsync(entities, **kwargs).get_result()
   File C:\Program Files 
 (x86)\Google\google_appengine\google\appengine\datastor
 e\datastore_rpc.py, line 809, in get_result
 results = self.__rpcs[0].get_result()
   File C:\Program Files 
 (x86)\Google\google_appengine\google\appengine\api\apip
 roxy_stub_map.py, line 604, in get_result
 return self.__get_result_hook(self)
   File C:\Program Files 
 (x86)\Google\google_appengine\google\appengine\datastor
 e\datastore_rpc.py, line 1579, in __put_hook
 self.check_rpc_success(rpc)
   File C:\Program Files 
 (x86)\Google\google_appengine\google\appengine\datastor
 e\datastore_rpc.py, line 1216, in check_rpc_success
 raise _ToDatastoreError(err)
 BadRequestError: app dev~myprog cannot access app myprog's data
 [INFO] [WorkerThread-3] Backing off due to errors: 1.0 seconds
 [INFO] An error occurred. Shutting down...
 [ERROR   ] Error in WorkerThread-4: app dev~myprog cannot access app 
 specl
 ib01's data

 [INFO] 9 entities total, 0 previously transferred
 [INFO] 0 entities (3494 bytes) transferred in 21.4 seconds
 [INFO] Some entities not successfully transferred

 Any ideas would be much appreciated. I could just debug on the domain 
 server but it defeats the purpose of the development server -- very 
 frustrating!

 thanks, sjh


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/6j_M45A9XnIJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.

[google-appengine] Re: How to solve the aggregate query with condition in Google App Engine

2012-08-06 Thread Steve James
I'd say horses for courses on this one.

IMHO the Datastore may not be the best fit to solving your requirement.

Perhaps Cloud SQL or BigQuery might be better suited?

Personally, i've consciously had to decide to make better use of all three; 
rather than hoping that Datastore'll solve all my needs (not saying that's 
necessarily what's happening here tho... don't get me wrong).

Im starting to find the following:-

Datastore's great for object persistence and basic querying

With a bit of live indexing onto Cloud Sql i can achieve the more complex 
searches i need

i copy Log type data into BigQuery for bigdata analytics.

And i guess there's also a legitimate place for the full text search Api too 
(tho i personally haven't used it yet).

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/_QhhWG8HVkAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: What are the pros and cons of using Google App engine for my startup?

2012-08-06 Thread Steve James
Firstly, I've got to agree with all of the the comments made by Andrei 
Volgin... App Engine is an excellent environment for startups and, having 
made a similar decision to yourself a couple of years ago, I couldn't be 
happier with my choice.

However, a word of caution for your specific requirement. The social 
networks rate limit some of their APIs to IP address. Being in App Engine 
means you're sharing your infrastructure (and IP addresses) with millions 
of other projects. This makes it almost impossible to connect to some 
(particularly Twitter) APIs. This might not be a problem if you're OAuthing 
specific users but its definitely worth checking out.

To end on a positive note though... in the past 2 years, our startup 
business has benefited from having an infinitely scalable architecture 
coping with numerous unexpected traffic spikes (up to 40x on occasion), 
with 0% downtime ... all at a cost of $350 a month.

When you look at App Engine alongside its new bed fellows of Cloud SQL, 
Cloud Storage and Big Query... Google's Cloud Platform is frankly looking 
like a top notch choice.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/h4liRDYdi6kJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] Re: What are the pros and cons of using Google App engine for my startup?

2012-08-06 Thread Steve James
Excuse my butting in guys... v interesting debate I tend to veer towards 
the pro app engine side of the argument myself.

However, IMHO, the idea of implementing a decent SOA with different 
subprojects running on different instance environments is one of my own 
personal gripes. I can't quite agree that the use of versions is an adequate 
solution to the problem. If only Google allowed the Datastore to be shared 
across different applications then we'd be cooking with gas (I'd say the same 
for blob store, but cloud storage looks like its stealing it's crown there 
anyway).

There's an issue raised for it which could benefit from a couple more stars if 
you agree :-)

http://code.google.com/p/googleappengine/issues/detail?id=1300can=5colspec=ID%20Type%20Component%20Status%20Stars%20Summary%20Language%20Priority%20Owner%20Log

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/gV3FDeHXezAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Frameworks on GAE

2012-08-06 Thread Steve James
Look likes there's a niche for a new framework.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/9RiGLtk17W4J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Frameworks on GAE

2012-08-06 Thread Steve James
Jeff... regarding your Objectify optimisations... I'd be interested in details 
if you have any to hand please :-)

I've personally made the introspection stage lazy load (moving it to trigger 
inside the getMetadata methods)... it's probably limited in scope to my 
specific needs (I'm not using any polymorphic queries, and I've made 
assumptions that all entities are @cached)... but it does the trick for me and 
reduces startup time significantly on my 60+ entities.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/AwtigY9GOCEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: What to do if you have problems signing up for an App Engine account

2012-07-06 Thread Steve
Is there any way to speed this process up? This is a matter of urgency as 
it's for business purposes and I'm considering ditching app engine in 
favour of AWS EC2 just to avoid these silly set up issues...

On Thursday, April 26, 2012 9:10:10 AM UTC+2, Amy Unruh wrote:

 We often get questions on this list about how to sign up for an App Engine 
 Account in the case where you are not able to receive SMS messages, or if 
 you don't have a mobile phone.  If you have those or similar issues, then 
 as described here:
   https://developers.google.com/appengine/kb/sms#error
 you can fill out a form:
  https://appengine.google.com/waitlist/sms_issues
 which will put you on a list to receive an invitation.  (Note that this 
 list is not processed automatically, so there can sometimes be a few days' 
 delay).

   -Amy


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/NBLCz1l1gJEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Early access to Page Speed Service for Google App Engine

2012-06-10 Thread Steve
The Page Speed Service link on the sign-up page is 404.  The new link 
appears to be:  https://developers.google.com/speed/pagespeed/service



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/EjFYMqj_4e4J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] GAE Python DB change Broke My App!

2012-06-09 Thread Steve
Thanks for the reply Alfred.  Sorry for the delayed response.  I'm only 
able to work on this on the weekend and I spent all last weekend porting to 
a different framework to debug the problem.

TL;DR - Despite crashing more often than not, I could never identify where 
the keyless encoded entities were being created.

My app was last deployed around Thanksgiving 2010 using whatever was the 
then current sdk.  It was created on top of the Kay framework.  When I 
installed the latest SDK (to get this code breaking change), Kay spit out 
errors.  Even after I upgraded to the latest Kay release the dev appserver 
still wouldn't run.  So I couldn't reproduce the problem in 
an environment where I could dig in to the entities causing the crash.

On the production servers, I could track down that the problems were from 
decoding memcache'd entities.  But since you can't browse the memcache 
entries (like the datastore) without knowing specific keys, I couldn't dig 
very deep there either.

Finally I gave up and started porting my app off of Kay and on to the 
latest webob  webapp2 releases that still support python 2.5.  When I was 
able to redeploy on that foundation, the problem disappeared.  I was 
pretty aggravated to have my app crashy for so long and then to lose a 
weekend to porting it, but at least the update has gotten me 75% of the way 
towards getting the app ported to the 2.7 runtime.

Thanks again for the reply with the source link.  If the problem rears it's 
head again I'll be better prepared to know where to look.

Regards,
Steve



On Sunday, June 3, 2012 12:22:39 PM UTC-10, Alfred Fuller wrote:

 Hi Steve,

 We try to avoid backwards incompatible changes as much as possible.

 You will get an expando when the decoded proto does not have a key (as in 
 this case the correct model class cannot be determined, see 
 http://code.google.com/p/googleappengine/source/browse/trunk/python/google/appengine/api/datastore.py#1086).
  
 Are you passing in an empty string to the decode function? Anything that 
 produces an expando should have failed to encode and decode before (with an 
 exception). Do you have a byte string (print '%r' % encoded_proto) you 
 can send me for testing?

 Thanks,

 Alfred

 On Sun, Jun 3, 2012 at 2:30 PM, Steve unetright.thebas...@xoxy.netwrote:

 I'm mistaken.  It's not a problem with Nones.  I still can't figure out 
 why sometimes I'm getting an Exapndo and my app crashes.  My app doesn't 
 use any Expandos.  Google, why u make backwards incompatible change??

 --Steve


 On Saturday, June 2, 2012 5:16:21 PM UTC-10, Steve wrote:

 The problem seems to be that previously I could encode None to a 
 protobuf and get a None back from decoding.  Now instead of None, I get 
 the new default_kind Expando.

 --Steve



 On Saturday, June 2, 2012 2:33:11 PM UTC-10, barryhunter wrote:

 Maybe it would help to actually explain how you are using it - what 
 exactly is broken? 

 Just saying 'its broken' doesnt go very far to explain the issue you 
 facing. Let alone being enough for anyone to figure out a solution 
 that could help you. 


 On Sun, Jun 3, 2012 at 12:48 AM, Steve unetright.thebas...@xoxy.net 
 wrote: 
  Revision 262 comitted on May 22 shows a change to  
  /trunk/python/google/**appengine/ext/db/__init__.py which added a 
  default_kind=Expando inside  model_from_protobuf. This has broken my 
  application for the last couple weeks. The change is not something I 
 can 
  override through exposed parameters. How am I supposed to fix this 
 without 
  significantly rewriting my app? 
  
  -- 
  You received this message because you are subscribed to the Google 
 Groups 
  Google App Engine group. 
  To view this discussion on the web visit 
  https://groups.google.com/d/**msg/google-appengine/-/**bVd8KrYiaxwJhttps://groups.google.com/d/msg/google-appengine/-/bVd8KrYiaxwJ.
   

  To post to this group, send email to google-appengine@googlegroups.**
 com google-appengine@googlegroups.com. 
  To unsubscribe from this group, send email to 
  google-appengine+unsubscribe@**googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com.
   

  For more options, visit this group at 
  http://groups.google.com/**group/google-appengine?hl=enhttp://groups.google.com/group/google-appengine?hl=en.
   


  -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To view this discussion on the web visit 
 https://groups.google.com/d/msg/google-appengine/-/CCbrNcjrfvYJ.

 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.




-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/1

[google-appengine] Datastore Statistics Not Updating

2012-06-09 Thread Steve
*Am I not understanding how this is supposed to work?*

https://lh6.googleusercontent.com/-dYLWx8pxPoc/T9QQbEqZuFI/D-4/BJzqe6_NJVM/s1600/statistics..png

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/c4Hx0bKgECIJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] GAE Python DB change Broke My App!

2012-06-02 Thread Steve
Revision 262 comitted on May 22 shows a change to  
/trunk/python/google/appengine/ext/db/__init__.py 
which added a default_kind=Expando inside  *model_from_protobuf. This has 
broken my application for the last couple weeks. The change is not 
something I can override through exposed parameters. How am I supposed to 
fix this without significantly rewriting my app?*

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/bVd8KrYiaxwJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] GAE Python DB change Broke My App!

2012-06-02 Thread Steve
I'm trying to dig in to what exactly is crashing.  It looks like I'm now 
getting an Expando instance where one is not expected.  I'm not sure what 
was expected in these crash cases.  I haven't looked at this code in 2 
years, so it's taking a lot to re-familiarize myself with what's going on. 
 I didn't expect backward incompatible changes.

--Steve


On Saturday, June 2, 2012 2:33:11 PM UTC-10, barryhunter wrote:

 Maybe it would help to actually explain how you are using it - what 
 exactly is broken? 

 Just saying 'its broken' doesnt go very far to explain the issue you 
 facing. Let alone being enough for anyone to figure out a solution 
 that could help you. 


 On Sun, Jun 3, 2012 at 12:48 AM, Steve unetright.thebas...@xoxy.net 
 wrote: 
  Revision 262 comitted on May 22 shows a change to  
  /trunk/python/google/appengine/ext/db/__init__.py which added a 
  default_kind=Expando inside  model_from_protobuf. This has broken my 
  application for the last couple weeks. The change is not something I can 
  override through exposed parameters. How am I supposed to fix this 
 without 
  significantly rewriting my app? 
  
  -- 
  You received this message because you are subscribed to the Google 
 Groups 
  Google App Engine group. 
  To view this discussion on the web visit 
  https://groups.google.com/d/msg/google-appengine/-/bVd8KrYiaxwJ. 
  To post to this group, send email to google-appengine@googlegroups.com. 
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com. 
  For more options, visit this group at 
  http://groups.google.com/group/google-appengine?hl=en. 


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/m4xUabFCCacJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] GAE Python DB change Broke My App!

2012-06-02 Thread Steve
The problem seems to be that previously I could encode None to a protobuf 
and get a None back from decoding.  Now instead of None, I get the new 
default_kind Expando.

--Steve



On Saturday, June 2, 2012 2:33:11 PM UTC-10, barryhunter wrote:

 Maybe it would help to actually explain how you are using it - what 
 exactly is broken? 

 Just saying 'its broken' doesnt go very far to explain the issue you 
 facing. Let alone being enough for anyone to figure out a solution 
 that could help you. 


 On Sun, Jun 3, 2012 at 12:48 AM, Steve unetright.thebas...@xoxy.net 
 wrote: 
  Revision 262 comitted on May 22 shows a change to  
  /trunk/python/google/appengine/ext/db/__init__.py which added a 
  default_kind=Expando inside  model_from_protobuf. This has broken my 
  application for the last couple weeks. The change is not something I can 
  override through exposed parameters. How am I supposed to fix this 
 without 
  significantly rewriting my app? 
  
  -- 
  You received this message because you are subscribed to the Google 
 Groups 
  Google App Engine group. 
  To view this discussion on the web visit 
  https://groups.google.com/d/msg/google-appengine/-/bVd8KrYiaxwJ. 
  To post to this group, send email to google-appengine@googlegroups.com. 
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com. 
  For more options, visit this group at 
  http://groups.google.com/group/google-appengine?hl=en. 


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/hAZet-Ib2fEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Cron job on backends not run

2012-05-25 Thread Steve Meyfroidt
I had the same. I think there's a timeout while the instance is
started.

I fixed it by scheduling a call to _ah/warmup a minute before the
first real work job. Now I see those warmups always fail, but the real
work gets done, presumably because the instance is up by the time
they're scheduled to run.

Steve


On May 24, 9:28 pm, Will vocalster@gmail.com wrote:
 I have a daily cron job running on backends instance. It has been run
 without problem until the last couple of days. The log shows /_ah/start
 and /_ah/stop have been invoked but not my work url. Yesterday I
 temporary scheduled one more occurrence and it ran properly, but today the
 same thing happened again.

 It is on HDR.

 Any ideas?

 Thanks,

 Will

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] TransientError on Text Search API ?

2012-05-14 Thread Steve Qian
Here is my search query code, currently it works without
'sort_options' in query_options.

sort_opts = search.SortOptions(expressions=[
search.SortExpression(expression='magnitude',
direction=search.SortExpression.DESCENDING, default_value=0)
 ],limit=1000)
query_options = search.QueryOptions(limit=limit,
cursor=cursor, ids_only=True, sort_options=sort_opts)
query_obj = search.Query(query_string=query_string,
options=query_options)
results = search.Index(name=cls._INDEX_NAME).search(query=query_obj)

Here is how I build the search index from a model

doc = search.Document(doc_id=self.key.id(),
fields=[search.TextField(name='text', value=self.text),
search.TextField(name='full_name', value=self.full_name),
search.TextField(name='source', value=self.source),
search.NumberField(name='magnitude', value=self.magnitude),
search.DateField(name='created',
value=self.created.date())])
search.Index(name=self._INDEX_NAME).add(doc)


Steve Qian



On Mon, May 14, 2012 at 8:54 PM, Sun Jing kea...@gmail.com wrote:
 I also got this error sometime if I mixed ascii char and Chinese char (in
 UTF-8 encode).

 On Mon, May 14, 2012 at 4:58 PM, Amy Unruh amyu+gro...@google.com wrote:

 Steve,

 Can you provide more info (e.g. example code) showing how you built the
 query object that you used for the search?

  -Amy

 On 12 May 2012 20:05, Steve Qian steve...@gmail.com wrote:


 I keep getting the following TransientError when doing a search query.

 Anyone experience the same error? Is there a problem with the service?


results = search.Index(name=cls._INDEX_NAME).search(query=query_obj)
   File
 /base/python27_runtime/python27_lib/versions/1/google/appengine/api/search/search.py,
 line 2487, in search
 _CheckStatus(response.status())



   File
 /base/python27_runtime/python27_lib/versions/1/google/appengine/api/search/search.py,
 line 443, in _CheckStatus
 raise _ERROR_MAP[status.code()](status.error_detail())
 TransientError



 Steve

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To view this discussion on the web visit
 https://groups.google.com/d/msg/google-appengine/-/7Yt0VM1sBdAJ.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] TransientError on Text Search API ?

2012-05-12 Thread Steve Qian


I keep getting the following TransientError when doing a search query. 

Anyone experience the same error? Is there a problem with the service?

   results = search.Index(name=cls._INDEX_NAME).search(query=query_obj)
   File 
 /base/python27_runtime/python27_lib/versions/1/google/appengine/api/search/search.py,
  line 2487, in search
 _CheckStatus(response.status())
   File 
 /base/python27_runtime/python27_lib/versions/1/google/appengine/api/search/search.py,
  line 443, in _CheckStatus
 raise _ERROR_MAP[status.code()](status.error_detail())
 TransientError


Steve 

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/7Yt0VM1sBdAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Google App Engine community support is moving to Stack Overflow

2012-02-06 Thread Steve
-1

The best way to accomplish a task in GAE (at least in the python runtime) 
seems to change, often significantly, over time.  I find the groups to be a 
better format for moving targets like GAE and Stack Overflow better for 
more established topics.

--Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Nz8BSKdG0KYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: GAE 1.6 can not import module jinja2

2012-01-16 Thread steve
I installed it locally and I am still unable to import jinja2, it is giving 
me the import jinja2 error every time.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/TB85cNSg1cUJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: [appengine-python] Re: 1.6.0 Prerelease SDKs are out

2011-11-03 Thread Steve Sherrie
I'm seeing incorrect parsing of multipart/form-data request bodies with 
2.7. Is this due to the same issue?

Steven Sherrie

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/OQAeHmIjDg0J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] high replication datastore limited to 1 write per second?!

2011-10-21 Thread Steve Sherrie
This just refers to the entity group write limit that is the same in 
both MS and HR datastores.


On 11-10-21 03:30 PM, Philip wrote:

I am concerned about the statement:

This allows queries on a single guestbook to be strongly consistent,
but also limits changes to the guestbook to * 1 write per second *
(the supported limit for entity groups).
http://code.google.com/appengine/docs/python/datastore/hr/overview.html.

Is it true that writes are limited to 1 per second when using the high
replication datastore or is this an old limitation?



--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] need immidiate help..!!!

2011-10-16 Thread Steve Sherrie
from google.appengine.ext import db instead of from 
google_appengine.ext import db.


Steve


On 11-10-16 03:45 PM, shobhit suman wrote:
I am trying to run my first application in python on google sdk. this 
is a simple datbase with a query statement . but I am getting an 
unexpected error statement of module not found.please help me asap..


--
SHOBHIT SUMAN
B.Tech(II year)
Computer Science Engineering
The LNM Institute of Information Technology
Jaipur, India.
#+91-7742475353

--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] need immidiate help..!!!

2011-10-16 Thread Steve Sherrie
Please include the error and the stacktrace, and we'll be able to help. 
It's a bit much to ask someone to fix your script and give it back to you :)


Steve


On 11-10-16 03:53 PM, shobhit suman wrote:

sir,

I rectified this mistake but still I am getting the same error 
message.It will be kind enough if u cud please please run the code on 
your system for it  might be possibl that my sdk has got sum problm.




On Mon, Oct 17, 2011 at 1:18 AM, Steve Sherrie st...@wasteofpaper.com 
mailto:st...@wasteofpaper.com wrote:


from google.appengine.ext import db instead of from
google_appengine.ext import db.

Steve



On 11-10-16 03:45 PM, shobhit suman wrote:

I am trying to run my first application in python on google sdk.
this is a simple datbase with a query statement . but I am
getting an unexpected error statement of module not found.please
help me asap..

-- 
SHOBHIT SUMAN

B.Tech(II year)
Computer Science Engineering
The LNM Institute of Information Technology
Jaipur, India.
#+91-7742475353

-- 
You received this message because you are subscribed to the

Google Groups Google App Engine group.
To post to this group, send email to
google-appengine@googlegroups.com
mailto:google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
mailto:google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
-- 
You received this message because you are subscribed to the Google

Groups Google App Engine group.
To post to this group, send email to
google-appengine@googlegroups.com
mailto:google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
mailto:google-appengine%2bunsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.




--
SHOBHIT SUMAN
B.Tech(II year)
Computer Science Engineering
The LNM Institute of Information Technology
Jaipur, India.
#+91-7742475353

--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] need immidiate help..!!!

2011-10-16 Thread Steve Sherrie
You corrected it incorrectly :)  from google.appengine.google.ext import 
db should be from google.appengine.ext import db.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Fdn-5-apNtkJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] need immidiate help..!!!

2011-10-16 Thread Steve Sherrie
Hmmm, not sure. That line is definitely right. Which OS are you using? Just 
so we have a better idea of your environment.

Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Fkz-ZitOpgMJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] need immidiate help..!!!

2011-10-16 Thread Steve Sherrie
And can you describe where you put the script (in relation to the 
appengine-sdk) and how you are running the application?


Steve

On 11-10-16 04:35 PM, shobhit suman wrote:


sir

 I am using a virtual machine with ubuntu running ||ly on my windows 7
On Mon, Oct 17, 2011 at 2:03 AM, Steve Sherrie st...@wasteofpaper.com 
mailto:st...@wasteofpaper.com wrote:


Hmmm, not sure. That line is definitely right. Which OS are you
using? Just so we have a better idea of your environment.

Steve
-- 
You received this message because you are subscribed to the Google

Groups Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/Fkz-ZitOpgMJ.

To post to this group, send email to
google-appengine@googlegroups.com
mailto:google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
mailto:google-appengine%2bunsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.




--
SHOBHIT SUMAN
B.Tech(II year)
Computer Science Engineering
The LNM Institute of Information Technology
Jaipur, India.
#+91-7742475353

--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: App Engine SDK 1.5.5 released!

2011-10-12 Thread Steve Sherrie
The 2.7 specific libraries do not seem to be included in the SDK as yet, 
but you can just download them yourself and put them in the root SDK 
directory, which is by default added to sys.path.


Steve

On 11-10-12 03:09 AM, Claudiu Apetrei wrote:

Hello,

Downloaded the 1.5.5.

When i do the python2.7 example I get  type 
'exceptions.ImportError': No module named webapp2 , Shouldn't 
import webapp2 work on 1.5.5 development server (python2.7 
../google_appengine/dev_appserver.py ./).


If I upload it to appengine, the application works.

10x,
Claudiu
--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/4_W1YWkL4KkJ.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Python 2.7 threadsafe: true running on local

2011-10-12 Thread Steve Sherrie
No, it looks like the dev_appserver is not yet capable of using 
'threadsafe: yes'. However, with 'threadsafe: no', and your handler 
setup like 'script: main.py', you *can* dev locally, and then make those 
2 changes before deploying.


I know that doesn't help if you're testing multithreading features, but 
I think we're gonna have to wait 'til 1.5.6, or whenever the 2.7 runtime 
leaves experimental status, before we get that upgrade.



Steve

On 11-10-11 07:02 PM, ivan starkov wrote:

Does anybody could run the base sample for Python 2.7
http://code.google.com/appengine/docs/python/gettingstartedpython27/helloworld.html
on*local machine* with  parameter threadsafe: true in yaml
This sample generate error: Could not find module helloworld.app

the only way this sample works on my computer
is to change this line script:helloworld.app
to this script:helloworld.py.app
and add
def main():
app.run();

if __name__ == __main__:
main()
to helloworld.py

And also what is official way to add webapp2 and jinja2 on local computer
i know two working solutions:
1) Add webapp2 jinja2 dirs to my app folder and exlude them in app.yaml

2) Add this libs to GAPP lib folder and change dev_appserver.py adding 
this lines

os.path.join(DIR_PATH,'lib','jinja2'),
os.path.join(DIR_PATH,'lib','webapp2') to EXTRA_PATHS list

Is any elegant solution to make webapp2 and jinja2 work locally?






--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/qFolbjU1WSIJ.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: How many times did Google Apps Engine went down since it's launch

2011-10-08 Thread Steve Sherrie

Close enough!

On 11-10-08 02:15 PM, Philip wrote:

Joshua, your calculation is wrong. A year has 8760 hours, 0.05% of
that time the service can be down -  8760 * 0.0005 = 4.38 hours of
downtime.

On Oct 8, 7:52 pm, Joshua Smithjoshuaesm...@charter.net  wrote:

Google had a lot of trouble with their original database, known as M/S.  It was 
responsible for the downtime you heard about.

So they invented a new database, known as HR, and it has never gone down since 
they released it.

So if you use HR (which is the default for new projects), history suggests that 
you will not see outages.

But be realistic: Everything goes down. Everything. There is no 100% uptime 
guarantee.  Google is promising 99.95% which means they are OK with 438 hours 
of downtime a year. And that's only a soft promise (like most SLAs, your 
recourse is negligible if you suffer losses because of their failures).

I'm quite sure that GAE on HR has better uptime than I could achieve with 
anything I could build and manage.

On Oct 8, 2011, at 11:42 AM, ahmed adel wrote:








What do you mean by HR?
What I meant is , If I have application hosted in Google Apps Engine ,
will it be affected in the future for example due to data center crash
like what happened before.
We will need this application be available starting from 7 AM to 1 PM
Cairo time. because of this I am asking about the crash time in Google
Apps engine.
I am asking this because my manager wanna be sure our app won't be
available for use. (internal and external).
Also I heard that Google apps engine was down many times and according
to this many companies changed the host from Apps engine to another
PAAS provider.
Another reason for my question is I suggested to develop over Google
Apps Engine for our Customers , but also I told Our management that we
can not trust Google Apps Engine to do this for now , because as you
know and correct me if I am wrong (Google don't care much about Apps
Engine Support)
so my question will be now , can I trust Google Apps engine to use it
for our Clients? in case of yes or no please tell me reasons for your
answer.
On Oct 6, 7:50 pm, Joshua Smithjoshuaesm...@charter.net  wrote:

Depends how you define down.
If you only consider HR, it hasn't gone completely down ever.  Some bugs have 
happened (like losing the ability to send mail to gmail addresses with .'s in 
them) which reduced functionality for HR, and there have been times when you 
could not update your app.  But I don't think HR has ever stopped serving since 
it was introduced.
M/S has been down lots of times, sometimes for extended periods. But that's 
irrelevant if you are using HR, which you should be if you care about downtime.
-Joshua
On Oct 6, 2011, at 1:42 PM, ahmed adel wrote:

I need to know how many time did Google apps engine went down since
launching this service also I need to know for how many hours and what
is the time exactly.
Also I need to know your opinion about the below.
We are planning to develop a product over Google apps  engine , a big
project actually for our company.
so should I start using Google apps engine or should I use another
PAAS and if so what is the recommended PAAS.
thx
--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group 
athttp://groups.google.com/group/google-appengine?hl=en.

--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group 
athttp://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Prerelease SDK 1.5.5 available for download!

2011-10-04 Thread Steve Sherrie
To be clear, this release is intended to work with Python2.7 locally?

If that is the case, I'm seeing this error (works as expected when 
deployed):
*Encountered error loading module main.application: type 
'exceptions.ImportError': Could not find module main.application*
*
*
...where main.application is denoted like this:

*- url: /.**
*  script: main.application*

Anyone else dealing with the same issue?

A note: I also had to manually set *os.environ['APPENGINE_RUNTIME'] = 
'python27' *before importing webapp, otherwise I'd end up with regular 
webapp instead of webapp2.


Any info.., and all that...

Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/F8bCmLZJR_AJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Prerelease SDK 1.5.5 available for download!

2011-10-04 Thread Steve Sherrie
Ikai, is the plan to include the ability to use the 2.7 runtime locally in 
the 1.5.5 final release? or will it have to wait?

Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Vc3Ksw2YJqYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: How to throttle or batch transactional updates to an entity group

2011-09-24 Thread Steve Sherrie
Yeah it's a pretty in depth topic, and I know I've watched the video 
several times over. I hope it works for you :)


Steve


On 11-09-23 07:06 PM, Nikolaj wrote:

Steve, I thought I had gotten everything out of that talk but clearly
I was sleeping in class!

The memcache fork join queue looks very interesting - I'm definitely
giving that a try.

Nikolaj

On Sep 23, 1:00 am, Steve Sherriest...@wasteofpaper.com  wrote:

Definitely checkout Brett Slatkin's Building high-throughput data
pipelines with Google App Engine
http://www.google.com/events/io/2010/sessions/high-throughput-data-pi...
I/O Session which should give you a fundamental understanding of the
caveats involved with batch writing.

You have to do a little work to make sure writes are not added to a
batch that's already applied (or is otherwise invalid), but Brett
explains how to do that with memcache locking.

Steve

On 11-09-22 07:11 PM, Brandon Wirtz wrote:








Start a another datastore that doesn't use the same entity, but uses an
incremental system.
On Write:
In a table with format
Writes to do, Entity to Overwrite, Data for Entity
1,Brandon Wirtz, +$120
2,Brandon Wirtz, -$120
3,Brandon Wirtz, +$0.66
Increment Write to do count, and store transaction.
If a  Read request for the entity comes in:
Get Entity
Get Latest committed Write To Do Value
Check Write Cache
Recalculate Value based on Entity Value and All Changes
On Batch:
For batch size calculate all values, and update entities
Store Late todo value as Last committed write.
You can now batch as often as every 2 seconds and not hit the entity write
limit.
-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Nikolaj
Sent: Thursday, September 22, 2011 3:59 PM
To: Google App Engine
Subject: [google-appengine] How to throttle or batch transactional updates
to an entity group
Hi there,
I'm developing an application that requires me to create lots of child
entities within the same entity group transactionally. The tasks being
generated to do this come in unpredictable bursts - sometimes 100/s for an
entity group. This is clearly exceeding the 1/s limit for transaction
contention and causing some real problems for my poor application.
I need a way to either batch the required updates for each entity group so I
can run through them serially or otherwise schedule each update to run on a
1/s basis. The ideas I've come up with so far:
1. Use some kind of memcache'd timestamp or counter to schedule or throttle
the updates. My question is how to do this in a way that will work with
100's of tasks hungrily looking for their time slot? Should I do a CAS for
when the last task was scheduled (would this even work with the contention
we're talking about?) or can I use an atomic operation like incr() somehow?
2. Store the work items somewhere and then at some later time query for the
work items for an entity group and create the children in serial. I'd like
to avoid this, if possible, as it creates many other headaches. My
application is already using the taskqueue to great effect.
This really seems like a queue problem - if only there was some kind of
dynamic subqueue where I could add tasks with a 'namespace' of the entity
group. Then entity groups could run in parallel, but the entity group items
would still be in serial. Does something like that exist?
Any suggestions or experiences on how I can work around this would be
appreciated.
Many thanks,
Nikolaj
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: calling out the app engine team on ssl for custom domains

2011-09-24 Thread Steve Sherrie
I too wonder about the availability of cloud fare. I'd like to find out 
how it goes for you if you end up using it.


Steve


On 11-09-24 02:48 PM, johnP wrote:

Jeff - thanks for the link to Cloudflare.  It certainly seems like an
interesting option. The risk with implementing them is that it's one
more layer that can fail.  Does anyone else have feedback about how
well it works?Also, does anyone have thoughts on whether the other
benefits of Cloudflare (edge-caching and security layer) is relevant
to Appengine users, is it essentially redundant?





On Sep 23, 2:50 am, Jeff Schnitzerj...@infohazard.org  wrote:

Try this out:

http://blog.cloudflare.com/ssl-on-custom-domains-for-appengine-and-other

When our business is ready to launch, this is our intended plan for
always-SSL for our app.  Cloudflare does edge caching for all content
too - possibly better than Google's (wholly undocumented and not
guaranteed) edge cache.

I hate to plug a solution that I haven't tried yet, but it looks
promising.  Try it out and let me know, or you can wait for my report
towards the end of the year.

Jeff


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: calling out the app engine team on ssl for custom domains

2011-09-24 Thread Steve Sherrie

There ya go then.

Steve

On 11-09-24 03:31 PM, Brandon Wirtz wrote:

You will be most unhappy.  Many of my SEO clients are FORMER cloudflare
users who found out the hard way that when Cloudflare mistakes Google Bot
for a DDoS Attack they get delisted, or when one of Google's Human Quality
validation techs visit the site and get a captcha challenge they get
Delisted.

Cloudflare also has issues that because adult sites often use it, that they
get blocked by large organizations firewall.


-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Steve Sherrie
Sent: Saturday, September 24, 2011 11:51 AM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Re: calling out the app engine team on ssl
for custom domains

I too wonder about the availability of cloud fare. I'd like to find out how
it goes for you if you end up using it.

Steve


On 11-09-24 02:48 PM, johnP wrote:

Jeff - thanks for the link to Cloudflare.  It certainly seems like an
interesting option. The risk with implementing them is that it's one
more layer that can fail.  Does anyone else have feedback about how
well it works?Also, does anyone have thoughts on whether the other
benefits of Cloudflare (edge-caching and security layer) is relevant
to Appengine users, is it essentially redundant?





On Sep 23, 2:50 am, Jeff Schnitzerj...@infohazard.org   wrote:

Try this out:

http://blog.cloudflare.com/ssl-on-custom-domains-for-appengine-and-ot
her

When our business is ready to launch, this is our intended plan for
always-SSL for our app.  Cloudflare does edge caching for all content
too - possibly better than Google's (wholly undocumented and not
guaranteed) edge cache.

I hate to plug a solution that I haven't tried yet, but it looks
promising.  Try it out and let me know, or you can wait for my report
towards the end of the year.

Jeff

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.




--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] How to throttle or batch transactional updates to an entity group

2011-09-22 Thread Steve Sherrie
Definitely checkout Brett Slatkin's Building high-throughput data 
pipelines with Google App Engine 
http://www.google.com/events/io/2010/sessions/high-throughput-data-pipelines-appengine.html 
I/O Session which should give you a fundamental understanding of the 
caveats involved with batch writing.


You have to do a little work to make sure writes are not added to a 
batch that's already applied (or is otherwise invalid), but Brett 
explains how to do that with memcache locking.



Steve



On 11-09-22 07:11 PM, Brandon Wirtz wrote:

Start a another datastore that doesn't use the same entity, but uses an
incremental system.

On Write:
In a table with format
Writes to do, Entity to Overwrite, Data for Entity
1,Brandon Wirtz, +$120
2,Brandon Wirtz, -$120
3,Brandon Wirtz, +$0.66

Increment Write to do count, and store transaction.


If a  Read request for the entity comes in:
Get Entity
Get Latest committed Write To Do Value
Check Write Cache
Recalculate Value based on Entity Value and All Changes

On Batch:
For batch size calculate all values, and update entities
Store Late todo value as Last committed write.

You can now batch as often as every 2 seconds and not hit the entity write
limit.


-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Nikolaj
Sent: Thursday, September 22, 2011 3:59 PM
To: Google App Engine
Subject: [google-appengine] How to throttle or batch transactional updates
to an entity group

Hi there,

I'm developing an application that requires me to create lots of child
entities within the same entity group transactionally. The tasks being
generated to do this come in unpredictable bursts - sometimes 100/s for an
entity group. This is clearly exceeding the 1/s limit for transaction
contention and causing some real problems for my poor application.

I need a way to either batch the required updates for each entity group so I
can run through them serially or otherwise schedule each update to run on a
1/s basis. The ideas I've come up with so far:

1. Use some kind of memcache'd timestamp or counter to schedule or throttle
the updates. My question is how to do this in a way that will work with
100's of tasks hungrily looking for their time slot? Should I do a CAS for
when the last task was scheduled (would this even work with the contention
we're talking about?) or can I use an atomic operation like incr() somehow?

2. Store the work items somewhere and then at some later time query for the
work items for an entity group and create the children in serial. I'd like
to avoid this, if possible, as it creates many other headaches. My
application is already using the taskqueue to great effect.

This really seems like a queue problem - if only there was some kind of
dynamic subqueue where I could add tasks with a 'namespace' of the entity
group. Then entity groups could run in parallel, but the entity group items
would still be in serial. Does something like that exist?

Any suggestions or experiences on how I can work around this would be
appreciated.

Many thanks,

Nikolaj

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.




--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Faster than get_by_key_name

2011-09-20 Thread Steve Sherrie
get_by_key_name first computes a db.Key from the key_name and then 
fetches the entity by that key, so it's already the quickest method. 
There's no practical time cost in the computing of the key.


Steve Sherrie

On 11-09-20 06:16 PM, yamadaag wrote:

Hello.

I often use get_by_key_name to get entities from Datastore.
I'm looking for faster way to get entities, does anyone know?





--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Entity Sizing / Grouping wrt New Pricing

2011-09-16 Thread Steve
I'm looking for some opinions on to what degree I should aggregate my now 
small entities together into larger entities.  Presently I have 50,000 Day 
entities where each entity is represents a day.

They are relatively small with 6 float, 2 bool, 1 int, and 1 string 
property.  No property indexes.  Datastore statistics says they average 161 
bytes of data and 80 bytes of metadata (241b total).

80% of my user requests are GETs in which I read:
70% of the time, 10 day entities
25% of the time, 30 day entities
05% of the time, 365 day entities

20 of my user requests are POSTs in which I read  write:
75% of the time, 1 day entity
15% of the time, 7 day entities
10% of the time, ~15 day entities

Since the new pricing is going to charge me per entity read and per entity 
write (and thankfully no property indexes here), I think I should look at 
reducing how many reads and writes are involved.  I could very easily chunk 
these individual day entities into groups of 10, or groups of 30.  That 
would (by my rough guess on metadata savings) put the entity size around 2k 
or 6k respectively.

I am wondering where the line is between retrieving fewer entities and each 
entity becoming too big because the overhead of unwanted days.  With a 10 
day chunk, my most frequent GET request would usually need 2 entities (4k) 
where only half the data was in the needed range.  At a 30 day chunk, 
usually 1 entity would suffice (6k) but 4k of that would be unwanted 
overhead.

I'm having a hard time getting some internal model for what the impact 
of serializing  deserializing the overhead days would be.  I wish appstats 
wasn't just for RPCs.  I'm guessing the extra time to transfer the larger 
entities to/from the datastore is relatively minimal with Google's network 
infrastructure.  But now that CPU is throttled down to 600Mhz I don't know 
what kind of latencies I'd be adding in with serialization.

Right now my most common POST operation is to put 1 entity of 241b.  With a 
30 day chunk, that would be still a single entity put but 6k in size.

Any opinions, ideas, gut feelings, etc?

Cheers,
Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/6Tk1jzXYZTAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Entity Sizing / Grouping wrt New Pricing

2011-09-16 Thread Steve
Thanks for the input.  If you don't mind me asking, how large were 
your entities when you noticed deserialization taking a long time?

Cheers,
Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/nQsXGqma5YkJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Remote API call: I/O error

2011-09-16 Thread Steve Roy
Hello,

We received several remote API call: I/O errors while call the remote api at 
3:02 AM East Coast last night.  Was there a brief outage or was some 
maintenance occurring?

Thank You,
- steve


com.google.appengine.tools.remoteapi.RemoteApiException: remote API call: 
I/O error

  at 
com.google.appengine.tools.remoteapi.RemoteRpc.makeException(RemoteRpc.java:133)

  at 
com.google.appengine.tools.remoteapi.RemoteRpc.callImpl(RemoteRpc.java:81)

  at 
com.google.appengine.tools.remoteapi.RemoteRpc.call(RemoteRpc.java:40)

  at 
com.google.appengine.tools.remoteapi.RemoteDatastore.runQuery(RemoteDatastore.java:116)

  at 
com.google.appengine.tools.remoteapi.RemoteDatastore.handleRunQuery(RemoteDatastore.java:85)

  at 
com.google.appengine.tools.remoteapi.RemoteDatastore.handleDatastoreCall(RemoteDatastore.java:63)

  at 
com.google.appengine.tools.remoteapi.RemoteApiDelegate.makeSyncCall(RemoteApiDelegate.java:80)

  at 
com.google.appengine.tools.remoteapi.RemoteApiDelegate$1.call(RemoteApiDelegate.java:102)

  at 
com.google.appengine.tools.remoteapi.RemoteApiDelegate$1.call(RemoteApiDelegate.java:98)

  at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)

  at java.util.concurrent.FutureTask.run(FutureTask.java:166)

  at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)

  at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

  at java.lang.Thread.run(Thread.java:679)

Caused by: java.net.ConnectException: Connection refused

  at java.net.PlainSocketImpl.socketConnect(Native Method)

  at 
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)

  at 
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)

  at 
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)

  at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)

  at java.net.Socket.connect(Socket.java:546)

  at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:579)

  at sun.security.ssl.SSLSocketImpl.init(SSLSocketImpl.java:421)

  at 
sun.security.ssl.SSLSocketFactoryImpl.createSocket(SSLSocketFactoryImpl.java:142)

  at 
com.google.appengine.repackaged.org.apache.commons.httpclient.protocol.SSLProtocolSocketFactory.createSocket(Unknown
 
Source)

  at 
com.google.appengine.repackaged.org.apache.commons.httpclient.protocol.SSLProtocolSocketFactory.createSocket(Unknown
 
Source)

  at 
com.google.appengine.repackaged.org.apache.commons.httpclient.HttpConnection.open(Unknown
 
Source)

  at 
com.google.appengine.repackaged.org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown
 
Source)

  at 
com.google.appengine.repackaged.org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown
 
Source)

  at 
com.google.appengine.repackaged.org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown
 
Source)

  at 
com.google.appengine.repackaged.org.apache.commons.httpclient.HttpClient.executeMethod(Unknown
 
Source)

  at 
com.google.appengine.repackaged.org.apache.commons.httpclient.HttpClient.executeMethod(Unknown
 
Source)

  at 
com.google.appengine.tools.remoteapi.AppEngineHttpClient.post(AppEngineHttpClient.java:57)

  at 
com.google.appengine.tools.remoteapi.RemoteRpc.callImpl(RemoteRpc.java:79)

  ... 12 more

 

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/zALx8OG15coJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Entity Sizing / Grouping wrt New Pricing

2011-09-16 Thread Steve
Hi Jeff,

Yes, it's really a concern.  Previously fetching 20 small sequential 
entities cost about the same as fetching 1 large entity 20x the size of the 
small ones.  Now it's costing 10-20x as much because of the per-read (and 
per write for puts) pricing.

I'm already using memcache extensively, but thanks for the suggestion in 
case I wasn't.  It's a big help... assuming google doesn't start charging 
per get/put next year.

I'm not keen on doing extra work either.  But I think now is the time to do 
it.  I'm refactoring a lot of other things to target the new billing 
realities.  Startup times used to be a problem, now it's keeping idle 
instances unnecessarily.  I might as well adjust the entity read/write load 
now while I'm up to my elbows in the code rather than have to come back in a 
year when it's not all fresh in my head.

Cheers,
Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/WlNgjgAJJ20J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Give me my $50 credit back!

2011-09-14 Thread Steve Sherrie

*Better call Saul!*


On 11-09-13 09:13 PM, Carson Welsh wrote:

The deal was: modify your billing settings and you get a $50 credit.

I got the credit, disabled billing and now my credit's gone.

I believe you are contractually obligated to restore my $50 credit: 
you never said anything about whether billing should be kept enabled 
or not.


Don't you guys ever get tired of bait and switch?

Don't you guys get tired of alienating App Engine developers?
--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Happy Programmer Day

2011-09-13 Thread Steve
So slashdot is telling me today is Programmer 
Dayhttp://www.networkworld.com/community/blog/its-programmer-day-best-you-can-do.
 
 Yay for us!  After heavily optimizing my app engine app, I was lucky enough 
to not need to update it for about a year.  Now, with pricing changes coming 
down the line, I'm doing massive refactoring to bring it inline with the new 
regime.  My head is throbbing from all the changes I'm tackling:

   - GAE 1.3.8 - 1.5.4
   - M/S - HR
   - Kay / werkzeug - webapp2
   - memcache sync calls - memcache async
   - db.sync - ndb.async
   - py25 - py27
   - single-threaded - multi-threaded
   - min(CPU) - min(idle time)
   - min(entity size) - min(separate entities)
   - mapreduce w fanout - taskqueues (single instance chain)

Happy Programmer Day!

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/IUBbBopolkAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Unexpected Entity Group transaction contention

2011-09-13 Thread Steve Sherrie
Testing is happening presently for multi-entity-group transactions I 
believe. I saw a thread on it about a week ago.


Steve



On 11-09-13 03:23 PM, Brian Olson wrote:
Re-reading the documentation, this kinda makes sense, but it bit me 
recently so I want to tell the story and see what others think.


I make an entity Parent(). Some time later I make an entity 
Child(parent=some_parent) and I do this in a transaction. I do this a 
bunch, concurrently from task-queue entries.


I was surprised to learn that simply creating a Child in a 
transaction, without otherwise doing anything to the parent, neither 
.get() nor .put(), locks the parent and all its children.


def txn_make_child(some_parent):
  foo = Child(parent=some_parent)
  foo.put()
  # also transactionally enqueue a task to operate on the Child 
instance foo


Code very much like that was failing out due to too many transaction 
retries. I didn't expect /any/ transaction contention, because I 
thought I was just creating an object and enqueueing a task, and those 
were the only two things in the transaction in my head. But it turns 
out the above code locks some_parent and all its children. Boo.


I think I was expecting things like this to lock parent and all its 
children:

def txn_p_c_example(parent_key, child_key):
  parent = db.get(parent_key)
  child = db.get(child_key)
  # now they're clearly both involved, and involving the parent winds 
up locking all the children. I can accept that.

  parent.put()
  child.put()

I was able to re-code it to make Child have no ancestor, but there are 
still times when I would much rather still commit parent and child at 
exactly the same time.

--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/NsvS8Fcq_EwJ.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Missing about 7 hours in Dashboard Charts

2011-09-13 Thread Steve
I also have this issue.

Cheers,
Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/T0kDhL4XpysJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Instance Hours, Python Concurrency, and Regret

2011-09-11 Thread Steve
On Sunday, September 11, 2011 3:27:43 PM UTC-7, Jeff Schnitzer wrote:

 The GIL (old or new) is not a problem for concurrency unless your
 application spends large quantities of time CPU-bound.  As soon as you
 make an I/O request, some other thread will run.  The GIL doesn't
 hurt.

 Jeff


On my GET requests, I/O accounts for roughly half of the time to process the 
request.  When a user POSTs new data, my app does a fair amount of 
recalculations and I/O is only about 20% of the request processing time.  So 
50% of my GETs and 80% of my POSTs would benefit from the improved 
concurrency of the new GIL.

Cheers,
Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/DHKRXZZF3v0J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Instance Hours, Python Concurrency, and Regret

2011-09-11 Thread Steve
The old 2.5/2.7 GIL hurts performance any time there is more than one thread 
that is doing python work.  Maybe you'd like to read up on how the old GIL 
burns cpu time in excess signalling and failed lock acquisition:
http://www.dabeaz.com/python/NewGIL.pdf

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/KKh6yIezaVoJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: The Unofficial Google App Engine Price Change FAQ

2011-09-10 Thread Steve
I would much rather specify a hard limit for number of active instances so 
my app scales up to that point and then degrades progressively. At that 
point the limit is reached, latencies would increase with increasing 
traffic, but if I was smart I would have set the limit so the higher traffic 
would not be able to exhaust my budget because instances stop increasing. 
 So if 30 instances worth of users were hammering my 10 hard limited 
instances, their browser loads would be unpleasant, but the site wouldn't go 
completely offline.

The current reality is that I can only limit idle instances.  As active 
traffic increases, the scheduler can spin up and actually exhaust my budget. 
 So browser latencies would be nicer for a bit, but then suddenly hit a 
brick wall.  After my budget is exhausted, now I've got 30 instances worth 
of users all hammering 1 single remaining instance.  For all intents, my 
site is offline.  In fact, if my budget is exhausted, I think it will go 
completely offline perhaps running 0 instances but definitely not able to do 
datastore operations.

That's not a red herring.  It's legitimately needing a way to limit 
performance scaling so costs stay within a manageable budget.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/K_KO68dzq1UJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Please add MIN idle instances and MAX total instances

2011-09-10 Thread Steve
+1 to MAX_TOTAL_INSTANCES

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/unbQnrwWTmIJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Please add MIN idle instances and MAX total instances

2011-09-10 Thread Steve
Please star Issue 
5858http://code.google.com/p/googleappengine/issues/detail?id=5858 that 
I just opened requesting Max-Instances control.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/9M0dTabYe3QJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Instance Hours, Python Concurrency, and Regret

2011-09-10 Thread Steve
I (and many others I think) have been frustrated with how instance hours 
billing can explode in the face of traffic spikes.  I've submitted Issue 
5858 http://code.google.com/p/googleappengine/issues/detail?id=5858 to 
help us put a hard limit on that scaling out.  Regardless, it is quite clear 
that the only real hope is to implement multi-threaded request handling. 
 Java has that option and the new Pytohn 2.7 runtime is supposed to bring 
that.  Seeing how important concurrent handling is going to be to keeping 
bills reasonable, it's a real shame that the Python's  New-GIL improved 
concurrencyhttp://docs.python.org/dev/py3k/whatsnew/3.2.html#multi-threading 
was 
rejected for Python 2.7 in part to keep encouraging adoption of 3.X.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/qui7GhQvcCcJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Please add MIN idle instances and MAX total instances

2011-09-10 Thread Steve
It's not silly.  When the workload exceeds your budget capacity, being able 
to limit the active instances would allow you to keep operating with 
increased latency.  Not being able to limit the instances means your app 
will scale beautifully right up to the point where your budget is exhausted 
and you app nose dives.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/OywwFtVu6oMJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] If the Scheduler worked right (and it doesn't)...

2011-09-09 Thread Steve Sherrie
It's great to see such a thorough breakdown of a real life request stream. 
It demonstrates the complexity of what might otherwise look like a simple 
task (scheduling efficiently).

About the Python 2.7 testing Will there be more testers accepted in the 
near future? I'm very keen to try it out, but I think I missed the boat for 
the first round.


Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/0u_7J4NE-zEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] No Google, It's Not Us, It's You!

2011-09-09 Thread Steve
Your new pricing scheme blows no matter how reasonable you try to make it 
sound.

https://lh4.googleusercontent.com/-BpLIsfeVN2Y/Tmp0cZ-ca8I/Bg8/KU5R-owDnrA/gaewtf.png

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/fDnpZWr9GhQJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: two questions regarding backends (configuring them and addressing them)

2011-09-09 Thread Steve Sherrie
Also, you can do...
*
*
*appcfg.py update **--backends /your_app*
*
*
*
*
Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/7tFwG2wYt_8J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: two questions regarding backends (configuring them and addressing them)

2011-09-09 Thread Steve Sherrie
Also, you can do...
*
*
*appcfg.py update **--backends your_app*
*
*
*
*
Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/gvpp7TaOlykJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] No Google, It's Not Us, It's You!

2011-09-09 Thread Steve Sherrie
That's funny, cause Google just upped the free instance hours to 28 from 
24, so you'd be about the same, without any optimizations.


Steve

On 11-09-09 04:18 PM, Steve wrote:
Your new pricing scheme blows no matter how reasonable you try to make 
it sound.


https://lh4.googleusercontent.com/-BpLIsfeVN2Y/Tmp0cZ-ca8I/Bg8/KU5R-owDnrA/gaewtf.png


--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/fDnpZWr9GhQJ.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: two questions regarding backends (configuring them and addressing them)

2011-09-09 Thread Steve Sherrie
I'm able to direct tasks to the backends using the *target* arg as in 
your example. And the backend state is 'start' when you're trying this?


Are you directing toward a specific backend instance (/N.backend_name/) 
or just to /backend_name/? I am doing the latter.



Steve


On 11-09-09 05:00 PM, Rishi Arora wrote:
Thanks.  Yes that worked for me.  It just seems that backend 
documentation isn't very intuitive.  I couldn't tell from any of the 
online docs that simply adding a backend to backends.yaml won't 
configure a backend for you.  It won't show up in the backends section 
of the admin console until you execute appcfg.py update backends.


Another non-intuitive behavior - probably only for dynamic backends. 
 The admin console has a start/stop button.  But obviously, if you hit 
start, the dynamic backend won't actually start.  That's clear from 
the documentation.  But, if you hit stop, it almost looks like that 
the backend is made inaccessbile.  It won't process requests, and it 
won't automatically restart on the next request.  You have to hit the 
start button first.  I think for dynamic backends that button should 
read enable/disable.


Now the next thing I'm trying to get to work is sending a backend a 
request from a task queue.  I'm using the default task queue to do 
this, and simply doing this doesn't work (a front-end instance 
processes the taskqueue request):


taskqueue.add(url=[relative path to request handler], method='POST', 
target=[backend name from app.yaml])


Modifying the above statement to specify the entire URL for the 
backend in the target parameter does not help either - the taskqueue 
request is still processed by a front-end instance.  I also tried just 
getting rid of the target parameter, and specifying the entire url 
in the url parameter i.e. 
url='https://backend.appid.appspot.com/path/to/requesthandler'.  And 
even that did not help.  I fear forcing backends to process cron 
entries defined with a full URL like above won't do the trick either.


So is there no way to force a backend to process a request?



On Fri, Sep 9, 2011 at 3:45 PM, Steve Sherrie st...@wasteofpaper.com 
mailto:st...@wasteofpaper.com wrote:


Also, you can do...
*
*
*appcfg.py update **--backends your_app*
*
*
*
*
Steve
-- 
You received this message because you are subscribed to the Google

Groups Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/gvpp7TaOlykJ.

To post to this group, send email to
google-appengine@googlegroups.com
mailto:google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
mailto:google-appengine%2bunsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] No Google, It's Not Us, It's You!

2011-09-09 Thread Steve
Yeah, great.  So when my app farts and uses 3 minutes of CPU time I can look 
forward to just barely blowing past the free quote by a half hour.  Yay...

Original Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/HPOjtpKkzHEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] No Google, It's Not Us, It's You!

2011-09-09 Thread Steve Sherrie
No offense (some offense), but it sounds like your application is wildly 
inefficient. You should crowd source a solution by offering up your code 
for review/improvement.


Steve Sherrie


On 11-09-09 05:11 PM, Steve wrote:
Yeah, great.  So when my app farts and uses 3 minutes of CPU time I 
can look forward to just barely blowing past the free quote by a half 
hour.  Yay...


Original Steve

--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/HPOjtpKkzHEJ.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] If the Scheduler worked right (and it doesn't)...

2011-09-09 Thread Steve
You've got plenty of time Steve.  Google is extending the 
python-instances-cant-multithread discount until the end of the day that 
they might release the 2.7 python to the public.  You'll have a good 12 
hours or so get your app ported to take advantage of multithreading before 
the discount evaporates.

Cheers,
Steve #2

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/GDdoES14ZTcJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] No Google, It's Not Us, It's You!

2011-09-09 Thread Steve
That's probably the exact opposite of the problem.  The problem is that I 
spent tremendous effort optimizing the application based on the previous 
guidelines and best practices.  That's why it's only consuming 3 minutes of 
CPU time.

Oh, and none taken, even if a little implied.  ;)

--Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/v4ki5rY2qG4J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] No Google, It's Not Us, It's You!

2011-09-09 Thread Steve Sherrie
But in all seriousness, you're saying it would be a gargantuan feat to 
improve those figures? 

To get such a extreme difference (3min cpu = 28+ frontend instance hours) 
you're probably heavily relying on synchronous RPCs in some way, and that's 
exactly the kind of thing that can be made substantially more cost-efficient 
under the new billing with relatively little effort. Is this the case?

Stove (I saw bridesmaids yesterday)

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/xNhQScOpLG4J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] No Google, It's Not Us, It's You!

2011-09-09 Thread Steve
Yeah, the question (in my mind) is with the sliders set to maximum latency 
and minimum instances why does the scheduler spin up an extra instance when 
the single instance could do fine on its own?  And was the 
Max-Idle-Instances=0 bug marked WONTFIX?  Just kidding, I already know that 
answer; I just think it's kinda crappy.

--Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/zvsX9KbsDYAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] No Google, It's Not Us, It's You!

2011-09-09 Thread Steve
That is a good idea, thank you.

It's still irritating that after many app refactorings and entity migrations 
to optimize to the previous GAE flaming hoops and best practices now again I 
need to convolute the program with more contortions.  At one time I thought 
one of GAE's best features was its straight-forward APIs and programming 
style.  It's as if the Python runtime didn't have enough bondage and 
discipline so Google had to add it back in somehow.

--Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/AZS6zU6FO_AJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: two questions regarding backends (configuring them and addressing them)

2011-09-09 Thread Steve Sherrie
Oh yeah, I guessed the *--backends* flag on *appcfg.py update *was 
intended as a replacement for running a separate backends update each time.


Steve

On 11-09-09 06:22 PM, Rishi Arora wrote:
Found my problem.  Looks like I must execute that appcfg.py update 
backends command each time I make a code change.  It seems obvious 
now, but of course, it never occurred to me!  I'm all good now, even 
with countdown set to 0, and tasqueue target set to either 
instance.backend_name or just backend_name.


It also might seem silly that I'm making my backend queue up requests 
for itself (in an attempt to break up requests), when in fact it could 
process the whole big request inline in one shot.  But its actually 
common code that might also get executed by a front-end in some 
circumstances.  I should look into a run-time condition that I can use 
to determine whether I'm in the context of a front-end or a backend, 
and queue up requests to myself only for front-end instances.  Do you 
know if there's a way to do that?


Thanks for your help!

Regards
-Rishi


On Fri, Sep 9, 2011 at 4:34 PM, Rishi Arora rishi.ar...@ship-rack.com 
mailto:rishi.ar...@ship-rack.com wrote:


I came across this

(http://code.google.com/appengine/docs/python/taskqueue/overview-push.html#Push_Queues_and_Backends).
 Which suggests that I should be able to use a specific backend
instance.  Not only was the backend started (really, enabled), but
it was up and running too, from serving up a request recently.  In
fact, I'm enqueueing the taskqueue request from the backend itself
(the backend logs prove it too).  I tried your method too (using
just the backend name, and no instance prefix), and that didn't
work either.  The only difference is that I'm not passing any
params parameter in the taskqueue.add() call.  The request is
just meant to be a trigger and does not carry any data.  Perhaps
the app engine scheduler thinks that my backend is busy (cause it
was processing the current request which enqueued the new
taskqueue request), and that causes it to send the request to a
front-end instance.  Maybe I should send the taskqueue rquest with
a countdown set to a comfortable 10 seconds or something.

Here's the snippet from the link above:

Push tasks typically must finish execution within 10 minutes. If
you have push tasks that require more time or computing resources
to process, you can use App Engine Backends to process these tasks
outside of the normal limits of App Engine applications. Backends
are addressable. When you create the push task, all you need to do
is address it to the URL of the backend you wish to process it.
The following code sample demonstrates how to create a push task
addressed to an instance 1 of a backend named backend1:
from google.appengine.api import taskqueue
...
def post(self):
key = self.request.get('key')

# Add the task to the default queue.
taskqueue.add(url='/path/to/my/worker/', params={'key':
key}, target='1.backend1')



On Fri, Sep 9, 2011 at 4:10 PM, Steve Sherrie
st...@wasteofpaper.com mailto:st...@wasteofpaper.com wrote:

I'm able to direct tasks to the backends using the *target*
arg as in your example. And the backend state is 'start' when
you're trying this?

Are you directing toward a specific backend instance
(/N.backend_name/) or just to /backend_name/? I am doing the
latter.


Steve



On 11-09-09 05:00 PM, Rishi Arora wrote:

Thanks.  Yes that worked for me.  It just seems that backend
documentation isn't very intuitive.  I couldn't tell from any
of the online docs that simply adding a backend to
backends.yaml won't configure a backend for you.  It won't
show up in the backends section of the admin console until
you execute appcfg.py update backends.

Another non-intuitive behavior - probably only for dynamic
backends.  The admin console has a start/stop button.  But
obviously, if you hit start, the dynamic backend won't
actually start.  That's clear from the documentation.  But,
if you hit stop, it almost looks like that the backend is
made inaccessbile.  It won't process requests, and it won't
automatically restart on the next request.  You have to hit
the start button first.  I think for dynamic backends that
button should read enable/disable.

Now the next thing I'm trying to get to work is sending a
backend a request from a task queue.  I'm using the default
task queue to do this, and simply doing this doesn't work (a
front-end instance processes the taskqueue request):

taskqueue.add(url=[relative path to request handler],
method='POST', target=[backend name from app.yaml])

Modifying

[google-appengine] Re: A SELECT query that returns 10 rows, twice as expensive as 5 rows?

2011-09-09 Thread Steve
My interpretation of the example is that a Query always uses 1 Read 
Operation. It also uses X Read Operations (or X Small Operations for a 
keys_only query) where X is the number of entities matching the query. 
 Conversely, GETing entities by key does NOT incur the 1 Query Read 
Operation but does charge you for every key fetched even if the 
corresponding entity does not exist.

--Steve

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/P874tDaKvGUJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] The Unofficial Google App Engine Price Change FAQ

2011-09-09 Thread Steve Sherrie
I was thinking the same! Looks lovely but after concentrating on the p 
text, those headings were painfully bright :)


Great job though! Great explanation of everything.


Steve

On 11-09-09 08:33 PM, Ikai Lan (Google) wrote:

Thanks for this, Jeff!

But dude, grey on black?!

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com http://plus.ikailan.com/ | twitter.com/ikai 
http://twitter.com/ikai




On Fri, Sep 9, 2011 at 5:05 PM, Jeff Schnitzer j...@infohazard.org 
mailto:j...@infohazard.org wrote:


Here ya go:


http://blorn.com/post/10013293300/the-unofficial-google-app-engine-price-change-faq

Jeff

--
You received this message because you are subscribed to the Google
Groups Google App Engine group.
To post to this group, send email to
google-appengine@googlegroups.com
mailto:google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
mailto:google-appengine%2bunsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: The Unofficial Google App Engine Price Change FAQ

2011-09-09 Thread Steve
Thanks for the good FAQ.  I have to strenuously disagree though with calling 
all the scheduler complaints a red herring.

It's legitimate complaint and mindbogglingly simple to fix by giving users a 
control called Max-Instances instead of Max-Idle-Instances.  Right now we 
have to play all these stupid tuning games to keep the scheduler from 
fanning things out in unsustainable ways.  If we could just set a hard limit 
we could make sure it never fanned out past a certain level of instance 
parallelism.  It's such a freaking easy thing to fix but Google doesn't want 
to do that for whatever internal reason.

Sigh...

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/9YEEiFuJsRUJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Class Action Lawsuit ?

2011-09-05 Thread Steve Sherrie
'My Cousin Vinnie' is like, my FAVOURITE movie!!1

On Sep 1, 2:31 pm, Will vocalster@gmail.com wrote:
 Well, consider what kind of in-house lawyers they have. Looking into
 the user agreement carefully, I bet you can find pretty much 'we can
 do whatever we like, especially it is a three year long preview
 period'.







 On Thu, Sep 1, 2011 at 11:25 AM, zdravko email.workbe...@gmail.com wrote:
  Plenty of bad faith practices.
  Some monopoly practices.
  Ambulance chasers' dream.

  On Sep 1, 2:20 pm, Angke Chen ang...@gmail.com wrote:
  Can we do it? I mean it was in Preview when it was cheap.

  Angke

  On Thu, Sep 1, 2011 at 11:18 AM, zdravko email.workbe...@gmail.com wrote:
   Why not and especially in America ?

   --
   You received this message because you are subscribed to the Google 
   Groups Google App Engine group.
   To post to this group, send email to google-appengine@googlegroups.com.
   To unsubscribe from this group, send email to 
   google-appengine+unsubscr...@googlegroups.com.
   For more options, visit this group 
   athttp://groups.google.com/group/google-appengine?hl=en.

  --
  You received this message because you are subscribed to the Google Groups 
  Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group 
  athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Google Bot Is Your Enemy

2011-09-05 Thread Steve Sherrie
Joshua,

I just read your post about idle instances, and scheduling, and it
makes a lot of sense. Also given this google bot stuff, I wonder if it
would be useful to have the ability to filter traffic into different
'types', each of which have different scheduling requirements.

Steve

On Sep 3, 4:15 pm, Joshua Smith joshuaesm...@charter.net wrote:
 Is there some way to get google bot requests to go to a dedicated back end?

 On Sep 3, 2011, at 3:35 PM, Brandon Wirtz wrote:







  The biggest Problem I have with the Scheduler/GAE isn’t GAE it is Google 
  Bot.

  Under the new model you are on the hook for 15 minutes of time for an 
  instance that spins up.  Google Bot can’t be throttled on GAE.  If you go 
  in to WebMasters Tools you get a “Your site has been assigned a special 
  crawl rate”.  This was my favorite feature when I was paying for CPU 
  cycles, but now when Google bot shows up and makes upwards of 100k requests 
  in 5 minutes every 6 hours, Google Bot will be accounting for about 85% of 
  the cost of hosting on several of the sites that have less than $50 a month 
  in hosting costs under the current plan, that will be paying about $400 a 
  month to serve requests to Google come November Pricing.

  -Brandon

  --
  You received this message because you are subscribed to the Google Groups 
  Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group 
  athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Some more real-world low-traffic scheduling data -- and a diagnosis

2011-09-05 Thread Steve Sherrie
The dynamic backends are spawned for a minimum of one hour (I believe), 
so the same problem (but worse) will exist in that case.


Steve

On 11-09-02 10:45 PM, Gregory D'alesandre wrote:

Hey Joshua,

This might be crazy, but with free apps you get 9 hours of backends 
per day for free as well.  Could you have the kiosk hit a dynamic 
backend and only users go through the frontends?


Greg

On Fri, Sep 2, 2011 at 12:55 PM, Joshua Smith 
joshuaesm...@charter.net mailto:joshuaesm...@charter.net wrote:


My app gets hit by a kiosk about every 3 minutes, and that chews
up about 1sec of CPU, and kicks off a task that eats another
250ms.  Users come and go now and then.  Today I tried 3 different
settings:

 9am: Max idle = 1, max latency = 1s
9am - 1pm: Max idle = auto, max latency = 1s
1pm - now: Max idle = 1, max latency = 5s



For low-traffic, it appears that max idle = 1 is the same as
auto.  That makes sense.  I'm going to leave it at auto, since
I'd like to be able to handle spikes well.

It looks like when I set the max latency way up, it sometimes lets
the second instance die, but never for very long.

When I've looked at the instances they never seem to have been
alive all that long.  So I think the scheduler is spinning up one,
adding another, letting the first die, adding another, and so on.

Right now I'm in one of those 1 instance troughs.  The site is
quite responsive, while I poke around, and it isn't starting
another instance.  So here in the trough, I'm getting the same
behavior that was reported by the person who tried a hello world
test.  Yet the above graph is what it is.

As I'm writing this, the number of instances just jumped up to 2!
 So now I can see what caused it:

The kiosk hits the URL with an XMLHttp request to make sure it's
alive, and if that works OK, then it refreshes itself.  This bit
of nastiness is there because it's impossible to get a browser to
handle failed page loads 100% consistently well.

When the kiosk hits the URL, a task is launched to do some
background processing recording that the heartbeat happened.   The
two hits therefore lead to two tasks.  I'm using countdown = 1.

These two tasks are bunching up in the queue, and being processed
essentially at the same time.  That requires, you guessed it, two
instances!

I have been thinking of task queues as sort of a background
process, and I certainly wouldn't expect the system to spin up an
instance just to handle a queued task.  But that thinking isn't
really right, since the docs explicitly suggest that spawning a
lot of tasks is a good way to get a bunch of instances to munch
your hard problem in parallel.

So my fix is actually not so hard.  I just need to pass a param
with the just checking initial kiosk request and use that to
avoid spawning the task.  That way I'll get hit-hit-task, not
hit-hit-task-task, and presumably the system won't feel compelling
to crank up a new instance.

If we get two kiosks going and they happen to get synchronized (as
such things tend to do), then I'll be screwed.  But for now, I
think I've got  my fix...

If you're still reading, I'll give you a reward: If you are trying
to diagnose why you have 2 instances when you have the sliders set
to 1/15, go to your log, view with Info and find the requests that
are spinning up a new instance.  Now look at all requests and find
that one that spun up the evil second instance.  Was it right on
the heels of another request?  I bet it was.  Is it your fault?
 (In my case, it certainly was my fault.)  Regardless, if you want
to avoid that second instance, you need to find a way to get those
requests to be farther apart.

-Joshua

-- 
You received this message because you are subscribed to the Google

Groups Google App Engine group.
To post to this group, send email to
google-appengine@googlegroups.com
mailto:google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
mailto:google-appengine%2bunsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.


--
You received this message because you are subscribed to the Google Groups Google 
App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine

[google-appengine] Re: Google Bot Is Your Enemy

2011-09-05 Thread Steve Sherrie
Joshua, can you see my posts? Not sure why I can't post

On Sep 3, 4:15 pm, Joshua Smith joshuaesm...@charter.net wrote:
 Is there some way to get google bot requests to go to a dedicated back end?

 On Sep 3, 2011, at 3:35 PM, Brandon Wirtz wrote:







  The biggest Problem I have with the Scheduler/GAE isn’t GAE it is Google 
  Bot.

  Under the new model you are on the hook for 15 minutes of time for an 
  instance that spins up.  Google Bot can’t be throttled on GAE.  If you go 
  in to WebMasters Tools you get a “Your site has been assigned a special 
  crawl rate”.  This was my favorite feature when I was paying for CPU 
  cycles, but now when Google bot shows up and makes upwards of 100k requests 
  in 5 minutes every 6 hours, Google Bot will be accounting for about 85% of 
  the cost of hosting on several of the sites that have less than $50 a month 
  in hosting costs under the current plan, that will be paying about $400 a 
  month to serve requests to Google come November Pricing.

  -Brandon

  --
  You received this message because you are subscribed to the Google Groups 
  Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group 
  athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: The Amazing Story Of Appengine And The Two Orders Of Magnitude

2011-09-05 Thread Steve Sherrie
I've create this feature request for a way to create scheduler
profiles and then filter traffic into those profiles.
Star it if you think it would be useful.

http://code.google.com/p/googleappengine/issues/detail?id=5775

Steve

On Sep 3, 4:14 pm, Joshua Smith joshuaesm...@charter.net wrote:
 This point is not so simple:

  (and unfortunately may remain
  that way because instance optimization is markedly revenue and profit
  negative for GAE)

 It really is not in google's economic interest to have idle instances 
 running.  More idle instances means more infrastructure cost, and, if you 
 charge for it, more user backlash.  Idle instances are a necessary evil when 
 you want responsive, dynamic scaling.  But technically, you only need as many 
 as it takes to satisfy the simple equation (rate of join * max wait) / 
 startup time.  That is, you need to have enough on hand to handle the 
 incoming requests while you spin up some more.

 The key problem is that for probably all applications, the numerator in that 
 equation is completely different for tasks than it is for users browsing the 
 site.  And it is often different for different kinds of tasks.  (In fact, 
 it's often different for different users/urls/handlers as well, but sometimes 
 too much configurability is a bad thing.)

 The scheduler isn't as complicated as many people seem to believe.  The only 
 real magic in it is the heuristics for computing the three values in that 
 equation when the user sets them to automatic.  The rest is simple trend 
 averaging.

 -Joshua

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Firewall blocks new goog.appengine.Channel(token);

2011-08-19 Thread steve
After a day of combing the web, I couldn't figure out why goog was
undefined in my javascript on a particular client.  Turns out my
customer's firewall blocks Google's talkgadget.google.com which is
where /_ah/channel/jsapi goes to.  I use just about every other
component of appengine and haven't found any other problems through
this firewall.

To solve the problem, I have to check if(goog == undefined) then use
an alternative to Channel.  If anyone else has a better solution, I'm
all ears.  Otherwise, sounds like a production ready app will need to
be prepared for firewall gotcha's when using Channel.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Firewall blocks new goog.appengine.Channel(token);

2011-08-19 Thread steve
Aha!  I starred the issue (see link below).  The first law of posts,
you figure it out immediately following your post.

http://code.google.com/p/googleappengine/issues/detail?id=4764


On Aug 18, 2:47 pm, steve bonham.st...@gmail.com wrote:
 After a day of combing the web, I couldn't figure out why goog was
 undefined in my javascript on a particular client.  Turns out my
 customer's firewall blocks Google's talkgadget.google.com which is
 where /_ah/channel/jsapi goes to.  I use just about every other
 component of appengine and haven't found any other problems through
 this firewall.

 To solve the problem, I have to check if(goog == undefined) then use
 an alternative to Channel.  If anyone else has a better solution, I'm
 all ears.  Otherwise, sounds like a production ready app will need to
 be prepared for firewall gotcha's when using Channel.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [appengine-java] two accounts

2011-06-18 Thread Steve
I like the idea of switching some settings so I can use my original account 
with my new domain.  It seems better than moving my code and data to the new 
account. It is a royal pain switching between two Google accounts and it 
would be nice to have just one.

How do I remove Google Sites and add App Engine specifying my appengine id? 


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/DvYHK377SCUJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



Re: [appengine-java] two accounts

2011-06-18 Thread Steve
Thank you.  I was able to remove the default site and add my app engine id 
to my new domain.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/NYMCCkw6yMkJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] two accounts

2011-06-17 Thread Steve
I created a Google App Engine application and deployed it at appspot.com. 
Then I decided to buy a domain name through Google Apps and use that with 
the site.  I cannot figure out how to use the new domain with the site.  I 
think my problem is that I now have two Google accounts, the original one 
with my appspot application and a new one with my new domain.  Any ideas on 
how to fix this?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/hwPF-2QsW9wJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] reading local log data

2011-05-27 Thread Steve
I'm starting out with App Engine Java and I have the guestbook application 
running on my local system. My question is how do I read/see the local log 
data?  I have read up on logging in this environment and searched for posts 
about it. I expect the log information to go to the terminal when 
dev_appserver.sh is used to start my app but no log info appears.  When I 
run my app from NetBeans 6.9.1, I would expect the log info to appear in one 
of the output windows but again no log info.  How do you see the log info?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] Re: reading local log data

2011-05-27 Thread Steve
I figured out the problem. My logging code was not getting hit because of 
another problem. Once my logging code got hit the output does go to the 
expected places.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] how to override Jetty default servlet

2011-05-27 Thread Steve
I have a Java servlet called Home that is mapped to /index.html.  I also 
have a file called index.html in the web folder. When the url /index.html is 
specified, the static file content is served instead of invoking the Home 
servlet. Jetty behaves this way but Tomcat works the other way and invokes 
the Home servlet.

What is a good way to make Jetty invoke the servlet instead?  I tried 
creating a new servlet mapped to / to override the default static 
servlet without any success.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



  1   2   >