Re: [google-appengine] GAE cluster under high load?

2012-02-01 Thread c h
Robert,

What i observed when it was brought to my attention was that the site had 
problems loading some pages.  it seemed to be isolated to a subset of pages 
on the site - some pages loaded well, some did not load.  a little bit 
after i posted the problem seems to have subsided, but so has traffic on 
the site.  the number of instances and latency seemed normal to me.

the site is the website and online ordering system for a restaurant in NYC. 
 the problem was brought to my attention when the stores reported that they 
had not received any online orders during first hour of the dinner rush 
today, and that concerned them.  that is when i looked into the problem and 
found the error messages in the online ordering part of the site.

does that info help?

thanks!

christian

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/UKqIJVkiEEoJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Report

2012-02-01 Thread Andrin von Rechenberg
this is somehow entertaining. It reminds me of kinder garden,
where one kid embarrassingly fucked up and is now standing in the corner
shouting for mommy/google and
refuses the help of the other kids.
So they start making fun of him.
Lol, how cruel kids are :)

I know my mom always told me not to do that, but it was still funny.
Sorry mom.

Cheers,
My nostalgic ego
On Feb 2, 2012 7:02 AM, "NAG"  wrote:

> No comments, I'm only replying the same way they are talking.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/1UELR21SKWIJ.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] App Engine SDK 1.6.2 is out!

2012-02-01 Thread Robert Kluin
Ouch.

By the way, a faster pattern looks like this:

while there's stuff to delete:
  do a keys only query (using a cursor to continue)
  insert one or more tasks to delete those keys
  insert a task and break from the while to continue if there are still
more to delete (to prevent deadline errors)

You can speed that up further by sharding the key space in the keys only
query, which will yield better parallelism.


Robert


On Thu, Feb 2, 2012 at 01:18, Brandon Wirtz  wrote:

> The version I have goes like this.
>
> ** **
>
> Yourapp.appspot.com/psuedodroptable/Name
>
> ** **
>
> Then the code logic says 
>
> For all batches of maximum size 
>
> delete async
>
> Next batch
>
> ** **
>
> We ran it the person hitting it’s Chrome crashed an hour later (unrelated)
> they came back in the morning Got the “Chrome has crashed would you like
> to restore?” “Yes why note”  and they deleted all the data we had spent
> 18 hours putting in to the system…  well not all the data, since we were
> still loading it, so new data wasn’t deleted cause it wasn’t in the batch
> J
>
> ** **
>
> ** **
>
> ** **
>
> ** **
>
> ** **
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> **
> **
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group *
>
> *
>
> ** **
>
> ** **
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Robert Kluin
> *Sent:* Wednesday, February 01, 2012 10:11 PM
>
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] App Engine SDK 1.6.2 is out!
>
> ** **
>
> WTF, a confirmation?  Coward.
>
>
> I'd also like to see a magic "reset" button, especially one that was fast
> and didn't cost a fortune.  Would sure be nice for testing purposes.
>
>
> Robert
>
> **
> **
>
> On Thu, Feb 2, 2012 at 01:07, Brandon Wirtz  wrote:**
> **
>
> Yeah, we have a something, I don’t like it. I need to password it, and ad
> a confirmation, and a bunch of stuff. Plus, we have a use case where we
> actually want a Flush every things NOW button.  That the SQL version of our
> code does really well. And we can’t quite find an analog for in GQL
>
>  
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> 
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group 
>
>  
>
>  
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Robert Kluin
> *Sent:* Wednesday, February 01, 2012 9:38 PM
>
>
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] App Engine SDK 1.6.2 is out!
>
>  
>
> I wrote a simple task-based script that can delete a few tens of millions
> of entities within a few hours.  So I'd suggest just writing something.
>
>
> Robert
>
>  
>
> ** **
>
> On Thu, Feb 2, 2012 at 00:27, Brandon Wirtz  wrote:**
> **
>
> It can take days.
>
>  
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> 
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group 
>
>  
>
>  
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Timofey Koolin
> *Sent:* Wednesday, February 01, 2012 9:14 PM
>
>
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] App Engine SDK 1.6.2 is out!
>
>  
>
> You can delete all items of any kind from datastore admin.
>
> 2012/2/2 Brandon Wirtz 
>
> I want Drop Table. 
>
>  
>
> Can I restore empty table?
>
>  
>
>  
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom

Re: [google-appengine] Re: Python — App Engine — AttributeError: 'list' object has no attribut 'has_key'

2012-02-01 Thread Robert Kluin
Hey Justin,
  That looks like a bug to me, I'd suggest you file a bug.  I posted
more details in the SO question.

  Note that you could fix this pretty easily in your local SDK.  Check
that entity is something, ie if not entity: return.  Then check if
entity is actually a list.  If it is, you'd need to loop over each
actual entity checking if the high id needs set.


Robert





On Wed, Feb 1, 2012 at 19:03, Justin Papez  wrote:
> The link above for some reason is not working. Here is a working link
> http://stackoverflow.com/questions/9089060/attributeerror-list-object-has-no-attribut-has-key-in-app-engine
>
> On Jan 31, 4:24 pm, Justin Papez  wrote:
>> Hey all,
>>
>> Been having quite a problem with this "AttributeError: 'list' object
>> has no attribut 'has_key'". My question is quite long and already on
>> stackoverflow so I am pasting a link (http://stackoverflow.com/
>> questions/9089060/python-app-engine-attributeerror-list-object-has-no-
>> attribut-has-key) instead of retyping everything all over again.
>> Thanks in advance for help/suggestions/answers!
>
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] file.create() throws an ApiDeadlineExceededException very frequently

2012-02-01 Thread Gaurav Misra
Hi Robert,

Thanks for your quick Response. It was only happening sporadically and and 
in bursts. I am not catching it and will retry a couple of times on failure.

Gaurav

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/ZZgasKQUhBEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] App Engine SDK 1.6.2 is out!

2012-02-01 Thread Robert Kluin
WTF, a confirmation?  Coward.

I'd also like to see a magic "reset" button, especially one that was fast
and didn't cost a fortune.  Would sure be nice for testing purposes.


Robert



On Thu, Feb 2, 2012 at 01:07, Brandon Wirtz  wrote:

> Yeah, we have a something, I don’t like it. I need to password it, and ad
> a confirmation, and a bunch of stuff. Plus, we have a use case where we
> actually want a Flush every things NOW button.  That the SQL version of
> our code does really well. And we can’t quite find an analog for in GQL***
> *
>
> ** **
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> **
> **
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group *
>
> *
>
> ** **
>
> ** **
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Robert Kluin
> *Sent:* Wednesday, February 01, 2012 9:38 PM
>
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] App Engine SDK 1.6.2 is out!
>
> ** **
>
> I wrote a simple task-based script that can delete a few tens of millions
> of entities within a few hours.  So I'd suggest just writing something.
>
>
> Robert
>
> ** **
>
>
> **
> **
>
> On Thu, Feb 2, 2012 at 00:27, Brandon Wirtz  wrote:**
> **
>
> It can take days.
>
>  
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> 
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group 
>
>  
>
>  
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Timofey Koolin
> *Sent:* Wednesday, February 01, 2012 9:14 PM
>
>
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] App Engine SDK 1.6.2 is out!
>
>  
>
> You can delete all items of any kind from datastore admin.
>
> 2012/2/2 Brandon Wirtz 
>
> I want Drop Table. 
>
>  
>
> Can I restore empty table?
>
>  
>
>  
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> 
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group 
>
>  
>
>  
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Chris Collins
> *Sent:* Wednesday, February 01, 2012 6:09 PM
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] App Engine SDK 1.6.2 is out!
>
>  
>
> Namespace backups would be pure awesomeness. Or some way to automate the
> backups. It seems you have to backup each entity manually at the moment?**
> **
>
> On Wed, Feb 1, 2012 at 10:35 AM, WGuerlich  wrote:**
> **
>
> The backup feature is great! But having backups not only by entity kind
> but also by namespace would be uber-awesome. 
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
>
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/yd8HVGZPREsJ.
>
>
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>  
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroup

Re: [google-appengine] file.create() throws an ApiDeadlineExceededException very frequently

2012-02-01 Thread Robert Kluin
Hi Gaurav,
  It is possible that you'll occasionally see services have small
disruptions.  Was it happening on every call, or only a few?  Did it
happen in small bursts or for long periods of time?  If it happens to
a majority of calls for a prolonged period, I'd file a production
issue.

  You might also want to add logic to your code that will retry if a
deadline is hit.


Robert





On Wed, Feb 1, 2012 at 12:13, Gaurav Misra  wrote:
> Hi,
>
> We are seeing this error very very frequently times when calling
> file.createBlobStore API. We are on the 1.6.1 Java SDK. This could cause
> service disruption.
>
> Also we are seeing that once this exception occurs, it happens a few more
> times in succession.
>
> Your help in this matter is greatly appreciated.
>
> Gaurav
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/D9rqPHiiOWgJ.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Report

2012-02-01 Thread NAG
No comments, I'm only replying the same way they are talking.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/1UELR21SKWIJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Report

2012-02-01 Thread Simon Knott
Your definition of "very rude" is over the top, and I'd classify "obviously 
you are not only incompetent byt very loud person" as insulting.

I wish you luck with recovering your ill-spent money, and hope you can find 
the help you are looking for elsewhere.

Cheers,
Simon

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/WngYO4eMUbsJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Report

2012-02-01 Thread Simon Knott
It might help if you took your own advice...

You've posted on a technical support forum and then insulted the very 
people who are offering you the most information, if sometimes in a 
sarcastic and off-the-cuff manner!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/R8A4zv0ThPYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] App Engine SDK 1.6.2 is out!

2012-02-01 Thread Robert Kluin
I wrote a simple task-based script that can delete a few tens of millions
of entities within a few hours.  So I'd suggest just writing something.


Robert




On Thu, Feb 2, 2012 at 00:27, Brandon Wirtz  wrote:

> It can take days.
>
> ** **
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> **
> **
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group *
>
> *
>
> ** **
>
> ** **
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Timofey Koolin
> *Sent:* Wednesday, February 01, 2012 9:14 PM
>
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] App Engine SDK 1.6.2 is out!
>
> ** **
>
> You can delete all items of any kind from datastore admin.
>
> 2012/2/2 Brandon Wirtz 
>
> I want Drop Table. 
>
>  
>
> Can I restore empty table?
>
>  
>
>  
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> 
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group 
>
>  
>
>  
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Chris Collins
> *Sent:* Wednesday, February 01, 2012 6:09 PM
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] App Engine SDK 1.6.2 is out!
>
>  
>
> Namespace backups would be pure awesomeness. Or some way to automate the
> backups. It seems you have to backup each entity manually at the moment?**
> **
>
> On Wed, Feb 1, 2012 at 10:35 AM, WGuerlich  wrote:**
> **
>
> The backup feature is great! But having backups not only by entity kind
> but also by namespace would be uber-awesome. 
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
>
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/yd8HVGZPREsJ.
>
>
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>  
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>
>
> 
>
> ** **
>
> --
> Blog: www.rekby.ru
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

<><>

Re: [google-appengine] Report

2012-02-01 Thread Robert Kluin
You need to take the legal agreement you made with the people you paid
to remove the content that details what they said they would do to an
attorney; they will help you get this all sorted out.  Maybe you can
even sue them to recover the attorney fees.

I was actually trying to make exactly the point that Brandon later
explained pretty clearly.  I hoped my point would be made with humor
-- know what you're getting and have a contract that clearly states
this.  You got duped, learn from it.



Robert




On Thu, Jan 26, 2012 at 06:38, NAG  wrote:
>
> Do you think you are funny. why have did you add this stupit comment?
>
> On Thu, Jan 26, 2012 at 02:16, Robert Kluin  wrote:
> I have some copper plated zinc engravings of Abraham Lincoln for sale
> for the low price of $19.99.
> On Sun, Jan 22, 2012 at 01:30, NAG  wrote:
>> Hi,
>>
>> I have reported a website where the registrant and domain hosting is
>> Google Inc. App Engine - Appspot.com
>>
>> This particular website is publishing unauthorised contents about my
>> business.
>>
>> This contents comes on the first and second page of google when I type
>> my business name.
>>
>> They are asking fees to remove contents. I made the payment via their
>> service section but they are asking for more money to remove all the
>> contents, It is against all applicable laws and Google Inc.
>> regulations.
>
> I have some copper plated zinc engravings of Abraham Lincoln for sale
> for the low price of $19.99.
>
>
>>
>> They still haven’t performed their service. They have offered fake
>> services. IT'S EXTORTION.
>>
>>  I tried many times to resolve the situation with the website owner
>> but they never respond to my request.
>>
>> I have reported the website to Google many times and I still do not
>> understant why Google haven't done any investigation and stay silence
>> regarding this important matter and also it is very dispointing that
>> Google support this kind of website.
>>
>> I have follow every Google steps to remove those contents but when I
>> ask help, Google goes silence. Why??
>>
>> I need Google asistance to remove those contents and invetigate this
>> criminal website.
>>
>> I hope this time I will have someone from Google App Engine to help
>> with this matter.
>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups 
>> "Google App Engine" group.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> To unsubscribe from this group, send email to 
>> google-appengine+unsubscr...@googlegroups.com.
>> For more options, visit this group at 
>> http://groups.google.com/group/google-appengine?hl=en.
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] App Engine SDK 1.6.2 is out!

2012-02-01 Thread Brandon Wirtz
It can take days.
 

Brandon Wirtz 
BlackWaterOps: President / Lead Mercenary 
Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg


Work: 510-992-6548 
Toll Free: 866-400-4536 
IM: drak...@gmail.com (Google Talk) 
Skype: drakegreene 
YouTube:   BlackWaterOpsDotCom 


  BlackWater Ops 

  Cloud On A String Mastermind Group



 
 
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Timofey Koolin
Sent: Wednesday, February 01, 2012 9:14 PM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] App Engine SDK 1.6.2 is out!
 
You can delete all items of any kind from datastore admin.
2012/2/2 Brandon Wirtz 
I want Drop Table. 
 
Can I restore empty table?
 
 

Brandon Wirtz 
BlackWaterOps: President / Lead Mercenary 
Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg


Work: 510-992-6548 
Toll Free: 866-400-4536 
IM: drak...@gmail.com (Google Talk) 
Skype: drakegreene 
YouTube:   BlackWaterOpsDotCom 
  BlackWater Ops 

  Cloud On A String Mastermind Group

 
 
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Chris Collins
Sent: Wednesday, February 01, 2012 6:09 PM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] App Engine SDK 1.6.2 is out!
 
Namespace backups would be pure awesomeness. Or some way to automate the
backups. It seems you have to backup each entity manually at the moment?
On Wed, Feb 1, 2012 at 10:35 AM, WGuerlich  wrote:
The backup feature is great! But having backups not only by entity kind but
also by namespace would be uber-awesome. 
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/yd8HVGZPREsJ.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
 .
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
 
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
 .
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.



 
-- 
Blog: www.rekby.ru
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

<><>

Re: [google-appengine] Re: Report

2012-02-01 Thread NAG
If can't help why you are replying, stay away.
 
As I said my comment was related to Google team to you.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/23Hwu2WAYOgJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Report

2012-02-01 Thread NAG
Go away Brandon, obviously you are not only incompetent byt very loud 
person. Your comments are so low and stupid that I won't even take it 
personal because I've got better things to do that to reply to your insult.
 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/wLd6k-D-g30J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Is App Engine suitable for write intensive applications?

2012-02-01 Thread Robert Kluin
So I'd say don't worry about it unless you actually hit this problem.
If you do know you'll hit it, see if you have a way to "shard" the
timestamp, by account, user, or region, etc..., to relieve some of the
pressure.  If you must have a global timestamp, I'd say keep it as
simple as possible, until you hit the issue.  At that point you can
figure out a fix.

When I have timestamps on high write-rate entities that are
non-critical, for example "expiration" times that are used only for
cleanup, I'll sometimes add a random jitter of several hours to spread
the writes out a bit.  I'd be surprised if changing it by a few
seconds helped much -- but it could.  Keep in mind, there will already
be some degree of randomness since the instance clocks have some
slight variation.  If you're hitting this issue, I'd give it a shot
though.  If it works it could at least buy you some time to get a
better fix.

I don't think there is a fixed number of rows per shard.  I think it
is split up by data size, and I don't think the exact number is
publicly documented.  Maybe you can roughly figure it out via
experimentation.


Robert


On Wed, Feb 1, 2012 at 02:28, WGuerlich  wrote:
> I know, I'm going to hit the write limit with a timestamp I need to update
> on every write and which needs to be indexed.
>
> As an alternative to sharding: What do you think about adding time jitter to
> the timestamp, that is, changing time randomly by a couple seconds? In my
> application the timestamp being off by a couple senconds wouldn't pose a
> problem.
>
> Now what I need to know is: How many index entries can I expect to go into
> one tablet? This is needed to estimate the amount of jitter necessary to
> avoid hitting the same tablet on every write.
>
> Any insights on this?
>
> Wolfram
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/r0SVTq6i4iEJ.
>
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Report

2012-02-01 Thread Jeff Schnitzer
Mr. Nag:

Stop now.  Nobody here can help you.  And thanks to your attitude, we
wouldn't even if we could.  All you have done here is convince a large
audience that you have absolutely no idea how the internet works.
Take your legal issues to a forum where someone actually gives a damn.

Jeff

On Wed, Feb 1, 2012 at 10:13 PM, NAG  wrote:
> The only one who's rude in this forum it's you Brandon
>
> I posted those comments to Google App Engine Team not to you Brandon so stop
> posting ? comments, relating to these mater.
>
> I was very patient with Google as I've already sent months ago all documents
> (emails + hard copy) to Google DNS and of course, still no reply.
>
> and yes I'm very concern - why Google still host such criminal website.
>
> Yes, I came to this forum to talk about Google App Engine Hosting issues and
> have someone from Google Team to talk to. Not you.
>
>
>
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/rkqT7plKhssJ.
>
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] App Engine SDK 1.6.2 is out!

2012-02-01 Thread Timofey Koolin
You can delete all items of any kind from datastore admin.

2012/2/2 Brandon Wirtz 

> I want Drop Table. 
>
> ** **
>
> Can I restore empty table?
>
> ** **
>
> ** **
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> **
> **
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group *
>
> *
>
> ** **
>
> ** **
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Chris Collins
> *Sent:* Wednesday, February 01, 2012 6:09 PM
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] App Engine SDK 1.6.2 is out!
>
> ** **
>
> Namespace backups would be pure awesomeness. Or some way to automate the
> backups. It seems you have to backup each entity manually at the moment?**
> **
>
> On Wed, Feb 1, 2012 at 10:35 AM, WGuerlich  wrote:**
> **
>
> The backup feature is great! But having backups not only by entity kind
> but also by namespace would be uber-awesome. 
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
>
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/yd8HVGZPREsJ.
>
>
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
> ** **
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>



-- 
Blog: www.rekby.ru

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

<>

Re: [google-appengine] 800 MB Datastorage for 11 entities.

2012-02-01 Thread Timofey Koolin
http://code.google.com/p/googleappengine/issues/detail?id=6849

2012/2/2 Robert Kluin 

> Hi Timofey,
>  I've seen a number of other people reporting sudden increases in
> reported stored data.  You might submit a production issue.  If you
> do, post back with the issue number.  I'd like to see what Google says
> about this.
>
>
> Robert
>
>
>
> On Wed, Feb 1, 2012 at 11:29, Timofey Koolin  wrote:
> > No - I delete all blobs with other data.
> > I have no blob objects, but quota detail show 0.02Gb usage.
> >
> > Last days I don't use tasks.
> >
> > 2012/2/1 Robert Kluin 
> >>
> >> Hi Timofey,
> >>  Do you have any blobs?  Do you make heavy usage of tasks?
> >>
> >>  There can be a delay after deleting data and the space actually
> >> being freed up, since the datastore does "soft" deletes.  However, I
> >> don't remember ever seeing this take 3 days.
> >>
> >>
> >> Robert
> >>
> >>
> >>
> >>
> >> On Wed, Feb 1, 2012 at 04:03, Timofey Koolin  wrote:
> >> > Now I store in datastore:
> >> > 1 Email - 5KB
> >> > 9 User - 2KB
> >> > 1  _AE_DatastoreAdmin_Operation - 300 Bytes
> >> >
> >> > BUT
> >> > summary statistic:
> >> > Total number of entities: 289,951
> >> > Total size: 227MB
> >> >
> >> > In quota details: 0.83GB
> >> >
> >> >
> >> > It is application in development state.
> >> > I have about 1-2 mounth active write-delete entities. In result I add
> to
> >> > storage about 1500 entities per day.
> >> >
> >> > Some days ago I delete all of this and ways 2-3 days for reset quota
> 2-3
> >> > times.
> >> > Now I have 11 entities in my storage and giant overhead.
> >> >
> >> > Why space don't freed in my storage after I delete my data?
> >> >
> >> >
> >> > I attach summary screenshots and quota detail row.
> >> >
> >> > --
> >> > Blog: www.rekby.ru
> >> >
> >> > --
> >> > You received this message because you are subscribed to the Google
> >> > Groups
> >> > "Google App Engine" group.
> >> > To post to this group, send email to
> google-appengine@googlegroups.com.
> >> > To unsubscribe from this group, send email to
> >> > google-appengine+unsubscr...@googlegroups.com.
> >> > For more options, visit this group at
> >> > http://groups.google.com/group/google-appengine?hl=en.
> >>
> >> --
> >> You received this message because you are subscribed to the Google
> Groups
> >> "Google App Engine" group.
> >> To post to this group, send email to google-appengine@googlegroups.com.
> >> To unsubscribe from this group, send email to
> >> google-appengine+unsubscr...@googlegroups.com.
> >> For more options, visit this group at
> >> http://groups.google.com/group/google-appengine?hl=en.
> >>
> >
> >
> >
> > --
> > Blog: www.rekby.ru
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Blog: www.rekby.ru

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] GAE cluster under high load?

2012-02-01 Thread Robert Kluin
Hi Christian,
  Are/were you seeing small bursts of those or seeing a solid stream
for a prolonged period?  Are you still seeing them?  Did you notice
anything strange about the number of instances?


Robert






On Wed, Feb 1, 2012 at 18:03, c h  wrote:
> Hello,
>
> I just started getting lots of these errors this afternoon on one of my
> apps:
>
> "Request was aborted after waiting too long to attempt to service your
> request. This may happen sporadically when the App Engine serving cluster is
> under unexpectedly high or uneven load. If you see this message frequently,
> please contact the App Engine team."
>
> i have not seen that before, and have not changed my app code in over a
> week. any ideas what might be going on? did something change with the 1.6.2
> upgrade that i need to account for in my code?
>
> thanks,
>
> christian
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/oUr3fUxx9K4J.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: (mostly) Consistent 20-second delay in starting backend tasks

2012-02-01 Thread Robert Kluin
Hey Dave,
  Hopefully Nick will be able to offer some insight into the cause of
your issues.  I'd guess it is something related to having very few
tasks (one) in the queue, and it not getting scheduled rapidly.

  In your case, you could use pull queues to immediately fetch the
next task when finished with a task.  Or even to fetch multiple tasks
and do the work in parallel.  Basically you'd have a backend that ran
a loop (possibly initiated via a push task) that would lease a task,
or tasks, from the pull queue, do the work, delete those tasks, then
repeat from the lease stage.  The cool thing is that if you're, for
example, using URL Fetch to pull data  this might let you do it in
parallel without increasing your costs much (if any).

Robert




On Wed, Feb 1, 2012 at 14:25, Dave Loomer  wrote:
> Here are logs from three consecutive task executions over the past weekend,
> with only identifying information removed. You'll see that each task
> completes in a few milliseconds, but are 20 seconds apart (remember: I've
> already checked my queue configurations, nothing else is running on this
> backend, and I later solved the problem by setting countdown=1 when adding
> the task).  I don't see any pending latency mentioned.
>
> 0.1.0.2 - - [27/Jan/2012:18:33:20 -0800] 200 124 ms=10 cpu_ms=47
> api_cpu_ms=0 cpm_usd=0.60 queue_name=overnight-tasks
> task_name=15804554889304913211 instance=0
> 0.1.0.2 - - [27/Jan/2012:18:33:00 -0800] 200 124 ms=11 cpu_ms=0 api_cpu_ms=0
> cpm_usd=0.60 queue_name=overnight-tasks task_name=15804554889304912461
> instance=0
> 0.1.0.2 - - [27/Jan/2012:18:32:41 -0800] 200 124 ms=26 cpu_ms=0 api_cpu_ms=0
> cpm_usd=0.60 queue_name=overnight-tasks task_name=4499136807998063691
> instance=0
>
>
> The 20 seconds seems to happen regardless of length of task. Even though my
> tasks mostly complete in a couple minutes, I do have cases where they take
> several minutes, and I don't see a difference. Of course, when a task takes
> 5-10 minutes to complete, I'm going to notice and care about a 20-second
> delay much less than when I'm trying to spin through a few tasks in a minute
> (which is a real-world need for me as well).
>
> When reading up on pull queues a while back, I was a little confused about
> where I would use them with my own backends. I definitely could see an
> application for offloading work to an AWS Linux instance. But in either
> case, could you explain why it might help?
>
> I saw you mention in a separate thread how M/S can perform differently from
> HRD even in cases where one wouldn't expect to see a difference. When I get
> around to it I'm going to create a tiny HRD app and run the same tests
> through that.
>
> I also wonder if M/S could be responsible for frequent latencies in my admin
> console. Those have gotten more frequent and annoying the past couple of
> months ...
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/lbNQRQdSx0AJ.
>
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Funny spikes in graphs

2012-02-01 Thread Robert Kluin
Not really.  Instances would immediately spin back up after getting
killed.  It was like a nasty cycle.  Take a look at your instance
list.  In my case I'd see very large groups with similar ages, for
instance 50 instances that were 5 minutes old, and maybe 15 that were
10 minutes old type of thing.  In some cases every instance was killed
and restarted.



Robert




On Wed, Feb 1, 2012 at 14:53, Andrin von Rechenberg  wrote:
> Interesting. Everything was looking fine in prodeagle,
> but there is only so much I can monitor...
>
> Did you ever figure out the cause for this?
>
> Cheers,
> -Andrin
>
>
> On Wed, Feb 1, 2012 at 5:08 PM, Robert Kluin  wrote:
>>
>> Hey Andrin,
>>  Do you know what your instances were doing when that was happening?
>> I've had issues on a few apps in the past where my instances all got
>> killed and respawned every 5 to 15 minutes.  I haven't seen that for a
>> couple months though.
>>
>>
>> Robert
>>
>>
>> On Wed, Feb 1, 2012 at 03:19, Andrin von Rechenberg 
>> wrote:
>> > No I dont have that or other timed requests.
>> > I'm pretty certain this problem is on Googles side
>> > because RAM consumption also oscillates like this.
>> > From 0 to max and back, and thats really almost
>> > impossible.
>> >
>> > Ooohhh, I just noticed that they fixed it, thank you Google :)
>> >
>> > Cheers,
>> > -Andrin
>> >
>> >
>> > On Wed, Feb 1, 2012 at 7:50 AM, Robert Kluin 
>> > wrote:
>> >>
>> >> By "reason" I meant such as an AJAX app controlling when requests are
>> >> made, etc
>> >>
>> >>
>> >>
>> >> On Wed, Feb 1, 2012 at 01:49, Robert Kluin 
>> >> wrote:
>> >> > Is there a reason your trafic would be bursty? I've seen strange
>> >> > patterns like that when there are scheduled jobs, but never from
>> >> > browser-based user traffic alone.
>> >> >
>> >> >
>> >> > Robert
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > On Tue, Jan 31, 2012 at 15:59, Andrin von Rechenberg
>> >> >  wrote:
>> >> >> I'm doing 250 queries per second. ProdEagle one per minute. Its not
>> >> >> from
>> >> >> that...
>> >> >>
>> >> >> :)
>> >> >>
>> >> >> On Jan 31, 2012 4:58 PM, "bFlood" 
>> >> >> wrote:
>> >> >>>
>> >> >>> maybe it's ProdEagle itself, that hits your app every minute
>> >> >>>
>> >> >>>
>> >> >>>
>> >> >>> On Jan 31, 10:16 am, Mike Wesner 
>> >> >>> wrote:
>> >> >>> > Have you looked at the logs to see what/who is making the
>> >> >>> > requests?
>> >> >>> > It could be some type of polling or service that is making
>> >> >>> > requests
>> >> >>> > at
>> >> >>> > those intervals.
>> >> >>> >
>> >> >>> > -Mike
>> >> >>> >
>> >> >>> > On Jan 31, 8:40 am, Andrin von Rechenberg 
>> >> >>> > wrote:
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > > Hey there
>> >> >>> >
>> >> >>> > > My dashboard shows funny spikes in all graphs (qps, bandwidth,
>> >> >>> > > ram).
>> >> >>> > > It's been doing this for a couple of days now. ProdEagle shows
>> >> >>> > > everything
>> >> >>> > > is fine, so I guess something must be messed up on Google's
>> >> >>> > > side...
>> >> >>> >
>> >> >>> > > Anyone else seeing this?
>> >> >>> >
>> >> >>> > > Cheers,
>> >> >>> > > -Andrin
>> >> >>> >
>> >> >>> > >  Screen shot 2012-01-31 at 3.38.39 PM.png
>> >> >>> > > 56KViewDownload
>> >> >>>
>> >> >>> --
>> >> >>> You received this message because you are subscribed to the Google
>> >> >>> Groups
>> >> >>> "Google App Engine" group.
>> >> >>> To post to this group, send email to
>> >> >>> google-appengine@googlegroups.com.
>> >> >>> To unsubscribe from this group, send email to
>> >> >>> google-appengine+unsubscr...@googlegroups.com.
>> >> >>> For more options, visit this group at
>> >> >>> http://groups.google.com/group/google-appengine?hl=en.
>> >> >>>
>> >> >> --
>> >> >> You received this message because you are subscribed to the Google
>> >> >> Groups
>> >> >> "Google App Engine" group.
>> >> >> To post to this group, send email to
>> >> >> google-appengine@googlegroups.com.
>> >> >> To unsubscribe from this group, send email to
>> >> >> google-appengine+unsubscr...@googlegroups.com.
>> >> >> For more options, visit this group at
>> >> >> http://groups.google.com/group/google-appengine?hl=en.
>> >>
>> >> --
>> >> You received this message because you are subscribed to the Google
>> >> Groups
>> >> "Google App Engine" group.
>> >> To post to this group, send email to google-appengine@googlegroups.com.
>> >> To unsubscribe from this group, send email to
>> >> google-appengine+unsubscr...@googlegroups.com.
>> >> For more options, visit this group at
>> >> http://groups.google.com/group/google-appengine?hl=en.
>> >>
>> >
>> > --
>> > You received this message because you are subscribed to the Google
>> > Groups
>> > "Google App Engine" group.
>> > To post to this group, send email to google-appengine@googlegroups.com.
>> > To unsubscribe from this group, send email to
>> > google-appengine+unsubscr...@googlegroups.com.
>> > For more options, visit this group at
>> > http://groups.g

Re: [google-appengine] Using associated domain for appengine apps

2012-02-01 Thread Robert Kluin
Hi Klaas,
  Yes, it is quite possible.
http://code.google.com/appengine/docs/domain.html

  I prefer to do it from the Google Apps Dashboard.  Goto Add
Services, select App Engine, then enter your appid.


Robert



On Wed, Feb 1, 2012 at 11:35, Klaas Pieter Annema  wrote:
> Is it possible to use an associated google apps domain for an app engine
> application?
> After adding the domain under Domain Settings in the Google Apps dashboard I
> can't choose it in the Add new URL drop down menu in the settings for the
> app engine application.
>
> - Klaas Pieter
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] 800 MB Datastorage for 11 entities.

2012-02-01 Thread Robert Kluin
Hi Timofey,
  I've seen a number of other people reporting sudden increases in
reported stored data.  You might submit a production issue.  If you
do, post back with the issue number.  I'd like to see what Google says
about this.


Robert



On Wed, Feb 1, 2012 at 11:29, Timofey Koolin  wrote:
> No - I delete all blobs with other data.
> I have no blob objects, but quota detail show 0.02Gb usage.
>
> Last days I don't use tasks.
>
> 2012/2/1 Robert Kluin 
>>
>> Hi Timofey,
>>  Do you have any blobs?  Do you make heavy usage of tasks?
>>
>>  There can be a delay after deleting data and the space actually
>> being freed up, since the datastore does "soft" deletes.  However, I
>> don't remember ever seeing this take 3 days.
>>
>>
>> Robert
>>
>>
>>
>>
>> On Wed, Feb 1, 2012 at 04:03, Timofey Koolin  wrote:
>> > Now I store in datastore:
>> > 1 Email - 5KB
>> > 9 User - 2KB
>> > 1  _AE_DatastoreAdmin_Operation - 300 Bytes
>> >
>> > BUT
>> > summary statistic:
>> > Total number of entities: 289,951
>> > Total size: 227MB
>> >
>> > In quota details: 0.83GB
>> >
>> >
>> > It is application in development state.
>> > I have about 1-2 mounth active write-delete entities. In result I add to
>> > storage about 1500 entities per day.
>> >
>> > Some days ago I delete all of this and ways 2-3 days for reset quota 2-3
>> > times.
>> > Now I have 11 entities in my storage and giant overhead.
>> >
>> > Why space don't freed in my storage after I delete my data?
>> >
>> >
>> > I attach summary screenshots and quota detail row.
>> >
>> > --
>> > Blog: www.rekby.ru
>> >
>> > --
>> > You received this message because you are subscribed to the Google
>> > Groups
>> > "Google App Engine" group.
>> > To post to this group, send email to google-appengine@googlegroups.com.
>> > To unsubscribe from this group, send email to
>> > google-appengine+unsubscr...@googlegroups.com.
>> > For more options, visit this group at
>> > http://groups.google.com/group/google-appengine?hl=en.
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> To unsubscribe from this group, send email to
>> google-appengine+unsubscr...@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/google-appengine?hl=en.
>>
>
>
>
> --
> Blog: www.rekby.ru
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Saving Datastore Read

2012-02-01 Thread Leandro Rezende
im replacing "GetObjectByID" with "returnmemcache"

i did a simple fuction like this

public Object returnmemcache(Class class,Key key)
{
 Cache cache = null;
 Object returntemp = null;
 try {
CacheFactory cacheFactory =
CacheManager.getInstance().getCacheFactory();
cache = cacheFactory.createCache(Collections.emptyMap());
returntemp = cache.get(key);
if (returntemp==null)
  {
  PersistenceManager pm = PMF.get().getPersistenceManager();
  returntemp=pm.getObjectById(class,key);
  cache.put(key, returntemp);
  }
 } catch (CacheException e) {
 PersistenceManager pm = PMF.get().getPersistenceManager();
 returntemp=pm.getObjectById(class.getClass(),key);
}
 return returntemp;
}

Can this be done? is there a quota to MemCache API call?


and thx again

2012/2/1 Leandro Rezende 

> thx for the source, now i will study a bit(googl) to learn how to
> "memcache" in JAVA
>
> and then i show the results, "My app without and with Memcache"
>
>
>
> 2012/2/1 Brandon Wirtz 
>
>>
>> http://bjk5.com/post/11766098283/app-engine-performance-hacks-youll-probably-never
>> 
>>
>> ** **
>>
>> *Brandon Wirtz
>> *BlackWaterOps: President / Lead Mercenary 
>>
>> [image: Description:
>> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>>
>> *Work:* 510-992-6548
>> *Toll Free:* 866-400-4536 
>>
>> *IM:* drak...@gmail.com (Google Talk)
>> *Skype:* drakegreene
>> *YouTube:* BlackWaterOpsDotCom
>> **
>> **
>>
>> BlackWater Ops 
>>
>> Cloud On A String Mastermind Group *
>>
>> *
>>
>> ** **
>>
>> ** **
>>
>> *From:* google-appengine@googlegroups.com [mailto:
>> google-appengine@googlegroups.com] *On Behalf Of *Leandro Rezende
>> *Sent:* Wednesday, February 01, 2012 4:38 AM
>>
>> *To:* google-appengine@googlegroups.com
>> *Subject:* Re: [google-appengine] Saving Datastore Read
>>
>> ** **
>>
>> Thanks Brandon, 
>>
>> So before i "GetObjectbyId()", i will search at Memcache, if the record
>> isnt there, i will "GetoBjectById()" to get data, and them store it into
>> Memcache.
>>
>> ** **
>>
>> 2012/2/1 Brandon Wirtz 
>>
>> Memcache is per App. All instances of an app will share the memcahce  so
>> if instance 1 writes, instance 3  can read.
>>
>>  
>>
>> *Brandon Wirtz
>> *BlackWaterOps: President / Lead Mercenary 
>>
>> [image: Description:
>> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>>
>> *Work:* 510-992-6548
>> *Toll Free:* 866-400-4536 
>>
>> *IM:* drak...@gmail.com (Google Talk)
>> *Skype:* drakegreene
>> *YouTube:* BlackWaterOpsDotCom
>> 
>>
>> BlackWater Ops 
>>
>> Cloud On A String Mastermind Group 
>>
>>  
>>
>>  
>>
>> *From:* google-appengine@googlegroups.com [mailto:
>> google-appengine@googlegroups.com] *On Behalf Of *Leandro Rezende
>> *Sent:* Wednesday, February 01, 2012 3:28 AM
>> *To:* google-appengine@googlegroups.com
>> *Subject:* Re: [google-appengine] Saving Datastore Read
>>
>>  
>>
>> Thx for the answer Robert, i was thinking about Memcache too, but i never
>> implemented it.
>>
>>  
>>
>> Do u know if the data cached on memcache is public for every instance? or
>> its "private" for each browser user?
>>
>>  
>>
>> thank you
>>
>> 2012/2/1 Robert Kluin 
>>
>> Hi Leandro,
>>  Think about the relative frequency of events.  It is probably
>> massively more common to list game info than for a player to change
>> their name / image, especially once they have a lot of data.  If
>> that's the case, denormalizing might be a very good choice.  If
>> someone does change their name/image you can easily use the taskqueue
>> to update all their game info.
>>
>>  Depending on the data, you may also be able to keep the normalized
>> model but reduce the number of reads.  Just gather a list of all
>> entities you need to fetch, remove any duplicates, then get the info
>> from those entities.  If there are some players who's stuff is very
>> often displayed, use memcache to store their details.
>>
>>
>> Robert
>>
>>
>>
>>
>>
>>
>> On Tue, Jan 31, 2012 at 07:51, Leandro Rezende
>>  wrote:
>> > if i have 2 "Tables",
>> >
>> > "Table Player" , (Fields - PlayerKey, PlayerName, PlayerUrlPhoto)
>> > "Table PlayerGames", (Fields - PlayerGameKey, PlayerKey, GameDate)
>> >
>> > if i wanna list all games, i will create a query in "PlayerGames", and
>> to
>> > show the "Players" info, i will have to "GetObjectbyID" to read
>> PlayerName
>> > and PLayerUrlPhoto.
>> >
>> > What is the best way to do this?
>> >
>> > 1 - Using GetObjectByID is the right way (spending 1 "datastore read"
>> more
>> > for each "PlayerGame" record)
>> > 2 - Store at "PlayerGames" the fields that i know that i will need to
>> list
>> > 

RE: [google-appengine] Re: Report

2012-02-01 Thread Brandon Wirtz
And Ikai responded. Told you what you needed to do. And I responded and told
you even more of what you needed to do, because google won't tell you to
lawyer up and get a court order.
 
I realize you are French, so that makes you more rude by default. But I gave
you the information you needed to resolve this.  I did so in a much nicer
tone than you.
 
The forum has been pretty nice to you considering how rude you are, and that
this is a technical support forum and your issue isn't technical in nature.
 
Now send Ikai a nice letter saying "Thanks Ikai, I appreciate the
information you provided, I'll follow up through the channels you linked
to."  Then go get a court order, you can even do that in your local country.
Submit it through the Legal Contact for Google in your local region. And the
site will come down. Or the Judge will decide not to do anything with the
site and you can sue the individual for your money.  Either way you will
have resolution. 
 

Brandon Wirtz 
BlackWaterOps: President / Lead Mercenary 
Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg


Work: 510-992-6548 
Toll Free: 866-400-4536 
IM: drak...@gmail.com (Google Talk) 
Skype: drakegreene 
YouTube:   BlackWaterOpsDotCom 


  BlackWater Ops 

  Cloud On A String Mastermind Group



 
 
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of NAG
Sent: Wednesday, February 01, 2012 7:14 PM
To: google-appengine@googlegroups.com
Subject: [google-appengine] Re: Report
 
The only one who's rude in this forum it's you Brandon
 
I posted those comments to Google App Engine Team not to you Brandon so stop
posting ? comments, relating to these mater.
 
I was very patient with Google as I've already sent months ago all documents
(emails + hard copy) to Google DNS and of course, still no reply.
 
and yes I'm very concern - why Google still host such criminal website. 
 
Yes, I came to this forum to talk about Google App Engine Hosting issues and
have someone from Google Team to talk to. Not you.
 
 
 
 
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/rkqT7plKhssJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

<>

[google-appengine] Re: Report

2012-02-01 Thread NAG
The only one who's rude in this forum it's you Brandon
 
I posted those comments to Google App Engine Team not to you Brandon so 
stop posting ? comments, relating to these mater.
 
I was very patient with Google as I've already sent months ago all 
documents (emails + hard copy) to Google DNS and of course, still no reply.
 
and yes I'm very concern - why Google still host such criminal website. 
 
Yes, I came to this forum to talk about Google App Engine Hosting issues 
and have someone from Google Team to talk to. Not you.
 
 
 
 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/rkqT7plKhssJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Report

2012-02-01 Thread Jeff Schnitzer
+1

(and you're *way* nicer than I was about to be)

Jeff

On Wed, Feb 1, 2012 at 7:30 PM, Brandon Wirtz  wrote:

> I am not a Google Employee. I can not speak for Google. That also affords
> me the Ability to say what Google Can’t.
>
> ** **
>
> Google would have your back if there was a Copyright complaint. You would
> file a DMCA and they would take it seriously.
>
> You on the other hand have a Criminal matter. And one that currently is
> your word against theirs.  You need to lawyer up. File a complaint
> against the web site owner. That will get you a court order that you can
> provide Google To release the information of the person you paid the money
> to if that is required, and a take down notice that Google will
> (typically) honor.
>
> ** **
>
> Without these things you are just a loud obnoxious person who stupidly
> paid money when they shouldn’t have.  Using a method they shouldn’t have.
> If you had used PayPal or another Escrow service you could say, “HEY that
> bastard didn’t do what they said they would” and your money would come back
> to you.
>
> ** **
>
> That didn’t happen. And that is an issue that you now have to deal with
> court and lawyers.
>
> ** **
>
> Should I feel bad for you? Maybe. But you came in to this forum screaming
> with Red underlined and bold text and wild allegations.  IF you had come
> in polite with a coherent story, I’d have said “Here are the things you
> need to do, sorry about your ordeal, Google can’t help you until you have
> the following things”.
>
> Instead. Currently I’m rooting for the other guy.  He may be sleaze, but
> at least he isn’t obnoxious.
>
> ** **
>
> ** **
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> **
> **
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group *
>
> *
>
> ** **
>
> ** **
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *NAG
> *Sent:* Sunday, January 29, 2012 6:45 PM
>
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] Report
>
> ** **
>
>  
>
> *So Ikai, you are telling me that www.showsiteinfo.appspot.com hasn't
> breach anything. I think they did.*
>
>  
>
> *This website has offered a service fee to remove contents. After I paid
> them they haven't proceed the service, they kept the money and they never
> reply to my emails.*
>
> *It's EXTORTION and UNETHICAL*
>
>  
>
> *and worst they have asked to pay them more money to remove all contents.*
> 
>
>  
>
> *Surprisingly after I have lodged a complaint the service page has
> disapeared?? - I have kept a screenshot of that page as a proof and all
> other documents.*
>
>  
>
> *I've tried to contact those people since novembre and nothing, no reply.
> www.showsiteinfo.appspot.com** as violated 'Customers obligations' on the
> terms and services**.*
>
>  
>
> *Bravo Google I didn't know that you are protecting criminal websites.
> *
>
>  
>
> *I have never asked to be on www.showsiteinfo.appspot.com  so I have the
> right to ask that my business contents should be removed; specially when
> this contents appears on the first page of google when I type my business
> name.*
>
>  
>
> This is Google responsability to investigate.
>
>  
>
> I have never had any problems to remove contents from websites form
> hosting company who has always helped. Google should take lots of advice
> from those hosting compnay.
>
>  
>
> As a Google App Engine, you should resolve this situation as this is your
> client.
>
>  
>
>  
>
>  
>
>  
>
>  
>
>  
>
>  
>
>  
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/zupgZzuI6D8J.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscri

RE: [google-appengine] App Engine SDK 1.6.2 is out!

2012-02-01 Thread Brandon Wirtz
I want Drop Table. 
 
Can I restore empty table?
 
 

Brandon Wirtz 
BlackWaterOps: President / Lead Mercenary 
Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg


Work: 510-992-6548 
Toll Free: 866-400-4536 
IM: drak...@gmail.com (Google Talk) 
Skype: drakegreene 
YouTube:   BlackWaterOpsDotCom 


  BlackWater Ops 

  Cloud On A String Mastermind Group



 
 
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Chris Collins
Sent: Wednesday, February 01, 2012 6:09 PM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] App Engine SDK 1.6.2 is out!
 
Namespace backups would be pure awesomeness. Or some way to automate the
backups. It seems you have to backup each entity manually at the moment?
On Wed, Feb 1, 2012 at 10:35 AM, WGuerlich  wrote:
The backup feature is great! But having backups not only by entity kind but
also by namespace would be uber-awesome. 
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/yd8HVGZPREsJ.

To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
 .
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
 
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

<>

Re: [google-appengine] App Engine SDK 1.6.2 is out!

2012-02-01 Thread Chris Collins
Namespace backups would be pure awesomeness. Or some way to automate the
backups. It seems you have to backup each entity manually at the moment?

On Wed, Feb 1, 2012 at 10:35 AM, WGuerlich  wrote:

> The backup feature is great! But having backups not only by entity kind
> but also by namespace would be uber-awesome.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/yd8HVGZPREsJ.
>
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] Report

2012-02-01 Thread Brandon Wirtz
I am not a Google Employee. I can not speak for Google. That also affords me
the Ability to say what Google Can't.
 
Google would have your back if there was a Copyright complaint. You would
file a DMCA and they would take it seriously.
You on the other hand have a Criminal matter. And one that currently is your
word against theirs.  You need to lawyer up. File a complaint against the
web site owner. That will get you a court order that you can provide Google
To release the information of the person you paid the money to if that is
required, and a take down notice that Google will (typically) honor.
 
Without these things you are just a loud obnoxious person who stupidly paid
money when they shouldn't have.  Using a method they shouldn't have.  If you
had used PayPal or another Escrow service you could say, "HEY that bastard
didn't do what they said they would" and your money would come back to you.
 
That didn't happen. And that is an issue that you now have to deal with
court and lawyers.
 
Should I feel bad for you? Maybe. But you came in to this forum screaming
with Red underlined and bold text and wild allegations.  IF you had come in
polite with a coherent story, I'd have said "Here are the things you need to
do, sorry about your ordeal, Google can't help you until you have the
following things".
Instead. Currently I'm rooting for the other guy.  He may be sleaze, but at
least he isn't obnoxious.
 
 

Brandon Wirtz 
BlackWaterOps: President / Lead Mercenary 
Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg


Work: 510-992-6548 
Toll Free: 866-400-4536 
IM: drak...@gmail.com (Google Talk) 
Skype: drakegreene 
YouTube:   BlackWaterOpsDotCom 


  BlackWater Ops 

  Cloud On A String Mastermind Group



 
 
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of NAG
Sent: Sunday, January 29, 2012 6:45 PM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Report
 
 
So Ikai, you are telling me that www.showsiteinfo.appspot.com hasn't breach
anything. I think they did.
 
This website has offered a service fee to remove contents. After I paid them
they haven't proceed the service, they kept the money and they never reply
to my emails.
It's EXTORTION and UNETHICAL
 
and worst they have asked to pay them more money to remove all contents.
 
Surprisingly after I have lodged a complaint the service page has
disapeared?? - I have kept a screenshot of that page as a proof and all
other documents.
 
I've tried to contact those people since novembre and nothing, no reply.
 www.showsiteinfo.appspot.com as
violated 'Customers obligations' on the terms and services.
 
Bravo Google I didn't know that you are protecting criminal websites.
 
I have never asked to be on www.showsiteinfo.appspot.com
   so I have the right to ask that my
business contents should be removed; specially when this contents appears on
the first page of google when I type my business name.
 
This is Google responsability to investigate.
 
I have never had any problems to remove contents from websites form hosting
company who has always helped. Google should take lots of advice from those
hosting compnay.
 
As a Google App Engine, you should resolve this situation as this is your
client.
 
 
 
 
 
 
 
 
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/zupgZzuI6D8J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

<>

Re: [google-appengine] Groundhog Day: Fatal - Wrong mime-type in CSS responses

2012-02-01 Thread James Broberg
Also please make sure it hits maven central in a timely manner.

On 2 February 2012 09:47, Jeff Schnitzer  wrote:
> Would you be sure to doublecheck that 1.6.2.1 gets into the Eclipse
> repo?  1.6.1.1 never seems to have made it.  There was something that
> looked like an update to 1.6.1 but it didn't fix the bug, whereas
> downloading the 1.6.1.1 sdk did, so I assume it never was posted.
>
> Thanks,
> Jeff
>
> On Wed, Feb 1, 2012 at 5:40 PM, Marzia Niccolai
>  wrote:
>> Hi Mos,
>>
>> Apologies for this regression. We've pushed a 1.6.2.1 that contains the fix.
>>
>> Since we had started our 1.6.2 release before this issue was fixed, we
>> didn't properly integrate the fix in to both the 1.6.1 and 1.6.2 SDK.
>>
>> -Marzia
>>
>>
>> On Wed, Feb 1, 2012 at 9:04 AM, Mos  wrote:
>>>
>>> Hello again,
>>>
>>> can't believe it?!
>>> The critical bug you fixed with 1.6.1.1  is reintroduced with the new
>>> version.
>>>
>>> Just deployed my application with 1.6.2 and again the css-files are
>>> returned with mime-type of null
>>> --> breaks the site in most browsers!
>>>
>>> Please reopen the ticket:
>>> http://code.google.com/p/googleappengine/issues/detail?id=6655
>>>
>>> @Ikai:  You still have my app-id and access-password, if you would see the
>>> bug in action.
>>>
>>> @GAE-Team: What's going on with your version-control /
>>> regression-testing?  Did we have to wait again two weeks for a fix with
>>> 1.6.2.1?
>>>
>>> Cheers
>>> Mos
>>>
>>>
>>>
>>> On Mon, Jan 9, 2012 at 6:44 PM, Mos  wrote:

 Hello GAE-Team,

 no news in 24h on this critical issue?

 I'm new to GAE and we will release our first application the next days.
 But this issue make me loose my confidence in GAE's reliability. I get
 doubt if Google App Engine was the right choice?

 As Jon mentioned: The issue is around on this list for more than two
 weeks.
 The issue breaks applications --> downtimes for more and more of your
 GAEs users

 And what I'm really wondering:
 It seems to be a simple fix on the GAE-Frontends. It shouldn't be such a
 complex thing,
 to evaluate why the response header sends a null mime-type and not the
 css mime-type for some
 application's  *.css files? You have more then one test-case on this
 Your GAE guys are so smart and can't fix this one?

 Cheers
 Mos



 On Sun, Jan 8, 2012 at 11:15 PM, Amy Unruh 
 wrote:
>
> Mos (and others),
>
> The issue is being actively investigated; we'll be sure to update this
> thread and the issue page as soon as there is more to report.
> Mos, you can go ahead and re-deploy if you want, as we have other test
> cases as this point.
>
>  -Amy
>
>
> On Mon, Jan 9, 2012 at 5:00 AM, Mos  wrote:
>>
>> Hello Ikai,
>>
>> did you have the chance to evaluate on the issue?
>> I sent you my broken test version / URL  two days ago.
>>
>> I wanna redeploy in near future, but don't want to destroy "your
>> test-case".
>>
>> Please give some feedback.
>>
>> Further I think we should put the issue on critical, because this bug
>> breaks
>> webpages and many people are affected:
>>
>> http://code.google.com/p/googleappengine/issues/detail?id=6655
>>
>> Cheers
>> Mos
>>
>>
>>
>>
>>
>> On Fri, Jan 6, 2012 at 12:26 PM, Mos  wrote:
>>>
>>> Hi Ikai,
>>>
>>> the problem occurs in all browsers (I tested Firefox, Chrome and IE).
>>> All browsers get a mime-type of null.
>>> Firefox is able to interpret the stylesheet nevertheless. IE and
>>> Chrome fail and the site is destroyed.
>>>
>>> Since yesterday I have a version of my application that still has the
>>> problem.
>>> I sent you the URL and the Beta-Login in a private email.
>>>
>>> I need to redepoy at the weekend, so please check it in the next
>>> hours.
>>>
>>> Greetings Mos
>>>
>>>
>>> On Thu, Jan 5, 2012 at 9:06 PM, Ikai Lan (Google) 
>>> wrote:

 Mos, what browser is this?

 I've seen some talk of this but it's passing and we can't seem to
 catch it in action. I need more data so I can hunt this down - URLs 
 when
 this is failing. The reports I've seen are that this happens 
 specifically to
 Chrome users.

 --
 Ikai Lan
 Developer Programs Engineer, Google App Engine
 plus.ikailan.com | twitter.com/ikai



 On Thu, Jan 5, 2012 at 8:37 AM, Mos  wrote:
>
> Just found the issue
> http://code.google.com/p/googleappengine/issues/detail?id=6655
>
> It's three days old and describes a fatal error that seems to hit
> more and more people.
>
> No response from Google?
>
>
> On Thu, Jan

Re: [google-appengine] Re: Datastore restore failure

2012-02-01 Thread Ikai Lan (Google)
Hi Francois,

I was just talking to Arie about this. So some implementation details (for
anyone who is curious): The way the backup tool works is by iterating over
all of your data in a mapper job. The number of shards is determined by the
number of Kinds * Entities per kind. Entities are serialized (
entity.ToPb().SerializeToString() ), batched in a LevelDB format (
http://code.google.com/p/leveldb/) and written to the Blobstore (
http://code.google.com/p/appengine-mapreduce/source/browse/trunk/python/src/mapreduce/output_writers.py
).

What's happening in your case is that there are too many worker shards and
the metadata required to describe the job is exceeding the entity size
limit, and it's causing a mapreduce exception which is bubbling all the way
up to the top. This is a bug in the API and will be fixed. I don't have an
ETA for when the fix will go live, however - hopefully sometime in the next
few days.

In the meantime, do you have an application ID? Arie on the engineering
team would like to take a look at your datastore to look at the metadata
entity, but he needs your permission to do so. He might be able to
recommend a workaround if there's something that jumps out at us.

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com



On Wed, Feb 1, 2012 at 1:26 PM, Arie Ozarov  wrote:

> We are looking into it.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/roABfczfSxYJ.
>
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Python — App Engine — AttributeError: 'list' object has no attribut 'has_key'

2012-02-01 Thread Justin Papez
The link above for some reason is not working. Here is a working link
http://stackoverflow.com/questions/9089060/attributeerror-list-object-has-no-attribut-has-key-in-app-engine

On Jan 31, 4:24 pm, Justin Papez  wrote:
> Hey all,
>
> Been having quite a problem with this "AttributeError: 'list' object
> has no attribut 'has_key'". My question is quite long and already on
> stackoverflow so I am pasting a link (http://stackoverflow.com/
> questions/9089060/python-app-engine-attributeerror-list-object-has-no-
> attribut-has-key) instead of retyping everything all over again.
> Thanks in advance for help/suggestions/answers!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: is app engine down? I'm seeing a huge number of deadline errors and our app failing to server, hr datastore

2012-02-01 Thread JW
I also experienced these issues, both last week and now (a few minutes ago).
This is how the requests / min chart looks in my dashboard:
http://i.imgur.com/q0Uax.png

It clearly shows how the cron job I am running once a minute wasn't
executed for 1 hour.

I am using the HR datastore.

2012/1/31 Olivier :
> we also just had issues with two production applications using HR.
>
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Python — App Engine — AttributeError: 'list' object has no attribut 'has_key'

2012-02-01 Thread Justin Papez
Hey all,

Been having quite a problem with this "AttributeError: 'list' object
has no attribut 'has_key'". My question is quite long and already on
stackoverflow so I am pasting a link (http://stackoverflow.com/
questions/9089060/python-app-engine-attributeerror-list-object-has-no-
attribut-has-key) instead of retyping everything all over again.
Thanks in advance for help/suggestions/answers!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Is App Engine suitable for write intensive applications?

2012-02-01 Thread WGuerlich
I know, I'm going to hit the write limit with a timestamp I need to update 
on every write and which needs to be indexed.

As an alternative to sharding: What do you think about adding time jitter 
to the timestamp, that is, changing time randomly by a couple seconds? In 
my application the timestamp being off by a couple senconds wouldn't pose a 
problem.

Now what I need to know is: How many index entries can I expect to go into 
one tablet? This is needed to estimate the amount of jitter necessary to 
avoid hitting the same tablet on every write.

Any insights on this?

Wolfram

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/r0SVTq6i4iEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Properties files in the server side

2012-02-01 Thread jorge prado
Hello!

I'm developping a GWT application and I'm trying to deploy it to GAE. I 
have properties files in the server side (these are just text files in 
ascii) wich I would like to access from my servlet. It works in development 
but when I deploy my application to GAE those files seem to be not uploaded 
since the application cannot access them.

Is there a way to include them so they could be accessed in production?

Thanks for your help!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/uzNRcjaXi6IJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Report

2012-02-01 Thread NAG
 
*So Ikai, you are telling me that **www.showsiteinfo.appspot.com hasn't 
breach anything. I think they did.*
** 
*This website has offered a service fee to remove contents. After I paid 
them they haven't proceed the service, they kept the money and they never 
reply to my emails.*
*It's EXTORTION and UNETHICAL*
** 
*and worst they have asked to pay them more money to remove all contents.*
** 
*Surprisingly after I have lodged a complaint the service page has 
disapeared?? - I have kept a screenshot of that page as a proof and **all 
other documents.*
** 
*I've tried to contact those people since novembre and nothing, no reply. 
www.showsiteinfo.appspot.com as violated 'Customers obligations' on the 
terms and services.*
** 
*Bravo Google I didn't know that you are protecting criminal websites.*
** 
*I have never asked to be on www.showsiteinfo.appspot.com  so I have the 
right to ask that my business contents should be removed; specially when 
this contents appears on the first page of google when I type my business 
name.*
** 
This is Google responsability to investigate.
 
I have never had any problems to remove contents from websites form hosting 
company who has always helped. Google should take lots of advice from those 
hosting compnay.
 
As a Google App Engine, you should resolve this situation as this is your 
client.
 
 
** 
 
** 
** 
** 
** 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/zupgZzuI6D8J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] App Engine SDK 1.6.2 is out!

2012-02-01 Thread WGuerlich
The backup feature is great! But having backups not only by entity kind but 
also by namespace would be uber-awesome.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/yd8HVGZPREsJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Datastore restore failure

2012-02-01 Thread Arie Ozarov
We are looking into it.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/roABfczfSxYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Problem with cglib enhancer, HashMap$Entry not found

2012-02-01 Thread Lars Egar
I am getting an exception "java.lang.NoClassDefFoundError: [Ljava/util/
HashMap$Entry;". I am using cglib to enhance a HashMap so I can
intercept method calls on the HashMap.

The line of code that throws the exception is:

   Enhancer.create(HashMap.class, new SomeInterceptor());

I am using the latest plugin for eclipse (3.7). I am using cglib
version 2.2 (cglib-nodep-2.2.jar)

The stack trace is:

java.lang.NoClassDefFoundError: [Ljava/util/HashMap$Entry;
at
com.google.appengine.runtime.Request.process-02796318ce7d3a7b(Request.java)
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2444)
at java.lang.Class.getDeclaredMethod(Class.java:229)
at net.sf.cglib.proxy.Enhancer.getCallbacksSetter(Enhancer.java:630)
at net.sf.cglib.proxy.Enhancer.setCallbacksHelper(Enhancer.java:618)
at net.sf.cglib.proxy.Enhancer.setThreadCallbacks(Enhancer.java:612)
at net.sf.cglib.proxy.Enhancer.createUsingReflection(Enhancer.java:
634)
at net.sf.cglib.proxy.Enhancer.firstInstance(Enhancer.java:538)
at
net.sf.cglib.core.AbstractClassGenerator.create(AbstractClassGenerator.java:
225)
at net.sf.cglib.proxy.Enhancer.createHelper(Enhancer.java:377)
at net.sf.cglib.proxy.Enhancer.create(Enhancer.java:285)
at net.sf.cglib.proxy.Enhancer.create(Enhancer.java:663)
at com.enhancetest.EnhanceTestServlet.doGet(EnhanceTestServlet.java:
30)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:
511)
at org.mortbay.jetty.servlet.ServletHandler
$CachedChain.doFilter(ServletHandler.java:1166)
at org.mortbay.jetty.servlet.ServletHandler
$CachedChain.doFilter(ServletHandler.java:1157)
at org.mortbay.jetty.servlet.ServletHandler
$CachedChain.doFilter(ServletHandler.java:1157)
at org.mortbay.jetty.servlet.ServletHandler
$CachedChain.doFilter(ServletHandler.java:1157)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:
388)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:
216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:
182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:
765)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:
418)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:
152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:
542)
at org.mortbay.jetty.HttpConnection
$RequestHandler.headerComplete(HttpConnection.java:923)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at com.google.tracing.TraceContext
$TraceContextRunnable.runInContext(TraceContext.java:449)
at com.google.tracing.TraceContext$TraceContextRunnable
$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:
695)
at com.google.tracing.TraceContext
$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:
333)
at com.google.tracing.TraceContext
$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:
325)
at com.google.tracing.TraceContext
$TraceContextRunnable.run(TraceContext.java:453)
at java.lang.Thread.run(Thread.java:679)
Caused by: java.lang.ClassNotFoundException: java.util.HashMap$Entry
... 35 more

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] What is the image data format for Image?

2012-02-01 Thread tz
Hi Everyone,

I want to generate my own image in GAE from my own data, but I don't
know what the format of the image data should be.   Can I just make it
24bit RGB?

The little test below has an illegal argument exception, and the
javadoc for getFormat says that occurs when the "image data is
invalid".

What should the format of the image data be?

Thanks.



byte[] imageData = new byte[200];
for (int i=0; i<200; i++){
if (i<100) imageData[i]=0;
else imageData[i] = (byte) 255;
}

ImagesService imagesService =
ImagesServiceFactory.getImagesService();
Image image = ImagesServiceFactory.makeImage(imageData);
Image.Format format = image.getFormat();

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] App Engine SDK 1.6.2 is out!

2012-02-01 Thread Melanie Siekmöller
be carefull with backups, maybe your app reaches the free quota limit... 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Cv_Xj3L5hP8J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] file.create() throws an ApiDeadlineExceededException very frequently

2012-02-01 Thread Gaurav Misra
Hi,

We are seeing this error very very frequently times when calling 
file.createBlobStore API. We are on the 1.6.1 Java SDK. This could cause 
service disruption.

Also we are seeing that once this exception occurs, it happens a few more 
times in succession.

Your help in this matter is greatly appreciated.

Gaurav

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/D9rqPHiiOWgJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] GAE cluster under high load?

2012-02-01 Thread c h
Hello,

I just started getting lots of these errors this afternoon on one of my 
apps:

"Request was aborted after waiting too long to attempt to service your 
request. This may happen sporadically when the App Engine serving cluster 
is under unexpectedly high or uneven load. If you see this message 
frequently, please contact the App Engine team."

i have not seen that before, and have not changed my app code in over a 
week. any ideas what might be going on? did something change with the 1.6.2 
upgrade that i need to account for in my code?

thanks,

christian

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/oUr3fUxx9K4J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: New User Problem

2012-02-01 Thread Jose Montes de Oca
As Leandro said, you will need to create another applicaiton with a new ID. 
a delete the one you mess up to free up the number of total apps you are 
able to create.

Best,
Jose

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/5cCIzf4vi3MJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: App Engine SDK 1.6.2 is out!

2012-02-01 Thread Brian Quinlan
Hi Ron,

On Thu, Feb 2, 2012 at 8:04 AM, Ron  wrote:
> why is Django 1.3 not available with Python 2.7 ?

Before Python 2.7's official release we want to maximize the amount of
testing that its existing libraries get instead of adding new ones.

> and will Django non-rel be available in a future release?

We generally don't commit to packaging new libraries but you can use
Django nonrel right now by downloading it yourself and putting it in
your application's directory.

Cheers,
Brian

> On Jan 31, 11:17 pm, "Ikai Lan (Google)"  wrote:
>> Hey everyone,
>>
>> Just wanted to announce that App Engine 1.6.2 is out! You can check out the
>> blog post here:
>>
>> http://googleappengine.blogspot.com/2012/01/app-engine-162-released.html
>>
>> Note that if you're getting an import error for task queues, you're
>> probably still using the old labs import. You'll want to get this cleared
>> up (you'll also want to pay attention to deprecation warnings).
>>
>> Release notes are below for your reading pleasure:
>>
>> *Java 1.6.2*
>> --
>>
>>    - The Admin Console Datastore Admin has added experimental backup and
>>    restore functionality. The job occurs within your application and counts
>>    against your application quota, including Instance Hours, Datastore Ops 
>> and
>>    Datastore Storage.
>>    - Developers can now specify how long a channel token will last until it
>>    expires, with the default remaining two hours. Channel API quota is now
>>    measured both in calls to create a channel and the number of hours of
>>    channel time requested. The maximum hours of quota is the maximum number 
>> of
>>    channel creation calls * 2, so free apps get 200 hours of requested
>>    channel token time.
>>    - Task Queue API requests now include a X-Appengine-TaskETA header, that
>>    can be used to measure task delivery latency.
>>    - We have removed the deprecated labs version of the TaskQueue API.
>>    - The default API deadlines for Blobstore API calls have been raised to
>>    15s for online and 30s for offline requests, up from 5s.
>>    - The Images API now allows you to stretch an image without maintaining
>>    the aspect ratio.
>>       -http://code.google.com/p/googleappengine/issues/detail?id=2220
>>    - Mail Quota for App Engine apps that have signed up for billing will
>>    only be increased after the first payment for the app is processed.
>>    - Fixed an issue where the SDK did not resize images down to 512 pixels
>>    by default, as it does in production.
>>    - Fixed an issue with the Images API where valid images were returning a
>>    NotImageError.
>>       -http://code.google.com/p/googleappengine/issues/detail?id=5545
>>
>> *Python 1.6.2*
>> 
>>
>>    - The Admin Console Datastore Admin has added experimental backup and
>>    restore functionality. The job occurs within your application and counts
>>    against your application quota, including Instance Hours, Datastore Ops 
>> and
>>    Datastore Storage.
>>    - Developers can now specify how long a channel token will last until it
>>    expires, with the default remaining two hours. Channel API quota is now
>>    measured both in calls to create a channel and the number of hours of
>>    channel time requested. The maximum hours of quota is the maximum number 
>> of
>>    channel creation calls * 2, so free apps get 200 hours of requested
>>    channel token time.
>>    - Python Django now work with Cloud SQL without additional
>>    configuration. For further information see
>>    https://developers.google.com/cloud-sql/.
>>    - Task Queue API requests now include a X-Appengine-TaskETA header, that
>>    can be used to measure task delivery latency.
>>    - The default API deadlines for Blobstore API calls have been raised to
>>    15s for online and 30s for offline requests, up from 5s.
>>    - The Images API now allows you to stretch an image without maintaining
>>    the aspect ratio.
>>       -http://code.google.com/p/googleappengine/issues/detail?id=2220
>>    - The Blobstore API now includes the asynchronous function calls
>>    create_upload_url_async, delete_async, and fetch_data_async.
>>    - Django version 1.3 is now available in the Python 2.5 runtime.
>>    - We've added a django_wsgi builtin to allow easier bootstrapping of
>>    Django applications.
>>    - Mail Quota for App Engine apps that have signed up for billing will
>>    only be increased after the first payment for the app is processed.
>>    - As announced in 1.6.1, in this release for the experimental Python 2.7
>>    runtime, the mapreduce and datastore_admin builtins are not available to
>>    apps deployed to Python 2.7.
>>    - Fixed an issue with remote_api where calling fetch_page() with a page
>>    size of 301 and chaining the calls through the returned cursor was 
>> skipping
>>    half of the results.
>>    - Fixed an issue where the PIL _imagingmath module was not available in
>>    Python 2.7.
>>    -

Re: [google-appengine] Groundhog Day: Fatal - Wrong mime-type in CSS responses

2012-02-01 Thread Jeff Schnitzer
Would you be sure to doublecheck that 1.6.2.1 gets into the Eclipse
repo?  1.6.1.1 never seems to have made it.  There was something that
looked like an update to 1.6.1 but it didn't fix the bug, whereas
downloading the 1.6.1.1 sdk did, so I assume it never was posted.

Thanks,
Jeff

On Wed, Feb 1, 2012 at 5:40 PM, Marzia Niccolai
 wrote:
> Hi Mos,
>
> Apologies for this regression. We've pushed a 1.6.2.1 that contains the fix.
>
> Since we had started our 1.6.2 release before this issue was fixed, we
> didn't properly integrate the fix in to both the 1.6.1 and 1.6.2 SDK.
>
> -Marzia
>
>
> On Wed, Feb 1, 2012 at 9:04 AM, Mos  wrote:
>>
>> Hello again,
>>
>> can't believe it?!
>> The critical bug you fixed with 1.6.1.1  is reintroduced with the new
>> version.
>>
>> Just deployed my application with 1.6.2 and again the css-files are
>> returned with mime-type of null
>> --> breaks the site in most browsers!
>>
>> Please reopen the ticket:
>> http://code.google.com/p/googleappengine/issues/detail?id=6655
>>
>> @Ikai:  You still have my app-id and access-password, if you would see the
>> bug in action.
>>
>> @GAE-Team: What's going on with your version-control /
>> regression-testing?  Did we have to wait again two weeks for a fix with
>> 1.6.2.1?
>>
>> Cheers
>> Mos
>>
>>
>>
>> On Mon, Jan 9, 2012 at 6:44 PM, Mos  wrote:
>>>
>>> Hello GAE-Team,
>>>
>>> no news in 24h on this critical issue?
>>>
>>> I'm new to GAE and we will release our first application the next days.
>>> But this issue make me loose my confidence in GAE's reliability. I get
>>> doubt if Google App Engine was the right choice?
>>>
>>> As Jon mentioned: The issue is around on this list for more than two
>>> weeks.
>>> The issue breaks applications --> downtimes for more and more of your
>>> GAEs users
>>>
>>> And what I'm really wondering:
>>> It seems to be a simple fix on the GAE-Frontends. It shouldn't be such a
>>> complex thing,
>>> to evaluate why the response header sends a null mime-type and not the
>>> css mime-type for some
>>> application's  *.css files? You have more then one test-case on this
>>> Your GAE guys are so smart and can't fix this one?
>>>
>>> Cheers
>>> Mos
>>>
>>>
>>>
>>> On Sun, Jan 8, 2012 at 11:15 PM, Amy Unruh 
>>> wrote:

 Mos (and others),

 The issue is being actively investigated; we'll be sure to update this
 thread and the issue page as soon as there is more to report.
 Mos, you can go ahead and re-deploy if you want, as we have other test
 cases as this point.

  -Amy


 On Mon, Jan 9, 2012 at 5:00 AM, Mos  wrote:
>
> Hello Ikai,
>
> did you have the chance to evaluate on the issue?
> I sent you my broken test version / URL  two days ago.
>
> I wanna redeploy in near future, but don't want to destroy "your
> test-case".
>
> Please give some feedback.
>
> Further I think we should put the issue on critical, because this bug
> breaks
> webpages and many people are affected:
>
> http://code.google.com/p/googleappengine/issues/detail?id=6655
>
> Cheers
> Mos
>
>
>
>
>
> On Fri, Jan 6, 2012 at 12:26 PM, Mos  wrote:
>>
>> Hi Ikai,
>>
>> the problem occurs in all browsers (I tested Firefox, Chrome and IE).
>> All browsers get a mime-type of null.
>> Firefox is able to interpret the stylesheet nevertheless. IE and
>> Chrome fail and the site is destroyed.
>>
>> Since yesterday I have a version of my application that still has the
>> problem.
>> I sent you the URL and the Beta-Login in a private email.
>>
>> I need to redepoy at the weekend, so please check it in the next
>> hours.
>>
>> Greetings Mos
>>
>>
>> On Thu, Jan 5, 2012 at 9:06 PM, Ikai Lan (Google) 
>> wrote:
>>>
>>> Mos, what browser is this?
>>>
>>> I've seen some talk of this but it's passing and we can't seem to
>>> catch it in action. I need more data so I can hunt this down - URLs when
>>> this is failing. The reports I've seen are that this happens 
>>> specifically to
>>> Chrome users.
>>>
>>> --
>>> Ikai Lan
>>> Developer Programs Engineer, Google App Engine
>>> plus.ikailan.com | twitter.com/ikai
>>>
>>>
>>>
>>> On Thu, Jan 5, 2012 at 8:37 AM, Mos  wrote:

 Just found the issue
 http://code.google.com/p/googleappengine/issues/detail?id=6655

 It's three days old and describes a fatal error that seems to hit
 more and more people.

 No response from Google?


 On Thu, Jan 5, 2012 at 5:30 PM, Mos  wrote:
>
> My site is down currently, because GAE response CSS files without
> mime-type:
>
> REQUEST:
>
> GET /static/css/master.css HTTP/1.1
>
>
>
>
>
>
>

Re: [google-appengine] Groundhog Day: Fatal - Wrong mime-type in CSS responses

2012-02-01 Thread Marzia Niccolai
Hi Mos,

Apologies for this regression. We've pushed a 1.6.2.1 that contains the fix.

Since we had started our 1.6.2 release before this issue was fixed, we
didn't properly integrate the fix in to both the 1.6.1 and 1.6.2 SDK.

-Marzia

On Wed, Feb 1, 2012 at 9:04 AM, Mos  wrote:

> Hello again,
>
> can't believe it?!
> The critical bug you fixed with 1.6.1.1  is reintroduced with the new
> version.
>
> Just deployed my application with 1.6.2 and again the css-files are
> returned with mime-type of null
> --> breaks the site in most browsers!
>
> Please reopen the ticket:
> http://code.google.com/p/googleappengine/issues/detail?id=6655
>
> @Ikai:  You still have my app-id and access-password, if you would see the
> bug in action.
>
> @GAE-Team: What's going on with your version-control /
> regression-testing?  Did we have to wait again two weeks for a fix with
> 1.6.2.1?
>
> Cheers
> Mos
>
>
>
> On Mon, Jan 9, 2012 at 6:44 PM, Mos  wrote:
>
>> Hello GAE-Team,
>>
>> no news in 24h on this critical issue?
>>
>> I'm new to GAE and we will release our first application the next days.
>> But this issue make me loose my confidence in GAE's reliability. I get
>> doubt if Google App Engine was the right choice?
>>
>> As Jon mentioned: The issue is around on this list for more than two
>> weeks.
>> The issue breaks applications --> downtimes for more and more of your
>> GAEs users
>>
>> And what I'm really wondering:
>> It seems to be a simple fix on the GAE-Frontends. It shouldn't be such a
>> complex thing,
>> to evaluate why the response header sends a null mime-type and not the
>> css mime-type for some
>> application's  *.css files? You have more then one test-case on this
>> Your GAE guys are so smart and can't fix this one?
>>
>> Cheers
>> Mos
>>
>>
>>
>> On Sun, Jan 8, 2012 at 11:15 PM, Amy Unruh wrote:
>>
>>> Mos (and others),
>>>
>>> The issue is being actively investigated; we'll be sure to update this
>>> thread and the issue page as soon as there is more to report.
>>> Mos, you can go ahead and re-deploy if you want, as we have other test
>>> cases as this point.
>>>
>>>  -Amy
>>>
>>>
>>> On Mon, Jan 9, 2012 at 5:00 AM, Mos  wrote:
>>>
 Hello Ikai,

 did you have the chance to evaluate on the issue?
 I sent you my broken test version / URL  two days ago.

 I wanna redeploy in near future, but don't want to destroy "your
 test-case".

 Please give some feedback.

 Further I think we should put the issue on critical, because this bug
 breaks
 webpages and many people are affected:

 http://code.google.com/p/googleappengine/issues/detail?id=6655

 Cheers
 Mos





 On Fri, Jan 6, 2012 at 12:26 PM, Mos  wrote:

> Hi Ikai,
>
> the problem occurs in all browsers (I tested Firefox, Chrome and IE).
> All browsers get a mime-type of null.
> Firefox is able to interpret the stylesheet nevertheless. IE and
> Chrome fail and the site is destroyed.
>
> Since yesterday I have a version of my application that still has the
> problem.
> I sent you the URL and the Beta-Login in a private email.
>
> I need to redepoy at the weekend, so please check it in the next hours.
>
> Greetings Mos
>
>
> On Thu, Jan 5, 2012 at 9:06 PM, Ikai Lan (Google) 
> wrote:
>
>> Mos, what browser is this?
>>
>> I've seen some talk of this but it's passing and we can't seem to
>> catch it in action. I need more data so I can hunt this down - URLs when
>> this is failing. The reports I've seen are that this happens specifically
>> to Chrome users.
>>
>> --
>> Ikai Lan
>> Developer Programs Engineer, Google App Engine
>> plus.ikailan.com | twitter.com/ikai
>>
>>
>>
>> On Thu, Jan 5, 2012 at 8:37 AM, Mos  wrote:
>>
>>> Just found the issue
>>> http://code.google.com/p/googleappengine/issues/detail?id=6655
>>>
>>> It's three days old and describes a fatal error that seems to hit
>>> more and more people.
>>>
>>> No response from Google?
>>>
>>>
>>> On Thu, Jan 5, 2012 at 5:30 PM, Mos  wrote:
>>>
 My site is down currently, because GAE response CSS files without
 mime-type:

 REQUEST:

 GET /static/css/master.css HTTP/1.1












 ...
 User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; 
 rv:1.9.2.25) Gecko/20111212 Firefox/3.6.25












 Accept: text/css,*/*;q=0.1
 ..

 WRONG RESPONSE:

 HTTP/1.1 200 OK
 Etag: "sR7Bag"
 Date: Thu, 05 Jan 2012 16:22:34 GMT
 Expires: Thu, 05 Jan 2012 16:32:34 GMT
 Cache

[google-appengine] Re: (mostly) Consistent 20-second delay in starting backend tasks

2012-02-01 Thread Dave Loomer
Finally, it's probably an important clue that when I explicitly set 
countdown=1 when creating the task, the delay in executing the task is 
always almost exactly 1.5 seconds (not sure why it's not 1.0). If I don't 
set a countdown value, it's almost as if I had set countdown=20. Except 
that the ETA in the Task Queue Details page in the admin console reflects 
the approximate time the task was created, rather than adding 20 seconds to 
that.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/sbd5Clqozg8J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: (mostly) Consistent 20-second delay in starting backend tasks

2012-02-01 Thread Dave Loomer
And here is backends.yaml:

backends:
- name: overnight-external-data
  class: B1
  options: dynamic
  instances: 1

and queue.yaml:

queue:
- name: overnight-tasks
  rate: 50/s
  bucket_size: 50
  retry_parameters:
max_backoff_seconds: 1800

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/nIP2SeQDMUsJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: (mostly) Consistent 20-second delay in starting backend tasks

2012-02-01 Thread Dave Loomer
To do one better, here is the entirety of the Python code:

#!/usr/bin/env python
#
# Copyright 2007 Google Inc.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#

import wsgiref.handlers
import datetime, time

from google.appengine.ext import webapp, db
from google.appengine.ext.webapp.util import run_wsgi_app 
from google.appengine.api import taskqueue

class AdhocHandler2(webapp.RequestHandler):
def get(self):
task_create_time = datetime.datetime.now()
import string
task_create_time_s = task_create_time.strftime("%Y-%m-%d %H:%M:%S") + "." + 
string.zfill(task_create_time.microsecond, 6)
t = taskqueue.Task(url='/batch/adhoc', params={'task_create_time': 
task_create_time_s}, target='overnight-external-data',
method='GET')
t.add(queue_name = 'overnight-tasks')

def main():
application = webapp.WSGIApplication([ \
('/batch/adhoc2', AdhocHandler2), \
],
 debug=True)

run_wsgi_app(application)

if __name__ == '__main__':
main()

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/ELiNYLg4B9cJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: (mostly) Consistent 20-second delay in starting backend tasks

2012-02-01 Thread Dave Loomer
The tasks are not run transactionally, and in my testing the task is the 
only one in queue. In fact, I also ran the tests *somewhat* successfully on 
a separate app where this was the only code running. I say somewhat 
because, as I stated in my original post, the 20-second delays didn't 
happen every time; more like once every four requests. But when they did 
occur, it was almost precisely 20 seconds.

Below is the entirety of my handler:

class AdhocHandler2(webapp.RequestHandler):
def get(self):
task_create_time = datetime.datetime.now()
import string
task_create_time_s = task_create_time.strftime("%Y-%m-%d %H:%M:%S") + "." + 
string.zfill(task_create_time.microsecond, 6)
t = taskqueue.Task(url='/batch/adhoc', params={'task_create_time': 
task_create_time_s}, target='overnight-external-data',
method='GET')
t.add(queue_name = 'overnight-tasks')

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/orTdYjTm7SkJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Saving Datastore Read

2012-02-01 Thread Leandro Rezende
thx for the source, now i will study a bit(googl) to learn how to
"memcache" in JAVA

and then i show the results, "My app without and with Memcache"



2012/2/1 Brandon Wirtz 

>
> http://bjk5.com/post/11766098283/app-engine-performance-hacks-youll-probably-never
> 
>
> ** **
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> **
> **
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group *
>
> *
>
> ** **
>
> ** **
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Leandro Rezende
> *Sent:* Wednesday, February 01, 2012 4:38 AM
>
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] Saving Datastore Read
>
> ** **
>
> Thanks Brandon, 
>
> So before i "GetObjectbyId()", i will search at Memcache, if the record
> isnt there, i will "GetoBjectById()" to get data, and them store it into
> Memcache.
>
> ** **
>
> 2012/2/1 Brandon Wirtz 
>
> Memcache is per App. All instances of an app will share the memcahce  so
> if instance 1 writes, instance 3  can read.
>
>  
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> 
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group 
>
>  
>
>  
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Leandro Rezende
> *Sent:* Wednesday, February 01, 2012 3:28 AM
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] Saving Datastore Read
>
>  
>
> Thx for the answer Robert, i was thinking about Memcache too, but i never
> implemented it.
>
>  
>
> Do u know if the data cached on memcache is public for every instance? or
> its "private" for each browser user?
>
>  
>
> thank you
>
> 2012/2/1 Robert Kluin 
>
> Hi Leandro,
>  Think about the relative frequency of events.  It is probably
> massively more common to list game info than for a player to change
> their name / image, especially once they have a lot of data.  If
> that's the case, denormalizing might be a very good choice.  If
> someone does change their name/image you can easily use the taskqueue
> to update all their game info.
>
>  Depending on the data, you may also be able to keep the normalized
> model but reduce the number of reads.  Just gather a list of all
> entities you need to fetch, remove any duplicates, then get the info
> from those entities.  If there are some players who's stuff is very
> often displayed, use memcache to store their details.
>
>
> Robert
>
>
>
>
>
>
> On Tue, Jan 31, 2012 at 07:51, Leandro Rezende
>  wrote:
> > if i have 2 "Tables",
> >
> > "Table Player" , (Fields - PlayerKey, PlayerName, PlayerUrlPhoto)
> > "Table PlayerGames", (Fields - PlayerGameKey, PlayerKey, GameDate)
> >
> > if i wanna list all games, i will create a query in "PlayerGames", and to
> > show the "Players" info, i will have to "GetObjectbyID" to read
> PlayerName
> > and PLayerUrlPhoto.
> >
> > What is the best way to do this?
> >
> > 1 - Using GetObjectByID is the right way (spending 1 "datastore read"
> more
> > for each "PlayerGame" record)
> > 2 - Store at "PlayerGames" the fields that i know that i will need to
> list
> > in the future? (as playername and playerurlphoto, Saving the "DataStore
> > read" to get Player info)
> > 3 - Other way...
> >
> > * reminding that the player can change his name and his photo, so if i
> store
> > the name and photo at "PlayerGames" i will have to update all the records
> > too. (and will spend alot of DataStore Writes)
> >
> > Can someone give me a tip about this?
> >
> > thx
> >
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send 

Re: [google-appengine] Re: (mostly) Consistent 20-second delay in starting backend tasks

2012-02-01 Thread Nicholas Verne
Dave,

Two questions will help us clarify what you're observing.

Are your tasks added transactionally?

You mention the pattern of executing a task then enqueuing another. In
the one backend case, is there typically no more than one task in the
queue?

Nick Verne

On Thu, Feb 2, 2012 at 6:25 AM, Dave Loomer  wrote:
> Here are logs from three consecutive task executions over the past weekend,
> with only identifying information removed. You'll see that each task
> completes in a few milliseconds, but are 20 seconds apart (remember: I've
> already checked my queue configurations, nothing else is running on this
> backend, and I later solved the problem by setting countdown=1 when adding
> the task).  I don't see any pending latency mentioned.
>
> 0.1.0.2 - - [27/Jan/2012:18:33:20 -0800] 200 124 ms=10 cpu_ms=47
> api_cpu_ms=0 cpm_usd=0.60 queue_name=overnight-tasks
> task_name=15804554889304913211 instance=0
> 0.1.0.2 - - [27/Jan/2012:18:33:00 -0800] 200 124 ms=11 cpu_ms=0 api_cpu_ms=0
> cpm_usd=0.60 queue_name=overnight-tasks task_name=15804554889304912461
> instance=0
> 0.1.0.2 - - [27/Jan/2012:18:32:41 -0800] 200 124 ms=26 cpu_ms=0 api_cpu_ms=0
> cpm_usd=0.60 queue_name=overnight-tasks task_name=4499136807998063691
> instance=0
>
>
> The 20 seconds seems to happen regardless of length of task. Even though my
> tasks mostly complete in a couple minutes, I do have cases where they take
> several minutes, and I don't see a difference. Of course, when a task takes
> 5-10 minutes to complete, I'm going to notice and care about a 20-second
> delay much less than when I'm trying to spin through a few tasks in a minute
> (which is a real-world need for me as well).
>
> When reading up on pull queues a while back, I was a little confused about
> where I would use them with my own backends. I definitely could see an
> application for offloading work to an AWS Linux instance. But in either
> case, could you explain why it might help?
>
> I saw you mention in a separate thread how M/S can perform differently from
> HRD even in cases where one wouldn't expect to see a difference. When I get
> around to it I'm going to create a tiny HRD app and run the same tests
> through that.
>
> I also wonder if M/S could be responsible for frequent latencies in my admin
> console. Those have gotten more frequent and annoying the past couple of
> months ...
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/lbNQRQdSx0AJ.
>
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: App Engine SDK 1.6.2 is out!

2012-02-01 Thread Ron
why is Django 1.3 not available with Python 2.7 ?

and will Django non-rel be available in a future release?

On Jan 31, 11:17 pm, "Ikai Lan (Google)"  wrote:
> Hey everyone,
>
> Just wanted to announce that App Engine 1.6.2 is out! You can check out the
> blog post here:
>
> http://googleappengine.blogspot.com/2012/01/app-engine-162-released.html
>
> Note that if you're getting an import error for task queues, you're
> probably still using the old labs import. You'll want to get this cleared
> up (you'll also want to pay attention to deprecation warnings).
>
> Release notes are below for your reading pleasure:
>
> *Java 1.6.2*
> --
>
>    - The Admin Console Datastore Admin has added experimental backup and
>    restore functionality. The job occurs within your application and counts
>    against your application quota, including Instance Hours, Datastore Ops and
>    Datastore Storage.
>    - Developers can now specify how long a channel token will last until it
>    expires, with the default remaining two hours. Channel API quota is now
>    measured both in calls to create a channel and the number of hours of
>    channel time requested. The maximum hours of quota is the maximum number of
>    channel creation calls * 2, so free apps get 200 hours of requested
>    channel token time.
>    - Task Queue API requests now include a X-Appengine-TaskETA header, that
>    can be used to measure task delivery latency.
>    - We have removed the deprecated labs version of the TaskQueue API.
>    - The default API deadlines for Blobstore API calls have been raised to
>    15s for online and 30s for offline requests, up from 5s.
>    - The Images API now allows you to stretch an image without maintaining
>    the aspect ratio.
>       -http://code.google.com/p/googleappengine/issues/detail?id=2220
>    - Mail Quota for App Engine apps that have signed up for billing will
>    only be increased after the first payment for the app is processed.
>    - Fixed an issue where the SDK did not resize images down to 512 pixels
>    by default, as it does in production.
>    - Fixed an issue with the Images API where valid images were returning a
>    NotImageError.
>       -http://code.google.com/p/googleappengine/issues/detail?id=5545
>
> *Python 1.6.2*
> 
>
>    - The Admin Console Datastore Admin has added experimental backup and
>    restore functionality. The job occurs within your application and counts
>    against your application quota, including Instance Hours, Datastore Ops and
>    Datastore Storage.
>    - Developers can now specify how long a channel token will last until it
>    expires, with the default remaining two hours. Channel API quota is now
>    measured both in calls to create a channel and the number of hours of
>    channel time requested. The maximum hours of quota is the maximum number of
>    channel creation calls * 2, so free apps get 200 hours of requested
>    channel token time.
>    - Python Django now work with Cloud SQL without additional
>    configuration. For further information see
>    https://developers.google.com/cloud-sql/.
>    - Task Queue API requests now include a X-Appengine-TaskETA header, that
>    can be used to measure task delivery latency.
>    - The default API deadlines for Blobstore API calls have been raised to
>    15s for online and 30s for offline requests, up from 5s.
>    - The Images API now allows you to stretch an image without maintaining
>    the aspect ratio.
>       -http://code.google.com/p/googleappengine/issues/detail?id=2220
>    - The Blobstore API now includes the asynchronous function calls
>    create_upload_url_async, delete_async, and fetch_data_async.
>    - Django version 1.3 is now available in the Python 2.5 runtime.
>    - We've added a django_wsgi builtin to allow easier bootstrapping of
>    Django applications.
>    - Mail Quota for App Engine apps that have signed up for billing will
>    only be increased after the first payment for the app is processed.
>    - As announced in 1.6.1, in this release for the experimental Python 2.7
>    runtime, the mapreduce and datastore_admin builtins are not available to
>    apps deployed to Python 2.7.
>    - Fixed an issue with remote_api where calling fetch_page() with a page
>    size of 301 and chaining the calls through the returned cursor was skipping
>    half of the results.
>    - Fixed an issue where the PIL _imagingmath module was not available in
>    Python 2.7.
>    - Fixed an issue where the SDK did not resize images down to 512 pixels
>    by default, as it does in production.
>    - Fixed an issue with the Images API where valid images were returning a
>    NotImageError.
>       -http://code.google.com/p/googleappengine/issues/detail?id=5545
>    - Fixed an issue where the SDK didn't start when using Python 2.7 and
>    the --backends flag.
>       -http://code.google.com/p/googleappengine/issues/detail?id=6187
>    - Fixed an issue where

Re: [google-appengine] Re: Funny spikes in graphs

2012-02-01 Thread Andrin von Rechenberg
Interesting. Everything was looking fine in prodeagle,
but there is only so much I can monitor...

Did you ever figure out the cause for this?

Cheers,
-Andrin

On Wed, Feb 1, 2012 at 5:08 PM, Robert Kluin  wrote:

> Hey Andrin,
>  Do you know what your instances were doing when that was happening?
> I've had issues on a few apps in the past where my instances all got
> killed and respawned every 5 to 15 minutes.  I haven't seen that for a
> couple months though.
>
>
> Robert
>
>
> On Wed, Feb 1, 2012 at 03:19, Andrin von Rechenberg 
> wrote:
> > No I dont have that or other timed requests.
> > I'm pretty certain this problem is on Googles side
> > because RAM consumption also oscillates like this.
> > From 0 to max and back, and thats really almost
> > impossible.
> >
> > Ooohhh, I just noticed that they fixed it, thank you Google :)
> >
> > Cheers,
> > -Andrin
> >
> >
> > On Wed, Feb 1, 2012 at 7:50 AM, Robert Kluin 
> wrote:
> >>
> >> By "reason" I meant such as an AJAX app controlling when requests are
> >> made, etc
> >>
> >>
> >>
> >> On Wed, Feb 1, 2012 at 01:49, Robert Kluin 
> wrote:
> >> > Is there a reason your trafic would be bursty? I've seen strange
> >> > patterns like that when there are scheduled jobs, but never from
> >> > browser-based user traffic alone.
> >> >
> >> >
> >> > Robert
> >> >
> >> >
> >> >
> >> >
> >> > On Tue, Jan 31, 2012 at 15:59, Andrin von Rechenberg
> >> >  wrote:
> >> >> I'm doing 250 queries per second. ProdEagle one per minute. Its not
> >> >> from
> >> >> that...
> >> >>
> >> >> :)
> >> >>
> >> >> On Jan 31, 2012 4:58 PM, "bFlood" 
> wrote:
> >> >>>
> >> >>> maybe it's ProdEagle itself, that hits your app every minute
> >> >>>
> >> >>>
> >> >>>
> >> >>> On Jan 31, 10:16 am, Mike Wesner 
> wrote:
> >> >>> > Have you looked at the logs to see what/who is making the
> requests?
> >> >>> > It could be some type of polling or service that is making
> requests
> >> >>> > at
> >> >>> > those intervals.
> >> >>> >
> >> >>> > -Mike
> >> >>> >
> >> >>> > On Jan 31, 8:40 am, Andrin von Rechenberg 
> >> >>> > wrote:
> >> >>> >
> >> >>> >
> >> >>> >
> >> >>> >
> >> >>> >
> >> >>> >
> >> >>> >
> >> >>> > > Hey there
> >> >>> >
> >> >>> > > My dashboard shows funny spikes in all graphs (qps, bandwidth,
> >> >>> > > ram).
> >> >>> > > It's been doing this for a couple of days now. ProdEagle shows
> >> >>> > > everything
> >> >>> > > is fine, so I guess something must be messed up on Google's
> >> >>> > > side...
> >> >>> >
> >> >>> > > Anyone else seeing this?
> >> >>> >
> >> >>> > > Cheers,
> >> >>> > > -Andrin
> >> >>> >
> >> >>> > >  Screen shot 2012-01-31 at 3.38.39 PM.png
> >> >>> > > 56KViewDownload
> >> >>>
> >> >>> --
> >> >>> You received this message because you are subscribed to the Google
> >> >>> Groups
> >> >>> "Google App Engine" group.
> >> >>> To post to this group, send email to
> >> >>> google-appengine@googlegroups.com.
> >> >>> To unsubscribe from this group, send email to
> >> >>> google-appengine+unsubscr...@googlegroups.com.
> >> >>> For more options, visit this group at
> >> >>> http://groups.google.com/group/google-appengine?hl=en.
> >> >>>
> >> >> --
> >> >> You received this message because you are subscribed to the Google
> >> >> Groups
> >> >> "Google App Engine" group.
> >> >> To post to this group, send email to
> google-appengine@googlegroups.com.
> >> >> To unsubscribe from this group, send email to
> >> >> google-appengine+unsubscr...@googlegroups.com.
> >> >> For more options, visit this group at
> >> >> http://groups.google.com/group/google-appengine?hl=en.
> >>
> >> --
> >> You received this message because you are subscribed to the Google
> Groups
> >> "Google App Engine" group.
> >> To post to this group, send email to google-appengine@googlegroups.com.
> >> To unsubscribe from this group, send email to
> >> google-appengine+unsubscr...@googlegroups.com.
> >> For more options, visit this group at
> >> http://groups.google.com/group/google-appengine?hl=en.
> >>
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, se

Re: [google-appengine] Re: Put_Async Use It

2012-02-01 Thread Andrin von Rechenberg
One thing I dont understand is, if one runs python2.7 with thread safe
enabled,
why would this reduce instance hours? Wouldn't the instance just handle
other tasks until the non-async rpc is complete? Or is a sync rpc blocking
the instance from handling another request (would surprise me)?
I'm assuming one has a lot of requests.

(Left aside the RAM & Latency optimization one would get)

Cheers,
-Andrin

On Wed, Feb 1, 2012 at 7:25 PM, Brandon Wirtz  wrote:

> I got deferred working. Missed that you have to enable it as a built in,
> which I chalk up as I shouldn't code when people are out of office and I'm
> tired.
>
> The result seems to be pretty awesome.  Not waiting for writes speeds us
> up,
> and pacing the tasks evens out the peaks and valleys of our instance use.
>
> I don't think we will save actual CPU hours, but by filling the valleys and
> delaying the peaks we should use fewer instance hours.
>
> The biggest thing I learned... Don't walk away when debugging 5 QPS spawned
> 1 task per second, which when it threw and error resulted in more tasks
> piling up and more instances... it would be expensive if I had just
> wandered
> off.
>
> Brandon Wirtz
> BlackWaterOps: President / Lead Mercenary
>
> Work: 510-992-6548
> Toll Free: 866-400-4536
> IM: drak...@gmail.com (Google Talk)
> Skype: drakegreene
> YouTube: BlackWaterOpsDotCom
>
> BlackWater Ops
>
> Cloud On A String Mastermind Group
>
>
>
>
>
>
>
> -Original Message-
> From: google-appengine@googlegroups.com
> [mailto:google-appengine@googlegroups.com] On Behalf Of Robert Kluin
> Sent: Tuesday, January 31, 2012 11:10 PM
> To: google-appengine@googlegroups.com
> Subject: Re: [google-appengine] Re: Put_Async Use It
>
> There is a good chance the gains you saw are due to improved batching.
>  The other gains are probably from async, ie you being able to prepare the
> data for your next put or fetch more data rather than waiting around.  If
> you're using Java, could also be multithreading gains.
>
> As Jeff said, all RPCs are flushed when your request handler returns.
>
>
>
>
> On Tue, Jan 31, 2012 at 19:43, James X Nelson 
> wrote:
> > Async everything will always save you instance hours.  It doesn't
> > matter if you are threadsafe or not, the async operations allow you to
> > perform a ds / memcahce / url fetch in a background thread, which you
> > can check on whenever you want.
> >
> > Async is extremely useful if you use it to perform "datastore
> > streaming"; if you have to operate on thousands of entities, you can
> > cut your runtime from "all of the time to create and persist all of
> > the entities" to "all of the time to create all of the entities, and
> > little to no time waiting for ds operations to complete".  I use a
> > helper object to stream all my writes, deletes and reads in async
> > batches, with custom page sizing.  The helper holds the entities in
> > memory, async puts() them in batches when the page size is reached,
> > and holds the entities in memory until their put() succeeds, so it can
> > retry anything that fails.  Another easy way to retry a future, at
> > least in Java, is to create a subclass of Future that takes
> > the Entity as a param, wraps the appengine Future, and
> > automatically retries in transient errors.  For retry, I use synchronous
> rather than async again, but you can do whatever you like.
> >
> > Using async everywhere, with threadsafe, got our app down from $30/day
> > for frontend instance hours to ~$0/day for frontend instance hours.
> > We generally have 4-6 live instances, but only use approximately 1
> > instance hour / hour.
> > The trick is that all your api operations can happen in the
> > background, so your total processing time is near or equal to your
> > "userland" processing only.
> >
> > PS - Anyone that doesn't actually call .get() on their futures to
> > finalize your async operations could lose data, especially if the last
> > operation in your method is an async put.  Async operations started by
> > your current processing thread die when the thread returns {in
> > production}, so make sure you call .get() on the returned future.
> >
> > --
> > You received this message because you are subscribed to the Google
> > Groups "Google App Engine" group.
> > To view this discussion on the web visit
> > https://groups.google.com/d/msg/google-appengine/-/hK5rhcibQ1oJ.
> >
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://

Re: [google-appengine] State of Python 2.7

2012-02-01 Thread Andrin von Rechenberg
Thanks for the reply. Let the migration begin!

-Andrin

On Wed, Feb 1, 2012 at 7:30 PM, Chris Ramsdale  wrote:

> Hey Andrin,
>
> Python 2.7 is very close to being announced as GA. We're monitoring the
> apps that have already moved over to 2.7 and are making some final
> performance tweaks -- things are looking good. Trust me, we want to get
> this door as bad as any one else.
>
> -- Chris
>
> Product Manager, Google App Engine
>
>
> On Wed, Feb 1, 2012 at 3:41 AM, Andrin von Rechenberg 
> wrote:
>
>> Hey there
>>
>> I was wondering what the state of Python 2.7 is.
>>
>> @Google: Will it be moved out of experimental soonish?
>>
>> @Everyone: Has anyone used it in a big production app?
>>
>> Cheers,
>> =Andrin
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> To unsubscribe from this group, send email to
>> google-appengine+unsubscr...@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/google-appengine?hl=en.
>>
>
>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: App Engine SDK 1.6.2 is out!

2012-02-01 Thread Kyle Finley
Thank you for your reply Moishe.

It's good to know that the "create" quote is on it's way out. 

I'm not sure that charging by "minutes requested" apposed to "minutes consumed" 
actually solves the problem, thought. Instead of reusing one "long lived 
channel" developers will be forced to create many "short lived channels", 
unless there's some financial deterrent in doing so. 

Also, charging by "minutes requested" seems contrary to App Engine philosophy 
of pay for the resources you use, and more like a cell phone plan, which relies 
on people purchasing based on least surprise.  I don't see the later 
translating well in this environment, however.  I can't imagine a developer 
paying for excess minutes, just to prevent a disconnect by app engine, when 
they would have to prepare for this anyways. 

In my mind the ideal solution would better mirror web sockets. Where I don't 
need to decide a head of time how long a user might decide to say on my site.

If there is an increased cost associated with the channel creation, on your 
end, I personally wouldn't be apposed to a minimum minute expiration ( much 
like the 15min instance minimum ). 

Thanks for listening,

Kyle 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: (mostly) Consistent 20-second delay in starting backend tasks

2012-02-01 Thread Dave Loomer
Here are logs from three consecutive task executions over the past weekend, 
with only identifying information removed. You'll see that each task 
completes in a few milliseconds, but are 20 seconds apart (remember: I've 
already checked my queue configurations, nothing else is running on this 
backend, and I later solved the problem by setting countdown=1 when adding 
the task).  I don't see any pending latency mentioned.

0.1.0.2 - - [27/Jan/2012:18:33:20 -0800] 200 124 ms=10 cpu_ms=47 
api_cpu_ms=0 cpm_usd=0.60 queue_name=overnight-tasks 
task_name=15804554889304913211 instance=0
0.1.0.2 - - [27/Jan/2012:18:33:00 -0800] 200 124 ms=11 cpu_ms=0 
api_cpu_ms=0 cpm_usd=0.60 queue_name=overnight-tasks 
task_name=15804554889304912461 instance=0
0.1.0.2 - - [27/Jan/2012:18:32:41 -0800] 200 124 ms=26 cpu_ms=0 
api_cpu_ms=0 cpm_usd=0.60 queue_name=overnight-tasks 
task_name=4499136807998063691 instance=0


The 20 seconds seems to happen regardless of length of task. Even though my 
tasks mostly complete in a couple minutes, I do have cases where they take 
several minutes, and I don't see a difference. Of course, when a task takes 
5-10 minutes to complete, I'm going to notice and care about a 20-second 
delay much less than when I'm trying to spin through a few tasks in a 
minute (which is a real-world need for me as well).

When reading up on pull queues a while back, I was a little confused about 
where I would use them with my own backends. I definitely could see an 
application for offloading work to an AWS Linux instance. But in either 
case, could you explain why it might help?

I saw you mention in a separate thread how M/S can perform differently from 
HRD even in cases where one wouldn't expect to see a difference. When I get 
around to it I'm going to create a tiny HRD app and run the same tests 
through that.

I also wonder if M/S could be responsible for frequent latencies in my 
admin console. Those have gotten more frequent and annoying the past couple 
of months ...

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/lbNQRQdSx0AJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] State of Python 2.7

2012-02-01 Thread Chris Ramsdale
Hey Andrin,

Python 2.7 is very close to being announced as GA. We're monitoring the
apps that have already moved over to 2.7 and are making some final
performance tweaks -- things are looking good. Trust me, we want to get
this door as bad as any one else.

-- Chris

Product Manager, Google App Engine


On Wed, Feb 1, 2012 at 3:41 AM, Andrin von Rechenberg wrote:

> Hey there
>
> I was wondering what the state of Python 2.7 is.
>
> @Google: Will it be moved out of experimental soonish?
>
> @Everyone: Has anyone used it in a big production app?
>
> Cheers,
> =Andrin
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] Re: Put_Async Use It

2012-02-01 Thread Brandon Wirtz
I got deferred working. Missed that you have to enable it as a built in,
which I chalk up as I shouldn't code when people are out of office and I'm
tired.

The result seems to be pretty awesome.  Not waiting for writes speeds us up,
and pacing the tasks evens out the peaks and valleys of our instance use.

I don't think we will save actual CPU hours, but by filling the valleys and
delaying the peaks we should use fewer instance hours.

The biggest thing I learned... Don't walk away when debugging 5 QPS spawned
1 task per second, which when it threw and error resulted in more tasks
piling up and more instances... it would be expensive if I had just wandered
off.

Brandon Wirtz
BlackWaterOps: President / Lead Mercenary

Work: 510-992-6548
Toll Free: 866-400-4536
IM: drak...@gmail.com (Google Talk)
Skype: drakegreene
YouTube: BlackWaterOpsDotCom

BlackWater Ops

Cloud On A String Mastermind Group







-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Robert Kluin
Sent: Tuesday, January 31, 2012 11:10 PM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Re: Put_Async Use It

There is a good chance the gains you saw are due to improved batching.
 The other gains are probably from async, ie you being able to prepare the
data for your next put or fetch more data rather than waiting around.  If
you're using Java, could also be multithreading gains.

As Jeff said, all RPCs are flushed when your request handler returns.




On Tue, Jan 31, 2012 at 19:43, James X Nelson 
wrote:
> Async everything will always save you instance hours.  It doesn't
> matter if you are threadsafe or not, the async operations allow you to
> perform a ds / memcahce / url fetch in a background thread, which you
> can check on whenever you want.
>
> Async is extremely useful if you use it to perform "datastore
> streaming"; if you have to operate on thousands of entities, you can
> cut your runtime from "all of the time to create and persist all of
> the entities" to "all of the time to create all of the entities, and
> little to no time waiting for ds operations to complete".  I use a
> helper object to stream all my writes, deletes and reads in async
> batches, with custom page sizing.  The helper holds the entities in
> memory, async puts() them in batches when the page size is reached,
> and holds the entities in memory until their put() succeeds, so it can
> retry anything that fails.  Another easy way to retry a future, at
> least in Java, is to create a subclass of Future that takes
> the Entity as a param, wraps the appengine Future, and
> automatically retries in transient errors.  For retry, I use synchronous
rather than async again, but you can do whatever you like.
>
> Using async everywhere, with threadsafe, got our app down from $30/day
> for frontend instance hours to ~$0/day for frontend instance hours.  
> We generally have 4-6 live instances, but only use approximately 1
> instance hour / hour.
> The trick is that all your api operations can happen in the
> background, so your total processing time is near or equal to your
> "userland" processing only.
>
> PS - Anyone that doesn't actually call .get() on their futures to
> finalize your async operations could lose data, especially if the last
> operation in your method is an async put.  Async operations started by
> your current processing thread die when the thread returns {in
> production}, so make sure you call .get() on the returned future.
>
> --
> You received this message because you are subscribed to the Google
> Groups "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/hK5rhcibQ1oJ.
>
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: App Engine SDK 1.6.2 is out!

2012-02-01 Thread Moishe
Unfortunately the initial release notes were incorrect about measuring the 
quota. Current metrics are still in place, but developers can change the 
expiration.

Over time we will switch over to removing the 'create' quota and billing 
and bill/assign quota by minutes only. However minutes will stay as 
"minutes requested" rather than "minutes consumed" for the foreseeable 
future.

-Moishe

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/PM9Nt8IoBj0J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: SLOW

2012-02-01 Thread A1programmer
Getting the same issues here... again...

Java for me.

Requests that are usually sub 200ms are now 3 to 4 seconds (if I'm
lucky).  Occasionally they're between 20 and 30 seconds.

On Feb 1, 12:15 pm, pdknsk  wrote:
> It hasn't helped here. The problem isn't even the short >10s spikes,
> but the sometimes many hours before it, with >1s response time (from
> usually ~100ms). It seems quite clear to me that the response time
> builds up slowly, suddenly peaks, and returns back to normal
> immediately. Shortly after that it builds up again.
>
> http://goo.gl/uUXqD

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: SLOW

2012-02-01 Thread pdknsk
It hasn't helped here. The problem isn't even the short >10s spikes,
but the sometimes many hours before it, with >1s response time (from
usually ~100ms). It seems quite clear to me that the response time
builds up slowly, suddenly peaks, and returns back to normal
immediately. Shortly after that it builds up again.

http://goo.gl/uUXqD

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Groundhog Day: Fatal - Wrong mime-type in CSS responses

2012-02-01 Thread Mos
Hello again,

can't believe it?!
The critical bug you fixed with 1.6.1.1  is reintroduced with the new
version.

Just deployed my application with 1.6.2 and again the css-files are
returned with mime-type of null
--> breaks the site in most browsers!

Please reopen the ticket:
http://code.google.com/p/googleappengine/issues/detail?id=6655

@Ikai:  You still have my app-id and access-password, if you would see the
bug in action.

@GAE-Team: What's going on with your version-control / regression-testing?
Did we have to wait again two weeks for a fix with 1.6.2.1?

Cheers
Mos



On Mon, Jan 9, 2012 at 6:44 PM, Mos  wrote:

> Hello GAE-Team,
>
> no news in 24h on this critical issue?
>
> I'm new to GAE and we will release our first application the next days.
> But this issue make me loose my confidence in GAE's reliability. I get
> doubt if Google App Engine was the right choice?
>
> As Jon mentioned: The issue is around on this list for more than two weeks.
> The issue breaks applications --> downtimes for more and more of your GAEs
> users
>
> And what I'm really wondering:
> It seems to be a simple fix on the GAE-Frontends. It shouldn't be such a
> complex thing,
> to evaluate why the response header sends a null mime-type and not the css
> mime-type for some
> application's  *.css files? You have more then one test-case on this
> Your GAE guys are so smart and can't fix this one?
>
> Cheers
> Mos
>
>
>
> On Sun, Jan 8, 2012 at 11:15 PM, Amy Unruh  wrote:
>
>> Mos (and others),
>>
>> The issue is being actively investigated; we'll be sure to update this
>> thread and the issue page as soon as there is more to report.
>> Mos, you can go ahead and re-deploy if you want, as we have other test
>> cases as this point.
>>
>>  -Amy
>>
>>
>> On Mon, Jan 9, 2012 at 5:00 AM, Mos  wrote:
>>
>>> Hello Ikai,
>>>
>>> did you have the chance to evaluate on the issue?
>>> I sent you my broken test version / URL  two days ago.
>>>
>>> I wanna redeploy in near future, but don't want to destroy "your
>>> test-case".
>>>
>>> Please give some feedback.
>>>
>>> Further I think we should put the issue on critical, because this bug
>>> breaks
>>> webpages and many people are affected:
>>>
>>> http://code.google.com/p/googleappengine/issues/detail?id=6655
>>>
>>> Cheers
>>> Mos
>>>
>>>
>>>
>>>
>>>
>>> On Fri, Jan 6, 2012 at 12:26 PM, Mos  wrote:
>>>
 Hi Ikai,

 the problem occurs in all browsers (I tested Firefox, Chrome and IE).
 All browsers get a mime-type of null.
 Firefox is able to interpret the stylesheet nevertheless. IE and Chrome
 fail and the site is destroyed.

 Since yesterday I have a version of my application that still has the
 problem.
 I sent you the URL and the Beta-Login in a private email.

 I need to redepoy at the weekend, so please check it in the next hours.

 Greetings Mos


 On Thu, Jan 5, 2012 at 9:06 PM, Ikai Lan (Google) wrote:

> Mos, what browser is this?
>
> I've seen some talk of this but it's passing and we can't seem to
> catch it in action. I need more data so I can hunt this down - URLs when
> this is failing. The reports I've seen are that this happens specifically
> to Chrome users.
>
> --
> Ikai Lan
> Developer Programs Engineer, Google App Engine
> plus.ikailan.com | twitter.com/ikai
>
>
>
> On Thu, Jan 5, 2012 at 8:37 AM, Mos  wrote:
>
>> Just found the issue
>> http://code.google.com/p/googleappengine/issues/detail?id=6655
>>
>> It's three days old and describes a fatal error that seems to hit
>> more and more people.
>>
>> No response from Google?
>>
>>
>> On Thu, Jan 5, 2012 at 5:30 PM, Mos  wrote:
>>
>>> My site is down currently, because GAE response CSS files without
>>> mime-type:
>>>
>>> REQUEST:
>>>
>>> GET /static/css/master.css HTTP/1.1
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> ...
>>> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; 
>>> rv:1.9.2.25) Gecko/20111212 Firefox/3.6.25
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> Accept: text/css,*/*;q=0.1
>>> ..
>>>
>>> WRONG RESPONSE:
>>>
>>> HTTP/1.1 200 OK
>>> Etag: "sR7Bag"
>>> Date: Thu, 05 Jan 2012 16:22:34 GMT
>>> Expires: Thu, 05 Jan 2012 16:32:34 GMT
>>> Cache-Control: public, max-age=600
>>> Content-Type: null
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> Server: Google Frontend
>>> Content-Length: 37206
>>>
>>> Does anybody else have the problem?
>>>
>>
>>  --
>> You received this message because you are subscribed to the Google
>> Groups "Google App Engine" group.
>> To post to this group, send email to
>> google-appengine@googlegroups.com.
>> To unsubscribe from this gro

[google-appengine] Using associated domain for appengine apps

2012-02-01 Thread Klaas Pieter Annema
Is it possible to use an associated google apps domain for an app engine 
application? 
After adding the domain under Domain Settings in the Google Apps dashboard I 
can't choose it in the Add new URL drop down menu in the settings for the app 
engine application.

- Klaas Pieter

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Datastore restore failure

2012-02-01 Thread Francois Masurel
I get this message when I try to restore a datastore backup :

Restore from backup Job Status 

There was a problem kicking off the jobs. The error was: 

: Huge tasks should specify parent entity.


Any help will be greatly appreciated.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/-snk_h1Wt9sJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] 800 MB Datastorage for 11 entities.

2012-02-01 Thread Timofey Koolin
No - I delete all blobs with other data.
I have no blob objects, but quota detail show 0.02Gb usage.

Last days I don't use tasks.

2012/2/1 Robert Kluin 

> Hi Timofey,
>  Do you have any blobs?  Do you make heavy usage of tasks?
>
>  There can be a delay after deleting data and the space actually
> being freed up, since the datastore does "soft" deletes.  However, I
> don't remember ever seeing this take 3 days.
>
>
> Robert
>
>
>
>
> On Wed, Feb 1, 2012 at 04:03, Timofey Koolin  wrote:
> > Now I store in datastore:
> > 1 Email - 5KB
> > 9 User - 2KB
> > 1  _AE_DatastoreAdmin_Operation - 300 Bytes
> >
> > BUT
> > summary statistic:
> > Total number of entities: 289,951
> > Total size: 227MB
> >
> > In quota details: 0.83GB
> >
> >
> > It is application in development state.
> > I have about 1-2 mounth active write-delete entities. In result I add to
> > storage about 1500 entities per day.
> >
> > Some days ago I delete all of this and ways 2-3 days for reset quota 2-3
> > times.
> > Now I have 11 entities in my storage and giant overhead.
> >
> > Why space don't freed in my storage after I delete my data?
> >
> >
> > I attach summary screenshots and quota detail row.
> >
> > --
> > Blog: www.rekby.ru
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Blog: www.rekby.ru

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Is App Engine suitable for write intensive applications?

2012-02-01 Thread Robert Kluin
Hey Richard,
  I believe indexes are written similar to what you've stated there.
You can use namespaces to mitigate this problem.  The other way to
"shard" would be to prefix the value with some known value -- like a
letter.  That way you spread the load across multiple index shards.
Both of these result in the same basic pain point though, to do a
"global" query you need to run a query within each of the shards then
join the results.

  In the past I've worked around this problem in several different
ways.  The best is to see if there is a natural way to "shard" the
index such that you won't need to do queries across the shards.  If
you can do that, you're done.  It also depends on what the problem
value is used for.  In some cases it may not need to be so precise, so
you can spread the load around a bit by randomizing the value within
some acceptable range of error.  I've also used the task-queue to
control the rate at which the problem entities get written.  This can
help if you've got very bursty write rates.



Robert





On Wed, Feb 1, 2012 at 09:00, Richard Watson  wrote:
> I haven't mixed it up with entity groups, I refer only to sharding in the
> context of an index. Apologies if my use of the terminology confused the
> issue in any way.
>
> My point was that the entries in the index are surely already sharded by
> some kind of prefix. There's no way all apps that save current millis in a
> field are being indexed on the same tablet. They must have some type of
> separation, which could maybe be achieved by prefix.  For example, the index
> entry could be something like
> [AppId][NamespaceId][EntityName][FieldName][123456789], which would remove
> contention between apps.  If [Namespace] is in there, then any apps that use
> namespaces already have a built-in natural shard point for index entries.
>
> And I think the point about adding the indexed field value later is still
> valid.  Save the value in an unindexed field (e.g. unindexedTimestamp), and
> then update the indexed field (indexedTimestamp) via a task later,
> controlling the frequency of saves so it reduced impact on the index
> tablets.  That way you don't mess about with prefixes and adding result sets
> together.
>
> Richard
>
> [1] Does an index entry look like this:
> [AppId][NamespaceId][
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/3Ltu7gGC8EsJ.
>
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] 800 MB Datastorage for 11 entities.

2012-02-01 Thread Robert Kluin
Hi Timofey,
  Do you have any blobs?  Do you make heavy usage of tasks?

  There can be a delay after deleting data and the space actually
being freed up, since the datastore does "soft" deletes.  However, I
don't remember ever seeing this take 3 days.


Robert




On Wed, Feb 1, 2012 at 04:03, Timofey Koolin  wrote:
> Now I store in datastore:
> 1 Email - 5KB
> 9 User - 2KB
> 1  _AE_DatastoreAdmin_Operation - 300 Bytes
>
> BUT
> summary statistic:
> Total number of entities: 289,951
> Total size: 227MB
>
> In quota details: 0.83GB
>
>
> It is application in development state.
> I have about 1-2 mounth active write-delete entities. In result I add to
> storage about 1500 entities per day.
>
> Some days ago I delete all of this and ways 2-3 days for reset quota 2-3
> times.
> Now I have 11 entities in my storage and giant overhead.
>
> Why space don't freed in my storage after I delete my data?
>
>
> I attach summary screenshots and quota detail row.
>
> --
> Blog: www.rekby.ru
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Authentication on a GAE App only for a selected Google Apps domains list

2012-02-01 Thread Robert Kluin
Hi Antoine,
  Glad you got that figured out.

  You should be able to have login required on your apps, just as
before. You'll just need to be sure to define a handler for
login_required (as is explained in the article).  Note that you won't
get redirected to it on the dev server, so you'll need to directly go
to the url to test it out.


Robert





On Wed, Feb 1, 2012 at 04:42, Antoine  wrote:
> Ok, I ve found out.
>
> this should be the URL for Google Apps domains :
>
> www.google.com/accounts/o8/site-xrds?hd=example.com
>
>
>
> On Feb 1, 4:59 pm, Antoine  wrote:
>> Thank you for your answer.
>>
>> I tried to follow this tutorial (I dont know why I didnt find it
>> before... :s ).
>>
>> However, I have a question left.
>>
>> I decided to let the user choose his domain by clicking on his domain
>> link.
>>
>> I deleted the "login required" in app.yaml and modified my main.py
>> such as...
>>
>> My python looks like :
>>
>> ---
>> #
>> #code
>> #
>>
>> providers = {
>>     'prov 1'   : 'google.com/a/domain.com',
>>     'prov 2'    : 'google.com/a/subdomain1.com',
>>     'prov 3'    : 'google.com/a/subdomain2.com'
>>     # add more here
>>
>> }
>>
>> #
>> #code
>> #
>>
>> else:
>>       self.response.out.write('Hello world! Sign in at: ')
>>       for name, uri in providers.items():
>>         self.response.out.write('[%s]' %
>> (users.create_login_url(federated_identity=uri), name))
>>
>> #
>> #code
>> #
>>
>> ---
>>
>> However links are not redirecting user...
>> I guess it should work, if you do this yourelf, that each Google Apps
>> domain should be used as a direct provider federated entities ?
>>
>> What should I do to have Google Apps domains login page after clicking
>> on a link (and get redirection to my app after authentication against
>> Google, of course) ?
>> I guess I dont have the right link/approach because, with myopenid.com
>> it's working (redirecting).
>>
>> thx in advance
>> Antoine
>>
>> On Jan 31, 1:34 pm, Robert Kluin  wrote:
>>
>>
>>
>>
>>
>>
>>
>> > HeyAntoine,
>> >   Use OpenID / Federated login.  You can provide users with a list of
>> > subdomains, or check them against that.  I usually either give users
>> > the option to enter their domain or email address (from which I can
>> > deduce the domain), then redirect them to the proper page.  It is
>> > pretty straight forward to do.
>>
>> >   I think Wesley's article on federated login provides all the basics.
>> >    http://code.google.com/appengine/articles/openid.html
>>
>> > Robert
>>
>> > On Sun, Jan 29, 2012 at 22:57,Antoine wrote:
>> > > Hi everyone,
>>
>> > > I am working on a simple application (actually a website) on Google
>> > > App Engine.
>> > > This application should be accessible only for a selected Google Apps
>> > > domains list.
>>
>> > > These domains are corporate Google Apps subdomains. One Google Apps
>> > > account domain handle several subdomains, one for each business unit.
>>
>> > > I would like to restrict my apps to those domain.
>>
>> > > However, there is only 3 ways to secure my app (Application Settings /
>> > > Authentication Options in Google App Engine Console) :
>> > > - Google Accounts API
>> > > - Google App Domain
>> > > - Open ID (Federated Login)
>>
>> > > For the first one, it can work, however, as we are using Federation
>> > > Login for all Google Apps domains, we dont want the user to login
>> > > twice : one on the Google Account Sign-in webpage which is displayed
>> > > automatically when we choose Google Accounts, and then on the
>> > > federation page.
>> > > Because with this Google App Engine authentication, the user is first
>> > > redirected to :http://accounts.google.com
>> > > then enter its credentials Google Apps, then Google tell him that
>> > > federation is working for this domain so he just need to Click to be
>> > > redirected.
>> > > This is not user friendly.
>>
>> > > Second one, works only with one Google App Primary domain. Subdomain
>> > > doesnt work with this feature...
>>
>> > > Maybe third one, Open ID/ Federated login, can work, but how ?
>>
>> > > Thx
>> > >Antoine
>>
>> > > --
>> > > You received this message because you are subscribed to the Google 
>> > > Groups "Google App Engine" group.
>> > > To post to this group, send email to google-appengine@googlegroups.com.
>> > > To unsubscribe from this group, send email to 
>> > > google-appengine+unsubscr...@googlegroups.com.
>> > > For more options, visit this group 
>> > > athttp://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received 

Re: [google-appengine] Re: Funny spikes in graphs

2012-02-01 Thread Robert Kluin
Hey Andrin,
  Do you know what your instances were doing when that was happening?
I've had issues on a few apps in the past where my instances all got
killed and respawned every 5 to 15 minutes.  I haven't seen that for a
couple months though.


Robert


On Wed, Feb 1, 2012 at 03:19, Andrin von Rechenberg  wrote:
> No I dont have that or other timed requests.
> I'm pretty certain this problem is on Googles side
> because RAM consumption also oscillates like this.
> From 0 to max and back, and thats really almost
> impossible.
>
> Ooohhh, I just noticed that they fixed it, thank you Google :)
>
> Cheers,
> -Andrin
>
>
> On Wed, Feb 1, 2012 at 7:50 AM, Robert Kluin  wrote:
>>
>> By "reason" I meant such as an AJAX app controlling when requests are
>> made, etc
>>
>>
>>
>> On Wed, Feb 1, 2012 at 01:49, Robert Kluin  wrote:
>> > Is there a reason your trafic would be bursty? I've seen strange
>> > patterns like that when there are scheduled jobs, but never from
>> > browser-based user traffic alone.
>> >
>> >
>> > Robert
>> >
>> >
>> >
>> >
>> > On Tue, Jan 31, 2012 at 15:59, Andrin von Rechenberg
>> >  wrote:
>> >> I'm doing 250 queries per second. ProdEagle one per minute. Its not
>> >> from
>> >> that...
>> >>
>> >> :)
>> >>
>> >> On Jan 31, 2012 4:58 PM, "bFlood"  wrote:
>> >>>
>> >>> maybe it's ProdEagle itself, that hits your app every minute
>> >>>
>> >>>
>> >>>
>> >>> On Jan 31, 10:16 am, Mike Wesner  wrote:
>> >>> > Have you looked at the logs to see what/who is making the requests?
>> >>> > It could be some type of polling or service that is making requests
>> >>> > at
>> >>> > those intervals.
>> >>> >
>> >>> > -Mike
>> >>> >
>> >>> > On Jan 31, 8:40 am, Andrin von Rechenberg 
>> >>> > wrote:
>> >>> >
>> >>> >
>> >>> >
>> >>> >
>> >>> >
>> >>> >
>> >>> >
>> >>> > > Hey there
>> >>> >
>> >>> > > My dashboard shows funny spikes in all graphs (qps, bandwidth,
>> >>> > > ram).
>> >>> > > It's been doing this for a couple of days now. ProdEagle shows
>> >>> > > everything
>> >>> > > is fine, so I guess something must be messed up on Google's
>> >>> > > side...
>> >>> >
>> >>> > > Anyone else seeing this?
>> >>> >
>> >>> > > Cheers,
>> >>> > > -Andrin
>> >>> >
>> >>> > >  Screen shot 2012-01-31 at 3.38.39 PM.png
>> >>> > > 56KViewDownload
>> >>>
>> >>> --
>> >>> You received this message because you are subscribed to the Google
>> >>> Groups
>> >>> "Google App Engine" group.
>> >>> To post to this group, send email to
>> >>> google-appengine@googlegroups.com.
>> >>> To unsubscribe from this group, send email to
>> >>> google-appengine+unsubscr...@googlegroups.com.
>> >>> For more options, visit this group at
>> >>> http://groups.google.com/group/google-appengine?hl=en.
>> >>>
>> >> --
>> >> You received this message because you are subscribed to the Google
>> >> Groups
>> >> "Google App Engine" group.
>> >> To post to this group, send email to google-appengine@googlegroups.com.
>> >> To unsubscribe from this group, send email to
>> >> google-appengine+unsubscr...@googlegroups.com.
>> >> For more options, visit this group at
>> >> http://groups.google.com/group/google-appengine?hl=en.
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> To unsubscribe from this group, send email to
>> google-appengine+unsubscr...@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/google-appengine?hl=en.
>>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: ImageService.getServingUrl() and migration to HRD

2012-02-01 Thread Ronoaldo Pereira
Robert,

Thanks for your tip. I filled the issue 
here: http://code.google.com/p/googleappengine/issues/detail?id=6848

Hope to find a solution soon.

Best Regards,

--
Ronoaldo Pereira

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/SbBGW_PKzHcJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: App Engine SDK 1.6.2 is out!

2012-02-01 Thread Cezary Wagner
Still no Django 1.3 since not deployed on server - check this out:
http://code.google.com/p/googleappengine/issues/detail?id=6847&sort=-id&colspec=ID%20Type%20Component%20Status%20Stars%20Summary%20Language%20Priority%20Owner%20Log

On Feb 1, 2:20 pm, sebastián serrano 
wrote:
> Python Django now work with Cloud SQL without additional configuration So
> cool.
>
> Thanks!!!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] State of Python 2.7

2012-02-01 Thread Brandon Wirtz
We burst to 500 and are on 2.7 we have load tested to 5000.
 
I am not finding the 2.7 issues list. There are a few, most are around
Startup and latency fluxuations. But there are a few others.
 

Brandon Wirtz 
BlackWaterOps: President / Lead Mercenary 
Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg


Work: 510-992-6548 
Toll Free: 866-400-4536 
IM: drak...@gmail.com (Google Talk) 
Skype: drakegreene 
YouTube:   BlackWaterOpsDotCom 


  BlackWater Ops 

  Cloud On A String Mastermind Group



 
 
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Andrin von
Rechenberg
Sent: Wednesday, February 01, 2012 4:14 AM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] State of Python 2.7
 
... where are these bugs documented?
On Wed, Feb 1, 2012 at 1:11 PM, Andrin von Rechenberg 
wrote:
~500 qps...
 
On Wed, Feb 1, 2012 at 12:51 PM, Brandon Wirtz  wrote:
How big is big?  I have a lot of apps on it. And very happy.  There are a
few bugs that are documented that we coded around.
 

Brandon Wirtz 
BlackWaterOps: President / Lead Mercenary 
Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg


Work: 510-992-6548 
Toll Free: 866-400-4536 
IM: drak...@gmail.com (Google Talk) 
Skype: drakegreene 
YouTube:   BlackWaterOpsDotCom 
  BlackWater Ops 

  Cloud On A String Mastermind Group

 
 
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Andrin von
Rechenberg
Sent: Wednesday, February 01, 2012 3:42 AM
To: google-appengine@googlegroups.com
Subject: [google-appengine] State of Python 2.7
 
Hey there
 
I was wondering what the state of Python 2.7 is.
 
@Google: Will it be moved out of experimental soonish?
 
@Everyone: Has anyone used it in a big production app?
 
Cheers,
=Andrin
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
 .
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
 
 
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

<><>

Re: [google-appengine] Re: Is App Engine suitable for write intensive applications?

2012-02-01 Thread Richard Watson
I haven't mixed it up with entity groups, I refer only to sharding in the 
context of an index. Apologies if my use of the terminology confused the 
issue in any way.

My point was that the entries in the index are surely already sharded by 
some kind of prefix. There's no way all apps that save current millis in a 
field are being indexed on the same tablet. They must have some type of 
separation, which could maybe be achieved by prefix.  For example, the 
index entry could be something like 
[AppId][NamespaceId][EntityName][FieldName][123456789], which would remove 
contention between apps.  If [Namespace] is in there, then any apps that 
use namespaces already have a built-in natural shard point for index 
entries.

And I think the point about adding the indexed field value later is still 
valid.  Save the value in an unindexed field (e.g. unindexedTimestamp), and 
then update the indexed field (indexedTimestamp) via a task later, 
controlling the frequency of saves so it reduced impact on the index 
tablets.  That way you don't mess about with prefixes and adding result 
sets together.

Richard

[1] Does an index entry look like this:
[AppId][NamespaceId][

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/3Ltu7gGC8EsJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] Saving Datastore Read

2012-02-01 Thread Brandon Wirtz
http://bjk5.com/post/11766098283/app-engine-performance-hacks-youll-probably
-never
 

Brandon Wirtz 
BlackWaterOps: President / Lead Mercenary 
Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg


Work: 510-992-6548 
Toll Free: 866-400-4536 
IM: drak...@gmail.com (Google Talk) 
Skype: drakegreene 
YouTube:   BlackWaterOpsDotCom 


  BlackWater Ops 

  Cloud On A String Mastermind Group



 
 
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Leandro Rezende
Sent: Wednesday, February 01, 2012 4:38 AM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Saving Datastore Read
 
Thanks Brandon, 
So before i "GetObjectbyId()", i will search at Memcache, if the record isnt
there, i will "GetoBjectById()" to get data, and them store it into
Memcache.
 
2012/2/1 Brandon Wirtz 
Memcache is per App. All instances of an app will share the memcahce  so if
instance 1 writes, instance 3  can read.
 

Brandon Wirtz 
BlackWaterOps: President / Lead Mercenary 
Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg


Work: 510-992-6548 
Toll Free: 866-400-4536 
IM: drak...@gmail.com (Google Talk) 
Skype: drakegreene 
YouTube:   BlackWaterOpsDotCom 
  BlackWater Ops 

  Cloud On A String Mastermind Group

 
 
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Leandro Rezende
Sent: Wednesday, February 01, 2012 3:28 AM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Saving Datastore Read
 
Thx for the answer Robert, i was thinking about Memcache too, but i never
implemented it.
 
Do u know if the data cached on memcache is public for every instance? or
its "private" for each browser user?
 
thank you
2012/2/1 Robert Kluin 
Hi Leandro,
 Think about the relative frequency of events.  It is probably
massively more common to list game info than for a player to change
their name / image, especially once they have a lot of data.  If
that's the case, denormalizing might be a very good choice.  If
someone does change their name/image you can easily use the taskqueue
to update all their game info.

 Depending on the data, you may also be able to keep the normalized
model but reduce the number of reads.  Just gather a list of all
entities you need to fetch, remove any duplicates, then get the info
from those entities.  If there are some players who's stuff is very
often displayed, use memcache to store their details.


Robert





On Tue, Jan 31, 2012 at 07:51, Leandro Rezende
 wrote:
> if i have 2 "Tables",
>
> "Table Player" , (Fields - PlayerKey, PlayerName, PlayerUrlPhoto)
> "Table PlayerGames", (Fields - PlayerGameKey, PlayerKey, GameDate)
>
> if i wanna list all games, i will create a query in "PlayerGames", and to
> show the "Players" info, i will have to "GetObjectbyID" to read PlayerName
> and PLayerUrlPhoto.
>
> What is the best way to do this?
>
> 1 - Using GetObjectByID is the right way (spending 1 "datastore read" more
> for each "PlayerGame" record)
> 2 - Store at "PlayerGames" the fields that i know that i will need to list
> in the future? (as playername and playerurlphoto, Saving the "DataStore
> read" to get Player info)
> 3 - Other way...
>
> * reminding that the player can change his name and his photo, so if i
store
> the name and photo at "PlayerGames" i will have to update all the records
> too. (and will spend alot of DataStore Writes)
>
> Can someone give me a tip about this?
>
> thx
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
 .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
 .
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
 
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
-- 
You received this m

Re: [google-appengine] App Engine SDK 1.6.2 is out!

2012-02-01 Thread sebastián serrano
Python Django now work with Cloud SQL without additional configuration So 
cool.

Thanks!!!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/w7rjoYDASkYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Saving Datastore Read

2012-02-01 Thread Leandro Rezende
Thanks Brandon,
So before i "GetObjectbyId()", i will search at Memcache, if the record
isnt there, i will "GetoBjectById()" to get data, and them store it into
Memcache.

2012/2/1 Brandon Wirtz 

> Memcache is per App. All instances of an app will share the memcahce  so
> if instance 1 writes, instance 3  can read.
>
> ** **
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> **
> **
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group *
>
> *
>
> ** **
>
> ** **
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Leandro Rezende
> *Sent:* Wednesday, February 01, 2012 3:28 AM
> *To:* google-appengine@googlegroups.com
> *Subject:* Re: [google-appengine] Saving Datastore Read
>
> ** **
>
> Thx for the answer Robert, i was thinking about Memcache too, but i never
> implemented it.
>
> ** **
>
> Do u know if the data cached on memcache is public for every instance? or
> its "private" for each browser user?
>
> ** **
>
> thank you
>
> 2012/2/1 Robert Kluin 
>
> Hi Leandro,
>  Think about the relative frequency of events.  It is probably
> massively more common to list game info than for a player to change
> their name / image, especially once they have a lot of data.  If
> that's the case, denormalizing might be a very good choice.  If
> someone does change their name/image you can easily use the taskqueue
> to update all their game info.
>
>  Depending on the data, you may also be able to keep the normalized
> model but reduce the number of reads.  Just gather a list of all
> entities you need to fetch, remove any duplicates, then get the info
> from those entities.  If there are some players who's stuff is very
> often displayed, use memcache to store their details.
>
>
> Robert
>
>
>
>
>
>
> On Tue, Jan 31, 2012 at 07:51, Leandro Rezende
>  wrote:
> > if i have 2 "Tables",
> >
> > "Table Player" , (Fields - PlayerKey, PlayerName, PlayerUrlPhoto)
> > "Table PlayerGames", (Fields - PlayerGameKey, PlayerKey, GameDate)
> >
> > if i wanna list all games, i will create a query in "PlayerGames", and to
> > show the "Players" info, i will have to "GetObjectbyID" to read
> PlayerName
> > and PLayerUrlPhoto.
> >
> > What is the best way to do this?
> >
> > 1 - Using GetObjectByID is the right way (spending 1 "datastore read"
> more
> > for each "PlayerGame" record)
> > 2 - Store at "PlayerGames" the fields that i know that i will need to
> list
> > in the future? (as playername and playerurlphoto, Saving the "DataStore
> > read" to get Player info)
> > 3 - Other way...
> >
> > * reminding that the player can change his name and his photo, so if i
> store
> > the name and photo at "PlayerGames" i will have to update all the records
> > too. (and will spend alot of DataStore Writes)
> >
> > Can someone give me a tip about this?
> >
> > thx
> >
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
> ** **
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubsc

Re: [google-appengine] State of Python 2.7

2012-02-01 Thread Andrin von Rechenberg
... where are these bugs documented?

On Wed, Feb 1, 2012 at 1:11 PM, Andrin von Rechenberg wrote:

> ~500 qps...
>
>
> On Wed, Feb 1, 2012 at 12:51 PM, Brandon Wirtz wrote:
>
>> How big is big?  I have a lot of apps on it. And very happy.  There are
>> a few bugs that are documented that we coded around.
>>
>> ** **
>>
>> *Brandon Wirtz
>> *BlackWaterOps: President / Lead Mercenary 
>>
>> [image: Description:
>> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>>
>> *Work:* 510-992-6548
>> *Toll Free:* 866-400-4536 
>>
>> *IM:* drak...@gmail.com (Google Talk)
>> *Skype:* drakegreene
>> *YouTube:* BlackWaterOpsDotCom
>> **
>> **
>>
>> BlackWater Ops 
>>
>> Cloud On A String Mastermind Group *
>>
>> *
>>
>> ** **
>>
>> ** **
>>
>> *From:* google-appengine@googlegroups.com [mailto:
>> google-appengine@googlegroups.com] *On Behalf Of *Andrin von Rechenberg
>> *Sent:* Wednesday, February 01, 2012 3:42 AM
>> *To:* google-appengine@googlegroups.com
>> *Subject:* [google-appengine] State of Python 2.7
>>
>> ** **
>>
>> Hey there
>>
>> ** **
>>
>> I was wondering what the state of Python 2.7 is.
>>
>> ** **
>>
>> @Google: Will it be moved out of experimental soonish?
>>
>> ** **
>>
>> @Everyone: Has anyone used it in a big production app?
>>
>> ** **
>>
>> Cheers,
>>
>> =Andrin
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> To unsubscribe from this group, send email to
>> google-appengine+unsubscr...@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/google-appengine?hl=en.
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> To unsubscribe from this group, send email to
>> google-appengine+unsubscr...@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/google-appengine?hl=en.
>>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

<>

Re: [google-appengine] State of Python 2.7

2012-02-01 Thread Andrin von Rechenberg
~500 qps...

On Wed, Feb 1, 2012 at 12:51 PM, Brandon Wirtz  wrote:

> How big is big?  I have a lot of apps on it. And very happy.  There are a
> few bugs that are documented that we coded around.
>
> ** **
>
> *Brandon Wirtz
> *BlackWaterOps: President / Lead Mercenary 
>
> [image: Description:
> http://www.linkedin.com/img/signature/bg_slate_385x42.jpg]
>
> *Work:* 510-992-6548
> *Toll Free:* 866-400-4536 
>
> *IM:* drak...@gmail.com (Google Talk)
> *Skype:* drakegreene
> *YouTube:* BlackWaterOpsDotCom
> **
> **
>
> BlackWater Ops 
>
> Cloud On A String Mastermind Group *
>
> *
>
> ** **
>
> ** **
>
> *From:* google-appengine@googlegroups.com [mailto:
> google-appengine@googlegroups.com] *On Behalf Of *Andrin von Rechenberg
> *Sent:* Wednesday, February 01, 2012 3:42 AM
> *To:* google-appengine@googlegroups.com
> *Subject:* [google-appengine] State of Python 2.7
>
> ** **
>
> Hey there
>
> ** **
>
> I was wondering what the state of Python 2.7 is.
>
> ** **
>
> @Google: Will it be moved out of experimental soonish?
>
> ** **
>
> @Everyone: Has anyone used it in a big production app?
>
> ** **
>
> Cheers,
>
> =Andrin
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

<>

Re: [google-appengine] App Engine SDK 1.6.2 is out!

2012-02-01 Thread Pieter Coucke
Is there an API or other method to trigger backups with a cron?



On Wed, Feb 1, 2012 at 7:42 AM, James Broberg  wrote:
> I noticed datanucleus-appengine 2.0.0-final has been released also:
> http://code.google.com/p/datanucleus-appengine/downloads/list
>
> Was this part of 1.6.2? If not, when will it be part of the main SDK package?
>
> On 1 February 2012 15:56, Chris Collins  wrote:
>> Is it possible to download the blob of backup data to examine it or load it
>> on the development server?
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> To unsubscribe from this group, send email to
>> google-appengine+unsubscr...@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.
>



-- 
Pieter Coucke
Onthoo BVBA - zamtam.com

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] State of Python 2.7

2012-02-01 Thread Brandon Wirtz
How big is big?  I have a lot of apps on it. And very happy.  There are a
few bugs that are documented that we coded around.
 

Brandon Wirtz 
BlackWaterOps: President / Lead Mercenary 
Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg


Work: 510-992-6548 
Toll Free: 866-400-4536 
IM: drak...@gmail.com (Google Talk) 
Skype: drakegreene 
YouTube:   BlackWaterOpsDotCom 


  BlackWater Ops 

  Cloud On A String Mastermind Group



 
 
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Andrin von
Rechenberg
Sent: Wednesday, February 01, 2012 3:42 AM
To: google-appengine@googlegroups.com
Subject: [google-appengine] State of Python 2.7
 
Hey there
 
I was wondering what the state of Python 2.7 is.
 
@Google: Will it be moved out of experimental soonish?
 
@Everyone: Has anyone used it in a big production app?
 
Cheers,
=Andrin
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

<>

[google-appengine] State of Python 2.7

2012-02-01 Thread Andrin von Rechenberg
Hey there

I was wondering what the state of Python 2.7 is.

@Google: Will it be moved out of experimental soonish?

@Everyone: Has anyone used it in a big production app?

Cheers,
=Andrin

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] Saving Datastore Read

2012-02-01 Thread Brandon Wirtz
Memcache is per App. All instances of an app will share the memcahce  so if
instance 1 writes, instance 3  can read.
 

Brandon Wirtz 
BlackWaterOps: President / Lead Mercenary 
Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg


Work: 510-992-6548 
Toll Free: 866-400-4536 
IM: drak...@gmail.com (Google Talk) 
Skype: drakegreene 
YouTube:   BlackWaterOpsDotCom 


  BlackWater Ops 

  Cloud On A String Mastermind Group



 
 
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Leandro Rezende
Sent: Wednesday, February 01, 2012 3:28 AM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Saving Datastore Read
 
Thx for the answer Robert, i was thinking about Memcache too, but i never
implemented it.
 
Do u know if the data cached on memcache is public for every instance? or
its "private" for each browser user?
 
thank you
2012/2/1 Robert Kluin 
Hi Leandro,
 Think about the relative frequency of events.  It is probably
massively more common to list game info than for a player to change
their name / image, especially once they have a lot of data.  If
that's the case, denormalizing might be a very good choice.  If
someone does change their name/image you can easily use the taskqueue
to update all their game info.

 Depending on the data, you may also be able to keep the normalized
model but reduce the number of reads.  Just gather a list of all
entities you need to fetch, remove any duplicates, then get the info
from those entities.  If there are some players who's stuff is very
often displayed, use memcache to store their details.


Robert





On Tue, Jan 31, 2012 at 07:51, Leandro Rezende
 wrote:
> if i have 2 "Tables",
>
> "Table Player" , (Fields - PlayerKey, PlayerName, PlayerUrlPhoto)
> "Table PlayerGames", (Fields - PlayerGameKey, PlayerKey, GameDate)
>
> if i wanna list all games, i will create a query in "PlayerGames", and to
> show the "Players" info, i will have to "GetObjectbyID" to read PlayerName
> and PLayerUrlPhoto.
>
> What is the best way to do this?
>
> 1 - Using GetObjectByID is the right way (spending 1 "datastore read" more
> for each "PlayerGame" record)
> 2 - Store at "PlayerGames" the fields that i know that i will need to list
> in the future? (as playername and playerurlphoto, Saving the "DataStore
> read" to get Player info)
> 3 - Other way...
>
> * reminding that the player can change his name and his photo, so if i
store
> the name and photo at "PlayerGames" i will have to update all the records
> too. (and will spend alot of DataStore Writes)
>
> Can someone give me a tip about this?
>
> thx
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
 .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
 .
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
 
-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

<>

Re: [google-appengine] Saving Datastore Read

2012-02-01 Thread Leandro Rezende
Thx for the answer Robert, i was thinking about Memcache too, but i never
implemented it.

Do u know if the data cached on memcache is public for every instance? or
its "private" for each browser user?

thank you

2012/2/1 Robert Kluin 

> Hi Leandro,
>  Think about the relative frequency of events.  It is probably
> massively more common to list game info than for a player to change
> their name / image, especially once they have a lot of data.  If
> that's the case, denormalizing might be a very good choice.  If
> someone does change their name/image you can easily use the taskqueue
> to update all their game info.
>
>  Depending on the data, you may also be able to keep the normalized
> model but reduce the number of reads.  Just gather a list of all
> entities you need to fetch, remove any duplicates, then get the info
> from those entities.  If there are some players who's stuff is very
> often displayed, use memcache to store their details.
>
>
> Robert
>
>
>
>
>
> On Tue, Jan 31, 2012 at 07:51, Leandro Rezende
>  wrote:
> > if i have 2 "Tables",
> >
> > "Table Player" , (Fields - PlayerKey, PlayerName, PlayerUrlPhoto)
> > "Table PlayerGames", (Fields - PlayerGameKey, PlayerKey, GameDate)
> >
> > if i wanna list all games, i will create a query in "PlayerGames", and to
> > show the "Players" info, i will have to "GetObjectbyID" to read
> PlayerName
> > and PLayerUrlPhoto.
> >
> > What is the best way to do this?
> >
> > 1 - Using GetObjectByID is the right way (spending 1 "datastore read"
> more
> > for each "PlayerGame" record)
> > 2 - Store at "PlayerGames" the fields that i know that i will need to
> list
> > in the future? (as playername and playerurlphoto, Saving the "DataStore
> > read" to get Player info)
> > 3 - Other way...
> >
> > * reminding that the player can change his name and his photo, so if i
> store
> > the name and photo at "PlayerGames" i will have to update all the records
> > too. (and will spend alot of DataStore Writes)
> >
> > Can someone give me a tip about this?
> >
> > thx
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Authentication on a GAE App only for a selected Google Apps domains list

2012-02-01 Thread Antoine
Ok, I ve found out.

this should be the URL for Google Apps domains :

www.google.com/accounts/o8/site-xrds?hd=example.com



On Feb 1, 4:59 pm, Antoine  wrote:
> Thank you for your answer.
>
> I tried to follow this tutorial (I dont know why I didnt find it
> before... :s ).
>
> However, I have a question left.
>
> I decided to let the user choose his domain by clicking on his domain
> link.
>
> I deleted the "login required" in app.yaml and modified my main.py
> such as...
>
> My python looks like :
>
> ---
> #
> #code
> #
>
> providers = {
>     'prov 1'   : 'google.com/a/domain.com',
>     'prov 2'    : 'google.com/a/subdomain1.com',
>     'prov 3'    : 'google.com/a/subdomain2.com'
>     # add more here
>
> }
>
> #
> #code
> #
>
> else:
>       self.response.out.write('Hello world! Sign in at: ')
>       for name, uri in providers.items():
>         self.response.out.write('[%s]' %
> (users.create_login_url(federated_identity=uri), name))
>
> #
> #code
> #
>
> ---
>
> However links are not redirecting user...
> I guess it should work, if you do this yourelf, that each Google Apps
> domain should be used as a direct provider federated entities ?
>
> What should I do to have Google Apps domains login page after clicking
> on a link (and get redirection to my app after authentication against
> Google, of course) ?
> I guess I dont have the right link/approach because, with myopenid.com
> it's working (redirecting).
>
> thx in advance
> Antoine
>
> On Jan 31, 1:34 pm, Robert Kluin  wrote:
>
>
>
>
>
>
>
> > HeyAntoine,
> >   Use OpenID / Federated login.  You can provide users with a list of
> > subdomains, or check them against that.  I usually either give users
> > the option to enter their domain or email address (from which I can
> > deduce the domain), then redirect them to the proper page.  It is
> > pretty straight forward to do.
>
> >   I think Wesley's article on federated login provides all the basics.
> >    http://code.google.com/appengine/articles/openid.html
>
> > Robert
>
> > On Sun, Jan 29, 2012 at 22:57,Antoine wrote:
> > > Hi everyone,
>
> > > I am working on a simple application (actually a website) on Google
> > > App Engine.
> > > This application should be accessible only for a selected Google Apps
> > > domains list.
>
> > > These domains are corporate Google Apps subdomains. One Google Apps
> > > account domain handle several subdomains, one for each business unit.
>
> > > I would like to restrict my apps to those domain.
>
> > > However, there is only 3 ways to secure my app (Application Settings /
> > > Authentication Options in Google App Engine Console) :
> > > - Google Accounts API
> > > - Google App Domain
> > > - Open ID (Federated Login)
>
> > > For the first one, it can work, however, as we are using Federation
> > > Login for all Google Apps domains, we dont want the user to login
> > > twice : one on the Google Account Sign-in webpage which is displayed
> > > automatically when we choose Google Accounts, and then on the
> > > federation page.
> > > Because with this Google App Engine authentication, the user is first
> > > redirected to :http://accounts.google.com
> > > then enter its credentials Google Apps, then Google tell him that
> > > federation is working for this domain so he just need to Click to be
> > > redirected.
> > > This is not user friendly.
>
> > > Second one, works only with one Google App Primary domain. Subdomain
> > > doesnt work with this feature...
>
> > > Maybe third one, Open ID/ Federated login, can work, but how ?
>
> > > Thx
> > >Antoine
>
> > > --
> > > You received this message because you are subscribed to the Google Groups 
> > > "Google App Engine" group.
> > > To post to this group, send email to google-appengine@googlegroups.com.
> > > To unsubscribe from this group, send email to 
> > > google-appengine+unsubscr...@googlegroups.com.
> > > For more options, visit this group 
> > > athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Is App Engine suitable for write intensive applications?

2012-02-01 Thread Jeff Schnitzer
On Wed, Feb 1, 2012 at 2:48 AM, Richard Watson  wrote:
>
> It seems obvious that fewer shards allow you to query across the full answer
> set with the least amount of queries. E.g. if you'll often query across
> users for a single multi-user customer, best would be to have a prefix that
> is shared for that customer, rather than one user. That way you don't have
> to sew the result sets together. (Does using a namespace handle this
> automatically or does it only affect keys? Where are the 'built-in'
> shard-points? Accounts must be sharded, otherwise the tablet covering the
> "current" timestamp would explode.)

The "sharding" in GAE-land works a little differently from the way you think.

There's the notion of an Entity Group, which is probably closest to a
traditional data federation, but with a twist:  you typically create
zillions of tiny entity groups, say, one for each customer.  The
sharding is quite transparent; you only notice it when you write to
the same EG too fast or you try to run transactions across EGs.

The kind of sharding you would have to do to escape the hot tablet
problem is sharding the values of a particular field.  The index
tablets span all EGs.  So you might create 4 "versions" of the login
timestamp (say, prefixed with a different letter) and then issue four
queries when you want to query for the last 100 people that logged in.
 In this case, you just pick a random prefix every time you write the
field... there's no need to make it stable.

Jeff

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Authentication on a GAE App only for a selected Google Apps domains list

2012-02-01 Thread Antoine
Thank you for your answer.

I tried to follow this tutorial (I dont know why I didnt find it
before... :s ).

However, I have a question left.

I decided to let the user choose his domain by clicking on his domain
link.

I deleted the "login required" in app.yaml and modified my main.py
such as...

My python looks like :

---
#
#code
#

providers = {
'prov 1'   : 'google.com/a/domain.com',
'prov 2': 'google.com/a/subdomain1.com',
'prov 3': 'google.com/a/subdomain2.com'
# add more here
}

#
#code
#

else:
  self.response.out.write('Hello world! Sign in at: ')
  for name, uri in providers.items():
self.response.out.write('[%s]' %
(users.create_login_url(federated_identity=uri), name))

#
#code
#

---

However links are not redirecting user...
I guess it should work, if you do this yourelf, that each Google Apps
domain should be used as a direct provider federated entities ?

What should I do to have Google Apps domains login page after clicking
on a link (and get redirection to my app after authentication against
Google, of course) ?
I guess I dont have the right link/approach because, with myopenid.com
it's working (redirecting).

thx in advance
Antoine

On Jan 31, 1:34 pm, Robert Kluin  wrote:
> HeyAntoine,
>   Use OpenID / Federated login.  You can provide users with a list of
> subdomains, or check them against that.  I usually either give users
> the option to enter their domain or email address (from which I can
> deduce the domain), then redirect them to the proper page.  It is
> pretty straight forward to do.
>
>   I think Wesley's article on federated login provides all the basics.
>    http://code.google.com/appengine/articles/openid.html
>
> Robert
>
>
>
>
>
>
>
> On Sun, Jan 29, 2012 at 22:57,Antoine wrote:
> > Hi everyone,
>
> > I am working on a simple application (actually a website) on Google
> > App Engine.
> > This application should be accessible only for a selected Google Apps
> > domains list.
>
> > These domains are corporate Google Apps subdomains. One Google Apps
> > account domain handle several subdomains, one for each business unit.
>
> > I would like to restrict my apps to those domain.
>
> > However, there is only 3 ways to secure my app (Application Settings /
> > Authentication Options in Google App Engine Console) :
> > - Google Accounts API
> > - Google App Domain
> > - Open ID (Federated Login)
>
> > For the first one, it can work, however, as we are using Federation
> > Login for all Google Apps domains, we dont want the user to login
> > twice : one on the Google Account Sign-in webpage which is displayed
> > automatically when we choose Google Accounts, and then on the
> > federation page.
> > Because with this Google App Engine authentication, the user is first
> > redirected to :http://accounts.google.com
> > then enter its credentials Google Apps, then Google tell him that
> > federation is working for this domain so he just need to Click to be
> > redirected.
> > This is not user friendly.
>
> > Second one, works only with one Google App Primary domain. Subdomain
> > doesnt work with this feature...
>
> > Maybe third one, Open ID/ Federated login, can work, but how ?
>
> > Thx
> >Antoine
>
> > --
> > You received this message because you are subscribed to the Google Groups 
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to 
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group 
> > athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Funny spikes in graphs

2012-02-01 Thread Andrin von Rechenberg
No I dont have that or other timed requests.
I'm pretty certain this problem is on Googles side
because RAM consumption also oscillates like this.
>From 0 to max and back, and thats really almost
impossible.

Ooohhh, I just noticed that they fixed it, thank you Google :)

Cheers,
-Andrin

On Wed, Feb 1, 2012 at 7:50 AM, Robert Kluin  wrote:

> By "reason" I meant such as an AJAX app controlling when requests are
> made, etc
>
>
>
> On Wed, Feb 1, 2012 at 01:49, Robert Kluin  wrote:
> > Is there a reason your trafic would be bursty? I've seen strange
> > patterns like that when there are scheduled jobs, but never from
> > browser-based user traffic alone.
> >
> >
> > Robert
> >
> >
> >
> >
> > On Tue, Jan 31, 2012 at 15:59, Andrin von Rechenberg 
> wrote:
> >> I'm doing 250 queries per second. ProdEagle one per minute. Its not from
> >> that...
> >>
> >> :)
> >>
> >> On Jan 31, 2012 4:58 PM, "bFlood"  wrote:
> >>>
> >>> maybe it's ProdEagle itself, that hits your app every minute
> >>>
> >>>
> >>>
> >>> On Jan 31, 10:16 am, Mike Wesner  wrote:
> >>> > Have you looked at the logs to see what/who is making the requests?
> >>> > It could be some type of polling or service that is making requests
> at
> >>> > those intervals.
> >>> >
> >>> > -Mike
> >>> >
> >>> > On Jan 31, 8:40 am, Andrin von Rechenberg 
> wrote:
> >>> >
> >>> >
> >>> >
> >>> >
> >>> >
> >>> >
> >>> >
> >>> > > Hey there
> >>> >
> >>> > > My dashboard shows funny spikes in all graphs (qps, bandwidth,
> ram).
> >>> > > It's been doing this for a couple of days now. ProdEagle shows
> >>> > > everything
> >>> > > is fine, so I guess something must be messed up on Google's side...
> >>> >
> >>> > > Anyone else seeing this?
> >>> >
> >>> > > Cheers,
> >>> > > -Andrin
> >>> >
> >>> > >  Screen shot 2012-01-31 at 3.38.39 PM.png
> >>> > > 56KViewDownload
> >>>
> >>> --
> >>> You received this message because you are subscribed to the Google
> Groups
> >>> "Google App Engine" group.
> >>> To post to this group, send email to google-appengine@googlegroups.com
> .
> >>> To unsubscribe from this group, send email to
> >>> google-appengine+unsubscr...@googlegroups.com.
> >>> For more options, visit this group at
> >>> http://groups.google.com/group/google-appengine?hl=en.
> >>>
> >> --
> >> You received this message because you are subscribed to the Google
> Groups
> >> "Google App Engine" group.
> >> To post to this group, send email to google-appengine@googlegroups.com.
> >> To unsubscribe from this group, send email to
> >> google-appengine+unsubscr...@googlegroups.com.
> >> For more options, visit this group at
> >> http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.