[google-appengine] Re: Cloud Storage ops price misreported on dashboard?

2016-02-12 Thread 'Nick (Cloud Platform Support)' via Google App Engine
Hi Simon,

The documentation related to Daily Budget 
 explains that it 
covers App Engine resources only, and is set in the App Engine section of 
the console. Cloud Storage is not coveed by this limit. Given that you have 
a case open, it's best to continue to follow up through that medium. I wish 
you all the best of luck.

Sincerely,

Nick

On Friday, February 12, 2016 at 12:20:38 PM UTC-5, Simon Green wrote:
>
> I'm migrating an app from Amazon to Google and part of it involves copying 
> some photos from S3 to GCS. I have a task running which iterates over the 
> datastore to copy the image for each entry and replace the location 
> reference. I'm not in any rush so it's just doing them one at a time and 
> chugging along running on App Engine classic F1, copying a file every few 
> seconds.
>
> Throughout the day I regularly check on the task queue, the datastore, the 
> logs (both App Engine and Amazon) and the GCS bucket and everything is 
> working as expected. I expect it will cost a few dollars based on my 
> calculations.
>
> Then one time the dashboard tries to kill me by reporting that I will owe 
> $190,000+ Eek! What happened to the $10 daily limit I set as a safety net?!
>
> So of course I immediately stop everything, report the issue with the 
> dashboard feedback option and open a support ticket and have waited a few 
> days but still haven't heard anything back from anyone.
>
> I am completely confident that the price reported is wrong but I still 
> have to go through and double or triple check everything and it's rather 
> concerning. I'm almost afraid to let anything run but I added more logging 
> and restarted the task and also started looking up flights to south america 
> to possibly begin my new life as a fugitive. It seems that once the number 
> of ops goes over 50,000 (free daily allowance?) the price displayed 
> suddenly starts jumping up by huge amounts.
>
> Here's snippets from screenshots taken a couple of minutes apart 
> (literally, between going to the task queue page to pause it and coming 
> back to double check).
>
>
> 
>
> It seems like it's expecting to charge $10 *per each billable op*, not 
> for a million of them but then the bill was almost exactly a million times 
> higher than I was expecting it to be.
>
> So my questions are:
>
> * It is a misreporting issue ... right? I mean, I *know* it has to be, 
> but such big numbers are scary and I want to be sure. Please tell me it is, 
> *please* (yeah, no desperate panic, keeping calm ... breathe ...)
>
> * Would the daily billing limit definitely protect against things like 
> this if my code was actually trying to use that level of resources? I tried 
> to find a definitive answer as to what it covered and what it didn't 
> (specifically GCS) and couldn't find one.
>
> Many thanks
> Simon
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/ceffcdbb-fac7-4bd7-97b1-a7c3e96097bc%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cloud Storage ops price misreported on dashboard?

2016-02-12 Thread 'Lorne Kligerman' via Google App Engine
Hi Simon,

This is in fact an issue within the Cloud Console on the reporting side. 
 We have confirmed that the bill is unaffected so there is nothing to worry 
about.  A fix will be coming shortly.

Cheers,
Lorne.

On Friday, February 12, 2016 at 2:44:21 PM UTC-8, Simon Green wrote:
>
> Thanks for the reply Nick
>
> That does seem to be a misleading UI layout having the usage and costs 
> listed under the Billing Status and Daily Budget heading if they are in 
> fact completely unconnected. It would be better to not have them there at 
> all (why not include all the GCE usage as well?). Maybe it's because it 
> used to be Blob Storage which was more tied to AppEngine?
>
> I'll wait to hear back from the ticket but I'm kind of stuck in the 
> meantime because of the lack of certainty which is very frustrating.
>
> Simon
>
>
> On Friday, 12 February 2016 14:53:39 UTC-7, Nick (Cloud Platform Support) 
> wrote:
>>
>> Hi Simon,
>>
>> The documentation related to Daily Budget 
>>  explains that 
>> it covers App Engine resources only, and is set in the App Engine section 
>> of the console. Cloud Storage is not coveed by this limit. Given that you 
>> have a case open, it's best to continue to follow up through that medium. I 
>> wish you all the best of luck.
>>
>> Sincerely,
>>
>> Nick
>>
>> On Friday, February 12, 2016 at 12:20:38 PM UTC-5, Simon Green wrote:
>>>
>>> I'm migrating an app from Amazon to Google and part of it involves 
>>> copying some photos from S3 to GCS. I have a task running which iterates 
>>> over the datastore to copy the image for each entry and replace the 
>>> location reference. I'm not in any rush so it's just doing them one at a 
>>> time and chugging along running on App Engine classic F1, copying a file 
>>> every few seconds.
>>>
>>> Throughout the day I regularly check on the task queue, the datastore, 
>>> the logs (both App Engine and Amazon) and the GCS bucket and everything is 
>>> working as expected. I expect it will cost a few dollars based on my 
>>> calculations.
>>>
>>> Then one time the dashboard tries to kill me by reporting that I will 
>>> owe $190,000+ Eek! What happened to the $10 daily limit I set as a safety 
>>> net?!
>>>
>>> So of course I immediately stop everything, report the issue with the 
>>> dashboard feedback option and open a support ticket and have waited a few 
>>> days but still haven't heard anything back from anyone.
>>>
>>> I am completely confident that the price reported is wrong but I still 
>>> have to go through and double or triple check everything and it's rather 
>>> concerning. I'm almost afraid to let anything run but I added more logging 
>>> and restarted the task and also started looking up flights to south america 
>>> to possibly begin my new life as a fugitive. It seems that once the number 
>>> of ops goes over 50,000 (free daily allowance?) the price displayed 
>>> suddenly starts jumping up by huge amounts.
>>>
>>> Here's snippets from screenshots taken a couple of minutes apart 
>>> (literally, between going to the task queue page to pause it and coming 
>>> back to double check).
>>>
>>>
>>> 
>>>
>>> It seems like it's expecting to charge $10 *per each billable op*, not 
>>> for a million of them but then the bill was almost exactly a million times 
>>> higher than I was expecting it to be.
>>>
>>> So my questions are:
>>>
>>> * It is a misreporting issue ... right? I mean, I *know* it has to be, 
>>> but such big numbers are scary and I want to be sure. Please tell me it is, 
>>> *please* (yeah, no desperate panic, keeping calm ... breathe ...)
>>>
>>> * Would the daily billing limit definitely protect against things like 
>>> this if my code was actually trying to use that level of resources? I tried 
>>> to find a definitive answer as to what it covered and what it didn't 
>>> (specifically GCS) and couldn't find one.
>>>
>>> Many thanks
>>> Simon
>>>
>>>
>>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/310c4ce7-49f1-4f7a-ab0e-5b748ffd370a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cloud Storage ops price misreported on dashboard?

2016-02-12 Thread Simon Green
Thanks for the reply Nick

That does seem to be a misleading UI layout having the usage and costs 
listed under the Billing Status and Daily Budget heading if they are in 
fact completely unconnected. It would be better to not have them there at 
all (why not include all the GCE usage as well?). Maybe it's because it 
used to be Blob Storage which was more tied to AppEngine?

I'll wait to hear back from the ticket but I'm kind of stuck in the 
meantime because of the lack of certainty which is very frustrating.

Simon


On Friday, 12 February 2016 14:53:39 UTC-7, Nick (Cloud Platform Support) 
wrote:
>
> Hi Simon,
>
> The documentation related to Daily Budget 
>  explains that 
> it covers App Engine resources only, and is set in the App Engine section 
> of the console. Cloud Storage is not coveed by this limit. Given that you 
> have a case open, it's best to continue to follow up through that medium. I 
> wish you all the best of luck.
>
> Sincerely,
>
> Nick
>
> On Friday, February 12, 2016 at 12:20:38 PM UTC-5, Simon Green wrote:
>>
>> I'm migrating an app from Amazon to Google and part of it involves 
>> copying some photos from S3 to GCS. I have a task running which iterates 
>> over the datastore to copy the image for each entry and replace the 
>> location reference. I'm not in any rush so it's just doing them one at a 
>> time and chugging along running on App Engine classic F1, copying a file 
>> every few seconds.
>>
>> Throughout the day I regularly check on the task queue, the datastore, 
>> the logs (both App Engine and Amazon) and the GCS bucket and everything is 
>> working as expected. I expect it will cost a few dollars based on my 
>> calculations.
>>
>> Then one time the dashboard tries to kill me by reporting that I will owe 
>> $190,000+ Eek! What happened to the $10 daily limit I set as a safety net?!
>>
>> So of course I immediately stop everything, report the issue with the 
>> dashboard feedback option and open a support ticket and have waited a few 
>> days but still haven't heard anything back from anyone.
>>
>> I am completely confident that the price reported is wrong but I still 
>> have to go through and double or triple check everything and it's rather 
>> concerning. I'm almost afraid to let anything run but I added more logging 
>> and restarted the task and also started looking up flights to south america 
>> to possibly begin my new life as a fugitive. It seems that once the number 
>> of ops goes over 50,000 (free daily allowance?) the price displayed 
>> suddenly starts jumping up by huge amounts.
>>
>> Here's snippets from screenshots taken a couple of minutes apart 
>> (literally, between going to the task queue page to pause it and coming 
>> back to double check).
>>
>>
>> 
>>
>> It seems like it's expecting to charge $10 *per each billable op*, not 
>> for a million of them but then the bill was almost exactly a million times 
>> higher than I was expecting it to be.
>>
>> So my questions are:
>>
>> * It is a misreporting issue ... right? I mean, I *know* it has to be, 
>> but such big numbers are scary and I want to be sure. Please tell me it is, 
>> *please* (yeah, no desperate panic, keeping calm ... breathe ...)
>>
>> * Would the daily billing limit definitely protect against things like 
>> this if my code was actually trying to use that level of resources? I tried 
>> to find a definitive answer as to what it covered and what it didn't 
>> (specifically GCS) and couldn't find one.
>>
>> Many thanks
>> Simon
>>
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/212658b4-7d50-4530-8293-ba8ae2988a14%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cloud Storage ops price misreported on dashboard?

2016-02-12 Thread Simon Green
Thank you Lorne, that's a relief.!

Glad I can carry on with the migration now :)

Cheers
Simon


On Friday, 12 February 2016 16:21:20 UTC-7, Lorne Kligerman wrote:
>
> Hi Simon,
>
> This is in fact an issue within the Cloud Console on the reporting side. 
>  We have confirmed that the bill is unaffected so there is nothing to worry 
> about.  A fix will be coming shortly.
>
> Cheers,
> Lorne.
>
> On Friday, February 12, 2016 at 2:44:21 PM UTC-8, Simon Green wrote:
>>
>> Thanks for the reply Nick
>>
>> That does seem to be a misleading UI layout having the usage and costs 
>> listed under the Billing Status and Daily Budget heading if they are in 
>> fact completely unconnected. It would be better to not have them there at 
>> all (why not include all the GCE usage as well?). Maybe it's because it 
>> used to be Blob Storage which was more tied to AppEngine?
>>
>> I'll wait to hear back from the ticket but I'm kind of stuck in the 
>> meantime because of the lack of certainty which is very frustrating.
>>
>> Simon
>>
>>
>> On Friday, 12 February 2016 14:53:39 UTC-7, Nick (Cloud Platform Support) 
>> wrote:
>>>
>>> Hi Simon,
>>>
>>> The documentation related to Daily Budget 
>>>  explains that 
>>> it covers App Engine resources only, and is set in the App Engine section 
>>> of the console. Cloud Storage is not coveed by this limit. Given that you 
>>> have a case open, it's best to continue to follow up through that medium. I 
>>> wish you all the best of luck.
>>>
>>> Sincerely,
>>>
>>> Nick
>>>
>>> On Friday, February 12, 2016 at 12:20:38 PM UTC-5, Simon Green wrote:

 I'm migrating an app from Amazon to Google and part of it involves 
 copying some photos from S3 to GCS. I have a task running which iterates 
 over the datastore to copy the image for each entry and replace the 
 location reference. I'm not in any rush so it's just doing them one at a 
 time and chugging along running on App Engine classic F1, copying a file 
 every few seconds.

 Throughout the day I regularly check on the task queue, the datastore, 
 the logs (both App Engine and Amazon) and the GCS bucket and everything is 
 working as expected. I expect it will cost a few dollars based on my 
 calculations.

 Then one time the dashboard tries to kill me by reporting that I will 
 owe $190,000+ Eek! What happened to the $10 daily limit I set as a safety 
 net?!

 So of course I immediately stop everything, report the issue with the 
 dashboard feedback option and open a support ticket and have waited a few 
 days but still haven't heard anything back from anyone.

 I am completely confident that the price reported is wrong but I still 
 have to go through and double or triple check everything and it's rather 
 concerning. I'm almost afraid to let anything run but I added more logging 
 and restarted the task and also started looking up flights to south 
 america 
 to possibly begin my new life as a fugitive. It seems that once the number 
 of ops goes over 50,000 (free daily allowance?) the price displayed 
 suddenly starts jumping up by huge amounts.

 Here's snippets from screenshots taken a couple of minutes apart 
 (literally, between going to the task queue page to pause it and coming 
 back to double check).


 

 It seems like it's expecting to charge $10 *per each billable op*, not 
 for a million of them but then the bill was almost exactly a million times 
 higher than I was expecting it to be.

 So my questions are:

 * It is a misreporting issue ... right? I mean, I *know* it has to be, 
 but such big numbers are scary and I want to be sure. Please tell me it 
 is, 
 *please* (yeah, no desperate panic, keeping calm ... breathe ...)

 * Would the daily billing limit definitely protect against things like 
 this if my code was actually trying to use that level of resources? I 
 tried 
 to find a definitive answer as to what it covered and what it didn't 
 (specifically GCS) and couldn't find one.

 Many thanks
 Simon




-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/e240b8be-062d-46b1-a49d-640d707d0959%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.