[google-appengine] Re: Managed VM with Go Runtime incoming bandwidth restricted to 22MB/min in Billing Enabled Project

2016-02-10 Thread 'Nick (Cloud Platform Support)' via Google App Engine
Hey Roy,

The main issue which needs to be dealt with here is that of determining 
whether the data received rate is actually being limited based on quotas or 
based on the network performance of the resource in question. Part of this 
might include producing the data and methods of the benchmark done with 
Compute Engine. I'll be attempting to look into whether your quota is what 
it should be in regard to UrlFetch in the meantime.

On Wednesday, February 10, 2016 at 2:17:40 AM UTC-5, Roy Palacios wrote:
>
>
> Hello,
>
> I've been trying App Engine Managed VM with Go runtime in my project 
> *sanguine-form-95600*
>
> I have a Go Handler that downloads a 300MB file from an external source, 
> and, even though I have billing enabled, it's being downloaded at 380KB/s 
> (~22MB/min), which I understand is the default quota for free projects (
> https://cloud.google.com/appengine/docs/quotas).
>
> Could you please check if this network quota is being correctly applied 
> for Managed VM? (shoudn't it be +740MB/min?)
>
> I have no problems with the same task in Java on Compute Engine.
>
> Thanks,
> Roy
>
> --
> Relevant Go source:
>
> response, err := http.Get(url)
>
> zipBody, err := ioutil.ReadAll(response.Body)
> --
>
> I'm also getting 502 Bad Gateway error after 18 minutes (roughly when the 
> 300MB may have been downloaded). Probably a side effect...
>
>  
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/71288071-9777-4be2-bb79-0ae108f51bb4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: Managed VM with Go Runtime incoming bandwidth restricted to 22MB/min in Billing Enabled Project

2016-02-10 Thread 'Nick (Cloud Platform Support)' via Google App Engine
Thanks for the clarification. I'm currently working to check in on your 
quota, or on the specifics of Managed VMs, to determine what might be 
behind this behaviour.

On Wednesday, February 10, 2016 at 7:35:14 PM UTC-5, Roy Palacios wrote:
>
> Hi Nick,
>
> I was concerned about this also, thus I did a test in my local at the same 
> time and was able to get the resource (350MB) in 6-7min whereas MVM was 
> considerably slower.
>
> The curious thing here is that the rate in MVM was 22MB/s as documented 
> for free apps.
>
> The tests were done few minutes before the original post.
>
> Thanks
> Roy
>
> On Wed, Feb 10, 2016 at 6:39 PM 'Nick (Cloud Platform Support)' via Google 
> App Engine  wrote:
>
>> Hey Roy,
>>
>> The main issue which needs to be dealt with here is that of determining 
>> whether the data received rate is actually being limited based on quotas or 
>> based on the network performance of the resource in question. Part of this 
>> might include producing the data and methods of the benchmark done with 
>> Compute Engine. I'll be attempting to look into whether your quota is what 
>> it should be in regard to UrlFetch in the meantime.
>>
>>
>> On Wednesday, February 10, 2016 at 2:17:40 AM UTC-5, Roy Palacios wrote:
>>>
>>>
>>> Hello,
>>>
>>> I've been trying App Engine Managed VM with Go runtime in my project 
>>> *sanguine-form-95600*
>>>
>>> I have a Go Handler that downloads a 300MB file from an external source, 
>>> and, even though I have billing enabled, it's being downloaded at 380KB/s 
>>> (~22MB/min), which I understand is the default quota for free projects (
>>> https://cloud.google.com/appengine/docs/quotas).
>>>
>>> Could you please check if this network quota is being correctly applied 
>>> for Managed VM? (shoudn't it be +740MB/min?)
>>>
>>> I have no problems with the same task in Java on Compute Engine.
>>>
>>> Thanks,
>>> Roy
>>>
>>> --
>>> Relevant Go source:
>>>
>>> response, err := http.Get(url)
>>>
>>> zipBody, err := ioutil.ReadAll(response.Body)
>>> --
>>>
>>> I'm also getting 502 Bad Gateway error after 18 minutes (roughly when 
>>> the 300MB may have been downloaded). Probably a side effect...
>>>
>>>  
>>>
>> -- 
>> You received this message because you are subscribed to a topic in the 
>> Google Groups "Google App Engine" group.
>> To unsubscribe from this topic, visit 
>> https://groups.google.com/d/topic/google-appengine/g6R7xI9Fcgo/unsubscribe
>> .
>> To unsubscribe from this group and all its topics, send an email to 
>> google-appengine+unsubscr...@googlegroups.com.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> Visit this group at https://groups.google.com/group/google-appengine.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/google-appengine/71288071-9777-4be2-bb79-0ae108f51bb4%40googlegroups.com
>>  
>> <https://groups.google.com/d/msgid/google-appengine/71288071-9777-4be2-bb79-0ae108f51bb4%40googlegroups.com?utm_medium=email&utm_source=footer>
>> .
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/2ea9b4a6-a9e6-402d-a9c3-8deb48a7a344%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Add the google sdk in my xcode project

2016-02-12 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey babaou100, 

Could you maybe go into some more detail about exactly what it is you're 
doing, what you'd like to do, and the technologies you're working with to 
attempt that? It seems I can't make sense of your current post.

On Sunday, February 7, 2016 at 10:49:41 AM UTC-5, babaou100 wrote:
>
> Hello guys, 
>
> I am new to the google cloud in the past I have used parse and aws. I know 
> when you want to link your Xcode project(swift) I need to download a 
> framework however for some reason I could not find any. I look at the 
> endpoint section they have Java library and Object-C library I was 
> wondering if they have one for Swift.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/eb0e2344-e207-4969-9ef0-ebebf955661b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cloud Storage ops price misreported on dashboard?

2016-02-12 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hi Simon,

The documentation related to Daily Budget 
 explains that it 
covers App Engine resources only, and is set in the App Engine section of 
the console. Cloud Storage is not coveed by this limit. Given that you have 
a case open, it's best to continue to follow up through that medium. I wish 
you all the best of luck.

Sincerely,

Nick

On Friday, February 12, 2016 at 12:20:38 PM UTC-5, Simon Green wrote:
>
> I'm migrating an app from Amazon to Google and part of it involves copying 
> some photos from S3 to GCS. I have a task running which iterates over the 
> datastore to copy the image for each entry and replace the location 
> reference. I'm not in any rush so it's just doing them one at a time and 
> chugging along running on App Engine classic F1, copying a file every few 
> seconds.
>
> Throughout the day I regularly check on the task queue, the datastore, the 
> logs (both App Engine and Amazon) and the GCS bucket and everything is 
> working as expected. I expect it will cost a few dollars based on my 
> calculations.
>
> Then one time the dashboard tries to kill me by reporting that I will owe 
> $190,000+ Eek! What happened to the $10 daily limit I set as a safety net?!
>
> So of course I immediately stop everything, report the issue with the 
> dashboard feedback option and open a support ticket and have waited a few 
> days but still haven't heard anything back from anyone.
>
> I am completely confident that the price reported is wrong but I still 
> have to go through and double or triple check everything and it's rather 
> concerning. I'm almost afraid to let anything run but I added more logging 
> and restarted the task and also started looking up flights to south america 
> to possibly begin my new life as a fugitive. It seems that once the number 
> of ops goes over 50,000 (free daily allowance?) the price displayed 
> suddenly starts jumping up by huge amounts.
>
> Here's snippets from screenshots taken a couple of minutes apart 
> (literally, between going to the task queue page to pause it and coming 
> back to double check).
>
>
> 
>
> It seems like it's expecting to charge $10 *per each billable op*, not 
> for a million of them but then the bill was almost exactly a million times 
> higher than I was expecting it to be.
>
> So my questions are:
>
> * It is a misreporting issue ... right? I mean, I *know* it has to be, 
> but such big numbers are scary and I want to be sure. Please tell me it is, 
> *please* (yeah, no desperate panic, keeping calm ... breathe ...)
>
> * Would the daily billing limit definitely protect against things like 
> this if my code was actually trying to use that level of resources? I tried 
> to find a definitive answer as to what it covered and what it didn't 
> (specifically GCS) and couldn't find one.
>
> Many thanks
> Simon
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/ceffcdbb-fac7-4bd7-97b1-a7c3e96097bc%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: java.lang.IllegalArgumentException: operating on too many entity groups in a single transaction.

2016-02-15 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
According to the documentation on XG-Transactions 
,
 
you should be able to operate on up to 25 entity groups in a cross-group 
transaction. It does mention that it will fail if another transaction 
running at the same time modifies any of those entity groups. This might be 
happening, although only you would know your system to be able to say 
definitively yes or no.

If that isn't happening, I think it would be worth posting this, along with 
simple code snippets allowing reproduction of the behaviour, in the Public 
Issue Tracker . We 
do regular monitoring of the Public Issue Trackers and the issue would get 
looked-at relatively quickly.

Best wishes,

Nick

On Monday, February 15, 2016 at 11:23:50 AM UTC-5, Louise Elmose Hedegaard 
wrote:
>
> I have a datastore with a kind "shop", a kind "order" and a kind 
> "transaction".
> One shop has many orders, and one order has many transactions.
> The parent of a transaction is an order, the parent of an order is a shop.
>
> I want to delete all entries in the transactions table:
>
> public void cleanUp() {
> Query query = new 
> Query(TransactionDBFields.TRANSACTION_TABLE_NAME);
> query.setKeysOnly();
> query.setFilter(
> new Query.FilterPredicate(
> TransactionDBFields.CREATED_AT,
> Query.FilterOperator.LESS_THAN_OR_EQUAL,
> new Date())
> );
>
> PreparedQuery preparedQuery = datastore.prepare(query);
> Iterable entities = 
> preparedQuery.asIterable(FetchOptions.Builder.withLimit(5));
>
> TransactionOptions options = 
> TransactionOptions.Builder.withXG(true);
> Transaction txn = datastore.beginTransaction(options);
> for (Entity en : entities) {
> datastore.delete(txn, en.getKey());
> }
> txn.commit();
> }
>
> If I change the limit to anything larger than 5 I get the error:
>
> java.lang.IllegalArgumentException: operating on too many entity groups in 
> a single transaction.
>
> - apparently as GAE does not allow operating on more than 5 entity groups 
> in a single transaction. 
>
> Is there a way to delete more than 5 entities at a time? executing the 
> above code continuously to delete all transaction entities does not seem 
> reasonable, nor when considering performance.
>
> -Louise
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/3377bed8-3cd6-4a7d-955d-3f97325a8292%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Using the bulkloader with Java App Engine

2016-02-15 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Andri,

OpenID authentication has been deprecated. You'll need to use OAuth2 to 
authenticate. This Stack Overflow Q&A has a potential solution 
.
 
In addition to this, however, the bulkloader feature is undocumented and 
not supported any longer. You can always use Datastore Backup to Cloud 
Storage 
 and 
download those files, etc.

Best of luck,

Nick 

On Sunday, February 14, 2016 at 3:11:55 PM UTC-5, Andri Firstianto-GCP 
wrote:
>
> Hi...
> Got error 500 as below (Please help)
>
> i am trying to follow steps on the above subject in this link 
> http://ikaisays.com/2010/06/10/using-the-bulkloader-with-java-app-engine/
>
> try to execute below.
> appcfg.py create_bulkloader_config --url=
> http://APPID.appspot.com/remote_api--application=APPID 
>  --filename=config.yml
>
> 11:46 AM Creating bulkloader configuration.
> [INFO] Logging to bulkloader-log-20160214.114630
> [INFO] Throttling transfers:
> [INFO] Bandwidth: 25 bytes/second
> [INFO] HTTP connections: 8/second
> [INFO] Entities inserted/fetched/modified: 20/second
> [INFO] Batch Size: 10
> [INFO] Opening database: bulkloader-progress-20160214.114630.sql3
> [INFO] Opening database: bulkloader-results-20160214.114630.sql3
> [INFO] Connecting to xx.com/remote_api
> [ERROR   ] Exception during authentication
> Traceback (most recent call last):
>   File "...\bulkloader.py", line 3466, in Run
> self.request_manager.Authenticate()
>   File "...\bulkloader.py", line 1329, in Authenticate
> remote_api_stub.MaybeInvokeAuthentication()
>   File "...t\remote_api\remote_api_stub.py", line 740, in 
> MaybeInvokeAuthentication
> datastore_stub._server.Send(datastore_stub._path, payload=None)
>   File "..\appengine_rpc.py", line 405, in Send
> f = self.opener.open(req)
>   File "C:\Python27\lib\urllib2.py", line 410, in open
> response = meth(req, response)
>   File "C:\Python27\lib\urllib2.py", line 523, in http_response
> 'http', request, response, code, msg, hdrs)
>   File "C:\Python27\lib\urllib2.py", line 448, in error
> return self._call_chain(*args)
>   File "C:\Python27\lib\urllib2.py", line 382, in _call_chain
> result = func(*args)
>   File "C:\Python27\lib\urllib2.py", line 531, in http_error_default
> raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
> HTTPError: HTTP Error 500: Internal Server Error
> [ERROR   ] Authentication Failed: Incorrect credentials or unsupported 
> authentication type (e.g. OpenId).
>
> Please help  and thank you
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/d5b43e74-57ec-4990-9f56-819fe4d67f17%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: the datastore download problem.

2016-02-15 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Andri,

If you have a question or issue, you should either post it to Stack Overflow 
 with relevant information (if you think that the 
error is in your lack of understanding somehow), the Public Issue Tracker 
 (if you think 
you've found an issue on the platform and can post a reproducing example or 
information necessary to reproduce the behaviour), or in a new thread in 
this forum (if you have generalized questions which will aid good 
discussion, not necessarily technical problem reports). Adding a small 
comment to an old thread gives very little possibility to determine what 
might be specifically happening to your system.

Best wishes,

Nick

On Sunday, February 14, 2016 at 5:21:50 PM UTC-5, Andri Firstianto-GCP 
wrote:
>
> suppose app.yaml for python app engine,
> how to set remote api : on for java app engine?
>
> On Monday, January 13, 2014 at 10:23:16 AM UTC-8, Roninio wrote:
>>
>>
>> you should enable remote_api in your app.yaml file
>>
>> builtins:
>> - remote_api: on #/_ah/remote_api/
>>
>>
>>
>>
>> On Tuesday, December 10, 2013 9:10:44 PM UTC+2, Alan Anderson wrote:
>>>
>>> I am having the exact same problem with appcfg.py download_data, and I 
>>> also have it with appcfg.py create_bulkloader_config. I've tried everything 
>>> I can think of and some things suggested by others, but I keep running into 
>>> a wall on this.I am using the HR datastore, The doc "Uploading and 
>>> Downloading Data" has the following warning.
>>>
>>> *Warning:* This document applies to apps that use the master/slave 
>>> datastore. If your app uses the High Replication datastore, it is 
>>> possible to copy data from the app, but Google does not currently support 
>>> this use case. If you attempt to copy from a High Replication datastore, 
>>> you'll see a high_replication_warning error in the Admin Console, and 
>>> the downloaded data might not include recently saved entities.
>>>
>>>
>>> So it says "it is possible to copy data from the app" and warns "the 
>>> downloaded 
>>> data might not include recently saved entities." I can deal with the 
>>> latter, but how do you get past this authentication problem. Surely they 
>>> would not take away this vital download_data functionality for a HR 
>>> datastore...or would they?
>>>
>>>
>>> On Wednesday, November 13, 2013 1:05:53 AM UTC-6, 陈友和 wrote:

 Hi guys, I'm stuck in a problem which drive me crazy. As the url(
 https://developers.google.com/appengine/docs/python/tools/uploadingdata?hl=zh-CN&csw=1#Configuring_the_Bulk_Loader)
  
 introducing the way to download the data from datastore of my app on 
 google 
 app engine, I try this command:

 appcfg.py download_data --application=news-leon --kind=csv --url=
 http://news-leon.appspot.com/remote_api --filename=test.csv

 but I always get the these information:

 --
 02:49 PM Downloading data records.
 [INFO] Logging to bulkloader-log-20131113.144907
 [INFO] Throttling transfers:
 [INFO] Bandwidth: 25 bytes/second
 [INFO] HTTP connections: 8/second
 [INFO] Entities inserted/fetched/modified: 20/second
 [INFO] Batch Size: 10
 [INFO] Opening database: bulkloader-progress-20131113.144907.sql3
 [INFO] Opening database: bulkloader-results-20131113.144907.sql3
 [INFO] Connecting to news-leon.appspot.com/remote_api
 [ERROR   ] Exception during authentication
 Traceback (most recent call last):
   File 
 "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py",
  
 line 3469, in Run
 self.request_manager.Authenticate()
   File 
 "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py",
  
 line 1332, in Authenticate
 remote_api_stub.MaybeInvokeAuthentication()
   File 
 "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py",
  
 line 740, in MaybeInvokeAuthentication
 datastore_stub._server.Send(datastore_stub._path, payload=None)
   File 
 "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appengine_rpc.py",
  
 line 409, in Send
 f = self.opener.open(req)
   File 
 "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py",
  
 line 394, in open
 response = self._open(req, data)
   File 
 "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py",
  

Re: [google-appengine] JacksonFactory problem

2016-02-16 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Benjamin,

That would be a correct analysis, but I have the sneaking suspicion that OP 
is not using Maven, and thus has forgotten to include the relevant jar 
dependencies for the API client library.

On Tuesday, February 16, 2016 at 12:01:35 PM UTC-5, Benjamin Com wrote:
>
> Hi Vinny,
> Presuming the OP is using Maven (which I am), isn't this a bug in the 
> "Google Client API" maven project? If that project requires Jackson to 
> work, then it should indicate Jackson as a dependency. In that case, any of 
> us depending on "Google Client API" should be enough, and it will 
> transitively register a dependency on Jackson. It will do this IMPLICITLY, 
> without any of us needing to explicitly indicate that dependency. As we 
> don't actually depend on Jackson directly, it would be bad design for us to 
> explicitly list it due to knowledge of internal implementation of "Google 
> Client API."
>
> I am having this error too, but I depend on some older versions of GAE 
> SDK. I will update those first to see if it resolves itself, otherwise I'll 
> use your approach and just force-depend on Jackson (despite having no 
> direct dependency).
> Thanks,
> -b
>
> (details: I currently use version 1.9.21 in my GAE maven dependencies)
>
> On Thursday, February 13, 2014 at 6:38:09 PM UTC-8, Vinny P wrote:
>>
>> On Thu, Feb 13, 2014 at 5:26 AM,  wrote:
>>
>>> Exception in thread "main" java.lang.NoClassDefFoundError: 
>>> org/codehaus/jackson/JsonFactory
>>> at 
>>> com.google.api.client.json.jackson.JacksonFactory.(JacksonFactory.java:38)
>>> at com.sial.DirectorySamples.(DirectorySamples.java:21)
>>> Caused by: java.lang.ClassNotFoundException: 
>>> org.codehaus.jackson.JsonFactory
>>> How can I resolve this plz help me regarding this.
>>>
>>
>>
>> Most of the time, this occurs when the runtime can't find the Jackson 
>> library. Have you added the Jackson JARs to your Eclipse project and added 
>> them to your build path? 
>>  
>>  
>> -
>> -Vinny P
>> Technology & Media Advisor
>> Chicago, IL
>>
>> App Engine Code Samples: http://www.learntogoogleit.com
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/51d4de6e-1940-405b-af46-a4f2af80660b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Performance of new gcloud-java API

2016-02-17 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
It's an interesting question. Obviously empirical testing is best, but one 
could investigate the source code to make an informed guess as to the 
efficiency. Really the native App Engine runtime API's benefit from using 
gRPC , rather than JSON, but I feel that the 
gcloud-java library will likely also be able to make use of the more 
efficient gRPC when in a suitable environment, falling back to HTTP JSON 
REST when necessary. I'll try to update this thread tomorrow with any of my 
findings from investigating the source of gcloud-java 
.


On Wednesday, February 17, 2016 at 4:19:33 PM UTC-5, Robert Fox wrote:
>
> I'm a Java developer on Googles App Engine platform. Lately I've been 
> using Managed VMs. According to new-ish documentation on Google's site [1 
> 
> ]:
>
> As you become more familiar with the Managed VM environment you should use 
>> the native features of the Java runtime and the Google Cloud client 
>> libraries for Java rather than App Engine SDKs.
>> I love that the new gcloud-java seems to be a unified API for 
>> local/remote usage. But I do have one concern... and that is my question: 
>> How does performance compare to the standard App Engine APIs? I get worried 
>> with the new REST APIs with their JSON text processing / parsing... I will 
>> build a test suite if I have to but I was hoping someone might already know.
>
>
> These new developments would seem to be a huge win for Compute Engine if 
> the new gcloud-java is performant and can run fully authenticated.
>
> Out of the following services I'm a heavy user of the four in bold.
>
> *Datastore*
> Logging
> *Memcache*
> Search
> *Task Queue*
> *URL Fetch*
> Users
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/3fe61131-057a-4bdc-849a-0fc851607ad6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Asynchronous Deployment With Java AppEngine SDK

2016-02-22 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Andrew,

You'll need to wait until the previous deployment completes. In most 
scripting languages, it would be a matter of explicitly making your calls 
*asynchronous* in order to even run into this 409 error. Are you perhaps 
using NodeJS, which is a somewhat asynchronous language often used for 
scripting?

Best wishes,

Nick


On Monday, February 22, 2016 at 11:31:09 AM UTC-5, Andrew Teall wrote:
>
> Hi,
> We're trying to deploy multiple modules and managed VMs using the Java 
> AppEngine SDK. We are currently using a script with a  for loop that 
> backgrounds each call to the appcfg.sh and waiting 30 seconds between 
> starting each deploy. However we see 409 conflicts pretty often. Is there a 
> better way to accomplish this or does anyone have any experience getting 
> this to work with 100% success.
>
> Thanks,
> Andrew
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/404e9bb9-a432-4c8c-adbf-a2c8a2a2fca3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Tasks failing silently with error 'Instance Unavailable'

2016-02-23 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Does the issue you're experiencing seem like it would be related to the 
behaviour described in the communication? Is the "instance unavailable" 
error possibly related to default/non-default modules?

If you experience what you believe to be a platform issue, not the fault of 
your own code, you should post to the Public Issue Tracker. 
 This forum is meant 
for more general discussion of the platform and services.


On Tuesday, February 23, 2016 at 11:49:37 AM UTC-5, bmurr wrote:
>
> Tasks have been failing silently in my taskqueue all day.
> No PermanentTaskFailures or other exceptions are being thrown -- nothing 
> in my logs.
> The tasks are just retrying a number of times, with the reason for retries 
> being 'Instance Unavailable'. Then they disappear.
>
>
> I received an email from AppEngine Support about a month ago about a bug 
> they were planning to fix:
>
>  
>
>> Currently, we have a bug in the system where tasks enqueued from a custom 
>> domain (e.g. your_domain.com) are always routed to the default module 
>> even if a non-default module is specified in the app's dispatch.yaml/xml 
>> file. This bug will be fixed by February 22, 2016.
>
>
>
> However, this email did not mention the app I'm having issues with and the 
> bug didn't seem relevant to my app.
>
> Were changes made to the TaskQueues today? Is anyone else experiencing 
> similar problems?
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/5b283b0c-ba78-4afd-a120-6cf5be1ef0b9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: New Cloud Console

2016-02-24 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Folks, 

Raj has done the best thing in this circumstance and that's to post to the 
Public 
Issue Tracker  if 
you have a feature request to make. It's much more likely that your request 
will be acknowledged if you post to the correct place, and at least in the 
Public Issue Tracker you have guaranteed triage of any feature requests, 
whereas in a Groups thread like this one, you pretty much rely on an 
informal method of someone reading your comment and taking time to work on 
it.

So, feel free to post any requests you have for the new Developers Console 
in the Public Issue Tracker for App Engine . You'll see it accepted and 
work begun relatively quickly.

Thanks,

Nick
Community Support

On Wednesday, February 24, 2016 at 9:14:31 AM UTC-5, bFlood wrote:
>
> how do you search/filter on the new log viewer? does it require enabling 
> Google Cloud Monitoring (which is still in beta)? 
>
> On Tuesday, February 23, 2016 at 6:46:19 PM UTC-5, johnP wrote:
>>
>> Just got email that old appengine console will be shut off in 6 weeks. 
>>  The new cloud console does not have a "migrate traffic" option in the 
>> Versions screen.  This was my absolute favorite new feature in a long, long 
>> time.  Will it be available in the new console?
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/1c318a6a-23c5-40c3-8f6a-e653ce5fc4f7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Suggestions - Want to develop a social network for martial artists website using java, mongodb, angularjs, bootstrap etc

2016-02-24 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Amit,

MEAN (MongoDB ,Express.js 
, Angular.js 
, and Node.js 
) is a full-stack web-development 
paradigm ("software bundle") which is popular right now. You can read more 
about it by googling. The technologies used are quite interesting and 
modern. The pricing is described on the page you linked, and yes, 
initially, the database and webserver are on the same machine. Feel free to 
explore the docs further to find all kinds of getting started guides. There 
are a ton of options of how to deploy, and what to deploy, on the Cloud 
Platform.

I hope this answer was helpful to you.

Sincerely,

Nick

On Wednesday, February 24, 2016 at 3:48:09 PM UTC-5, Amit Chavan wrote:
>
> Thanks. Do you suggest any blog or books to familiarize with GCP. 
> Can you explain this environment -- 
> https://cloud.google.com/launcher/solution/bitnami-launchpad/meanstack
>
> How is the pricing determined. Does MongoDB and node is on same 
> environment ? 
>
> For the GCE  - Do you have a good example on the cloud platform reference 
> guide that I can use to get started. I am looking at the launcher document 
> https://cloud.google.com/launcher/
>
>
>
> On Tuesday, 23 February 2016 16:15:19 UTC-5, Nick wrote:
>>
>> You have 4 options right now on GCP:
>> GCE - runs VMs same as ec2
>> GKE - runs docker containers instead of full VMs
>> Managed VMs - these are appengine apps running in a less sandboxes 
>> environment, basically containers with access to managed services using 
>> 'native' APIs (as opposed to service calls)
>> GAE - appengine, a PaaS in a fully managed environment, you deploy code 
>> and they run on their own, accessing services as native APIs
>>
>> You can run a servlet 3.x app in the first three, with different levels 
>> of operational effort. 
>>
>> Right now, GAE is servlet 2.5 (Java 7). Don't hold your breath for this 
>> to change, it's been on the roadmap for years (although we're all very 
>> hopefully)
>>
>> Managed VMs are not GA yet either, which may affect your choice.
>>
>> Regarding play, I can't help there.
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/81aa3d59-63d4-4b1c-8439-2a8125ccb856%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: java.lang.NoClassDefFoundError: javax.servlet.FilterChain is a restricted class.

2016-02-24 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
It appears that some code you are attempting to use (possibly in a 
library?) is attempting to access javax.servlet.FilterChain, which, as 
described, is disallowed by the GAE runtime environment. Could you share 
some more details about your project?

On Tuesday, February 23, 2016 at 8:14:46 PM UTC-5, J Han wrote:
>
>
> I am new to Google App Engine. When try to use it, I immediately hit this 
> exception. I have googled that problem and found a couple of solutions. But 
> none of the solutions applied to my case. 
> Anyone have idea what could be wrong?
>
> I am use Java8, Eclipse Luna, and installed Google plugin to my Eclipse. 
> See attached screenshot gae-1.jpg.
> I created a web Application Project and run it as Web Application. See 
> attached gae-2.jpg.
>
> When I point my browser to http://localhost:/gaeservlet, it returns 
> HTTP 500 error. And there is exception in my Eclipse application console:
>
> Feb 23, 2016 5:03:10 PM java.util.prefs.WindowsPreferences 
> WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at 
> root 0x8002. Windows RegCreateKeyEx(...) returned error code 5.
> 
> There is a new version of the SDK available.
> ---
> Latest SDK:
> Release: 1.9.32
> Timestamp: Thu Dec 10 11:32:34 PST 2015
> API versions: [1.0]
>
> ---
> Your SDK:
> Release: 1.9.30
> Timestamp: Wed Nov 04 17:09:48 PST 2015
> API versions: [1.0]
>
> ---
> Please visit https://developers.google.com/appengine/downloads for the 
> latest SDK.
> 
> Feb 23, 2016 5:03:12 PM 
> com.google.appengine.tools.development.SystemPropertiesManager 
> setSystemProperties
> INFO: Overwriting system property key 'java.util.logging.config.file', 
> value 
> 'C:\eclipse\plugins\com.google.appengine.eclipse.sdkbundle_1.9.30\appengine-java-sdk-1.9.30\config\sdk\logging.properties'
>  
> with value 'WEB-INF/logging.properties' from 
> 'C:\Users\jhan\workspace\GaeServlet\war\WEB-INF\appengine-web.xml'
> Feb 23, 2016 5:03:12 PM com.google.apphosting.utils.jetty.JettyLogger info
> INFO: Logging to JettyLogger(null) via 
> com.google.apphosting.utils.jetty.JettyLogger
> Feb 23, 2016 5:03:12 PM com.google.apphosting.utils.jetty.JettyLogger info
> INFO: jetty-6.1.x
> Feb 23, 2016 5:03:13 PM com.google.apphosting.utils.jetty.JettyLogger info
> INFO: Started SelectChannelConnector@127.0.0.1:
> Feb 23, 2016 5:03:13 PM 
> com.google.appengine.tools.development.AbstractModule startup
> INFO: Module instance default is running at http://localhost:/
> Feb 23, 2016 5:03:13 PM 
> com.google.appengine.tools.development.AbstractModule startup
> INFO: The admin console is running at http://localhost:/_ah/admin
> Feb 23, 2016 5:03:13 PM 
> com.google.appengine.tools.development.DevAppServerImpl doStart
> INFO: Dev App Server is now running
> Feb 23, 2016 5:03:21 PM com.google.apphosting.utils.jetty.JettyLogger warn
> WARNING: Error for /gaeservlet
> java.lang.NoClassDefFoundError: javax.servlet.FilterChain is a restricted 
> class. Please see the Google  App Engine developer's guide for more details.
> at 
> com.google.appengine.tools.development.agent.runtime.Runtime.reject(Runtime.java:52)
> at 
> com.google.apphosting.utils.servlet.TransactionCleanupFilter.doFilter(TransactionCleanupFilter.java:43)
> at 
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
> at 
> com.google.appengine.tools.development.StaticFileFilter.doFilter(StaticFileFilter.java:125)
> at 
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
> at 
> com.google.appengine.tools.development.DevAppServerModulesFilter.doDirectRequest(DevAppServerModulesFilter.java:366)
> at 
> com.google.appengine.tools.development.DevAppServerModulesFilter.doDirectModuleRequest(DevAppServerModulesFilter.java:349)
> at 
> com.google.appengine.tools.development.DevAppServerModulesFilter.doFilter(DevAppServerModulesFilter.java:116)
> at 
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
> at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:388)
> at 
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
> at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
> at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
> at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)
> at 
> com.google.appengine.tools.development.DevAppEngineWebAppContext.handle(DevAppEngineWebAppContext.java:98)
> at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> at 
> com.google.appengine.tools.development.JettyContainerService$ApiProxyHandler.handle(JettyContainerService.java:512)
> at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> at org.mortbay.jetty.Server.handle(Server.java:326)
> at 

Re: [google-appengine] Is the Search API on the chopping block?

2016-02-26 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
As can be read in other threads for other topics, our deprecation timeline 
will leave a healthy margin if such a deprecation were to occur. You can 
read about this in the Terms of Service . 
Searchable Document Indexes are quite popular and it's very unlikely that 
the service would change or go away without an equivalent solution. 

On Thursday, February 25, 2016 at 4:06:48 PM UTC-5, PK wrote:
>
> Amen!! It is much more than just an API so this change sounds in the right 
> direction. I hope they put it inside the Storing Data section next, where 
> it belongs.
>
> PK
> p...@gae123.com
>
>
>
>
> On Feb 25, 2016, at 12:17 PM, Robert Fox  wrote:
>
> Moreover what used to be called the "Search API" on the App Engine 
> documentation is now labeled as "Searchable Document Indexes" not it's 
> not an API we swear
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/17aa3732-66e0-41e1-869f-325dad54154c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Scheduling Background Tasks

2016-02-26 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Mark,

First, I'll just explain that this forum is probably not the best place to 
post (or repost) a Stack Overflow question (a specific-issue, 
technical-support oriented one-on-one request for aid). This forum is meant 
for more general discussion of the platform and services. Posting a 
question like this to Stack Overflow is the best way to go, since there is 
a large userbase who are willing and able to answer questions of this form.

Now, as to the specifics of this question, I'll of course be happy to 
assist nonetheless: Task Queues can't post directly to Endpoints API routes 
.
 
You'll need to use code in the task handler to call the endpoint.

Best of luck in your future development :)

Sincerely,

Nick

On Thursday, February 25, 2016 at 3:42:46 PM UTC-5, Mark Stang wrote:
>
> I am trying to schedule a task to run in background.  I can't seem to find 
> a example.
> I posted this on Stackoverflow and I received one response:
>
> I've not really done much with Cloud Endpoints in python, but 415 is 
> *Unsupported 
> Media Type*. Since you are posting to an endpoint, it's probably 
> expecting a Content-type of application/json and a payload like {"key": 
> "key"}
>
> But I am not making a call, I am using the taskqueue function, which is 
> making the call and it should know how to make the http call.
>
> Anyone have an example or an idea on how to make this work?
>
>
> 0down votefavorite 
> 
>
> I will be the first to admit that I have no idea how to make this work, 
> but I can't seem to find any examples.
>
> What I am trying to do is to execute a Task in Background on the GAE using 
> python.
>
> I have a function that I am calling from the client that is taking longer 
> than 1 minute and is timing out. So, my solution is to make it a background 
> task. It could also be a cron task.
>
> Where I am running into issues is in trying to configure a url that I can 
> pass to the taskqueue.add function
>
>   @endpoints.method(endpoints.ResourceContainer(SimpleMessage), SimpleMessage,
> path='rdflib_add_task', http_method='POST', name='rdflib.add_task')
>   def RdfLibAddTask(self, request):
> # Add the task to the default queue.
> taskqueue.add(url='/_ah/spi/TTApi.RdfLibTaskTest', params={'key': "key"})
> return SimpleMessage(message="response")
>
>   @endpoints.method(endpoints.ResourceContainer(SimpleMessage), SimpleMessage,
> path='rdflib_task_test', http_method='POST', name='rdflib.task_test')
>   def RdfLibTaskTest(self, params):
> print "in RdfLibTaskTest", params
> return SimpleMessage(message="RdfLibTaskTest")
>
> When I call the "RdfLibAddTask" from the client it works and adds the task 
> to my default queue. However, the default queue runs the task a bunch of 
> times and they all fail with a 415.
>
> 0.1.0.2 - - [22/Feb/2016:08:50:23 -0800] "POST /_ah/spi/TTApi.RdfLibTaskTest 
> HTTP/1.1" 415 574 
> https://ttapi-test-ms.appspot.com/_ah/spi/TTApi.RdfLibAddTask 
> "AppEngine-Google; (+http://code.google.com/appengine)" 
> "ttapi-test-ms.appspot.com" ms=26 cpu_ms=14 cpm_usd=6.4149e-8 
> instance=00c61b117c7a727c0cabea61b0086576f7ca4fe4 app_engine_release=1.9.33 
> trace_id=-
>
> So, I am doing something wrong and I can't find a simple example that will 
> let me proceed. Can anyone identify what is wrong with my example or 
> provide me with a working example? And it doesn't have to be a push queue, 
> it could be a cron task.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/bdbce541-b703-486c-8c3d-16a7720cf823%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: How to add backend function that gets triggered according to changes in the datastore?

2016-02-29 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Since you control what is in your code, you can control whether all entity 
put / update events also then trigger any code you want to run. From such a 
high level description, there are many possible implementations. 

You could use any number of persistence layers for various languages which 
support  such as JPA , 
JDO 
 
(Java), NDB Model "Hook Methods" 
 (python), 
or if using the Cloud Datastore REST API 
 or an appengine 
language-runtime API directly 
, you can 
simply be sure to put the relevant function calls wherever you also have a 
post/put or update.

There are many services on the platform which might be of use to you in 
further exploring message passing patterns and logical flow relating to 
databases that you build:

Datastore Transactions 


Push 
 / 
Pull 
 
Queues 

Cloud Pub/Sub 

 
 

On Friday, February 26, 2016 at 12:20:50 PM UTC-5, jackson wang wrote:
>
> After days of frustration with AWS, I decided to try out Google App 
> Engine. However, I'm not sure what I can do to have a backend function that 
> gets triggered to run a full text search algorithm in the database. When 
> new data is added to the database, I want this function to be invoked and 
> do a search action in the database, then send notifications according to 
> the search result.
>
>
> What I want to do is like Parse Cloud Code, or AWS Lambda + S3. 
>
>
> Please help, I'm desperate, any suggestions would be highly appreciated.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/c09d7acd-b6c0-4882-afec-abc1f4fefbe8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: java.net.SocketException: Permission denied: Attempt to access a blocked recipient without permission. (mapped-IPv4)

2016-02-29 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Hemanth,

It will depend on what you are attempting to connect to. It appears that 
FrEaKmAn was connecting to a local database while developing (127.0.0.1) 
and then attempted to deploy but still deployed code which tried to reach 
"127.0.0.1" which fails in the production network for obvious reasons.

On Friday, February 26, 2016 at 5:39:30 PM UTC-5, Hemanth Kumar wrote:
>
> HI FrEaKmAn, 
>
>Please may you help on , how you configure the correct production IP? 
>
> Thanks 
> Manish 
>
>
>
> -- 
> View this message in context: 
> http://google-app-engine.75637.x6.nabble.com/java-net-SocketException-Permission-denied-Attempt-to-access-a-blocked-recipient-without-permission--tp1825p3157.html
>  
> Sent from the Google App Engine mailing list archive at Nabble.com. 
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/75cbc0f0-021b-494c-99c6-cfb5c8fcb1b7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: java.lang.NoClassDefFoundError: javax.servlet.FilterChain is a restricted class.

2016-02-29 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Using the same version of the SDK I'm unable to replicate this behaviour. 
Perhaps you should download a fresh copy of the SDK, in the chance that 
your version is somehow corrupted? I can't really think of much else at the 
moment. Can you try to run the same project using the dev_appserver.sh 
script in the SDK?

On Monday, February 29, 2016 at 2:05:49 PM UTC-5, J Han wrote:
>
> I just created a Google Web Application Project, see attached screenshot 
> gae-2.jpg, and without any changes,  run it as Web Application.
>
> On Wednesday, February 24, 2016 at 2:44:17 PM UTC-8, Nick (Cloud Platform 
> Support) wrote:
>>
>> It appears that some code you are attempting to use (possibly in a 
>> library?) is attempting to access javax.servlet.FilterChain, which, as 
>> described, is disallowed by the GAE runtime environment. Could you share 
>> some more details about your project?
>>
>> On Tuesday, February 23, 2016 at 8:14:46 PM UTC-5, J Han wrote:
>>>
>>>
>>> I am new to Google App Engine. When try to use it, I immediately hit 
>>> this exception. I have googled that problem and found a couple of 
>>> solutions. But none of the solutions applied to my case. 
>>> Anyone have idea what could be wrong?
>>>
>>> I am use Java8, Eclipse Luna, and installed Google plugin to my Eclipse. 
>>> See attached screenshot gae-1.jpg.
>>> I created a web Application Project and run it as Web Application. See 
>>> attached gae-2.jpg.
>>>
>>> When I point my browser to http://localhost:/gaeservlet, it returns 
>>> HTTP 500 error. And there is exception in my Eclipse application console:
>>>
>>> Feb 23, 2016 5:03:10 PM java.util.prefs.WindowsPreferences 
>>> WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs 
>>> at root 0x8002. Windows RegCreateKeyEx(...) returned error code 5.
>>> 
>>> There is a new version of the SDK available.
>>> ---
>>> Latest SDK:
>>> Release: 1.9.32
>>> Timestamp: Thu Dec 10 11:32:34 PST 2015
>>> API versions: [1.0]
>>>
>>> ---
>>> Your SDK:
>>> Release: 1.9.30
>>> Timestamp: Wed Nov 04 17:09:48 PST 2015
>>> API versions: [1.0]
>>>
>>> ---
>>> Please visit https://developers.google.com/appengine/downloads for the 
>>> latest SDK.
>>> 
>>> Feb 23, 2016 5:03:12 PM 
>>> com.google.appengine.tools.development.SystemPropertiesManager 
>>> setSystemProperties
>>> INFO: Overwriting system property key 'java.util.logging.config.file', 
>>> value 
>>> 'C:\eclipse\plugins\com.google.appengine.eclipse.sdkbundle_1.9.30\appengine-java-sdk-1.9.30\config\sdk\logging.properties'
>>>  
>>> with value 'WEB-INF/logging.properties' from 
>>> 'C:\Users\jhan\workspace\GaeServlet\war\WEB-INF\appengine-web.xml'
>>> Feb 23, 2016 5:03:12 PM com.google.apphosting.utils.jetty.JettyLogger 
>>> info
>>> INFO: Logging to JettyLogger(null) via 
>>> com.google.apphosting.utils.jetty.JettyLogger
>>> Feb 23, 2016 5:03:12 PM com.google.apphosting.utils.jetty.JettyLogger 
>>> info
>>> INFO: jetty-6.1.x
>>> Feb 23, 2016 5:03:13 PM com.google.apphosting.utils.jetty.JettyLogger 
>>> info
>>> INFO: Started SelectChannelConnector@127.0.0.1:
>>> Feb 23, 2016 5:03:13 PM 
>>> com.google.appengine.tools.development.AbstractModule startup
>>> INFO: Module instance default is running at http://localhost:/
>>> Feb 23, 2016 5:03:13 PM 
>>> com.google.appengine.tools.development.AbstractModule startup
>>> INFO: The admin console is running at http://localhost:/_ah/admin
>>> Feb 23, 2016 5:03:13 PM 
>>> com.google.appengine.tools.development.DevAppServerImpl doStart
>>> INFO: Dev App Server is now running
>>> Feb 23, 2016 5:03:21 PM com.google.apphosting.utils.jetty.JettyLogger 
>>> warn
>>> WARNING: Error for /gaeservlet
>>> java.lang.NoClassDefFoundError: javax.servlet.FilterChain is a 
>>> restricted class. Please see the Google  App Engine developer's guide for 
>>> more details.
>>> at 
>>> com.google.appengine.tools.development.agent.runtime.Runtime.reject(Runtime.java:52)
>>> at 
>>> com.google.apphosting.utils.servlet.TransactionCleanupFilter.doFilter(TransactionCleanupFilter.java:43)
>>> at 
>>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
>>> at 
>>> com.google.appengine.tools.development.StaticFileFilter.doFilter(StaticFileFilter.java:125)
>>> at 
>>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
>>> at 
>>> com.google.appengine.tools.development.DevAppServerModulesFilter.doDirectRequest(DevAppServerModulesFilter.java:366)
>>> at 
>>> com.google.appengine.tools.development.DevAppServerModulesFilter.doDirectModuleRequest(DevAppServerModulesFilter.java:349)
>>> at 
>>> com.google.appengine.tools.development.DevAppServerModulesFilter.doFilter(DevAppServerModulesFilter.java:116)
>>> at 
>>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
>>> at 
>>> org

[google-appengine] Re: Task Queue Configuration Query

2016-02-29 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
What do you mean by assigning names in the task queue, and what relation to 
domain names have to this? Are you depending on the exception catching in 
the local environment?

On Monday, February 29, 2016 at 3:31:01 AM UTC-5, Anthony Shapley wrote:
>
>
> Hi,
>
> I've been developing a reverse lookup tool, using the task queue and 
> datastore in PHP, in order to prevent duplicate crawling we decided to 
> assign names in the task queue (the domain name) however since configuring 
> this the task queue on my local environment isn't running at all. Is there 
> a reason why this might be?
>
> I've not tested it live, because it isn't ready, the queue.yaml file for 
> this queue is:
> - name: domaincrawler
>   rate: 1/s
>   max_concurrent_requests: 10
>
> Please let me know if you have any ideas.
>
> Best,
> Ant
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/fb9b6c55-3659-4721-ba39-e6c2048add10%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Larger Server Instance - App Engine Python

2016-02-29 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
You can control the machine specs at deployment-time in app.yaml 
,
 
to specify the instance class 
.

On Monday, February 29, 2016 at 7:14:46 PM UTC-5, Jay Kyburz wrote:
>
> Is it possible to use larger server instances for App Engine Python?
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/b6de058d-add7-4e2e-8aa3-9ed79ca6481e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Unable to deploy application.

2016-03-01 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Thanasis,

This forum is meant for more general discussion of the platform and 
services, and so isn't really suitable to a posting like this, which should 
be either made to Stack Overflow  or the Public 
Issue Tracker . It 
seems that you've left out a great deal of relevant information which could 
help someone in one of those forums to assist you, such as the SDK version 
you're running.

If you'd like, you could post to either of the places mentioned above and 
post a link here, and perhaps somebody who sees this posting will be able 
to assist you over there. The main reason to post in those places is that 
they're explicitly set up to handle one-on-one technical support requests 
like this, while this forum is meant for more high-level discussion.

Best wishes,

Nick

On Tuesday, March 1, 2016 at 2:43:51 PM UTC-5, Thanasis Delenikas wrote:
>
> I am trying to deploy my "eqgr-gr" application, and I get this:
>
>
>  Deploying frontend 
>
> Preparing to deploy:
> Created staging directory at: 
> 'C:\Users\TDELE_~1\AppData\Local\Temp\appcfg7895862570243532095.tmp'
> Scanning for jsp files.
> Compiling jsp files.
> Scanning files on local disk.
> Scanned 250 files.
> Scanned 500 files.
> Scanned 750 files.
> Initiating update.
> Cloning 452 static files.
> Cloning 539 application files.
>
> Deploying:
> Uploading 0 files.
> Initializing precompilation...
> Deploying new version.
>
> Verifying availability:
> Will check again in 1 seconds.
> Will check again in 2 seconds.
> Will check again in 4 seconds.
> Will check again in 8 seconds.
> Closing update: new version is ready to start serving.
>
> Updating datastore:
> Uploading index definitions.
> Uploading cron jobs.
> Uploading task queues.
> com.google.appengine.tools.admin.HttpIoException: Error posting to URL: 
> https://appengine.google.com/api/appversion/updatepagespeed?app_id=eqgr-gr&version=15&;
> 302 Found
>
> Deployment does not finish...
> I've tried to increase the version number in order to deploy a "fresh" 
> one, but I get the same error.
>
> Please advise!
>
> Thank you.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/55062ed9-3721-47ca-b973-cdbee2192f54%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cannot send mail

2016-03-01 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Petr,

If you're experiencing an issue on the platform, you should post to the Public 
Issue Tracker  and 
include a minimal application which can be used to reproduce the behaviour 
on our end. The example email you show is likely breaking exactly the 
specific conditions needed to observe the behaviour - often mail will fail 
to send due to matching a spam signature, although without seeing the 
message content (or the error output in the logs, for that matter), it's 
impossible to know. 

If you post to the Public Issue Tracker and then post the link to the 
created thread here, I'll be happy to take a look and help you out. As it 
is, this thread is somewhat off-topic since this forum is meant for general 
and high-level discussion of the platform and services, not specific-issue 
technical support requests.

Best wishes,

Nick

On Tuesday, March 1, 2016 at 6:14:20 PM UTC-5, Petr Balogh wrote:
>
> Hello, 
>
> I've met problem in my application.. problem is that I cannot send email.. 
> or behaviour seems weird..
>
> First time I've got email.. but after that haven't..  if app was running 
> day, maybe two it started sending email.. but after I sent some changes to 
> app, it stopped sending mails again..
>
> I tried create different testing page but doesn't work :( :
>
> from google.appengine.api import mail 
>   
> import webapp2 
>  
>   
>   
>
> [code] 
>
> class emailTest(webapp2.RequestHandler):   
>  
> def get(self): 
>  
> message = mail.EmailMessage(   
>  
> sender="noreply ", 
>  
> subject="Testing email"   
>   
> ) 
>   
>   
>   
> message.to = "My Name "  
> message.body = """ 
>  
> Dear Albert:   
>  
>   
>   
> Your example.com account has been approved.  You can now visit   
>
> http://www.example.com/ and sign in using your Google Account to 
>
> access new features.   
>  
>   
>   
> Please let us know if you have any questions. 
>   
>   
>   
> The example.com Team 
>
> """   
>   
>   
>   
> message.send() 
>  
> self.response.out.write(message.body)   
> [code]
>
> it is almost same as in doc: 
> https://cloud.google.com/appengine/docs/python/mail/sendingmail 
>
> Any idea what I am doing wrong?  I have still free version of app and can 
> see in quota that sent email value is increasing if I send email.  
>
> Thanks   
> ~ 
>
> ~  
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/f6a5e3f9-d3ac-409e-b227-c48591c087da%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Unsecured request by the taskqueue

2016-03-03 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey John,

Given that the HTTP requests for push queues exist only within our secured 
infrastructure and aren't exposed to anything but the endpoint which 
receives them, there's no need to worry about eavesdropping attacks which 
motivate the existence of SSL and HTTPS. When it comes to using the Task 
Queues REST API, this is protected by HTTPS and OAuth2.0, so again there 
should be no cause for concern. 

If you'd like, for any reason, to suggest a feature request on the 
platform, feel free to lodge these in the App Engine Public Issue Tracker 
 or the Cloud 
Platform Public Issue Tracker 
. Those issue 
trackers are triaged regularly and you should see a response relatively 
quickly.

Best wishes,

Nick
Cloud Platform Community Support

On Thursday, March 3, 2016 at 10:53:36 AM UTC-5, JohnGB wrote:
>
> It seems that the calls from the push taskqueue are made using an 
> unsecured HTTP, and not a HTTPS connection.  Given that sensitive 
> information is often passed on the taskqueue, is it possible to change this?
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/c6185693-b35b-4049-9da3-b0c77d7ca794%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Unsecured request by the taskqueue

2016-03-03 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Although, there is the question of securing the endpoint against user 
requests from outside the Task Queues infrastructure. In that case, a small 
section in the documentation 

 
explains how to protect the endpoint with "login: admin" in app.yaml when 
deploying.

On Thursday, March 3, 2016 at 10:53:36 AM UTC-5, JohnGB wrote:
>
> It seems that the calls from the push taskqueue are made using an 
> unsecured HTTP, and not a HTTPS connection.  Given that sensitive 
> information is often passed on the taskqueue, is it possible to change this?
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/03b3e47f-2619-4437-8468-431907d522d8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Too many instances being launched!

2016-03-03 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Edward,

It sounds as though some of your instances were migrating to the newest 
version of the runtime (1.9.34), and it's possible that the new version 
caused the instances to spin up in strange ways. This should never affect 
your billing or cause you to go over the daily budget, so you should contact 
Billing 
 to 
get that sorted out immediately. I wish you the best of luck in contacting 
them. 

As far as the reason for the instances restarting once killed, this could 
have something to do with the autoscaler's perception of your request load, 
and the configuration you gave in your app.yaml, but it could also be a 
behaviour of the version of the 1.9.34 runtime which some of you instances 
were using. You can feel free to ask about this in the case that you open 
with billing.

This is about all the advice I can give you from looking at the graphs and 
reading your post. Again, I wish you the best of luck in getting a good 
resolution to your issues here.

Sincerely,

Nick
Cloud Platform Community Support

On Thursday, March 3, 2016 at 8:33:39 AM UTC-5, Edward Sentongo wrote:
>
> Hello, 
>
> Since February 29, too many instances are being launched to service few 
> requests.
> I have not updated any app whatsoever. Front end requests are normal or 
> even slightly less that previous.
>
> *Example:* 
> - at one time 2 instances of v1.9.34 and 4 instances of v1.9.33 were 
> launched. Yes, it release versions v1.9.33 and v1.9.34 are being toggled at 
> will!
> - one instanced serviced 700 request.
> - the other 2 serviced 10 - 20 requests
> - the rest serviced 1 or 2 requests. 
>
> *What I have done:*
> - I shutdown the instances serving less than 10 requests. They were 
> immediately restarted. Why should 3 instances service 1 simple request be 
> restarted as soon as I shut them down?
> - I disabled the affected apps and re-enable them. This didn't help 
> anything.
> * There's no options in my app-settings to limit the number of (idle) 
> instances
>
> *Consequences:*
> - My costs have been increasing. In the last 3 days, I have been billed 
> what I normally use in a week. Is there a possibility of a refund? Is there 
> a 'trick' I am missing here?
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/5c7c18ef-1484-498f-8e5e-77886420f33f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Managed VM Java - Start Error

2016-03-03 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Rahul,

This forum isn't the right place to post specific-issue technical support 
requests. These should be posted to either Stack Overflow 
 or the App Engine Public Issue Tracker 
, depending on 
whether you believe the issue to be mostly based on your own 
misunderstanding or on an actual issue in the platform itself (and thus 
would require tracking in a public issue tracker). In those places, your 
post is far more likely to find its way to people who are willing and able 
to assist in debugging. 

Sincerely,

Nick
Cloud Platform Community Support



On Wednesday, March 2, 2016 at 4:27:41 PM UTC-5, Rahul Tongia wrote:
>
> Hi,
>
> I am using appengine managed vm for Java. I use priority order for setting 
> the jars of my choice in appengine-web.xml
> 
> 
>
>
> Since this morning, I am getting the following error. Also suspisiously, 
> the appengine version shown in console is 1.9.33 for which there was no 
> Java release.:
>
> Any one else facing this kind of issue. I have changed no code or anything 
> else, but now Managed VM refuses to start.
>
> Regards,
> Rahul
>
> 2016-03-02 20:19:19.736:INFO:oejs.Server:main: jetty-9.2.10.v20150310
> 2016-03-02 20:19:19.766:INFO:oejs.AbstractNCSARequestLog:main: Opened 
> /var/log/app_engine/request.2016_03_02.log
> 2016-03-02 20:19:19.770:INFO:oejdp.ScanningAppProvider:main: Deployment 
> monitor [file:/home/vmagent/appengine-java-
> vmruntime/contexts/] at interval 1
> Mar 02, 2016 8:19:20 PM 
> com.google.apphosting.utils.config.AppEngineWebXmlReader readAppEngineWebXml
> SEVERE: Received exception processing 
> /home/vmagent/appengine-java-vmruntime/webapps/root/WEB-INF/appengine-web.xml
> java.lang.NumberFormatException: empty String
> at 
> sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1020)
> at java.lang.Double.parseDouble(Double.java:540)
> at 
> com.google.apphosting.utils.config.AppEngineWebXml$PrioritySpecifierEntry.setPriority(AppEngineWebXml.ja
> va:2110)
> at 
> com.google.apphosting.utils.config.AppEngineWebXmlProcessor.processClassPathPrioritySpecifier(AppEngineW
> ebXmlProcessor.java:601)
> at 
> com.google.apphosting.utils.config.AppEngineWebXmlProcessor.processClassLoaderConfig(AppEngineWebXmlProc
> essor.java:594)
> at 
> com.google.apphosting.utils.config.AppEngineWebXmlProcessor.processSecondLevelNode(AppEngineWebXmlProces
> sor.java:209)
> at 
> com.google.apphosting.utils.config.AppEngineWebXmlProcessor.processXml(AppEngineWebXmlProcessor.java:64)
> at 
> com.google.apphosting.utils.config.AppEngineWebXmlReader.processXml(AppEngineWebXmlReader.java:132)
> at 
> com.google.apphosting.utils.config.AppEngineWebXmlReader.readAppEngineWebXml(AppEngineWebXmlReader.java:
> 76)
> at 
> com.google.apphosting.vmruntime.jetty9.VmRuntimeWebAppContext.init(VmRuntimeWebAppContext.java:224)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.eclipse.jetty.util.TypeUtil.call(TypeUtil.java:500)
> at 
> org.eclipse.jetty.xml.XmlConfiguration$JettyXmlConfiguration.call(XmlConfiguration.java:730)
> at 
> org.eclipse.jetty.xml.XmlConfiguration$JettyXmlConfiguration.configure(XmlConfiguration.java:417)
> at 
> org.eclipse.jetty.xml.XmlConfiguration$JettyXmlConfiguration.configure(XmlConfiguration.java:354)
> at 
> org.eclipse.jetty.xml.XmlConfiguration.configure(XmlConfiguration.java:262)
> at 
> org.eclipse.jetty.deploy.providers.WebAppProvider.createContextHandler(WebAppProvider.java:287)
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/34b205ca-5bb7-4bdb-aa7b-f44ca12ec3a3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Unable to deply the application.

2016-03-03 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Diego,

Is this still occurring for you, or was it a one-time error? 

Can you possibly include the full logs of running gcloud with "--verbosity 
debug" argument? Feel free to search for your app id in the output and 
replace it with "xxx", etc. if you have concerns about security. 

This issue may need to be reported in the Public Issue Tracker 
, so I'll also ask 
for as much information as I can right now, in addition to the full debug 
logs, such as:

* OS version
* SDK version

So, feel free to reply with the given information and possibly we can 
create a report in the Public Issue Tracker which will begin the work on 
finding the root cause of this.

On Wednesday, March 2, 2016 at 4:19:46 PM UTC-5, Diego Molteni wrote:
>
> Hi Expert,
>
> I'm was trying to deploy an application (first time for me) but i had this 
> error message:
>
> Copying certificates for secure access. You may be prompted to create an 
> SSH keypair.
> ERROR: gcloud crashed (DockerException): Error while fetching server API 
> version: [Errno 1] _ssl.c:510: error:14090086:SSL 
> routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed
>
> I tried to figure out what's going on but I can't find a solution.\
>
> Help please :)
> Thanks
> Diego
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/5bfca9da-363f-4a0e-8ea7-57964ace8c02%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: App returning 500 for past hours

2016-03-03 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Bharath,

Can you post the logs of the request? 500 usually means an error internal 
to your application's code, which should leave a stack trace in the logs.

On Wednesday, March 2, 2016 at 10:30:48 PM UTC-5, Bharath Kumaar wrote:
>
> Hello all, our app "live-adaptivecourse" is returning 500 internal server 
> error almost 6 hours. No request is getting processed. Is app engine 
> elevated?
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/5c3fa818-e20d-4d22-9e24-616ba39a0ddd%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cannot send mail

2016-03-03 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Rob,

The best way to get us to look at a potential issue is to make a report in 
the Public Issue Tracker 
. Feel free to do 
so, with as much technical information as possible, and you'll find that 
the responses are quick and the issue will make progress. Posting in a 
forum meant for general discussion (such as this one) is far less likely to 
find its way to people who can help.

Best wishes,

Nick



On Wednesday, March 2, 2016 at 12:49:42 PM UTC-5, Rob Williams wrote:
>
> Hi,
>
> I've seen the same since yesterday, 1-March-2015. Existing code queues 
> mails to not send too fast. Test case has a small number of receivers.
>
> Have found that:
>
>- Logs indicate mail was sent
>- Quota is updated to show mail being sent
>- Only a small random subset of the sent mails are received by remote 
>hosts
>   - Have tested with multiple receiving domains
>   - Emails are not in junk folders
>   - The few emails that are delivered arrive instantly
>- No bounce backs have been delivered
>
>
> Several people are seeing similar behaviour on stack overflow. 
> http://stackoverflow.com/questions/35727054/google-app-engine-python-mail-sent-but-not-received
>   
>
> http://stackoverflow.com/questions/35737937/sending-email-stopped-working-using-anythingtestapp-appspotmail-com
>
>
> Is email transmission broken? Is email being radically queued?
>
> Thanks!
>
>
> On Tuesday, March 1, 2016 at 6:14:20 PM UTC-5, Petr Balogh wrote:
>>
>> Hello, 
>>
>> I've met problem in my application.. problem is that I cannot send 
>> email.. or behaviour seems weird..
>>
>> First time I've got email.. but after that haven't..  if app was running 
>> day, maybe two it started sending email.. but after I sent some changes to 
>> app, it stopped sending mails again..
>>
>> I tried create different testing page but doesn't work :( :
>>
>> from google.appengine.api import mail 
>>   
>> import webapp2   
>>
>>   
>>   
>>
>> [code]   
>>  
>> class emailTest(webapp2.RequestHandler): 
>>
>> def get(self):   
>>
>> message = mail.EmailMessage( 
>>
>> sender="noreply ", 
>>  
>> subject="Testing email"   
>>   
>> ) 
>>   
>>   
>>   
>> message.to = "My Name "  
>> message.body = """   
>>
>> Dear Albert: 
>>
>>   
>>   
>> Your example.com account has been approved.  You can now visit   
>>
>> http://www.example.com/ and sign in using your Google Account to 
>>
>> access new features. 
>>
>>   
>>   
>> Please let us know if you have any questions. 
>>   
>>   
>>   
>> The example.com Team 
>>
>> """   
>>   
>>   
>>   
>> message.send()   
>>
>> self.response.out.write(message.body)   
>> [code]
>>
>> it is almost same as in doc: 
>> https://cloud.google.com/appengine/docs/python/mail/sendingmail 
>>
>> Any idea what I am doing wrong?  I have still free version of app and can 
>> see in quota that sent email value is increasing if I send email.  
>>
>> Thanks   
>> ~ 
>>
>> ~  
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this 

[google-appengine] Re: Unsecured request by the taskqueue

2016-03-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey John,

Ah, that makes sense. Yep, feel free to file a Feature Request explaining 
your entire situation and we can see what we can do about it! 

On Thursday, March 3, 2016 at 4:25:59 PM UTC-5, JohnGB wrote:
>
> Thanks for the info Nick.
>
> Part of the pain with this is that I have middleware which forces secure 
> connections.  To have an exception for this, I will have to change to 
> having per route middleware, which is quite frankly ugly code wise.  But it 
> seems like that is the only option open here.  I'll likely lodge an issue 
> on that link.
>
> ~ John
>
> On Thursday, March 3, 2016 at 8:53:43 PM UTC+1, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey John,
>>
>> Given that the HTTP requests for push queues exist only within our 
>> secured infrastructure and aren't exposed to anything but the endpoint 
>> which receives them, there's no need to worry about eavesdropping attacks 
>> which motivate the existence of SSL and HTTPS. When it comes to using the 
>> Task Queues REST API, this is protected by HTTPS and OAuth2.0, so again 
>> there should be no cause for concern. 
>>
>> If you'd like, for any reason, to suggest a feature request on the 
>> platform, feel free to lodge these in the App Engine Public Issue Tracker 
>>  or the Cloud 
>> Platform Public Issue Tracker 
>> . Those 
>> issue trackers are triaged regularly and you should see a response 
>> relatively quickly.
>>
>> Best wishes,
>>
>> Nick
>> Cloud Platform Community Support
>>
>> On Thursday, March 3, 2016 at 10:53:36 AM UTC-5, JohnGB wrote:
>>>
>>> It seems that the calls from the push taskqueue are made using an 
>>> unsecured HTTP, and not a HTTPS connection.  Given that sensitive 
>>> information is often passed on the taskqueue, is it possible to change this?
>>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/cebca172-378c-4490-aa84-df09e7c923b3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: App returning 500 for past hours

2016-03-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Bharath,

Sounds good, glad to hear that. In future, feel free to open an issue in 
the Public Issue Tracker 
 if you notice a 
production issue, as it's a much more direct line to engineering than this 
forum, which is also meant more for discussion and not technical support. 
We monitor the Public Issue Tracker just as much as this forum, so your 
issue will be picked up quickly.

Best wishes for your future development,

Nick
Cloud Platform Community Support

On Thursday, March 3, 2016 at 7:53:14 PM UTC-5, Bharath Kumaar wrote:
>
> Thanks guys. It got solved after contacting GAE support team. It problem 
> is with the newly rolled out AppEngine version.
>
> On Thursday, March 3, 2016 at 9:00:48 AM UTC+5:30, Bharath Kumaar wrote:
>>
>> Hello all, our app "live-adaptivecourse" is returning 500 internal server 
>> error almost 6 hours. No request is getting processed. Is app engine 
>> elevated?
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/8eb4ec59-48b8-4fd6-81e5-4cc5bb68cc6c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Too many instances being launched!

2016-03-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Good to hear, I wish you the best in your interaction with Billing support. 
Feel free to update this thread if you have any useful information for 
other users.

On Thursday, March 3, 2016 at 7:51:19 PM UTC-5, Edward Sentongo wrote:
>
> Hello Nick,
>
> Thank you for your reply. I submitted the issue. There was no option to 
> submit screenshots.
>
> *"Thank you for contacting us. One of our support agents will process it 
> shortly, usually within 2-3 business days. We can not guarantee a response 
> time. In the meantime, please see our help center to see if your question 
> may have already been answered there."*
>
> Hopefully my issue will be solved immediately because around this time is 
> when payments are deduct from me for google app engine usage.
>
> Cheers,
> Edward
>
> On Thursday, March 3, 2016 at 10:04:00 PM UTC+1, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Edward,
>>
>> It sounds as though some of your instances were migrating to the newest 
>> version of the runtime (1.9.34), and it's possible that the new version 
>> caused the instances to spin up in strange ways. This should never affect 
>> your billing or cause you to go over the daily budget, so you should contact 
>> Billing 
>>  
>> to get that sorted out immediately. I wish you the best of luck in 
>> contacting them. 
>>
>> As far as the reason for the instances restarting once killed, this could 
>> have something to do with the autoscaler's perception of your request load, 
>> and the configuration you gave in your app.yaml, but it could also be a 
>> behaviour of the version of the 1.9.34 runtime which some of you instances 
>> were using. You can feel free to ask about this in the case that you open 
>> with billing.
>>
>> This is about all the advice I can give you from looking at the graphs 
>> and reading your post. Again, I wish you the best of luck in getting a good 
>> resolution to your issues here.
>>
>> Sincerely,
>>
>> Nick
>> Cloud Platform Community Support
>>
>> On Thursday, March 3, 2016 at 8:33:39 AM UTC-5, Edward Sentongo wrote:
>>>
>>> Hello, 
>>>
>>> Since February 29, too many instances are being launched to service few 
>>> requests.
>>> I have not updated any app whatsoever. Front end requests are normal or 
>>> even slightly less that previous.
>>>
>>> *Example:* 
>>> - at one time 2 instances of v1.9.34 and 4 instances of v1.9.33 were 
>>> launched. Yes, it release versions v1.9.33 and v1.9.34 are being toggled at 
>>> will!
>>> - one instanced serviced 700 request.
>>> - the other 2 serviced 10 - 20 requests
>>> - the rest serviced 1 or 2 requests. 
>>>
>>> *What I have done:*
>>> - I shutdown the instances serving less than 10 requests. They were 
>>> immediately restarted. Why should 3 instances service 1 simple request be 
>>> restarted as soon as I shut them down?
>>> - I disabled the affected apps and re-enable them. This didn't help 
>>> anything.
>>> * There's no options in my app-settings to limit the number of (idle) 
>>> instances
>>>
>>> *Consequences:*
>>> - My costs have been increasing. In the last 3 days, I have been billed 
>>> what I normally use in a week. Is there a possibility of a refund? Is there 
>>> a 'trick' I am missing here?
>>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a7088b29-5c06-4d81-84f5-d60f22277fec%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Custom domains blocked by firewall

2016-03-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Mathew,

Thank you for asking your question. As it turns out, this isn't quite the 
right place, but I can direct you to where you should post: You should 
report any production issues to the Public Issue Tracker 
 with enough 
technical information (logs, requests, etc.) to show what's happening and 
allow us to investigate. Feel free to post there any time, as we monitor it 
actively. 

Best wishes,

Nick

On Friday, March 4, 2016 at 12:53:56 AM UTC-5, Mathew Paret wrote:
>
>
> 
> Custom domains are not resolving after it reaches google. This is a 
> service disruption. Is this the right place to request support for this?
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/9717b475-8095-4010-82cc-e18173741fea%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cannot send mail

2016-03-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Rob,

Thanks for the link, and for posting in the right place :) We'll be active 
on that thread shortly. 

On Friday, March 4, 2016 at 10:56:02 AM UTC-5, Rob Williams wrote:
>
> Hi Nick,
>
> I've created 
> https://code.google.com/p/googleappengine/issues/detail?id=12786
>
> Thanks.
>
> On Thursday, March 3, 2016 at 6:38:11 PM UTC-5, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Rob,
>>
>> The best way to get us to look at a potential issue is to make a report 
>> in the Public Issue Tracker 
>> . Feel free to do 
>> so, with as much technical information as possible, and you'll find that 
>> the responses are quick and the issue will make progress. Posting in a 
>> forum meant for general discussion (such as this one) is far less likely to 
>> find its way to people who can help.
>>
>> Best wishes,
>>
>> Nick
>>
>>
>>
>> On Wednesday, March 2, 2016 at 12:49:42 PM UTC-5, Rob Williams wrote:
>>>
>>> Hi,
>>>
>>> I've seen the same since yesterday, 1-March-2015. Existing code queues 
>>> mails to not send too fast. Test case has a small number of receivers.
>>>
>>> Have found that:
>>>
>>>- Logs indicate mail was sent
>>>- Quota is updated to show mail being sent
>>>- Only a small random subset of the sent mails are received by 
>>>remote hosts
>>>   - Have tested with multiple receiving domains
>>>   - Emails are not in junk folders
>>>   - The few emails that are delivered arrive instantly
>>>- No bounce backs have been delivered
>>>
>>>
>>> Several people are seeing similar behaviour on stack overflow. 
>>> http://stackoverflow.com/questions/35727054/google-app-engine-python-mail-sent-but-not-received
>>>   
>>>
>>> http://stackoverflow.com/questions/35737937/sending-email-stopped-working-using-anythingtestapp-appspotmail-com
>>>
>>>
>>> Is email transmission broken? Is email being radically queued?
>>>
>>> Thanks!
>>>
>>>
>>> On Tuesday, March 1, 2016 at 6:14:20 PM UTC-5, Petr Balogh wrote:

 Hello, 

 I've met problem in my application.. problem is that I cannot send 
 email.. or behaviour seems weird..

 First time I've got email.. but after that haven't..  if app was 
 running day, maybe two it started sending email.. but after I sent some 
 changes to app, it stopped sending mails again..

 I tried create different testing page but doesn't work :( :

 from google.appengine.api import mail   
 
 import webapp2 
  
 
 

 [code] 

 class emailTest(webapp2.RequestHandler):   
  
 def get(self): 
  
 message = mail.EmailMessage(   
  
 sender="noreply ",   

 subject="Testing email" 
 
 )   
 
 
 
 message.to = "My Name "  
 message.body = """ 
  
 Dear Albert:   
  
 
 
 Your example.com account has been approved.  You can now visit 
  
 http://www.example.com/ and sign in using your Google Account 
 to
 access new features.   
  
 
 
 Please let us know if you have any questions.   
 
 
 
 The example.com Team   
  
 """ 
 
 
 
 message.send() 
  
 self.response.out.write(message.body)   
 [code]

 it is almost same as in doc: 
 https://cloud.google.com/appengine/docs/python/mail/sendingmail 

 Any idea what I am doing wrong?  I have still free version of app and 
 can see in quota that sent email value is increasin

Re: [google-appengine] New Cloud Console

2016-03-07 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Chris,

If you could link which issues those are which have been fixed but not 
updated, we could take a look and determine whether they should be updated 
with any new relevant information, such as a fix. Feel free to reply to me 
in this thread.

Best wishes,

Nick

On Thursday, February 25, 2016 at 1:09:43 PM UTC-5, Christian F. Howes 
wrote:
>
> Thanks Lorne. 
>
> Will we also be better at triaging and updating the Public Issue 
> Tracker?  Paid support told me today that several of the issues I filed 
> last year are supposedly fixed, but the Public Issue Tracker has yet to 
> be updated. 
>
> The lack of information provided, but the hard deadline on the turn-down 
> notice really concerns me as I don't have confidence that I will be able 
> to efficiently and effectively manage my app 6 weeks from now. 
>
> Thanks, 
>
> Christian 
>
> On 2/25/16 04:49, 'Lorne Kligerman' via Google App Engine wrote: 
> > Thanks everyone for the feedback.  Overall, we are going to reach 
> feature 
> > parity in the Cloud Platform Console before turning down the Admin 
> Console. 
> >   The next communication we send will have more details and will outline 
> any 
> > gaps that exist and our plans to address them.  To answer the questions 
> > asked here: 
> > 
> > - the dispatch rules will not be visible right away, but we are actively 
> > working on a mechanism for you to view all of your App Engine 
> configuration 
> > in one place 
> > - prohibiting code downloads will not show up in the same way, but this 
> can 
> > be managed through roles and upcoming IAM functionality 
> > - as mentioned already, performance is a known issue that is a top 
> priority 
> > for the team 
> > 
> > Please continue to log issues as Nick mentioned and we will triage 
> > accordingly. 
> > 
> > Cheers, 
> > Lorne. 
> > 
> > On Thursday, February 25, 2016 at 6:13:25 AM UTC-5, troberti wrote: 
> >> 
> >> 1+ for speed. Also, is the requests/seconds coming to the new console? 
> At 
> >> least for me that's an easier value to discuss. Besides, the new 
> console's 
> >> request/minute do not match the request/second metric in the old 
> console. 
> >> 
> >> On Thursday, February 25, 2016 at 11:20:34 AM UTC+1, Mark Cummins 
> wrote: 
> >>> 
> >>> +1 for the speed of the new console. The old console is very 
> noticeably 
> >>> faster. 
> >>> 
> >>> On Thursday, 25 February 2016 01:58:58 UTC, Christian F. Howes wrote: 
>  
>  Hi Lorne, 
>  
>  Is there any chance that you can share the console roadmap with us? 
>  given that we are getting the turn-down threats again, and the new 
> console 
>  is still missing many features it would be helpful to know which ones 
> are 
>  known to the team working on the console and which need new tickets. 
>  
>  Is overall speed of the new console going to be addressed?  I lose 
>  several developer hours a week using the new console waiting for 
> things to 
>  load, and as such my team and I tend to use the old console whenever 
>  possible. 
>  
>  Thanks, 
>  
>  Christian 
>  
>  On Tuesday, February 23, 2016 at 4:43:55 PM UTC-8, Lorne Kligerman 
> wrote: 
> > 
> > I'm happy to report that both features are in the works and will 
> launch 
> > shortly, before the old console is turned down. 
> > 
> > Cheers, 
> > Lorne. 
> > 
> > 
> > On Tuesday, February 23, 2016 at 3:52:19 PM UTC-8, PK wrote: 
> >> 
> >> We also need the “Billing/Usage History” equivalent functionality, 
> has 
> >> this page been migrated to the new console? 
> >> 
> >> PK 
> >> p...@gae123.com 
> >> 
> >> 
> >> 
> >> 
> >> On Feb 23, 2016, at 3:46 PM, johnP  wrote: 
> >> 
> >> Just got email that old appengine console will be shut off in 6 
> weeks. 
> >>   The new cloud console does not have a "migrate traffic" option in 
> the 
> >> Versions screen.  This was my absolute favorite new feature in a 
> long, long 
> >> time.  Will it be available in the new console? 
> >> 
> >> -- 
> >> You received this message because you are subscribed to the Google 
> >> Groups "Google App Engine" group. 
> >> To unsubscribe from this group and stop receiving emails from it, 
> send 
> >> an email to google-appengi...@googlegroups.com. 
> >> To post to this group, send email to google-a...@googlegroups.com. 
> >> Visit this group at 
> https://groups.google.com/group/google-appengine. 
> >> To view this discussion on the web visit 
> >> 
> https://groups.google.com/d/msgid/google-appengine/540d27f2-1841-4be8-a21b-17aea883dd84%40googlegroups.com
>  
> >> <
> https://groups.google.com/d/msgid/google-appengine/540d27f2-1841-4be8-a21b-17aea883dd84%40googlegroups.com?utm_medium=email&utm_source=footer>
>  
>
> >> . 
> >> For more options, visit https://groups.google.com/d/optout. 
> >> 
> >> 
> >> 
> > 
>


[google-appengine] Re: Whats best practice to separate environments for a Django App on Google App Engine?

2016-03-08 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Silvan,

These are a whole lot of excellent questions and details. I'll try to offer 
my feedback on several points and address your questions. 

Without knowing what your system is, it's hard to tell beyond the abstract 
notion of "separating environments" what your goals should be in 
development. However, you seem to have a strong knowledge of many tools and 
it seems that you'll be able to select tools and services which meet the 
needs you have.

As far as the question of os.getenv('SERVER_SOFTWARE', '').startswith('Google 
App Engine'), I can say that while this is not exactly a "universal best 
practice", there's nothing wrong with it, either. It's just a particularity 
of how to detect the production environment on GAE python. Pretty much 
every web framework in every language will have some idiomatic means of 
determining whether we're in production or development, and choosing 
appropriate database and API connection params / code paths, etc. 
accordingly.

As far as running django management commands locally, there are tons of 
toolchains out there for managing development commands. I just learned 
about Fabric based on your mention of it, and it seems like an excellent 
tool for python developers to do exactly what you need. As for more 
specifics of exactly what kinds of questions can arise in regard to "local 
management of Django", we enter a situation where we need more specifics to 
spur the development of more specific answers. For example, does your 
"local Django" (really the development environment version of your code 
which uses the Django framework) connect to a remote DB? Or a local copy of 
the DB?

Now, as to the question of best practices in migrating production 
databases, this depends largely on two factors: the database technology 
itself and the environment it's deployed to. A MySQL server running on a 
GCE instance is different from Cloud SQL, which is different from 
Datastore, which is different from a MongoDB server, etc. Finally, the 
system which *interacts *with the database is also critical for determining 
the specifics of a migration strategy: will the app require a period of 
read-only activity? Can the migration happen incrementally? Etc.

One strategy for management of databases which you mentioned, used 
especially when you have multiple database instances (as in the case where 
you want to have multiple separate environments on the same 
infrastructure), would be to have an admin instance from which scripts are 
run. One benefit of this is that both control and logging are centralized. 
Logging separately into each database instance to manage it isn't 
necessarily scalable, and is almost impossible or an anti-pattern when 
dealing with primary-replica DB systems, sharding, etc.

With Datastore, often you see *schema* migrations, in which a user's 
"schema" for the schemaless datastore needs to update, in which case the 
relevant elements need to either be incrementally-migrated as they're 
updated / retrieved *or *all at once, through simple iteration with 
cursors, a Map-Reduce job, etc. In addition to this sense of the word 
"migration", often people will backup their Datastore to Cloud Storage 
which basically means a JSON / binary serialization of entities for 
insertion into another app's Datastore (or in more exotic cases, for 
translation to an external RDBMS, etc.).

As to your final post, manage.py from Django and remote_api from App Engine 
can work well together. If you find complexity is increasing, something 
like Fabric, again, is a very valuable tool. You could run Fabric off of 
your "admin instance" in the cloud, while keeping a local copy of all 
scripts and credentials in the rare case that your admin instance needs 
redundancy (of course you can save images of the instance and merely spin 
these up in such a case). Another advantage of having a cloud-based admin 
instance which centralizes your administrative scripts is the more 
consistent uptime than simply running these off your laptop, or a special 
box in your workspace, etc.

I hope some of these thoughts have been helpful in responding to your very 
interesting post. You seem well-placed to develop any solutions required as 
the need for them comes along. A commitment to experimentation and reading 
documentation is indispensable in our era where a proliferation of 
potential solutions for each of the classic problems (and new problems) of 
web systems development, all with great selling-points and specific 
peculiar features, confronts us as developers.

Feel free to use this forum for general, high level discussion as you've 
done here, and feel free to ask questions about any services in particular. 
Thanks for contributing your thoughts and use-case details!

Sincerely,

Nick
Cloud Platform Community Support




On Monday, March 7, 2016 at 9:11:54 AM UTC-5, Silvan Spross wrote:
>
> I'm used to deploy to managed servers through some Fabric scripts (or CI's 
> using them). I al

Re: [google-appengine] New Cloud Console

2016-03-08 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Nickolas,

If you can, capture the tab's activity during the error into a HAR file 
<https://toolbox.googleapps.com/apps/har_analyzer/>, you should post that 
to the Public Issue Tracker 
<https://code.google.com/p/googleappengine/issues/list>, attaching the 
"Restrict-View-EditIssue" label, so that only Google and yourself can view 
it. We'll be in touch shortly after the thread is created.

Best wishes,

Nick
Cloud Platform Community Support

On Monday, March 7, 2016 at 6:27:49 PM UTC-5, Nickolas Daskalou wrote:
>
> Hi Lorne / Nick,
>
> Yet another new issue with the Logs viewer which just occurred about 5 
> minutes ago.
>
> Upon visiting the Logs viewer for 2 different projects, this error popped 
> up before any logs were shown, then disappeared after about 5 seconds 
> without me doing anything (and finally logs were indeed shown):
>
> [image: Inline images 1]
>
> Nick
>
>
>
> On 8 March 2016 at 06:15, 'Nick (Cloud Platform Support)' via Google App 
> Engine  wrote:
>
>> Hey Chris,
>>
>> If you could link which issues those are which have been fixed but not 
>> updated, we could take a look and determine whether they should be updated 
>> with any new relevant information, such as a fix. Feel free to reply to me 
>> in this thread.
>>
>> Best wishes,
>>
>> Nick
>>
>>
>> On Thursday, February 25, 2016 at 1:09:43 PM UTC-5, Christian F. Howes 
>> wrote:
>>>
>>> Thanks Lorne. 
>>>
>>> Will we also be better at triaging and updating the Public Issue 
>>> Tracker?  Paid support told me today that several of the issues I filed 
>>> last year are supposedly fixed, but the Public Issue Tracker has yet to 
>>> be updated. 
>>>
>>> The lack of information provided, but the hard deadline on the turn-down 
>>> notice really concerns me as I don't have confidence that I will be able 
>>> to efficiently and effectively manage my app 6 weeks from now. 
>>>
>>> Thanks, 
>>>
>>> Christian 
>>>
>>> On 2/25/16 04:49, 'Lorne Kligerman' via Google App Engine wrote: 
>>> > Thanks everyone for the feedback.  Overall, we are going to reach 
>>> feature 
>>> > parity in the Cloud Platform Console before turning down the Admin 
>>> Console. 
>>> >   The next communication we send will have more details and will 
>>> outline any 
>>> > gaps that exist and our plans to address them.  To answer the 
>>> questions 
>>> > asked here: 
>>> > 
>>> > - the dispatch rules will not be visible right away, but we are 
>>> actively 
>>> > working on a mechanism for you to view all of your App Engine 
>>> configuration 
>>> > in one place 
>>> > - prohibiting code downloads will not show up in the same way, but 
>>> this can 
>>> > be managed through roles and upcoming IAM functionality 
>>> > - as mentioned already, performance is a known issue that is a top 
>>> priority 
>>> > for the team 
>>> > 
>>> > Please continue to log issues as Nick mentioned and we will triage 
>>> > accordingly. 
>>> > 
>>> > Cheers, 
>>> > Lorne. 
>>> > 
>>> > On Thursday, February 25, 2016 at 6:13:25 AM UTC-5, troberti wrote: 
>>> >> 
>>> >> 1+ for speed. Also, is the requests/seconds coming to the new 
>>> console? At 
>>> >> least for me that's an easier value to discuss. Besides, the new 
>>> console's 
>>> >> request/minute do not match the request/second metric in the old 
>>> console. 
>>> >> 
>>> >> On Thursday, February 25, 2016 at 11:20:34 AM UTC+1, Mark Cummins 
>>> wrote: 
>>> >>> 
>>> >>> +1 for the speed of the new console. The old console is very 
>>> noticeably 
>>> >>> faster. 
>>> >>> 
>>> >>> On Thursday, 25 February 2016 01:58:58 UTC, Christian F. Howes 
>>> wrote: 
>>> >>>> 
>>> >>>> Hi Lorne, 
>>> >>>> 
>>> >>>> Is there any chance that you can share the console roadmap with us? 
>>> >>>> given that we are getting the turn-down threats again, and the new 
>>> console 
>>> >>>> is still missing many features it would be helpful to know which 
>>> ones are 
>>> >>>> known

Re: [google-appengine] New Cloud Console

2016-03-08 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Christian,

I just noticed that case is still open. Feel free to respond to that case 
if you feel that anything you've brought up there remains unaddressed. For 
my part, I'm looking over the given Public Issue Tracker threads and 
looking into getting a communication out on those threads.

Regards,

Nick 

On Tuesday, March 8, 2016 at 3:29:37 PM UTC-5, Christian F. Howes wrote:
>
> Hi Nick,
>
> Can you just review cloud support case 08706899 for which PIT issues are 
> not properly updated?  I've listed them out there in the original filing of 
> the case and the response from the support team is that several of them are 
> fixed.
>
> Thanks,
>
> Christian
>
> On Monday, March 7, 2016 at 11:15:49 AM UTC-8, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Chris,
>>
>> If you could link which issues those are which have been fixed but not 
>> updated, we could take a look and determine whether they should be updated 
>> with any new relevant information, such as a fix. Feel free to reply to me 
>> in this thread.
>>
>> Best wishes,
>>
>> Nick
>>
>> On Thursday, February 25, 2016 at 1:09:43 PM UTC-5, Christian F. Howes 
>> wrote:
>>>
>>> Thanks Lorne. 
>>>
>>> Will we also be better at triaging and updating the Public Issue 
>>> Tracker?  Paid support told me today that several of the issues I filed 
>>> last year are supposedly fixed, but the Public Issue Tracker has yet to 
>>> be updated. 
>>>
>>> The lack of information provided, but the hard deadline on the turn-down 
>>> notice really concerns me as I don't have confidence that I will be able 
>>> to efficiently and effectively manage my app 6 weeks from now. 
>>>
>>> Thanks, 
>>>
>>> Christian 
>>>
>>> On 2/25/16 04:49, 'Lorne Kligerman' via Google App Engine wrote: 
>>> > Thanks everyone for the feedback.  Overall, we are going to reach 
>>> feature 
>>> > parity in the Cloud Platform Console before turning down the Admin 
>>> Console. 
>>> >   The next communication we send will have more details and will 
>>> outline any 
>>> > gaps that exist and our plans to address them.  To answer the 
>>> questions 
>>> > asked here: 
>>> > 
>>> > - the dispatch rules will not be visible right away, but we are 
>>> actively 
>>> > working on a mechanism for you to view all of your App Engine 
>>> configuration 
>>> > in one place 
>>> > - prohibiting code downloads will not show up in the same way, but 
>>> this can 
>>> > be managed through roles and upcoming IAM functionality 
>>> > - as mentioned already, performance is a known issue that is a top 
>>> priority 
>>> > for the team 
>>> > 
>>> > Please continue to log issues as Nick mentioned and we will triage 
>>> > accordingly. 
>>> > 
>>> > Cheers, 
>>> > Lorne. 
>>> > 
>>> > On Thursday, February 25, 2016 at 6:13:25 AM UTC-5, troberti wrote: 
>>> >> 
>>> >> 1+ for speed. Also, is the requests/seconds coming to the new 
>>> console? At 
>>> >> least for me that's an easier value to discuss. Besides, the new 
>>> console's 
>>> >> request/minute do not match the request/second metric in the old 
>>> console. 
>>> >> 
>>> >> On Thursday, February 25, 2016 at 11:20:34 AM UTC+1, Mark Cummins 
>>> wrote: 
>>> >>> 
>>> >>> +1 for the speed of the new console. The old console is very 
>>> noticeably 
>>> >>> faster. 
>>> >>> 
>>> >>> On Thursday, 25 February 2016 01:58:58 UTC, Christian F. Howes 
>>> wrote: 
>>>  
>>>  Hi Lorne, 
>>>  
>>>  Is there any chance that you can share the console roadmap with us? 
>>>  given that we are getting the turn-down threats again, and the new 
>>> console 
>>>  is still missing many features it would be helpful to know which 
>>> ones are 
>>>  known to the team working on the console and which need new 
>>> tickets. 
>>>  
>>>  Is overall speed of the new console going to be addressed?  I lose 
>>>  several developer hours a week using the new console waiting for 
>>> things to 
>>>  load, and as such my team and I tend to use the old console 
>>> whenever 
>>>  possible. 
>>>  
>>>  Thanks, 
>>>  
>>>  Christian 
>>>  
>>>  On Tuesday, February 23, 2016 at 4:43:55 PM UTC-8, Lorne Kligerman 
>>> wrote: 
>>> > 
>>> > I'm happy to report that both features are in the works and will 
>>> launch 
>>> > shortly, before the old console is turned down. 
>>> > 
>>> > Cheers, 
>>> > Lorne. 
>>> > 
>>> > 
>>> > On Tuesday, February 23, 2016 at 3:52:19 PM UTC-8, PK wrote: 
>>> >> 
>>> >> We also need the “Billing/Usage History” equivalent 
>>> functionality, has 
>>> >> this page been migrated to the new console? 
>>> >> 
>>> >> PK 
>>> >> p...@gae123.com 
>>> >> 
>>> >> 
>>> >> 
>>> >> 
>>> >> On Feb 23, 2016, at 3:46 PM, johnP  wrote: 
>>> >> 
>>> >> Just got email that old appengine console will be shut off in 6 
>>> weeks. 
>>> >>   The new cloud console does not have a "migrate traffic" option 
>>> in the 
>>> >>

[google-appengine] Re: Logger message pattern

2016-03-08 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Daniel,

This specific-issue technical support question should be asked on Stack 
Overflow. We monitor our tags there quite well, and you should be put in 
touch with a much larger user-base of potential aides. This forum (Google 
Groups for App Engine) is intended for more high-level discussion of the 
platform and services.

When you post your question, you should be sure to include some more 
relevant information:

* What the output looks like now
* What you'd like to see
* Links to sources which led you to expect what you expected

This will ensure that whoever wants to help (such as myself, someone else 
from Google, or a random user) is in the best position to do so.

Cheers!

Nick
Cloud Platform Community Support

On Tuesday, March 8, 2016 at 4:07:01 PM UTC-5, Daniel Felix Ferber wrote:
>
> Hi, 
> My GAE application writes log using SLF4J over JUL.
> I notice that each log message contains date/time, class name (that called 
> the logger), method name (that called the logger) and the message itself. I 
> am missing the logger name.
> I would like to confirm if this is the expected behavior? I do not care 
> about the class and method that called the logger, but I appreciate knowing 
> the logger name.
> Could not find anything about in documentation and searching Google.
> Best regards,
> Daniel
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/e713ea22-a301-4801-8b35-5fd95e7cd6b0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: another wrinkle with GAE/Python Managed VMs: timezone set to local deploy location, not UTC like in GAE

2016-03-10 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Adam,

Glad to see you found a workaround, I was going to some lengths to verbally 
describe what you basically ended up doing. You should post a quick 
description of this issue to the Public Issue Tracker for App Engine 
 and we'll be happy 
to take a look. It seems rational to have UTC as the default.

Cheers,

Nick
Cloud Platform Community Support

On Thursday, March 10, 2016 at 6:28:39 PM UTC-5, Adam Sah wrote:
>
> OK, horrible workaround deployed.  Roughly:
>
> main.py:
>
> PATHS=[...
>   (r'/_ah/warmup', WarmupView),
>   (r'/_ah/start', StartView),
>
> class WarmupView(webapp.RequestHandler):
>   def get(self, *args):  # pylint:disable=W0613,R0201
> base.SERVER_TZ = None  # allow base.set_now() to reset server timezone
> base.now()
>
> class StartView(webapp.RequestHandler):
>   def get(self, *args):  # pylint:disable=W0613,R0201
> base.SERVER_TZ = None  # allow base.set_now() to reset server timezone
> base.now()
>
> base.py:
>
> import pytz
> ...
> SERVER_TZ = None
> ...
> def now(nowval=None):
>   global SERVER_TZ
>   ...
>   if SERVER_TZ is None:
>   try:
> # HACK of the year award!  os.environ['TZ'] isn't available during 
> GAE/Managed VMs startup
> # and date +%Z and /etc/timezone didn't have useful information 
> either
> # even env | grep TZ failed!!
> import subprocess
> localtz = subprocess.check_output("date +%Z", shell=True).strip()
> # SUPER HACK: I couldn't find pytz-compatible timezone strings, so 
> I hacked it.
> # Yes, I know I'm going to hell for this.
> SERVER_TZ = 'America/Chicago' if localtz == 'CST' else 'UTC'
>   except:
> SERVER_TZ = 'UTC'
> nowval = datetime.datetime.now()  # pylint:disable=W9914
> if SERVER_TZ != 'UTC':
>   # set the tz to the server tz, convert to UTC, then strip the tz info
>   nowval = nowval.replace(tzinfo=pytz.timezone(SERVER_TZ)).astimezone(
> pytz.timezone('UTC')).replace(tzinfo=None)
>   return nowval
>
>
> adam
>
>
> On Thursday, March 10, 2016 at 1:01:57 PM UTC-8, Adam Sah wrote:
>>
>> oops, to be specific here's what I'm seeing:
>>
>>datetime.datetime.now().strftime("%c %Z") ==> Thu Mar 10 14:57:31 2016 
>>(i.e. timestamp is in CST with no timezone info)
>>os.environ['TZ'] ==> America/Chicago
>>
>> where dev_appserver and standard GAE return:
>>
>>datetime.datetime.now().strftime("%c %Z") ==> Thu Mar 10 21:00:14 2016 
>>(i.e. timestamp is in UTC with no timezone info)
>>os.environ['TZ'] ==> 'UTC'
>>
>> adam
>>
>> On Thursday, March 10, 2016 at 12:32:07 PM UTC-8, Adam Sah wrote:
>>>
>>> Here's what I've tried so far...
>>>  - set os.environ['TZ'] to 'UTC' on startup - failed because GAE 
>>> overwrites this.
>>>  - set os.environ['TZ'] to 'UTC' on each call by creating a child class 
>>> to webapp.WSGIApplication and adding it to __call__() - failed because GAE 
>>> overwrites this.
>>>  - monkeypatching datetime.datetime.now() to use a specially hacked 
>>> function - failed because GAE disallows modifying now()
>>>
>>> I'm currently trying a hack to rewrite all calls (100+) 
>>> to datetime.datetime.now() to instead use an app-specific implementation 
>>> which returns the UTC time - this won't work for third party libraries, but 
>>> that maybe OK for my app, which uses pylint custom rules to migrate 
>>> engineers to using app-specific replacement functions (e.g. we disallow 
>>> direct calls to gc.collect() so we can track stats better).  If this works, 
>>> I'll post.
>>>
>>> adam
>>>
>>>
>>> On Wednesday, March 9, 2016 at 1:45:54 PM UTC-8, Adam Sah wrote:

 e.g. os.environ['TZ'] changed to America/Chicago when before it was UTC.

 The docs don't mention this difference anywhere.

 If anyone has a workaround, pls reply - I'm working on a workaround 
 now, will post if successful.

 hope this helps,
 adam



-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/781f16be-304c-4db1-bbeb-3deb886950c2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: New Log Viewer - Unusable

2016-03-10 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Rajesh,

Thanks for taking the time to write your feedback. Unfortunately, this 
isn't the right place to make such a posting. If you have any concrete 
issues to report or feature requests to propose, feel free to open a thread 
in the Public Issue Tracker for the Cloud Platform 
. We monitor 
it every day and will react quickly to any issue reports or feature 
requests there.  

Best wishes,

Nick
Cloud Platform Community Support

On Thursday, March 10, 2016 at 7:24:24 AM UTC-5, Rajesh Gupta wrote:
>
> New Log viewer is slow with many issues.
> It is just not usable for production logs.
> I was examining the logs that are 10 days old.  
> I am using the advance filter.  
> - Don't know if I am scrolling down, wheather the logs are shown older or 
> newer
> - When given the date, don't know, the logs are searching older than the 
> given date or later than
> the given date.
> - Too slow, 
> - Some times does not fetch the logs even after waiting for 1-2 min.
> - The menu link 'view - show new logs at the top'.  Don't know which state 
> that it is, and it does not store the state. There should be a checkmark, 
> saying it is showing the new logs at top or at the bottom.
>
> Request appengine team, to fix the log viewer and make it more pleasant to 
> use.
>
>
> -- 
> Rajesh
> *www.VeersoftSolutions.com *
> *www.AccountingGuru.net *
> *Accounting/Inventory/Orders on Google Cloud Platform and Mobile*
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/dcc37c86-d42c-4c2e-8c47-e19659877a1d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Make local appengine use remote datastore (Python)

2016-03-10 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Danny,

I can't say that I'm 100% sure what's happening to cause this behaviour. 
Could you share some more logs, config files, and code? If possible, I'd 
like to try to observe this on my own system. If it represents an issue in 
the SDK or platform, rather than a user misconfiguration, this would be 
necessary to get it fixed, and in the event that it's a user error, I'd 
like to help discover the proper means of getting access to remote 
Datastore via remote API from the development machine. 

Best wishes,

Nick
Cloud Platform Community Support

On Thursday, March 10, 2016 at 11:32:32 AM UTC-5, Danny Tran wrote:
>
> I'm attempting to make my appengine application running locally use a 
> remote datastore.
>
> In appengine_config.py I'm adding the following lines.
>
> from google.appengine.ext.remote_api import remote_api_stub
> remote_api_stub.ConfigureRemoteApiForOAuth('MyApp.appspot.com','/_ah/remote_api')
>  
> # name removed
>
> Per the instructions here:
> https://cloud.google.com/appengine/docs/python/tools/remoteapi
>
> However, when I try to send a basic HTTP request to my local app, it 
> results in an infinite recursion loop between a url fetcher and a logger.
>
> Am I missing something?
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/8aa5c78e-ab37-4699-a355-e055d9a0e1e7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: I cannot verify my domain name on Developers Console

2016-03-10 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Ian,

This seems like it would be perfectly suited as a defect report at the Public 
Issue Tracker for the Cloud Platform 
. If you 
provide all relevant information, along with your project ID, the domain 
name, and a HAR recording 
 of your attempted 
verification, we'll quickly reply and get to work on determining the root 
cause of the issue. We monitor the Public Issue Trackers every day, so rest 
assured you'll see a response. This thread here is slightly off-topic since 
the App Engine Google Groups forum is meant more for general discussion of 
the platform and services.

Best wishes,

Nick
Cloud Platform Community Support

On Thursday, March 10, 2016 at 2:31:01 PM UTC-5, Ian Anderson wrote:
>
> I think it's a bug. I'm able to do so on the Webmaster Tool/Search 
> Console. But on the Developer Console. With the DNS TXT record 
> verification, it still does not verify despite everything being correct. I 
> even added the record for 2 days so I know it's not a propagation issue. 
>
> The domain I need to verify is poz.com. I'm already verified on Webmaster 
> Tools but not in Developer Console. Any ideas? Where can I set in a bug 
> report?
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/93e92988-d850-462c-b8eb-bd5e859a5a04%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cannot send mail

2016-03-10 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Mark,

We continue to look into this issue. The best thing to do would be to 
create a Public Issue Tracker thread with your specific information so that 
we can have a focused and clear context in which to track your issue, which 
might be different or overlapping (we don't know from this point). We 
monitor the Public Issue Tracker every day, so not to worry, we'll be in 
contact quickly after your posting.

On Thursday, March 10, 2016 at 8:15:46 AM UTC-5, Marek Dusek wrote:
>
> Hello,
>
> may I ask how you solved the issue (as the link is no longer valid and the 
> ticket ID disappeared from the public ticket listing)?
>
> We are facing similar issue on our GAE application - emails suddenly 
> (within last days) stopped being delivered, although no change was made to 
> the settings or code (and the mail quota in dev console is being updated 
> properly).
>
> I believe there are similar posts on SO without any conclusion.
>
> Thank you,
> Marek Dusek
>
> On Friday, March 4, 2016 at 9:58:57 PM UTC+1, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Rob,
>>
>> Thanks for the link, and for posting in the right place :) We'll be 
>> active on that thread shortly. 
>>
>> On Friday, March 4, 2016 at 10:56:02 AM UTC-5, Rob Williams wrote:
>>>
>>> Hi Nick,
>>>
>>> I've created 
>>> https://code.google.com/p/googleappengine/issues/detail?id=12786
>>>
>>> Thanks.
>>>
>>> On Thursday, March 3, 2016 at 6:38:11 PM UTC-5, Nick (Cloud Platform 
>>> Support) wrote:

 Hey Rob,

 The best way to get us to look at a potential issue is to make a report 
 in the Public Issue Tracker 
 . Feel free to 
 do so, with as much technical information as possible, and you'll find 
 that 
 the responses are quick and the issue will make progress. Posting in a 
 forum meant for general discussion (such as this one) is far less likely 
 to 
 find its way to people who can help.

 Best wishes,

 Nick



 On Wednesday, March 2, 2016 at 12:49:42 PM UTC-5, Rob Williams wrote:
>
> Hi,
>
> I've seen the same since yesterday, 1-March-2015. Existing code queues 
> mails to not send too fast. Test case has a small number of receivers.
>
> Have found that:
>
>- Logs indicate mail was sent
>- Quota is updated to show mail being sent
>- Only a small random subset of the sent mails are received by 
>remote hosts
>   - Have tested with multiple receiving domains
>   - Emails are not in junk folders
>   - The few emails that are delivered arrive instantly
>- No bounce backs have been delivered
>
>
> Several people are seeing similar behaviour on stack overflow. 
> http://stackoverflow.com/questions/35727054/google-app-engine-python-mail-sent-but-not-received
>   
>
> http://stackoverflow.com/questions/35737937/sending-email-stopped-working-using-anythingtestapp-appspotmail-com
>
>
> Is email transmission broken? Is email being radically queued?
>
> Thanks!
>
>
> On Tuesday, March 1, 2016 at 6:14:20 PM UTC-5, Petr Balogh wrote:
>>
>> Hello, 
>>
>> I've met problem in my application.. problem is that I cannot send 
>> email.. or behaviour seems weird..
>>
>> First time I've got email.. but after that haven't..  if app was 
>> running day, maybe two it started sending email.. but after I sent some 
>> changes to app, it stopped sending mails again..
>>
>> I tried create different testing page but doesn't work :( :
>>
>> from google.appengine.api import mail 
>>   
>> import webapp2   
>>
>>   
>>   
>>
>> [code]   
>>  
>> class emailTest(webapp2.RequestHandler): 
>>
>> def get(self):   
>>
>> message = mail.EmailMessage( 
>>
>> sender="noreply ", 
>>  
>> subject="Testing email"   
>>   
>> ) 
>>   
>>   
>>   
>> message.to = "My Name "  
>> message.body = """   
>>
>> Dear Albert: 
>>
>>

[google-appengine] Re: Separate sets of system properties for production and development

2016-03-15 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Partha,

A good question, but perhaps one that would best be asked on StackOverflow. 
This forum is meant for general discussion of the platform, not 
specific-issue technical support. Regardless, I'm happy to help with the 
beginnings of an answer: 

1) You can detect whether you're in production or development 
programmatically using com.google.appengine.api.utils.SystemProperty 
.
 


2) You can also use maven's own feature of "Build Profiles 
" 
to have the system automagically insert the correct values for the correct 
environment through maven, rather than programmatically at servlet init, as 
suggested in 1).

I hope these resources are helpful to you! 

Sincerely,

Nick
Cloud Platform Community Support

On Monday, March 14, 2016 at 8:39:14 PM UTC-4, Partha Bhaumik wrote:
>
> I am trying to use two sets of system properties for an App Engine 
> application. Is there a way to specify the development properties somewhere 
> and the production properties somewhere else so that depending on the 
> execution environment the correct set is loaded? I am new to App Engine, 
> and this was easy to do in Play Framework using two .conf files.
>
> I tried putting the dev properties in pom.xml under the jvm flags in the 
> appengine-maven-plugin, and the production properties in appengine-web.xml. 
> But when I am running "mvn appengine:devserver", the jvm flags are getting 
> overwritten by the ones from appengine-web.xml.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/b1e612fb-7e08-435d-9107-03cc63211756%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: see the logfile c:\program file(x86)\Google\google_appengine\launcher\googleappenginelauncher.exe.log' for details

2016-03-15 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Naveen,

The message is telling you to look at the log file in that location on your 
own system. It will contain details of what went wrong. I suggest using Stack 
Overflow  to search for other users who might 
have seen the same error once you manage to read the log file.

Best wishes,

Nick
Cloud Platform Community Support

On Tuesday, March 15, 2016 at 2:06:11 AM UTC-4, NAVEEN GANDHI wrote:
>
>
> how to fix the error see the logfile c:\program 
> files(x86)\google\google_appengine\launcher\googleappenginelauncher.exe.log' 
> . 
>
>
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/2816809d-a8cd-4663-9654-cb6bdf4382b0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: App engiene change impacts my code ? Pls look into

2016-03-15 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Deepak,

As mentioned in a great number of threads in this forum, if you encounter 
the need to post technical issues and support requests, these should be 
made at the Public Issue Tracker 
 or 
StackOverflow . This forum is meant for general 
discussion of the platform and services, which might be more along the 
lines of a thread saying "*What are some ways that people have used java 
serialization in the context of App Engine? Do you store serialized objects 
in Memcache? Or just primitives like Strings?*" (and even still, this isn't 
a perfect example since it's a sort of abstract way to pose a question, but 
at any rate, would not be off-topic by any means).

With that said, I'm happy to offer these initial thoughts which could help 
point you toward a solution:

* You should post the full stack trace when you get an error

* You should indicate whether the issue is recurring or happened only once

* You should explain the history of the error (has it always worked until 
now? Does a specific file, request, etc. trigger the error?)

If you reply here, I'll be happy to help assist more. Just know that 
ultimately, technical questions like this are better for Stack Overflow not 
only because we define this forum differently, but also because there are 
far more people there who can help you than have ever visited this forum, 
in all likelihood.

Best wishes,

Nick
Cloud Platform Community Support

On Sunday, March 13, 2016 at 12:59:59 AM UTC-5, Deepak Singh wrote:
>
>
> Facing business impact - 
>
> Code was working fine for last 2 years. No change in code but issue 
> persists. Does app engine change anything ?
>
> Sending ---
> response.setContentType("application/x-java-serialized-object");
> response.setHeader("Content-Encoding", "gzip");
> GZIPOutputStream gos = new GZIPOutputStream(response.getOutputStream());
> ObjectOutputStream oos = new ObjectOutputStream(gos);
> oos.writeObject(rs);
> gos.finish();
> oos.flush();
> oos.close();
>
>
> Reading ---
>
> GZIPInputStream gi = new GZIPInputStream(new 
> ByteArrayInputStream(res.getContent()));
> ObjectInputStream ois = new ObjectInputStream(gi);
>
>
> Exception -
> java.io.StreamCorruptedException: invalid stream header: 1F8B0800
> at red color line
>
> .
>
> Pls help gae java team.
>
>
>
> On Sat, Mar 12, 2016 at 11:49 PM, Deepak Singh  
> wrote:
>
>> Dear App engine team,
>>
>> For last couple of days, we are facing serialization issue. Our app does 
>> not add 'GZIP' header to response and thus we are getting the exception as 
>> below
>>
>>
>> java.io.StreamCorruptedException: invalid stream header: 1F8B0800
>>
>>
>> App id: pdstechi
>>
>> Pls resolve the same.
>>
>> The issue happens most frequently but not always.
>>
>>
>
>
> -- 
> Deepak Singh
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/83dc3212-6332-4cbc-ac18-91293aa72997%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Make local appengine use remote datastore (Python)

2016-03-15 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Danny,

Thanks for your detailed analysis. I was proceeding with attempting to get 
the code into a reproducing example, and your latest post and deep 
reporting of the information has been a model of how to report an issue. 
While this thread is technically off-topic here and should be in the Public 
Issue Tracker, I'll handle cross-posting the information you've provided 
there from this point on. 

Thanks again for your excellent reporting and analysis!

Sincerely,

Nick
Cloud Platform Community Support

On Tuesday, March 15, 2016 at 4:16:34 PM UTC-4, Danny Tran wrote:
>
> Ok, I think I figured out the issue.
>
> ConfigureRemoteApiForOAuth replaces the stub for ALL services. 
>
> This includes the "urlfetch" service.
>
> The problem is the httplib2 library uses "urlfetch" when it detects google 
> appengine.
>
> So using urlfetch in your app, results in a call to rpc.check_success() 
> which results in another call to "urlfetch" and so on ad infinitum.
>
> One workaround I have is to replace the 'urlfetch' stub with it's original 
> value after configuring the the remote api for oauth.
>
> from google.appengine.ext.remote_api import remote_api_stub
> from google.appengine.api import apiproxy_stub_map
>
>
> local_stub = apiproxy_stub_map.apiproxy.GetStub('urlfetch')
> remote_api_stub.ConfigureRemoteApiForOAuth('myapp.appspot.com',
> '/_ah/remote_api')
> apiproxy_stub_map.apiproxy.ReplaceStub('urlfetch', local_stub)
>
>
> This prevented the infinite recursion.
>
> I'm curious if there is a way to disable urlfetch from using google 
> appengine built in that I am missing.  Either way, the documentation on 
> making an app use the remote api does not mention anything about the 
> urlfetch service recursion issue.
>
> Hope this helps someone.
>
>
> On Thursday, March 10, 2016 at 10:32:32 AM UTC-6, Danny Tran wrote:
>>
>> I'm attempting to make my appengine application running locally use a 
>> remote datastore.
>>
>> In appengine_config.py I'm adding the following lines.
>>
>> from google.appengine.ext.remote_api import remote_api_stub
>> remote_api_stub.ConfigureRemoteApiForOAuth('MyApp.appspot.com','/_ah/remote_api')
>>  
>> # name removed
>>
>> Per the instructions here:
>> https://cloud.google.com/appengine/docs/python/tools/remoteapi
>>
>> However, when I try to send a basic HTTP request to my local app, it 
>> results in an infinite recursion loop between a url fetcher and a logger.
>>
>> Am I missing something?
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/d7646412-4881-4672-a254-e9fee55bee63%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Datastore ancestor filters

2016-03-18 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Louise,

The specific details required to diagnose this specific issue are not 
provided, so it's difficult to reason about the issue. And while I'm happy 
to assist, I feel I should take a moment to emphasize that this is a 
specific technical issue, and not so much a general discussion on the 
platform which will be useful or informative to other users. Posts like 
this are better suited to Stack Overflow (we monitor there as well, so not 
to worry), and if you were to post there, the following information would 
give the highest chance of a good reply:

* The definitions of the entities
* The code which creates / inserts the entities
* The code which retrieves the entities

With those details, potential issues in the entity relations or in the 
query, or in the code even, could be diagnosed.

Best wishes,

Nick
Cloud Platform Community Support

On Thursday, March 17, 2016 at 11:31:14 AM UTC-4, Louise Elmose Hedegaard 
wrote:
>
> Hi,
>
> I am trying to use ancestor filters, but it does not work as I expect it 
> to.
>
> I have a shop entity with an id generated by the datastore.
> I have an order entity with an id I set myself, and the parent of the 
> order is the shop.
> I have a transaction entity with an id I set myself, and the parent of the 
> transaction is the order.
>
> Now I would like to get the transactions which has a given shop ancestor, 
> so I set the ancestor on the transaction query like this:
>
> query.setAncestor(KeyFactory.createKey("shop", shop.getId()));
>
> where shop.getId() is a string, i.e. the key name.
>
> But when I execute the query I do not get any results.
> Did I misunderstod how ancestor filters are to be used?
>
> When I create orders I can see the parent is set to the shop as expected, 
> when I create transactions I can see the parent is set to the shop as 
> expected.
> But when I have a transaction entity and call 
> transaction.getParent().getParent() I would expect to get the shop, but I 
> get null.
>
> Thanks,
> -Louise
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/b7321105-8cec-4947-bb3a-29289e4ba742%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Using gdata with google app engine

2016-03-18 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Kajal,

If you encounter a specific technical issue such as this, the better place 
to post would be Stack Overflow . We monitor 
there, and there is a much larger community of people to help. This 
question is simply off topic for this forum here, which is meant more for 
general and high-level discussion of the platform and services.

Some information you would probably want to include to make it possible for 
anybody to help with your issue:

* The full stack trace of any errors

* Result of logging your python path (sys.path) prior to attempting the 
import of the module

* What your project directory hierarchy looks like, and how you installed 
any modules you are attempting to import

Feel free to link the Stack Overflow question once you've posted it, and 
I'll be happy to take a look myself. 

Best wishes,

Nick
Cloud Platform Community Support

On Friday, March 18, 2016 at 7:38:56 AM UTC-4, Kajal Gupta wrote:
>
> Hello,
>
> I am using gdata to retrieve picasa photos. I am using google app engine 
> for deployment. But the main problem is google app engine is not allowing 
> me to use the gdata.photos.service . Whenever I try to import the given 
> module it throws an "ImportError: No module named fcntl"
>
> Can anyone please suggest way of using Gdata with GAE
>
> Thanks
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/120bfa2d-d0ba-4f56-a7c0-c3f29d01b632%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Make local appengine use remote datastore (Python)

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Here's the link to the thread 
,
 
it should see replies shortly. Cheers!

On Tuesday, March 15, 2016 at 8:29:38 PM UTC-4, Danny Tran wrote:
>
> Sure thing, and sorry about being off-topic. 
>
> Please let me know the public issue tracking link/number when you get 
> around to it. 
>
> Thanks :)
>
> On Tuesday, March 15, 2016 at 4:39:23 PM UTC-5, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Danny,
>>
>> Thanks for your detailed analysis. I was proceeding with attempting to 
>> get the code into a reproducing example, and your latest post and deep 
>> reporting of the information has been a model of how to report an issue. 
>> While this thread is technically off-topic here and should be in the Public 
>> Issue Tracker, I'll handle cross-posting the information you've provided 
>> there from this point on. 
>>
>> Thanks again for your excellent reporting and analysis!
>>
>> Sincerely,
>>
>> Nick
>> Cloud Platform Community Support
>>
>> On Tuesday, March 15, 2016 at 4:16:34 PM UTC-4, Danny Tran wrote:
>>>
>>> Ok, I think I figured out the issue.
>>>
>>> ConfigureRemoteApiForOAuth replaces the stub for ALL services. 
>>>
>>> This includes the "urlfetch" service.
>>>
>>> The problem is the httplib2 library uses "urlfetch" when it detects 
>>> google appengine.
>>>
>>> So using urlfetch in your app, results in a call to rpc.check_success() 
>>> which results in another call to "urlfetch" and so on ad infinitum.
>>>
>>> One workaround I have is to replace the 'urlfetch' stub with it's 
>>> original value after configuring the the remote api for oauth.
>>>
>>> from google.appengine.ext.remote_api import remote_api_stub
>>> from google.appengine.api import apiproxy_stub_map
>>>
>>>
>>> local_stub = apiproxy_stub_map.apiproxy.GetStub('urlfetch')
>>> remote_api_stub.ConfigureRemoteApiForOAuth('myapp.appspot.com',
>>> '/_ah/remote_api')
>>> apiproxy_stub_map.apiproxy.ReplaceStub('urlfetch', local_stub)
>>>
>>>
>>> This prevented the infinite recursion.
>>>
>>> I'm curious if there is a way to disable urlfetch from using google 
>>> appengine built in that I am missing.  Either way, the documentation on 
>>> making an app use the remote api does not mention anything about the 
>>> urlfetch service recursion issue.
>>>
>>> Hope this helps someone.
>>>
>>>
>>> On Thursday, March 10, 2016 at 10:32:32 AM UTC-6, Danny Tran wrote:

 I'm attempting to make my appengine application running locally use a 
 remote datastore.

 In appengine_config.py I'm adding the following lines.

 from google.appengine.ext.remote_api import remote_api_stub
 remote_api_stub.ConfigureRemoteApiForOAuth('MyApp.appspot.com','/_ah/remote_api')
  
 # name removed

 Per the instructions here:
 https://cloud.google.com/appengine/docs/python/tools/remoteapi

 However, when I try to send a basic HTTP request to my local app, it 
 results in an infinite recursion loop between a url fetcher and a logger.

 Am I missing something?



-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/89c51d78-d686-45b7-b4da-49dfa2befe56%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Whats best practice to separate environments for a Django App on Google App Engine?

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
No worries Silvan, glad to be of help! And yes, Managed VMs are awesome. I 
wouldn't worry too much about them going away any time soon based on how 
much attention they're getting and how much the community is enjoying them!

On Wednesday, March 16, 2016 at 4:22:05 AM UTC-4, Silvan Spross wrote:
>
> Hi Nick
>
> Thank you very much for your reply and thoughts. I appreciate your time! I 
> tend to use GAE managed vm instead of "vanilla" GAE At the moment. I know 
> it's beta right now, but I hope you keep it up and I think this way we are 
> not too much tied to GAE stuff. This also solves some of my "problems" I 
> described above too.
>
> I'm in a hurry right now, but I'll, if you don't mind, try to ask more 
> specific and better explained questions later about my current problems.
>
> Regards,
> Silvan
>
> On Tuesday, March 8, 2016 at 6:59:31 PM UTC+1, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Silvan,
>>
>> These are a whole lot of excellent questions and details. I'll try to 
>> offer my feedback on several points and address your questions. 
>>
>> Without knowing what your system is, it's hard to tell beyond the 
>> abstract notion of "separating environments" what your goals should be in 
>> development. However, you seem to have a strong knowledge of many tools and 
>> it seems that you'll be able to select tools and services which meet the 
>> needs you have.
>>
>> As far as the question of os.getenv('SERVER_SOFTWARE', 
>> '').startswith('Google 
>> App Engine'), I can say that while this is not exactly a "universal best 
>> practice", there's nothing wrong with it, either. It's just a particularity 
>> of how to detect the production environment on GAE python. Pretty much 
>> every web framework in every language will have some idiomatic means of 
>> determining whether we're in production or development, and choosing 
>> appropriate database and API connection params / code paths, etc. 
>> accordingly.
>>
>> As far as running django management commands locally, there are tons of 
>> toolchains out there for managing development commands. I just learned 
>> about Fabric based on your mention of it, and it seems like an excellent 
>> tool for python developers to do exactly what you need. As for more 
>> specifics of exactly what kinds of questions can arise in regard to "local 
>> management of Django", we enter a situation where we need more specifics to 
>> spur the development of more specific answers. For example, does your 
>> "local Django" (really the development environment version of your code 
>> which uses the Django framework) connect to a remote DB? Or a local copy of 
>> the DB?
>>
>> Now, as to the question of best practices in migrating production 
>> databases, this depends largely on two factors: the database technology 
>> itself and the environment it's deployed to. A MySQL server running on a 
>> GCE instance is different from Cloud SQL, which is different from 
>> Datastore, which is different from a MongoDB server, etc. Finally, the 
>> system which *interacts *with the database is also critical for 
>> determining the specifics of a migration strategy: will the app require a 
>> period of read-only activity? Can the migration happen incrementally? Etc.
>>
>> One strategy for management of databases which you mentioned, used 
>> especially when you have multiple database instances (as in the case where 
>> you want to have multiple separate environments on the same 
>> infrastructure), would be to have an admin instance from which scripts are 
>> run. One benefit of this is that both control and logging are centralized. 
>> Logging separately into each database instance to manage it isn't 
>> necessarily scalable, and is almost impossible or an anti-pattern when 
>> dealing with primary-replica DB systems, sharding, etc.
>>
>> With Datastore, often you see *schema* migrations, in which a user's 
>> "schema" for the schemaless datastore needs to update, in which case the 
>> relevant elements need to either be incrementally-migrated as they're 
>> updated / retrieved *or *all at once, through simple iteration with 
>> cursors, a Map-Reduce job, etc. In addition to this sense of the word 
>> "migration", often people will backup their Datastore to Cloud Storage 
>> which basically means a JSON / binary serialization of entities for 
>> insertion into another app's Datastore (or in more exotic cases, for 
>> translation to an external RDBMS, etc.).
>>
>> As to your final post, manage.py from Django and remote_api from App 
>> Engine can work well together. If you find complexity is increasing, 
>> something like Fabric, again, is a very valuable tool. You could run Fabric 
>> off of your "admin instance" in the cloud, while keeping a local copy of 
>> all scripts and credentials in the rare case that your admin instance needs 
>> redundancy (of course you can save images of the instance and merely spin 
>> these up in such a case). Another advantage of having a cloud-ba

[google-appengine] Re: New Cloud Console

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey John,

Feel free to file Feature Requests over at the Public Issue Tracker and 
we'll be more than happy to get started on tracking them!

Best regards,

Nick
Cloud Platform Community Support

On Friday, March 18, 2016 at 1:28:30 PM UTC-4, johnP wrote:
>
>
> I suppose the 'constructive suggestion' in this case is to include a 
> 'refresh' button on all screens :)
>
>
> On Friday, March 18, 2016 at 10:16:09 AM UTC-7, johnP wrote:
>>
>>
>> Glad this issue is getting lots of attention.  Another major issue for me 
>> is the Instances viewer.  The original console made it easy to hit refresh 
>> to see how many requests each instance has served, and how many errors for 
>> each instance.
>>
>> With the new console, I do not know how to refresh the view.  Hitting 
>> refresh does not help.  Exiting and re-entering the screen does not help. 
>>  Searching for another 30 minutes to see if I missed the refresh button on 
>> the screen does not help (am I missing it after all these hours of 
>> searching?  Am I really dyslexic?)  
>>
>> In general, it seems like the original console was built by engineers who 
>> used app engine and the new console is built with engineers who were told 
>> to 'make it better'  but don't use app engine at all.  Some really basic 
>> stuff is missing. 
>>
>>
>>
>>
>> On Tuesday, February 23, 2016 at 3:46:19 PM UTC-8, johnP wrote:
>>>
>>> Just got email that old appengine console will be shut off in 6 weeks. 
>>>  The new cloud console does not have a "migrate traffic" option in the 
>>> Versions screen.  This was my absolute favorite new feature in a long, long 
>>> time.  Will it be available in the new console?
>>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/ddc13861-988e-4a64-9349-9cf3436bdbba%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: New Cloud Console

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Kaan,

The best way to track these requests is to give them each their own unique, 
trackable thread in the Public Issue Tracker. 
 Your suggestions 
are excellent and I'd be sad to see them languish in a one-off comment in a 
long groups thread!

Best regards,

Nick
Cloud Platform Community Support

On Friday, March 18, 2016 at 4:01:11 PM UTC-4, Kaan Soral wrote:
>
> Since I have years of GAE experience, I just let things roll, so I didn't 
> complain when the new Console rolled out, just waiting things to play out 
> is more logical and sane
>
> However, I will just say this, the new console needs:
>
> *1) Logs in the Main Menu*
> *2) Usage History in the Main Menu, including Yesterday, maybe 
> unofficially until the calculations are final*
> *3) Daily Usage Total in the Dashboard *(the charges exist individually, 
> yet I'm not interested in calculating the total on my own, I just use the 
> calculation to quickly check that the app isn't consuming too much)
>
> I know the main comeback is to suggest a public tracker issue, yet I had 
> issues in the past, some recent, nothing happened, so I will just throw 
> these here
>
> 2 years ago I wrote my own Logs Viewer, as even back then the Logs Viewer 
> was unreliable, so I only used the console to check the usage and queues, 
> now I don't/can't use the new Console at all, if one of my apps went 
> haywire and spent $200 a day, I would refute the charges :) - as I'm 
> practically blind since this new Console is so impractical and cryptic
>
> Just list everything in one place goddammit
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/1ef33b91-e559-4ad5-99c8-32f28e6c8f15%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: another wrinkle with GAE/Python Managed VMs: timezone set to local deploy location, not UTC like in GAE

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Michael,

We're currently working on getting this resolved, although the best way to 
track its resolution is by posting and following a Public Issue Tracker 
issue. At any rate, we're currently working on it and it should be resolved 
soon. If your application is sensitive to the system time-zone, the natural 
recourse is to set it explicitly, rather than assume a default. 
Nonetheless, UTC is a sensible default I believe and should be implemented. 

I'll update this thread with any progress on the issue.

Best wishes,

Nick
Cloud Platform Community Support

On Wednesday, March 16, 2016 at 2:01:46 PM UTC-4, Michael Sander wrote:
>
> I've seen this too, but I just started working on Managed VM. Has this 
> been around for a while? It seems like a pretty major bug for it not to be 
> fixed. Also, the workaround is totally nuts. Is this going to be fixed or 
> is the hack our only recourse?
>
> On Thursday, March 10, 2016 at 6:54:04 PM UTC-5, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Adam,
>>
>> Glad to see you found a workaround, I was going to some lengths to 
>> verbally describe what you basically ended up doing. You should post a 
>> quick description of this issue to the Public Issue Tracker for App 
>> Engine  and we'll 
>> be happy to take a look. It seems rational to have UTC as the default.
>>
>> Cheers,
>>
>> Nick
>> Cloud Platform Community Support
>>
>> On Thursday, March 10, 2016 at 6:28:39 PM UTC-5, Adam Sah wrote:
>>>
>>> OK, horrible workaround deployed.  Roughly:
>>>
>>> main.py:
>>>
>>> PATHS=[...
>>>   (r'/_ah/warmup', WarmupView),
>>>   (r'/_ah/start', StartView),
>>>
>>> class WarmupView(webapp.RequestHandler):
>>>   def get(self, *args):  # pylint:disable=W0613,R0201
>>> base.SERVER_TZ = None  # allow base.set_now() to reset server 
>>> timezone
>>> base.now()
>>>
>>> class StartView(webapp.RequestHandler):
>>>   def get(self, *args):  # pylint:disable=W0613,R0201
>>> base.SERVER_TZ = None  # allow base.set_now() to reset server 
>>> timezone
>>> base.now()
>>>
>>> base.py:
>>>
>>> import pytz
>>> ...
>>> SERVER_TZ = None
>>> ...
>>> def now(nowval=None):
>>>   global SERVER_TZ
>>>   ...
>>>   if SERVER_TZ is None:
>>>   try:
>>> # HACK of the year award!  os.environ['TZ'] isn't available 
>>> during GAE/Managed VMs startup
>>> # and date +%Z and /etc/timezone didn't have useful information 
>>> either
>>> # even env | grep TZ failed!!
>>> import subprocess
>>> localtz = subprocess.check_output("date +%Z", shell=True).strip()
>>> # SUPER HACK: I couldn't find pytz-compatible timezone strings, 
>>> so I hacked it.
>>> # Yes, I know I'm going to hell for this.
>>> SERVER_TZ = 'America/Chicago' if localtz == 'CST' else 'UTC'
>>>   except:
>>> SERVER_TZ = 'UTC'
>>> nowval = datetime.datetime.now()  # pylint:disable=W9914
>>> if SERVER_TZ != 'UTC':
>>>   # set the tz to the server tz, convert to UTC, then strip the tz 
>>> info
>>>   nowval = 
>>> nowval.replace(tzinfo=pytz.timezone(SERVER_TZ)).astimezone(
>>> pytz.timezone('UTC')).replace(tzinfo=None)
>>>   return nowval
>>>
>>>
>>> adam
>>>
>>>
>>> On Thursday, March 10, 2016 at 1:01:57 PM UTC-8, Adam Sah wrote:

 oops, to be specific here's what I'm seeing:

datetime.datetime.now().strftime("%c %Z") ==> Thu Mar 10 14:57:31 
 2016(i.e. timestamp is in CST with no timezone info)
os.environ['TZ'] ==> America/Chicago

 where dev_appserver and standard GAE return:

datetime.datetime.now().strftime("%c %Z") ==> Thu Mar 10 21:00:14 
 2016(i.e. timestamp is in UTC with no timezone info)
os.environ['TZ'] ==> 'UTC'

 adam

 On Thursday, March 10, 2016 at 12:32:07 PM UTC-8, Adam Sah wrote:
>
> Here's what I've tried so far...
>  - set os.environ['TZ'] to 'UTC' on startup - failed because GAE 
> overwrites this.
>  - set os.environ['TZ'] to 'UTC' on each call by creating a child 
> class to webapp.WSGIApplication and adding it to __call__() - failed 
> because GAE overwrites this.
>  - monkeypatching datetime.datetime.now() to use a specially hacked 
> function - failed because GAE disallows modifying now()
>
> I'm currently trying a hack to rewrite all calls (100+) 
> to datetime.datetime.now() to instead use an app-specific implementation 
> which returns the UTC time - this won't work for third party libraries, 
> but 
> that maybe OK for my app, which uses pylint custom rules to migrate 
> engineers to using app-specific replacement functions (e.g. we disallow 
> direct calls to gc.collect() so we can track stats better).  If this 
> works, 
> I'll post.
>
> adam
>
>
> On Wednesday, March 9, 2016 at 1:45:54 PM UTC-8, Adam Sah wrote:
>>
>> e.g. os.environ['TZ'] changed to Am

[google-appengine] Re: another wrinkle with GAE/Python Managed VMs: timezone set to local deploy location, not UTC like in GAE

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Folks,

Here's the PIT thread to track this 
.
 
Expect any updates to be posted there.

On Thursday, March 17, 2016 at 4:40:45 PM UTC-4, Jon Parrott wrote:
>
> To further Nick's point here, Python provides datetime.datetime.utcnow() 
> which allows you to explicitly get the current time in UTC. It's almost 
> always preferable to use that unless you explicitly want to deal with 
> system-local time.
>
> On Wednesday, March 16, 2016 at 12:30:33 PM UTC-7, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Michael,
>>
>> We're currently working on getting this resolved, although the best way 
>> to track its resolution is by posting and following a Public Issue Tracker 
>> issue. At any rate, we're currently working on it and it should be resolved 
>> soon. If your application is sensitive to the system time-zone, the natural 
>> recourse is to set it explicitly, rather than assume a default. 
>> Nonetheless, UTC is a sensible default I believe and should be implemented. 
>>
>> I'll update this thread with any progress on the issue.
>>
>> Best wishes,
>>
>> Nick
>> Cloud Platform Community Support
>>
>> On Wednesday, March 16, 2016 at 2:01:46 PM UTC-4, Michael Sander wrote:
>>>
>>> I've seen this too, but I just started working on Managed VM. Has this 
>>> been around for a while? It seems like a pretty major bug for it not to be 
>>> fixed. Also, the workaround is totally nuts. Is this going to be fixed or 
>>> is the hack our only recourse?
>>>
>>> On Thursday, March 10, 2016 at 6:54:04 PM UTC-5, Nick (Cloud Platform 
>>> Support) wrote:

 Hey Adam,

 Glad to see you found a workaround, I was going to some lengths to 
 verbally describe what you basically ended up doing. You should post a 
 quick description of this issue to the Public Issue Tracker for App 
 Engine  and 
 we'll be happy to take a look. It seems rational to have UTC as the 
 default.

 Cheers,

 Nick
 Cloud Platform Community Support

 On Thursday, March 10, 2016 at 6:28:39 PM UTC-5, Adam Sah wrote:
>
> OK, horrible workaround deployed.  Roughly:
>
> main.py:
>
> PATHS=[...
>   (r'/_ah/warmup', WarmupView),
>   (r'/_ah/start', StartView),
>
> class WarmupView(webapp.RequestHandler):
>   def get(self, *args):  # pylint:disable=W0613,R0201
> base.SERVER_TZ = None  # allow base.set_now() to reset server 
> timezone
> base.now()
>
> class StartView(webapp.RequestHandler):
>   def get(self, *args):  # pylint:disable=W0613,R0201
> base.SERVER_TZ = None  # allow base.set_now() to reset server 
> timezone
> base.now()
>
> base.py:
>
> import pytz
> ...
> SERVER_TZ = None
> ...
> def now(nowval=None):
>   global SERVER_TZ
>   ...
>   if SERVER_TZ is None:
>   try:
> # HACK of the year award!  os.environ['TZ'] isn't available 
> during GAE/Managed VMs startup
> # and date +%Z and /etc/timezone didn't have useful 
> information either
> # even env | grep TZ failed!!
> import subprocess
> localtz = subprocess.check_output("date +%Z", 
> shell=True).strip()
> # SUPER HACK: I couldn't find pytz-compatible timezone 
> strings, so I hacked it.
> # Yes, I know I'm going to hell for this.
> SERVER_TZ = 'America/Chicago' if localtz == 'CST' else 'UTC'
>   except:
> SERVER_TZ = 'UTC'
> nowval = datetime.datetime.now()  # pylint:disable=W9914
> if SERVER_TZ != 'UTC':
>   # set the tz to the server tz, convert to UTC, then strip the tz 
> info
>   nowval = 
> nowval.replace(tzinfo=pytz.timezone(SERVER_TZ)).astimezone(
> pytz.timezone('UTC')).replace(tzinfo=None)
>   return nowval
>
>
> adam
>
>
> On Thursday, March 10, 2016 at 1:01:57 PM UTC-8, Adam Sah wrote:
>>
>> oops, to be specific here's what I'm seeing:
>>
>>datetime.datetime.now().strftime("%c %Z") ==> Thu Mar 10 14:57:31 
>> 2016(i.e. timestamp is in CST with no timezone info)
>>os.environ['TZ'] ==> America/Chicago
>>
>> where dev_appserver and standard GAE return:
>>
>>datetime.datetime.now().strftime("%c %Z") ==> Thu Mar 10 21:00:14 
>> 2016(i.e. timestamp is in UTC with no timezone info)
>>os.environ['TZ'] ==> 'UTC'
>>
>> adam
>>
>> On Thursday, March 10, 2016 at 12:32:07 PM UTC-8, Adam Sah wrote:
>>>
>>> Here's what I've tried so far...
>>>  - set os.environ['TZ'] to 'UTC' on startup - failed because GAE 
>>> overwrites this.
>>>  - set os.environ['TZ'] to 'UTC' on each call by creating a child 
>>> class to webapp.WSGIAppli

[google-appengine] Re: GAE scaleability limits

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Yair,

The extent to which your specific app will scale or not scale is largely 
dependent on what code is running, what language runtime and frameworks you 
use, and how you configure 

 
your scaling settings 
. Needless to say, 
efficient scaling is something we make a top priority and to the extent 
that we can at all control for these factors beyond your own code and 
configuration, we strive to make our services (Datastore, Memcache, etc.) 
as available and efficient as possible so that you can focus on your code 
and the issue of scaling can be manageable to consider.

To see what potential bottlenecks exist in any system you build, you'll 
really need to do load testing of your app on the infrastructure *in 
addition to* any abstract reasoning based on technical specs, and all of 
this is to speak agnostically with respect to serving infrastructure (of 
course, again, we believe our infrastructure, due to our extensive and 
explicit work towards this end, is very scalable indeed, and numerous 
companies  have found the same to be 
true).

All this said, scaling effectively in an environment different to the 
traditional heavy monolithic server paradigm of web development in years 
past does require a mind-shift, although that's true of any modern cloud 
deployment infrastructure. Check out some of these articles we've produced 
to get a start on best-practices:

Building Scalable and Resilient Web Applications on Google Cloud Platform 


Designing for ScaleFinally, I want to assure you that migrating away from 
the platform is definitely a possibility, especially so if you use an 
abstraction layer to our services and APIs, such as Datastore (interacting 
with Datastore via JDO or JPA in Java is one example). Secondly, Managed VMs 
 and especially Custom 
Runtimes 
 for 
Managed VMs makes this even easier, given that you can deploy your 
application as a self-contained Docker image which can really run on any 
deployment infrastructure.

I hope this has answered some of your questions and given you confidence to 
go deeper into our documentation. Feel free to ask me any further questions 
you have and I'll be happy to assist.

Regards,

Nick
Cloud Platform Community Support

On Tuesday, March 15, 2016 at 5:49:23 AM UTC-4, Yair Lempert wrote:
>
> We are at an earlier stages of new mobile app project with cloud server 
> backend.
>
> One of the cloud backend candidates is GAE. 
> I'd like to know if anyone here had experienced any sort of degradation of 
> service once reaching certain amount of users/load.
> I know this question is a bit vague and the implementation plays a major 
> part but still, it would be interesting to know if keeping all other 
> factors but an increase in concurrent users constant, did you notice a 
> lower response time or retrieving or updating objects in the datastore 
> becomes slower?
> Would appreciate any concrete figures you could share.
> The safe bet is to take mongo/node.js where we can control every factor. 
> On the other hand the GAE is obviously lucrative as it saves much dev/ops 
> work. However, porting from GAE should the scale wouldn't hold is extremely 
> difficult.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/d8ede50e-f18d-49fe-bfa7-346345828ab6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Avoiding races when using memcache to back datastore queries

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Joel,

Your question fits more on the "general discussion" side of the sometimes* 
ambiguous boundary where it might be too in-depth for Stack Overflow, with 
too many possible answers, and yet is also a sort-of-specific issue which 
tends to get redirected to Stack. In the spirit of helping you out 
regardless, I'll be happy to assist here with some advice.

Cache invalidation is traditionally held up as a class of problem in 
computing which is devilishly hard to get right. The cardinal sin is to 
have the system perceive stale data as fresh, although it's acceptable to 
fetch stale data as long as it's identifiable as such and the path to fresh 
data is relatively cheap. 

The race condition you describe is definitely something to avoid, and I see 
one possible solution:

The deletion of the memcache key by instance 1 is clearly meant to prepare 
the way for a put() to the datastore of the new entity, so we should make 
the composition of these two actions into one atomic action, so that 
instance 2 will fail to fetch from memcache and thereafter find the new 
value in datastore. This can be accomplished as follows:

Rather than deleting the memcache key before put, a timestamp can be put in 
its place (or somehow associated with it), only to be deleted once the 
datastore entity is safely put. This means that instance 2, attempting to 
access the memcache key, would notice that it's currently being updated and 
do extremely small incremental sleeps until it finds the new version 
available in the datastore.

Could you go into a little more detail about your system specifically? I 
feel this will help spur more concrete discussion of the trade-offs you can 
make in your specific situation.

Regards,

Nick
Cloud Platform Community Support



On Thursday, March 17, 2016 at 1:27:46 PM UTC-4, Joel Holveck wrote:
>
> By the way, feel free to say this should be on Stack Overflow if that's 
> more appropriate.  I still don't have a good feel for what should be posted 
> here vs. elsewhere.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/54d3c351-83d7-481d-a46d-0d3225a447ed%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Entity not appearing in Entities under console datastore

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Richard,

The best thing to do, if you've waited long enough that any kind of 
propagation couldn't be at issue, would be to capture a HAR recording 
 of the issue and post 
to the Public Issue Tracker 
. We monitor that 
forum daily and you should see a response relatively quickly. 

Best of luck!

Nick
Cloud Platform Community Support

On Wednesday, March 16, 2016 at 5:26:16 AM UTC-4, Richard Cheesmar wrote:
>
> I have an entity called LatestRealestate that is showing up on the 
> console's datastore dashboard but not in the entities list...
>
> Any ideas anyone?
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/91117545-9cf2-4549-b536-b40a5a739fd2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Architecture question

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Rajesh,

Only somebody intimately familiar with both your code-base and the problems 
you want to solve, and the future directions you might want to move (adding 
functionality) could give an answer which is appropriately concrete. 
However I can give general advice in line with the general nature of the 
question. You can look at ways to restructure your data, or determine which 
indexes may not be needed by running analysis of how often different 
indexes are used. You could also potentially file a Public Issue Tracker 
request with many details if you absolutely need to have more indexes 
without restructuring, but it's usually possible to restructure.

Here are some articles which might help you to make some concrete decisions:


   - How Entities and Indexes are Stored 
   
   - Modeling Entity Relationships 
   
   - Index Selection and Advanced Search 
   
   
   
Best wishes,

Nick
Cloud Platform Community Support

On Thursday, March 17, 2016 at 8:03:05 AM UTC-4, Rajesh Gupta wrote:
>
> Hi,
> We are using java appengine.  We have already using 160 indexes.  
>
> We plan to expand further with more functionality, but we will hit the 200 
> index limit.  
> Our current architecture is servlets/jsp, with several GWT modules.
>
> What are my architecture options to add more functionality, with out 
> hitting the 200 index limit.  
> Can I use another new appid, and do the remote-api from the serverside 
> java code?  
>
> Rajesh
> *www.VeersoftSolutions.com *
> *www.AccountingGuru.net *
> *Accounting/Inventory/Orders on Google Cloud Platform and Mobile*
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/7a1989ed-4f07-4861-a1ab-91152a8b60fe%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Handing of the multiple task at a same time

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Hemanth,

There remain, after your post, some questions as to how you've implemented 
your system. The rate of inserts according to 47,000 / hour is 
approximately 13 / second. That seems very low - the maximum rate of 
inserts for streaming inserts is 100,000 rows per second, per table and 
1,000,000 rows per second, per project. 
 

Correct me if I'm wrong, but this starts to look like this number (47,000 
in 1 hour) represents the overall time of the entire pipeline from API call 
to sending the BigQuery insert(), not simply the rate at which inserts 
could theoretically take place. 

Ultimately, the best way to insert BigQuery rows is not with isolated HTTP 
requests, which have a lot of overhead costs, but with batch inserts. It 
might be worth looking into ways that you could aggregate the records in a 
layer after the task pipeline but before BigQuery which would allow you to 
send big batched inserts.

Let me know your thoughts on this, and best wishes,

Nick
Cloud Platform Community Support 

On Friday, March 18, 2016 at 8:46:59 AM UTC-4, Hemanth Kumar wrote:
>
>
> HI ALL
>
>Urgently required some help.
>
> I am facing a slowness problem while writing the data to the big query.
>
> My problem is I have 5000 task , and each task is interacting with the 
> Rest Api. The rest api is giving me the JSON response. I am parsing the 
> JSON response, and the same response I have to write to big query. 
>
> Every JSON response will give me around 3000 List of JSON Array.
> If I calculate the total data which will get inserted in the google big 
> query is around 1500. 
> To insert 47000 record its taking 1 hour. If I have to insert lakhs of 
> record of data , my performance is getting hit.
>
> Please give a good suggestion to improve the time complexity for this 
> problem. How I will resolve this using Google App Engine,
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/21fa5145-ac51-422a-8513-c660bdcb0157%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Write errors between Appengine and CloudStorage

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey David,

It's possible you experienced a transient issue which did not affect enough 
users to warrant a status post. It's good to program your systems to be 
fault-tolerant when the backbone functions of your system rely on API 
calls. This could mean simply retrying the request on error with an 
exponential backoff. 

If you continue to see the issue manifest, feel free to either post in this 
thread to get our attention or post a Public Issue Tracker 
 thread with any 
relevant code, logs, time-frame and project ID. We'll be happy to assist in 
any way we can!

Regards,

Nick
Cloud Platform Community Support


On Thursday, March 17, 2016 at 6:49:25 PM UTC-4, David Fischer wrote:
>
> From 11:43am - 11:56am Pacific time today as well as 3:28pm through 
> 3:41pm, I'm seeing elevated errors writing to Cloud Storage from Appengine. 
> Is anyone else seeing the same?
>
> Is there a reason this isn't on the status page? 
> https://status.cloud.google.com/
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/c7dc1201-ca5f-4e06-bf74-b98daad3dc2d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cannot send mail

2016-03-19 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey All,

Thanks for your reports. We're noticing that there are more than a normal 
number of reporters on this issue and we're looking into it with a high 
priority. Feel free to post the specific details of your case in a 
self-contained comment on the thread linked above (now public again) and 
we'll take it into account. If, after the resolution of this issue, yours 
turns out to be slightly different, or persists, feel free to post an 
entirely separate thread. We'll be, as always, actively monitoring the new 
threads and will respond quickly with questions or progress updates.

On Tuesday, March 15, 2016 at 11:49:36 AM UTC-4, Rob Williams wrote:
>
> Sounds like it's happening to a big number of sites.
>
> I wonder how many people it's happening to that just haven't noticed it 
> yet...
>
> On Tuesday, March 15, 2016 at 7:23:35 AM UTC-4, Gert wrote:
>>
>> https://code.google.com/p/googleappengine/issues/detail?id=12819
>>
>> Can this be a higher priority please then medium. Not be able to send 
>> confirmation mails is critical to my app
>>
>> On Friday, March 11, 2016 at 1:59:56 AM UTC+1, Nick (Cloud Platform 
>> Support) wrote:
>>>
>>> Hey Mark,
>>>
>>> We continue to look into this issue. The best thing to do would be to 
>>> create a Public Issue Tracker thread with your specific information so that 
>>> we can have a focused and clear context in which to track your issue, which 
>>> might be different or overlapping (we don't know from this point). We 
>>> monitor the Public Issue Tracker every day, so not to worry, we'll be in 
>>> contact quickly after your posting.
>>>
>>> On Thursday, March 10, 2016 at 8:15:46 AM UTC-5, Marek Dusek wrote:

 Hello,

 may I ask how you solved the issue (as the link is no longer valid and 
 the ticket ID disappeared from the public ticket listing)?

 We are facing similar issue on our GAE application - emails suddenly 
 (within last days) stopped being delivered, although no change was made to 
 the settings or code (and the mail quota in dev console is being updated 
 properly).

 I believe there are similar posts on SO without any conclusion.

 Thank you,
 Marek Dusek

 On Friday, March 4, 2016 at 9:58:57 PM UTC+1, Nick (Cloud Platform 
 Support) wrote:
>
> Hey Rob,
>
> Thanks for the link, and for posting in the right place :) We'll be 
> active on that thread shortly. 
>
> On Friday, March 4, 2016 at 10:56:02 AM UTC-5, Rob Williams wrote:
>>
>> Hi Nick,
>>
>> I've created 
>> https://code.google.com/p/googleappengine/issues/detail?id=12786
>>
>> Thanks.
>>
>> On Thursday, March 3, 2016 at 6:38:11 PM UTC-5, Nick (Cloud Platform 
>> Support) wrote:
>>>
>>> Hey Rob,
>>>
>>> The best way to get us to look at a potential issue is to make a 
>>> report in the Public Issue Tracker 
>>> . Feel free 
>>> to do so, with as much technical information as possible, and you'll 
>>> find 
>>> that the responses are quick and the issue will make progress. Posting 
>>> in a 
>>> forum meant for general discussion (such as this one) is far less 
>>> likely to 
>>> find its way to people who can help.
>>>
>>> Best wishes,
>>>
>>> Nick
>>>
>>>
>>>
>>> On Wednesday, March 2, 2016 at 12:49:42 PM UTC-5, Rob Williams wrote:

 Hi,

 I've seen the same since yesterday, 1-March-2015. Existing code 
 queues mails to not send too fast. Test case has a small number of 
 receivers.

 Have found that:

- Logs indicate mail was sent
- Quota is updated to show mail being sent
- Only a small random subset of the sent mails are received by 
remote hosts
   - Have tested with multiple receiving domains
   - Emails are not in junk folders
   - The few emails that are delivered arrive instantly
- No bounce backs have been delivered


 Several people are seeing similar behaviour on stack overflow. 
 http://stackoverflow.com/questions/35727054/google-app-engine-python-mail-sent-but-not-received
   

 http://stackoverflow.com/questions/35737937/sending-email-stopped-working-using-anythingtestapp-appspotmail-com


 Is email transmission broken? Is email being radically queued?

 Thanks!


 On Tuesday, March 1, 2016 at 6:14:20 PM UTC-5, Petr Balogh wrote:
>
> Hello, 
>
> I've met problem in my application.. problem is that I cannot send 
> email.. or behaviour seems weird..
>
> First time I've got email.. but after that haven't..  if app was 
> running day, maybe two it started sen

Re: [google-appengine] Re: Handing of the multiple task at a same time

2016-03-21 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Hemanth,

I suggest that you attempt to batch requests, as mentioned in my previous 
comment, as this could show some performance improvements without the 
network overhead of one request per record. Additionally, you should post 
the actual error text which the other user requested, as this is highly 
relevant to diagnosing task failure.

Regards,

Nick
Cloud Platform Community Support

On Monday, March 21, 2016 at 2:44:21 AM UTC-4, Hemanth Kumar wrote:
>
> The error is like process is already taken by some other request, like 
> that its coming
>
> On Mon, Mar 21, 2016 at 11:42 AM, Nickolas Daskalou  
> wrote:
>
>> Why are most of the tasks failing? What is the most common error when a 
>> task fails?
>>
>>
>> On 21 March 2016 at 16:40, Hemanth Kumar  
>> wrote:
>>
>>> HI Nick
>>>
>>> My queue configuration is like this
>>>
>>> 
>>> appannie-queue
>>> 60/s
>>> 100
>>> 50
>>> 
>>> 0
>>> 
>>> 
>>>
>>> But with this, the problem is maximum of the tasks are getting failed 
>>> and the number of records which I am getting in the big query is very less 
>>> its about 30 Lakh instead of 240 lakh. Not able to figure out how 
>>>  to resolve this.
>>>
>>> On Monday, March 21, 2016 at 10:51:38 AM UTC+5:30, Nickolas Daskalou 
>>> wrote:

 Hi Hemanth,

 Is your task queue set up to allow enough concurrency and/or execution 
 rate?

 See: https://cloud.google.com/appengine/docs/python/config/queue

 Nick


 On 21 March 2016 at 15:59, Hemanth Kumar  wrote:

> HI Nick,
>
>This includes a call to the API getting the response and 
> inserting into big query. For the batch insert I am using TableRow only, 
> but at a time I can only form a batch of 3000 records, and then call it 
> to 
> the big query. As I had written earlier, we have split our whole logic 
> into 
> a sets of task. The total count of task is around 5000. And each task 
> will 
> give me 3000 records. To complete all the task, how to reduce the time 
> complexity, its a biggest challenge for me.
>
> Earlier , before breaking the job into multiple task , I created only 
> one task, but to execute the whole task it was taking a long time because 
> it almost 5000 times we have to hit the rest api to get the response. So 
> in 
> that case timeout exception was coming, to overcome this we splitted this 
> whole job into 5000 task. Now , its not throwing the timeout exception, 
> but 
> the execution of all these task is taking a long time. 
>
> Please suggest me how to overcome of this problem. It will be very 
> useful for me.
>
>
>
> On Saturday, March 19, 2016 at 12:56:50 AM UTC+5:30, Nick (Cloud 
> Platform Support) wrote:
>>
>> Hey Hemanth,
>>
>> There remain, after your post, some questions as to how you've 
>> implemented your system. The rate of inserts according to 47,000 / hour 
>> is 
>> approximately 13 / second. That seems very low - the maximum rate of 
>> inserts for streaming inserts is 100,000 rows per second, per table 
>> and 1,000,000 rows per second, per project. 
>>  
>>
>> Correct me if I'm wrong, but this starts to look like this number 
>> (47,000 in 1 hour) represents the overall time of the entire pipeline 
>> from 
>> API call to sending the BigQuery insert(), not simply the rate at which 
>> inserts could theoretically take place. 
>>
>> Ultimately, the best way to insert BigQuery rows is not with isolated 
>> HTTP requests, which have a lot of overhead costs, but with batch 
>> inserts. 
>> It might be worth looking into ways that you could aggregate the records 
>> in 
>> a layer after the task pipeline but before BigQuery which would allow 
>> you 
>> to send big batched inserts.
>>
>> Let me know your thoughts on this, and best wishes,
>>
>> Nick
>> Cloud Platform Community Support 
>>
>> On Friday, March 18, 2016 at 8:46:59 AM UTC-4, Hemanth Kumar wrote:
>>>
>>>
>>> HI ALL
>>>
>>>Urgently required some help.
>>>
>>> I am facing a slowness problem while writing the data to the big 
>>> query.
>>>
>>> My problem is I have 5000 task , and each task is interacting with 
>>> the Rest Api. The rest api is giving me the JSON response. I am parsing 
>>> the 
>>> JSON response, and the same response I have to write to big query. 
>>>
>>> Every JSON response will give me around 3000 List of JSON Array.
>>> If I calculate the total data which will get inserted in the google 
>>> big query is around 1500. 
>>> To insert 47000 record its taking 1 hour. If I have to insert lakhs 
>>> of record of data , my performance is getting hit.
>>>
>>> Please give a good suggestion

[google-appengine] Re: Architecture question

2016-03-21 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Good points, Janne, yeah, that's a great alternative way to cut down on 
indexes.

On Saturday, March 19, 2016 at 2:31:10 AM UTC-4, Janne Savukoski wrote:
>
> Hi Rajesh,
>
> I'd suggest to consider moving some queries over to Search API (
> https://cloud.google.com/appengine/docs/java/search/). For example, we 
> use the custom datastore indexes (indices) primarily only for queries which 
> have strong consistency requirements.
>
> After we adopted this approach of focusing all “non-strict” queries to 
> Search API, our custom index count stopped increasing quite effectively. As 
> an added bonus, you also gain the much more versatile query capability of 
> the Search API. And save the trouble of keeping track what kind of queries 
> need to be supported by custom indices.
>
>
> Cheers,
> Janne, Swap.com
>
> On Thursday, March 17, 2016 at 2:03:05 PM UTC+2, Rajesh Gupta wrote:
>>
>> Hi,
>> We are using java appengine.  We have already using 160 indexes.  
>>
>> We plan to expand further with more functionality, but we will hit the 
>> 200 index limit.  
>> Our current architecture is servlets/jsp, with several GWT modules.
>>
>> What are my architecture options to add more functionality, with out 
>> hitting the 200 index limit.  
>> Can I use another new appid, and do the remote-api from the serverside 
>> java code?  
>>
>> Rajesh
>> *www.VeersoftSolutions.com *
>> *www.AccountingGuru.net *
>> *Accounting/Inventory/Orders on Google Cloud Platform and Mobile*
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a18011eb-5c94-4269-9561-d7e86fb59bb1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: New Cloud Console

2016-03-22 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Stefano,

I believe I know what you're referring to - you used to be able to change 
the dispatch rules within the old console itself, no? Currently the 
established method to change dispatch rules is via deployment of the 
dispatch.yaml file 
.
 
If you'd like, you could make a feature request in the Public Issue Tracker 
 for dispatch rule 
management in the new console, as you can for any other feature request 
you'd like to see, whether related to the console or any other service.

Best of luck!

Nick
Cloud Platform Community Support

On Tuesday, March 22, 2016 at 4:12:08 AM UTC-4, Stefano Ciccarelli wrote:
>
> Thank you very much for sharing the FAQs, but there are no words about the 
> "dispatch" configuration.
>
>
> Il giorno lun 21 mar 2016 alle ore 19:30 'Lorne Kligerman' via Google App 
> Engine  ha scritto:
>
>> We've created a page with more specific details about the migration to 
>> the Cloud Console:
>> https://cloud.google.com/appengine/articles/console-faq
>>
>> Thanks for the suggestion about refreshing the instances view, noted!
>>
>>
>> On Saturday, March 19, 2016 at 12:33:58 PM UTC-7, mike wrote:
>>>
>>> Please keep the old console for longer!
>>>
>>> I really like the old console, way better than the new console. Old 
>>> console is clean and fast, new console slow and trying to offer too much.
>>>
>>> On Tuesday, February 23, 2016 at 6:46:19 PM UTC-5, johnP wrote:

 Just got email that old appengine console will be shut off in 6 weeks.  
 The new cloud console does not have a "migrate traffic" option in the 
 Versions screen.  This was my absolute favorite new feature in a long, 
 long 
 time.  Will it be available in the new console?

>>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to google-appengine+unsubscr...@googlegroups.com.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> Visit this group at https://groups.google.com/group/google-appengine.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/google-appengine/da39da0e-b3db-4ade-9dd6-00921f68659b%40googlegroups.com
>>  
>> 
>> .
>> For more options, visit https://groups.google.com/d/optout.
>>
> -- 
> *Stefano Ciccarelli* 
> GAE Application Division 
> / Director 
> stefano.ciccare...@mmbsoftware.it 
>
> *M.M.B. s.r.l.* 
> via Granarolo, 177/7 - 48018 Faenza (RA) - Italy 
> tel. +39.0546.637711 - fax +39.0546.46077 
> www.mmbsoftware.it - i...@mmbsoftware.it
>
> Le informazioni contenute in questa comunicazione sono riservate e 
> destinate esclusivamente alla/e persona/e o all'ente sopra indicati. E' 
> vietato ai soggetti diversi dai destinatari qualsiasi uso, copia, 
> diffusione di quanto in esso contenuto sia ai sensi dell'art. 616 c.p., sia 
> ai sensi del DL n. 196/03. Se questa comunicazione Vi e' pervenuta per 
> errore, Vi preghiamo di rispondere a questa e-mail e successivamente 
> cancellarla dal Vostro sistema.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/6ece29f4-2bd9-4e0d-be45-917879bea4eb%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: installing cloud based server storage

2016-03-22 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Vasni,

This forum is meant for the discussion of the App Engine and Cloud Platform 
services, and while it appears that ODK (just Googled this) possibly runs 
on App Engine, it's very unlikely anyone here has the necessary experience 
to advise you on how to proceed. I think you would have much better luck 
following the links on the ODK website which point to their community and 
issue tracker , etc. They also appear 
to have some documentation and usage instructions.

Best of luck,

Nick 
Cloud Platform Community Support

On Monday, March 21, 2016 at 3:49:00 PM UTC-4, Vasni Pech wrote:
>
>
>
> On Monday, March 21, 2016 at 1:39:24 PM UTC-6, Vasni Pech wrote:
>>
>> Hi can someone help me in installing the cloud based server for open data 
>> kit. I am trying to develop a cloud server but I am not able to create the 
>> cloud based server for ODK
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/6518fb04-0429-463d-ad86-59e86df840d7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Reg: Tools on Google cloud platform that helps us to analytics

2016-03-22 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Seconding @troberti here, BigQuery is definitely a better match for logs 
storage and analysis. Datastore would have an advantage if you wanted to 
update records, but logs are immutable and write-once, so BigQuery, which 
doesn't support UPDATE queries, is the best match, also because it can 
query large amounts of data very quickly (the central design premise of 
BigQuery).

On Tuesday, March 22, 2016 at 4:52:14 AM UTC-4, Manikanta Kondeti wrote:
>
> Hello, 
>
> We are just one of the groups that uses app engine for hosting. I have a 
> few questions related to storing logs (logging of various actions that 
> happen in the app) . Currently we are storing all the information in form 
> of entities in datastore. If I want to do a behavioral analytics on a 
> particular group of users I have to fetch all of them from app engine and 
> run queries. It takes lots of time to fetch those data and do analytics. 
> Are there any good tools on google cloud platform that help us to make this 
> entire process better?
>
> Regards,
> Manikanta 
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/e21d45da-ed80-44fc-b90a-7388f92c9fba%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Reg: Tools on Google cloud platform that helps us to analytics

2016-03-22 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
You can also set up streaming 
 of your 
logs  
directly into BigQuery. Just wanted to add that link in case you hadn't 
seen it, Manikanta.

Cheers,

Nick
Cloud Platform Community Support

On Tuesday, March 22, 2016 at 11:39:22 AM UTC-4, Nick (Cloud Platform 
Support) wrote:
>
> Seconding @troberti here, BigQuery is definitely a better match for logs 
> storage and analysis. Datastore would have an advantage if you wanted to 
> update records, but logs are immutable and write-once, so BigQuery, which 
> doesn't support UPDATE queries, is the best match, also because it can 
> query large amounts of data very quickly (the central design premise of 
> BigQuery).
>
> On Tuesday, March 22, 2016 at 4:52:14 AM UTC-4, Manikanta Kondeti wrote:
>>
>> Hello, 
>>
>> We are just one of the groups that uses app engine for hosting. I have a 
>> few questions related to storing logs (logging of various actions that 
>> happen in the app) . Currently we are storing all the information in form 
>> of entities in datastore. If I want to do a behavioral analytics on a 
>> particular group of users I have to fetch all of them from app engine and 
>> run queries. It takes lots of time to fetch those data and do analytics. 
>> Are there any good tools on google cloud platform that help us to make this 
>> entire process better?
>>
>> Regards,
>> Manikanta 
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a05f47f2-bb11-4652-afaf-ff2bb88cd51d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: How can I load my Earth Engine script in App Engine?

2016-03-22 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Unesco,

The documentation you linked says the following, I think you may have just 
missed it in all the details:

The Earth Engine App Engine examples directory 
>  on GitHub 
> contains a set of useful App Engine examples. See the Example Apps page 
>  for a 
> brief description of each example. This doc provides instructions for how 
> to set up and deploy the examples or custom apps you create.
>

Let me know if this information isn't what you're looking for, but I 
believe it is exactly what you've requested. 

Cheers,

Nick
Cloud Platform Community Support

On Tuesday, March 22, 2016 at 11:53:22 AM UTC-4, Unesco Iha wrote:
>
> Hi everyone,
>
> I have this Earth Engine Script that outputs the land cover % inside a 
> polygon : 
> https://code.earthengine.google.com/1dcdb45ae0a3b1738f8125f425210057
> I want an app similar to the elevation demo (
> https://polygon-drawing-dot-ee-demos.appspot.com/) where one can draw a 
> polygon and get the land cover %.
>
> *How can I transfert my Earth Engine Script in App Engine?*
> The instructions are not really clear, or at least I don't understand them 
> : https://developers.google.com/earth-engine/app_engine_intro
> Do I simply make an landcover.py file with my Earth Engine script inside 
> and a app.yaml configuration file identical to the one in the "helloworld" 
> example, but add "application: [my project ID]" in the first line?
>
> I have Pyhton 2.7.8 (installed with ArcGIS 10.3) and the Google App Engine 
> Launcher installed on Windows 10. 
> *Do I need anything else?*
>
> I know I'm asking a lot of question, but I am truly lost.
>
> Thank you!
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/beb93a89-57d2-435c-84ba-b44d117ac555%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cannot send mail

2016-03-23 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
This issue appears to have been resolved. If anybody is still experiencing 
the issue, feel free to post in the linked PIT thread and / or here and we 
can look into your specific case.

Cheers!

Nick
Cloud Platform Community Support

On Wednesday, March 16, 2016 at 12:42:24 PM UTC-4, Nick (Cloud Platform 
Support) wrote:
>
> Hey All,
>
> Thanks for your reports. We're noticing that there are more than a normal 
> number of reporters on this issue and we're looking into it with a high 
> priority. Feel free to post the specific details of your case in a 
> self-contained comment on the thread linked above (now public again) and 
> we'll take it into account. If, after the resolution of this issue, yours 
> turns out to be slightly different, or persists, feel free to post an 
> entirely separate thread. We'll be, as always, actively monitoring the new 
> threads and will respond quickly with questions or progress updates.
>
> On Tuesday, March 15, 2016 at 11:49:36 AM UTC-4, Rob Williams wrote:
>>
>> Sounds like it's happening to a big number of sites.
>>
>> I wonder how many people it's happening to that just haven't noticed it 
>> yet...
>>
>> On Tuesday, March 15, 2016 at 7:23:35 AM UTC-4, Gert wrote:
>>>
>>> https://code.google.com/p/googleappengine/issues/detail?id=12819
>>>
>>> Can this be a higher priority please then medium. Not be able to send 
>>> confirmation mails is critical to my app
>>>
>>> On Friday, March 11, 2016 at 1:59:56 AM UTC+1, Nick (Cloud Platform 
>>> Support) wrote:

 Hey Mark,

 We continue to look into this issue. The best thing to do would be to 
 create a Public Issue Tracker thread with your specific information so 
 that 
 we can have a focused and clear context in which to track your issue, 
 which 
 might be different or overlapping (we don't know from this point). We 
 monitor the Public Issue Tracker every day, so not to worry, we'll be in 
 contact quickly after your posting.

 On Thursday, March 10, 2016 at 8:15:46 AM UTC-5, Marek Dusek wrote:
>
> Hello,
>
> may I ask how you solved the issue (as the link is no longer valid and 
> the ticket ID disappeared from the public ticket listing)?
>
> We are facing similar issue on our GAE application - emails suddenly 
> (within last days) stopped being delivered, although no change was made 
> to 
> the settings or code (and the mail quota in dev console is being updated 
> properly).
>
> I believe there are similar posts on SO without any conclusion.
>
> Thank you,
> Marek Dusek
>
> On Friday, March 4, 2016 at 9:58:57 PM UTC+1, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Rob,
>>
>> Thanks for the link, and for posting in the right place :) We'll be 
>> active on that thread shortly. 
>>
>> On Friday, March 4, 2016 at 10:56:02 AM UTC-5, Rob Williams wrote:
>>>
>>> Hi Nick,
>>>
>>> I've created 
>>> https://code.google.com/p/googleappengine/issues/detail?id=12786
>>>
>>> Thanks.
>>>
>>> On Thursday, March 3, 2016 at 6:38:11 PM UTC-5, Nick (Cloud Platform 
>>> Support) wrote:

 Hey Rob,

 The best way to get us to look at a potential issue is to make a 
 report in the Public Issue Tracker 
 . Feel free 
 to do so, with as much technical information as possible, and you'll 
 find 
 that the responses are quick and the issue will make progress. Posting 
 in a 
 forum meant for general discussion (such as this one) is far less 
 likely to 
 find its way to people who can help.

 Best wishes,

 Nick



 On Wednesday, March 2, 2016 at 12:49:42 PM UTC-5, Rob Williams 
 wrote:
>
> Hi,
>
> I've seen the same since yesterday, 1-March-2015. Existing code 
> queues mails to not send too fast. Test case has a small number of 
> receivers.
>
> Have found that:
>
>- Logs indicate mail was sent
>- Quota is updated to show mail being sent
>- Only a small random subset of the sent mails are received by 
>remote hosts
>   - Have tested with multiple receiving domains
>   - Emails are not in junk folders
>   - The few emails that are delivered arrive instantly
>- No bounce backs have been delivered
>
>
> Several people are seeing similar behaviour on stack overflow. 
> http://stackoverflow.com/questions/35727054/google-app-engine-python-mail-sent-but-not-received
>   
>
> http://stackoverflow.com/questions/35737937/sending-email-stopped-working-using-anythingtestapp-appspotmail-com
>
>

[google-appengine] Re: App Engine Security

2016-03-23 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Fendy,

I'm unsure what specific aspect of the talks you're referring to, but in 
addition to the question of authentication libraries and systems, the 
statements may have been referring to the fact that when dealing with a 
managed platform within secured infrastructure, you face less security 
issues as a system administrator or developer than you would by simply 
deploying your site on a traditional server box. However, I wouldn't want 
to speculate. You can read more about Cloud Platform security in our 
whitepaper and docs .

Cheers,

Nick
Cloud Platform Community Support 

On Wednesday, March 23, 2016 at 3:42:49 PM UTC-4, Fendy Jong wrote:
>
> Hi,
>
> I am new to App Engine and lacking a lot about security.
>
> I just watch GCP Live 2016. Google kept on mentioning that the security is 
> automatically handled. I am just wandering, does that means I don't have to 
> configure App Engine security anymore? If it requires configuration, what 
> kind of configuration that I need to do? Thank you
>
> Best regards,
> Tjin Fendy
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/264734fa-c20a-47e1-bff4-cd3a2f02e764%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cannot send mail

2016-03-24 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey All,

As some post-mortem analysis as requeset by Gert:

These issues just happened to be fixed by a change made to the way the mail 
filters determined what was spam and what wasn't. Some points to note:
  
There is no guarantee it won't happen in the future and GAE doesn't provide 
insight into dropped messages for the most part. 

The best advice we can really give is to move to Sendgrid if you have a 
higher standard requirement for programmatic email sending, and this is 
recommended in the documentation. Sendgrid has SLAs and other stuff 
surrounding mail delivery which put it above the Mail API, which is 
recommended for admin mail and other light tasks. It also gives users more 
visibility into what's actually going on with the mail than the Mail API 
[1]. 

[1] https://cloud.google.com/appengine/docs/php/mail/sendgrid

Cheers!

Nick
Cloud Platform Community Support

On Wednesday, March 23, 2016 at 9:35:40 PM UTC-4, Gert wrote:
>
> For me it's working thanks, can we have a explanation please what went 
> wrong?
>
> On Thursday, March 24, 2016 at 12:25:37 AM UTC+1, Nick (Cloud Platform 
> Support) wrote:
>>
>> This issue appears to have been resolved. If anybody is still 
>> experiencing the issue, feel free to post in the linked PIT thread and / or 
>> here and we can look into your specific case.
>>
>> Cheers!
>>
>> Nick
>> Cloud Platform Community Support
>>
>> On Wednesday, March 16, 2016 at 12:42:24 PM UTC-4, Nick (Cloud Platform 
>> Support) wrote:
>>>
>>> Hey All,
>>>
>>> Thanks for your reports. We're noticing that there are more than a 
>>> normal number of reporters on this issue and we're looking into it with a 
>>> high priority. Feel free to post the specific details of your case in a 
>>> self-contained comment on the thread linked above (now public again) and 
>>> we'll take it into account. If, after the resolution of this issue, yours 
>>> turns out to be slightly different, or persists, feel free to post an 
>>> entirely separate thread. We'll be, as always, actively monitoring the new 
>>> threads and will respond quickly with questions or progress updates.
>>>
>>> On Tuesday, March 15, 2016 at 11:49:36 AM UTC-4, Rob Williams wrote:

 Sounds like it's happening to a big number of sites.

 I wonder how many people it's happening to that just haven't noticed it 
 yet...

 On Tuesday, March 15, 2016 at 7:23:35 AM UTC-4, Gert wrote:
>
> https://code.google.com/p/googleappengine/issues/detail?id=12819
>
> Can this be a higher priority please then medium. Not be able to send 
> confirmation mails is critical to my app
>
> On Friday, March 11, 2016 at 1:59:56 AM UTC+1, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Mark,
>>
>> We continue to look into this issue. The best thing to do would be to 
>> create a Public Issue Tracker thread with your specific information so 
>> that 
>> we can have a focused and clear context in which to track your issue, 
>> which 
>> might be different or overlapping (we don't know from this point). We 
>> monitor the Public Issue Tracker every day, so not to worry, we'll be in 
>> contact quickly after your posting.
>>
>> On Thursday, March 10, 2016 at 8:15:46 AM UTC-5, Marek Dusek wrote:
>>>
>>> Hello,
>>>
>>> may I ask how you solved the issue (as the link is no longer valid 
>>> and the ticket ID disappeared from the public ticket listing)?
>>>
>>> We are facing similar issue on our GAE application - emails suddenly 
>>> (within last days) stopped being delivered, although no change was made 
>>> to 
>>> the settings or code (and the mail quota in dev console is being 
>>> updated 
>>> properly).
>>>
>>> I believe there are similar posts on SO without any conclusion.
>>>
>>> Thank you,
>>> Marek Dusek
>>>
>>> On Friday, March 4, 2016 at 9:58:57 PM UTC+1, Nick (Cloud Platform 
>>> Support) wrote:

 Hey Rob,

 Thanks for the link, and for posting in the right place :) We'll be 
 active on that thread shortly. 

 On Friday, March 4, 2016 at 10:56:02 AM UTC-5, Rob Williams wrote:
>
> Hi Nick,
>
> I've created 
> https://code.google.com/p/googleappengine/issues/detail?id=12786
>
> Thanks.
>
> On Thursday, March 3, 2016 at 6:38:11 PM UTC-5, Nick (Cloud 
> Platform Support) wrote:
>>
>> Hey Rob,
>>
>> The best way to get us to look at a potential issue is to make a 
>> report in the Public Issue Tracker 
>> . Feel 
>> free to do so, with as much technical information as possible, and 
>> you'll 
>> find that the responses are quick and the issue will make progress. 
>> Posting 
>> in a forum

Re: [google-appengine] Re: my git repo is empty

2016-03-28 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Andrew, 

Seconding what Nickolas has recommended in the general case that you have 
an issue in production to request feedback / guidance on (or if you merely 
want to report it), although in this specific case, since the issue should 
be a relatively quick investigation and you've supplied all necessary 
information, I'll be happy to look into the issue from this thread alone. 
For anything other than one-off spot-checks, it's 100% advisable to post in 
the Public Issue Tracker, otherwise.

Expect a response on or before April 1st.

Cheers!

Nick
Cloud Platform Community Response

On Saturday, March 26, 2016 at 12:11:09 PM UTC-4, Andrew Arrow wrote:
>
> also empty. I think during a transition from old app engine to new 
> gcloud google lost my code? I want to submitt a support request but 
> I'm on free plan. 
>
>
> On 3/26/16, Mihail Russu  wrote: 
> >>Where's my code? 
> > Check the Downloading source code 
> > <
> https://cloud.google.com/appengine/docs/python/tools/uploadinganapp#Python_Downloading_source_code>
>  
>
> > section 
> > to see if it'll help... 
> > 
> > On Saturday, March 26, 2016 at 1:18:16 AM UTC+2, Andrew Arrow wrote: 
> >> 
> >> my site has been running for a year at: 
> >> 
> >> https://static-1064.appspot.com/ 
> >> 
> >> I went to clone the repo: 
> >> 
> >> https://source.developers.google.com/p/static-1064/r/default 
> >> 
> >> and it clones an empty repo. Where's my code? 
> >> 
> >> 
> > 
> > -- 
> > You received this message because you are subscribed to a topic in the 
> > Google Groups "Google App Engine" group. 
> > To unsubscribe from this topic, visit 
> > 
> https://groups.google.com/d/topic/google-appengine/WCz0JORRoQ0/unsubscribe. 
>
> > To unsubscribe from this group and all its topics, send an email to 
> > google-appengine+unsubscr...@googlegroups.com. 
> > To post to this group, send email to google-appengine@googlegroups.com. 
> > Visit this group at https://groups.google.com/group/google-appengine. 
> > To view this discussion on the web visit 
> > 
> https://groups.google.com/d/msgid/google-appengine/5e58dc33-0d0d-4c43-8719-f0c4df7f6638%40googlegroups.com.
>  
>
> > For more options, visit https://groups.google.com/d/optout. 
> > 
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/b92d9831-1e5f-455a-9a75-9f96437e0ba1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Deployment issues

2016-03-28 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Mayank,

I understand that you're seeing some issues in deployment to via your 
bitnami-jenkins GCE instance. While connection issues in a cloud 
environment are to be expected, the tools we use to make connections should 
be fault-tolerant although this isn't always automatically the case. It 
appears that some aspect of your deployment system is failing when a 
connection to Cloud Storage fails. Your post didn't make it quite clear 
exactly how this manifests, as full system and logs context were not given. 
However, there is enough information to make clear that you need to contact 
either Cloud Platform or Bitnami support. You could either try to report it 
in the Cloud Platform Public Issue Tracker 
, or use the 
recommended path from the documentation 
, 
which explains:

Free support is provided via our community site 
>  by the Bitnami team. For free 
> support, we do not provide a guaranteed response time, however we do our 
> best to respond to questions within 24 hours Monday through Friday.
>
 

 *Go to Bitnami support (community.bitnami.com) 
> *


> Additional Google Cloud Platform technical support is available as a paid 
> package from Google Cloud Support .


Either way you will shortly be in touch with someone who can assist you 
further. Be sure to provide full context of how you run the deployment, how 
you gather the error, all messages which are output, etc.

If there's anything else you feel I could assist with here, feel free to 
let me know and I'll do my best to answer any questions.

Sincerely,

Nick
Cloud Platform Community Support 

On Monday, March 28, 2016 at 5:55:08 AM UTC-4, Mayank Bhagya wrote:
>
> We face this issue every day. And no, I am not exaggerating.
> EVERY SINGLE DAY!
>
> Every day, from about 12 in the afternoon to 5 in the evening (GMT+0530), 
> the push-to-deploy bitnami-jenkins setup complains that it couldn't copy 
> files to cloud storage.
> The error is intermittent. Certain deployments succeed in first attempt, 
> some others in second and some others don't complete for hours!
>
> Today we have to deploy a critical fix and this thing is not ready to 
> deploy!
>
> Here are some logs:
>
> Updating module [default]...-
> Updating module [default]...\
> Updating module [default]...|
> Updating module [default].../
> Updating module [default]...-
> Updating module [default]...failed.
> ERROR: (gcloud.preview.app.deploy) Error Response: [13] Errors were 
> encountered while copying files to App Engine.
>
> Details: [
>   [
> {
>   "@type": "type.googleapis.com/google.rpc.ResourceInfo",
>   "description": "Error reading from Google Cloud Storage.",
>   "resourceName": 
> "https://storage.googleapis.com/staging.myappname.appspot.com/9daf160fc37b8d609092a9f47367188d596ab34e.jpeg";,
>   "resourceType": "file"
> }
>   ]
> ]
>
>
> Do you think adding more features and not addressing bugs like these will 
> make your customers' life easy?
> Whatever happened to quality. 
> Can Google folks be serious enough and understand the impact of such 
> issues?
>
> Having downtime in an application is not a joke. 
> Not everybody ships with 'beta' quality.
>
> Please look into this issue asap and let me know if you know anything from 
> my side.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/5071c941-c48d-4362-9e6c-c5574a2e4d22%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Deployment issues

2016-03-29 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Mayank,

I'm sorry that you found my comments unhelpful. I'll try to clarify:

It is to be expected that errors will occur when dealing with any software 
product which is beta (such as gcloud). As well, in a distributed (cloud) 
computing environment, connection issues are a fact of life, even for the 
best-intentioned developers and companies, and it's not necessarily a 
matter of attitude toward quality, which I'm sure we all agree is the most 
important factor. The question becomes, how to deal with inevitable 
connection error situations? Software should attempt to retry failed 
connections, generally, using an incremental backoff scheme to prevent 
flooding the target server.  However, when software doesn't behave in this 
nice way, what's a developer to do? In this case, it appears that a failure 
to connect to Cloud Storage led to the entire bitnami-jenkins setup failing.

The reason I had directed you to the appropriate channels of support is 
because in those locations you will find people expressly-oriented to 
addressing your specific issue here, while this forum is meant for more 
general discussion of the Google Cloud Platform and services, not specific 
technical issues. When you post to Bitnami support, or Cloud Platform 
support (this could also mean the Public Issue Tracker 
), you should 
be sure to include all relevant details, such as which command you are 
running or which documentation you are following, what version of all 
relevant softwares and OS's are involved, etc. I'm unsure at this point 
whether you're following documentation on our side or from Bitnami, if you 
could clarify that would be great.

All that said, I'll be happy to offer whatever assistance I can here, in 
whatever form I can. Feel free to supply more info and we can try to get to 
the bottom of this.

Regards,

Nick
Cloud Platform Community Support

On Tuesday, March 29, 2016 at 2:49:12 AM UTC-4, Mayank Bhagya wrote:
>
> Thanks for the reply, Nick.
>
> While connection issues in a cloud environment are to be expected, the 
>> tools we use to make connections should be fault-tolerant although this 
>> isn't always automatically the case. 
>>
>
> Do you mean we should expect these tools to fail?
>
> Your post didn't make it quite clear exactly how this manifests, as full 
>> system and logs context were not given. 
>>
>
> Well, the appengine push-to-deploy setup, states very clearly, how to use 
> 'gcloud' on a compute-engine instance to deploy to appengine.
> The attached logs were the output of 'gcloud preview app deploy', as 
> visible on line#7 of the logs.
>  
>
>> However, there is enough information to make clear that you need to 
>> contact either Cloud Platform or Bitnami support. You could either try to 
>> report it in the Cloud Platform Public Issue Tracker 
>> , or use 
>> the recommended path from the documentation 
>> , 
>> which explains:
>>
>>
> That doesn't help a lot Nick.
>  
>
>> Either way you will shortly be in touch with someone who can assist you 
>> further. Be sure to provide full context of how you run the deployment, how 
>> you gather the error, all messages which are output, etc.
>>
>>
> Thanks. This should help.
> Do let me know if you need more info or if you need me to run gcloud in a 
> debug / verbose mode.
>
> If there's anything else you feel I could assist with here, feel free to 
>> let me know and I'll do my best to answer any questions.
>>
>> Sincerely,
>>
>> Nick
>> Cloud Platform Community Support 
>>
>> On Monday, March 28, 2016 at 5:55:08 AM UTC-4, Mayank Bhagya wrote:
>>>
>>> We face this issue every day. And no, I am not exaggerating.
>>> EVERY SINGLE DAY!
>>>
>>> Every day, from about 12 in the afternoon to 5 in the evening 
>>> (GMT+0530), the push-to-deploy bitnami-jenkins setup complains that it 
>>> couldn't copy files to cloud storage.
>>> The error is intermittent. Certain deployments succeed in first attempt, 
>>> some others in second and some others don't complete for hours!
>>>
>>> Today we have to deploy a critical fix and this thing is not ready to 
>>> deploy!
>>>
>>> Here are some logs:
>>>
>>> Updating module [default]...-
>>> Updating module [default]...\
>>> Updating module [default]...|
>>> Updating module [default].../
>>> Updating module [default]...-
>>> Updating module [default]...failed.
>>> ERROR: (gcloud.preview.app.deploy) Error Response: [13] Errors were 
>>> encountered while copying files to App Engine.
>>>
>>> Details: [
>>>   [
>>> {
>>>   "@type": "type.googleapis.com/google.rpc.ResourceInfo",
>>>   "description": "Error reading from Google Cloud Storage.",
>>>   "resourceName": 
>>> "https://storage.googleapis.com/staging.myappname.appspot.com/9daf160fc37b8d609092a9f47367188d596ab34e.jpeg";,
>>>   "resourceType": "file"

[google-appengine] Re: Geo information from Traces

2016-03-29 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Sandeep,

Excellent question. I've just noticed this feature after checking at your 
advice. I'll report back to this thread with information, if possible, on 
how to replicate the same within your code. There are geolocation APIs and 
libraries out there, but I'll see if I can shed some light on whether we 
have a Cloud Platform way of doing this which is available to users.

Regards,

Nick
Cloud Platform Community Supper

On Tuesday, March 29, 2016 at 2:03:53 AM UTC-4, Sandeep Dhameshia wrote:
>
> I've just observed geo information coming in the Traces(logs) for my GAE 
> project, as a http/client_city and http/client_country fields. Can this be 
> stored anyway and used within the project? Is it legit to use this in the 
> first place? In terms of Google policies. Your thoughts please, Thanks.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/7a8e5852-cba6-4fea-a9cf-120c80ccc2e4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: Geo information from Traces

2016-03-29 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Ah yes, the X-AppEngine headers, my old friends. This is indeed the correct 
solution, and can be accessed in every runtime. 

On Tuesday, March 29, 2016 at 1:12:08 PM UTC-4, Sandeep Dhameshia wrote:
>
> thanks for the pointer guys, I'll check it out!
> On Mar 29, 2016 10:39 PM, "Mihail Russu" <*@russu.net> wrote:
>
>> Have you looked at X-AppEngine-Country & X-AppEngine-City request headers 
>> 
>>  that 
>> contain this information on every request received by your app? 
>>
>> On Tuesday, March 29, 2016 at 9:03:53 AM UTC+3, Sandeep Dhameshia wrote:
>>>
>>> I've just observed geo information coming in the Traces(logs) for my GAE 
>>> project, as a http/client_city and http/client_country fields. Can this be 
>>> stored anyway and used within the project? Is it legit to use this in the 
>>> first place? In terms of Google policies. Your thoughts please, Thanks.
>>>
>> -- 
>> You received this message because you are subscribed to a topic in the 
>> Google Groups "Google App Engine" group.
>> To unsubscribe from this topic, visit 
>> https://groups.google.com/d/topic/google-appengine/zZWxtB-rVXA/unsubscribe
>> .
>> To unsubscribe from this group and all its topics, send an email to 
>> google-appengine+unsubscr...@googlegroups.com.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> Visit this group at https://groups.google.com/group/google-appengine.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/google-appengine/923e2609-91c4-4041-83a4-767bb37de6e5%40googlegroups.com
>>  
>> 
>> .
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/9e7ee5b9-b590-4e57-9468-99345cadf0de%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Problems uploading images from GAE app using gcloud library.

2016-03-29 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Juan,

I believe I've figured out what When running in development, packages 
installed to your python system can appear to resolve dependencies. These 
will be absent in production for the reason that only your app's folder is 
uploaded, not all the python packages on your system. 

For this reason, many developers work within a virtualenv 
, so that outside dependencies don't 
come into the equation. Within the virtualenv, you shouldn't global-install 
packages, but should install them to a subfolder of your project and 
explicitly add these using vendoring 
. 

If you inspect the python path (sys.path) in the non-failing example as you 
currently have it, you'll notice system folders in the path. In production, 
you'll notice these are missing if you inspect sys.path there. 

I hope this has helped clarify the issue as to why you're seeing an 
ImportError in production and not in dev. Feel free to post a reply if you 
find something different.

Best regards,

Nick
Cloud Platform Community Support

On Tuesday, March 29, 2016 at 6:54:57 AM UTC-4, Juan Antonio Fernández 
Sánchez wrote:
>
> I'm trying upload images to a bucket in Cloud Storage from an app in GAE 
> and I can't find the way to do this.
> I don't have problems when I try do this with a simple program written in 
> python using the library gcloud, this work fine and I can see the pictures 
> in a bucket with the web console but when I try do this inside GAE app (I 
> install gcloud library in /lib folder before) always I find the same error 
> when I import the gcloud library to use: 
>
> raise ImportError('No module named %s' % fullname)
> ImportError: No module named cryptography.hazmat.bindings._openssl
>
> And I don't undesrtand why when use the library in my localhost this work 
> fine but not inside GAE app.
>
> I thought use JSON API for do this but I want know how is the problem 
> before to change the way to do this.
>
> Thanks you so much for any help, and sorry for my english.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/30d71bc1-9bb6-4b18-b798-24f317c226da%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Tardy? Porting to new platform version?

2016-03-29 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Nick,

This sounds like something that could get a quick solution if filed in the 
Public 
Issue Tracker . You 
should capture a HAR recording of the browser interaction 
 and explain what you're 
attempting to do. Be sure, when you create the issue, to attach the label "
Restrict-View-EditIssue" so that only Google and yourself can view the 
thread. We should be able to inspect things from our end and determine 
what's at the bottom of this issue. In the meantime, you could try to visit 
console.developers.google.com and see if you can see your projects there. 
That information will likely be important to the issue when you report it.

Best wishes,

Nick
Cloud Platform Community Support

On Tuesday, March 29, 2016 at 2:35:51 AM UTC-4, Nick Topper wrote:
>
> Hi,
>
> In the last few months, is there something I should know about porting my 
> old old old GAE apps to a new version of the platform?
>
> My apps are so stable that I rarely log into the GAE admin-console.  Today 
> I did -- first time in a long time -- and see that most of the console is 
> disabled, and clicking the link to the new console yields a message "You do 
> not have sufficient permissions to view this page."
>
> I have a vague recollection that Google sent an email several months ago 
> about apps needing to be ported to a new something-or-other, but cannot 
> find it.  Is there a pointer to a description of the changes, and what I 
> need to do?
>
> Thanks,
> NT
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/645869a9-4a2e-44c3-a644-7a438fe56762%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Problems uploading images from GAE app using gcloud library.

2016-03-29 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
I believe I've figured out what is happening here *

On Tuesday, March 29, 2016 at 2:34:37 PM UTC-4, Nick (Cloud Platform 
Support) wrote:
>
> Hey Juan,
>
> I believe I've figured out what When running in development, packages 
> installed to your python system can appear to resolve dependencies. These 
> will be absent in production for the reason that only your app's folder is 
> uploaded, not all the python packages on your system. 
>
> For this reason, many developers work within a virtualenv 
> , so that outside dependencies 
> don't come into the equation. Within the virtualenv, you shouldn't 
> global-install packages, but should install them to a subfolder of your 
> project and explicitly add these using vendoring 
> . 
>
> If you inspect the python path (sys.path) in the non-failing example as 
> you currently have it, you'll notice system folders in the path. In 
> production, you'll notice these are missing if you inspect sys.path there. 
>
> I hope this has helped clarify the issue as to why you're seeing an 
> ImportError in production and not in dev. Feel free to post a reply if you 
> find something different.
>
> Best regards,
>
> Nick
> Cloud Platform Community Support
>
> On Tuesday, March 29, 2016 at 6:54:57 AM UTC-4, Juan Antonio Fernández 
> Sánchez wrote:
>>
>> I'm trying upload images to a bucket in Cloud Storage from an app in GAE 
>> and I can't find the way to do this.
>> I don't have problems when I try do this with a simple program written in 
>> python using the library gcloud, this work fine and I can see the pictures 
>> in a bucket with the web console but when I try do this inside GAE app (I 
>> install gcloud library in /lib folder before) always I find the same error 
>> when I import the gcloud library to use: 
>>
>> raise ImportError('No module named %s' % fullname)
>> ImportError: No module named cryptography.hazmat.bindings._openssl
>>
>> And I don't undesrtand why when use the library in my localhost this work 
>> fine but not inside GAE app.
>>
>> I thought use JSON API for do this but I want know how is the problem 
>> before to change the way to do this.
>>
>> Thanks you so much for any help, and sorry for my english.
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/cefd4d85-d84e-4720-9e91-abf269f5ad98%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Tardy? Porting to new platform version?

2016-03-30 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Christian,

Thanks for pointing that out. console.developers.google.com now points to 
the API sub-section, with console.cloud.google.com pointing to the main 
dashboard.

Regards,

Nick
Cloud Platform Community Support

On Tuesday, March 29, 2016 at 6:32:10 PM UTC-4, Christian F. Howes wrote:
>
> note that last week google changed console.developers.google.com to 
> redirect to https://console.developers.google.com/apis/library which is 
> not what i am expecting.  you probably want to verify that 
> https://console.cloud.google.com allows you to load your project.
>
> cfh
>
> On Tuesday, March 29, 2016 at 12:21:00 PM UTC-7, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Nick,
>>
>> This sounds like something that could get a quick solution if filed in 
>> the Public Issue Tracker 
>> . You should 
>> capture a HAR recording of the browser interaction 
>>  and explain what 
>> you're attempting to do. Be sure, when you create the issue, to attach the 
>> label "Restrict-View-EditIssue" so that only Google and yourself can 
>> view the thread. We should be able to inspect things from our end and 
>> determine what's at the bottom of this issue. In the meantime, you could 
>> try to visit console.developers.google.com and see if you can see your 
>> projects there. That information will likely be important to the issue when 
>> you report it.
>>
>> Best wishes,
>>
>> Nick
>> Cloud Platform Community Support
>>
>> On Tuesday, March 29, 2016 at 2:35:51 AM UTC-4, Nick Topper wrote:
>>>
>>> Hi,
>>>
>>> In the last few months, is there something I should know about porting 
>>> my old old old GAE apps to a new version of the platform?
>>>
>>> My apps are so stable that I rarely log into the GAE admin-console. 
>>>  Today I did -- first time in a long time -- and see that most of the 
>>> console is disabled, and clicking the link to the new console yields a 
>>> message "You do not have sufficient permissions to view this page."
>>>
>>> I have a vague recollection that Google sent an email several months ago 
>>> about apps needing to be ported to a new something-or-other, but cannot 
>>> find it.  Is there a pointer to a description of the changes, and what I 
>>> need to do?
>>>
>>> Thanks,
>>> NT
>>>
>>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/6733b41e-9cc9-4ec5-876e-5f6323bd7296%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Deployment issues

2016-03-30 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Mayank,

I understand that you've been seeing an error for five hours every day, on 
and off for a few months. This is obviously a problem which is worth 
investigating, and I'm doing everything I can to make sure the issue is 
reported and dealt with in the most efficient, clear, and appropriate way 
possible. This is why I recommended that the full issue detail be posted, 
and in a location where the highest probability of detailed assistance is 
available - that would be bitnami support or a Cloud Platform Public Issue 
Tracker , or Cloud 
Platform Support . Posting to the Cloud 
SDK Groups forum is probably not the best location, since it's unlikely the 
error is originating in the Cloud SDK - the Cloud SDK is merely reporting 
that an error occurred (and again it's worth posting the full debug output 
to potentially see more information). 

As said before, I'll be happy to offer whatever assistance I can here, in 
whatever form I can. Feel free to supply more info and we can try to get to 
the bottom of this.

Sincerely,

Nick
Cloud Platform Community Support

On Wednesday, March 30, 2016 at 1:59:15 AM UTC-4, Mayank Bhagya wrote:
>
> Thanks Nick. 
>
> It is to be expected that errors will occur when dealing with any software 
>> product which is beta (such as gcloud). As well, in a distributed (cloud) 
>> computing environment, connection issues are a fact of life, even for the 
>> best-intentioned developers and companies, and it's not necessarily a 
>> matter of attitude toward quality, which I'm sure we all agree is the most 
>> important factor. 
>>
> I understand that connection errors are a common thing. But if an error 
> occurs for five hours EVERY DAY, then it should probably be looked at with 
> some importance than just waiving it off, attributing it to beta quality or 
> cloud environments.
>  
>
>> The question becomes, how to deal with inevitable connection error 
>> situations? Software should attempt to retry failed connections, generally, 
>> using an incremental backoff scheme to prevent flooding the target server. 
>>  However, when software doesn't behave in this nice way, what's a developer 
>> to do? 
>>
> I understand what fault tolerance is Nick. Thanks for explaining.
>  
>
>> In this case, it appears that a failure to connect to Cloud Storage led 
>> to the entire bitnami-jenkins setup failing. 
>>
> The reason I had directed you to the appropriate channels of support is 
>> because in those locations you will find people expressly-oriented to 
>> addressing your specific issue here, while this forum is meant for more 
>> general discussion of the Google Cloud Platform and services, not specific 
>> technical issues. 
>>
> Alright, I'll write to the google-cloud-sdk group.
>
> When you post to Bitnami support, or Cloud Platform support (this could 
>> also mean the Public Issue Tracker 
>> ), you 
>> should be sure to include all relevant details, such as which command you 
>> are running or which documentation you are following, what version of all 
>> relevant softwares and OS's are involved, etc.
>>
> 'bitnami-jenkins' is a pre-built image offered on google cloud. So the OS 
> is fixed. It comes with google-cloud-sdk installed. So that is also fixed. 
> I'm unsure at this point whether you're following documentation on our side 
> or from Bitnami, if you could clarify that would be great.
> As far as the command is concerned, it is 'gcloud preview app deploy', as 
> visible in the logs.
> The entire thing was setup and functional as per Google's article on 
> 'push-to-deploy' setup. 
> This was setup a few months ago and has been performing on and off with 
> this error.
> The documentation regarding the same has disappeared from the docs now. 
> See this 
> 
> .
>
>
> Anyway, thanks for all the help.
> I'll write this on the google-cloud-sdk group.
>
>
>> All that said, I'll be happy to offer whatever assistance I can here, in 
>> whatever form I can. Feel free to supply more info and we can try to get to 
>> the bottom of this.
>>
>> Regards,
>>
>> Nick
>> Cloud Platform Community Support
>>
>> On Tuesday, March 29, 2016 at 2:49:12 AM UTC-4, Mayank Bhagya wrote:
>>>
>>> Thanks for the reply, Nick.
>>>
>>> While connection issues in a cloud environment are to be expected, the 
 tools we use to make connections should be fault-tolerant although this 
 isn't always automatically the case. 

>>>
>>> Do you mean we should expect these tools to fail?
>>>
>>> Your post didn't make it quite clear exactly how this manifests, as full 
 system and logs context were not given. 

>>>
>>> Well, the appengine push-to-deploy setup, states very clearly, how to 
>>> use 'gcloud' on a compute-engine instance to deploy to appe

Re: [google-appengine] Re: my git repo is empty

2016-03-30 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Andrew,

After attempting a cursory examination, we've determine we'll need more 
info to ensure we're looking at the right parts of the system. Can you 
attempt to clone the repository (gcloud beta source repos clone 
) 
with `--verbosity debug` flag and reply with the output?

Regards,

Nick
Cloud Platform Community Support

On Saturday, March 26, 2016 at 12:11:09 PM UTC-4, Andrew Arrow wrote:
>
> also empty. I think during a transition from old app engine to new 
> gcloud google lost my code? I want to submitt a support request but 
> I'm on free plan. 
>
>
> On 3/26/16, Mihail Russu  wrote: 
> >>Where's my code? 
> > Check the Downloading source code 
> > <
> https://cloud.google.com/appengine/docs/python/tools/uploadinganapp#Python_Downloading_source_code>
>  
>
> > section 
> > to see if it'll help... 
> > 
> > On Saturday, March 26, 2016 at 1:18:16 AM UTC+2, Andrew Arrow wrote: 
> >> 
> >> my site has been running for a year at: 
> >> 
> >> https://static-1064.appspot.com/ 
> >> 
> >> I went to clone the repo: 
> >> 
> >> https://source.developers.google.com/p/static-1064/r/default 
> >> 
> >> and it clones an empty repo. Where's my code? 
> >> 
> >> 
> > 
> > -- 
> > You received this message because you are subscribed to a topic in the 
> > Google Groups "Google App Engine" group. 
> > To unsubscribe from this topic, visit 
> > 
> https://groups.google.com/d/topic/google-appengine/WCz0JORRoQ0/unsubscribe. 
>
> > To unsubscribe from this group and all its topics, send an email to 
> > google-appengine+unsubscr...@googlegroups.com. 
> > To post to this group, send email to google-appengine@googlegroups.com. 
> > Visit this group at https://groups.google.com/group/google-appengine. 
> > To view this discussion on the web visit 
> > 
> https://groups.google.com/d/msgid/google-appengine/5e58dc33-0d0d-4c43-8719-f0c4df7f6638%40googlegroups.com.
>  
>
> > For more options, visit https://groups.google.com/d/optout. 
> > 
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/1554602c-3b85-4a1a-8f75-29a5f05000e3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: my git repo is empty

2016-03-30 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Thanks for the quick reply! We'll update this thread with any further info 
on or before Friday April 8th. If you have any questions or extra 
information until then, feel free to reply with it and we'll be happy to 
assist.

Regards,

Nick
Cloud Platform Community Support

On Wednesday, March 30, 2016 at 2:45:33 PM UTC-4, Andrew Arrow wrote:
>
> sure, 
>
> ~/dev $ gcloud beta source repos clone --verbosity debug default 
> DEBUG: Running gcloud.beta.source.repos.clone with 
> Namespace(__calliope_internal_deepest_parser=ArgumentParser(prog='gcloud.beta.source.repos.clone',
>  
>
> usage=None, description='*(BETA)* Clone project git repository in the 
> current directory.', version=None, formatter_class= 'argparse.HelpFormatter'>, conflict_handler='error', add_help=False), 
> account=None, authority_selector=None, authorization_token_file=None, 
> cmd_func= >, 
> command_path=['gcloud', 'beta', 'source', 'repos', 'clone'], 
> configuration=None, credential_file_override=None, document=None, 
> dry_run=False, dst=None, format=None, h=None, help=None, 
> http_timeout=None, log_http=None, project=None, quiet=None, 
> src='default', trace_email=None, trace_log=None, trace_token=None, 
> user_output_enabled=None, verbosity='debug', version=None). 
> DEBUG: Executing ['git', 'clone', 
> 'https://source.developers.google.com/p/static-1064/r/default', 
> '/Users/aa/dev/default', '--config', 'credential.helper="gcloud.sh"'] 
> Cloning into '/Users/aa/dev/default'... 
> warning: You appear to have cloned an empty repository. 
> Checking connectivity... done. 
> Project [static-1064] repository [default] was cloned to 
> [/Users/aa/dev/default]. 
> INFO: Display format "default". 
>
>
>
> On 3/30/16, 'Nick (Cloud Platform Support)' via Google App Engine 
>  wrote: 
> > Hey Andrew, 
> > 
> > After attempting a cursory examination, we've determine we'll need more 
> > info to ensure we're looking at the right parts of the system. Can you 
> > attempt to clone the repository (gcloud beta source repos clone 
> > <https://cloud.google.com/sdk/gcloud/reference/beta/source/repos/clone>) 
>
> > with `--verbosity debug` flag and reply with the output? 
> > 
> > Regards, 
> > 
> > Nick 
> > Cloud Platform Community Support 
> > 
> > On Saturday, March 26, 2016 at 12:11:09 PM UTC-4, Andrew Arrow wrote: 
> >> 
> >> also empty. I think during a transition from old app engine to new 
> >> gcloud google lost my code? I want to submitt a support request but 
> >> I'm on free plan. 
> >> 
> >> 
> >> On 3/26/16, Mihail Russu  wrote: 
> >> >>Where's my code? 
> >> > Check the Downloading source code 
> >> > < 
> >> 
> https://cloud.google.com/appengine/docs/python/tools/uploadinganapp#Python_Downloading_source_code>
>  
>
> >> 
> >> 
> >> > section 
> >> > to see if it'll help... 
> >> > 
> >> > On Saturday, March 26, 2016 at 1:18:16 AM UTC+2, Andrew Arrow wrote: 
> >> >> 
> >> >> my site has been running for a year at: 
> >> >> 
> >> >> https://static-1064.appspot.com/ 
> >> >> 
> >> >> I went to clone the repo: 
> >> >> 
> >> >> https://source.developers.google.com/p/static-1064/r/default 
> >> >> 
> >> >> and it clones an empty repo. Where's my code? 
> >> >> 
> >> >> 
> >> > 
> >> > -- 
> >> > You received this message because you are subscribed to a topic in 
> the 
> >> > Google Groups "Google App Engine" group. 
> >> > To unsubscribe from this topic, visit 
> >> > 
> >> 
> https://groups.google.com/d/topic/google-appengine/WCz0JORRoQ0/unsubscribe. 
>
> >> 
> >> 
> >> > To unsubscribe from this group and all its topics, send an email to 
> >> > google-appengine+unsubscr...@googlegroups.com. 
> >> > To post to this group, send email to 
> google-appengine@googlegroups.com. 
> >> > 
> >> > Visit this group at https://groups.google.com/group/google-appengine. 
>
> >> > To view this discussion on the web visit 
> >> > 
> >> 
> https://groups.google.com/d/msgid/google-appengine/5e58dc33-0d0d-4c43-8719-f0c4df7f

[google-appengine] Re: Cannot send mail

2016-03-31 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Rob,

I understand your concerns about reliability. I'll do my best to assure you 
that this is not a regular or expected occurrence. Spam detection filters 
will have false positives, but the rate here was not normal and 
corresponded to a hiccup in upgrading our systems. It's generally 
recommended to test any email campaigns on a known receiver before sending 
them to ensure they won't be caught in a filter. If you notice a message 
bouncing which should not, as this thread reinforced, the best thing is to 
immediately get in contact with us via the Public Issue Tracker 
 and we can take a 
look at the message and ensure it clears. Stronger guarantees and minimal 
spam filtering are part of SendGrid's sales pitch as a service 
, and it does very well in these 
areas, this is why it's recommended. 

I hope that this has balanced out any perception of risk and clarified the 
question of choices. Feel free to reply if you have any further questions. 

Sincerely,

Nick
Cloud Platform Community Support

On Monday, March 28, 2016 at 11:24:45 AM UTC-4, Rob Williams wrote:
>
> Hi Nick,
>
> From your link:
>
> "Using SendGrid *can* improve your deliverability and provide 
> transparency into what actually happens to those emails your app sends." 
> That's the extent of the recommendation?
>
> Reading the docs - there's nothing super compelling to try SendGrid. The 
> App Engine Mail API is fully featured and fully documented. If people have 
> followed this documentation and internal changes are going to cripple their 
> apps - this really needs to be made clearer...
>
> Thanks.
>
>
>
> On Thursday, March 24, 2016 at 7:22:08 PM UTC-4, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey All,
>>
>> As some post-mortem analysis as requeset by Gert:
>>
>> These issues just happened to be fixed by a change made to the way the 
>> mail filters determined what was spam and what wasn't. Some points to note:
>>   
>> There is no guarantee it won't happen in the future and GAE doesn't 
>> provide insight into dropped messages for the most part. 
>>
>> The best advice we can really give is to move to Sendgrid if you have a 
>> higher standard requirement for programmatic email sending, and this is 
>> recommended in the documentation. Sendgrid has SLAs and other stuff 
>> surrounding mail delivery which put it above the Mail API, which is 
>> recommended for admin mail and other light tasks. It also gives users more 
>> visibility into what's actually going on with the mail than the Mail API 
>> [1]. 
>>
>> [1] https://cloud.google.com/appengine/docs/php/mail/sendgrid
>>
>> Cheers!
>>
>> Nick
>> Cloud Platform Community Support
>>
>> On Wednesday, March 23, 2016 at 9:35:40 PM UTC-4, Gert wrote:
>>>
>>> For me it's working thanks, can we have a explanation please what went 
>>> wrong?
>>>
>>> On Thursday, March 24, 2016 at 12:25:37 AM UTC+1, Nick (Cloud Platform 
>>> Support) wrote:

 This issue appears to have been resolved. If anybody is still 
 experiencing the issue, feel free to post in the linked PIT thread and / 
 or 
 here and we can look into your specific case.

 Cheers!

 Nick
 Cloud Platform Community Support

 On Wednesday, March 16, 2016 at 12:42:24 PM UTC-4, Nick (Cloud Platform 
 Support) wrote:
>
> Hey All,
>
> Thanks for your reports. We're noticing that there are more than a 
> normal number of reporters on this issue and we're looking into it with a 
> high priority. Feel free to post the specific details of your case in a 
> self-contained comment on the thread linked above (now public again) and 
> we'll take it into account. If, after the resolution of this issue, yours 
> turns out to be slightly different, or persists, feel free to post an 
> entirely separate thread. We'll be, as always, actively monitoring the 
> new 
> threads and will respond quickly with questions or progress updates.
>
> On Tuesday, March 15, 2016 at 11:49:36 AM UTC-4, Rob Williams wrote:
>>
>> Sounds like it's happening to a big number of sites.
>>
>> I wonder how many people it's happening to that just haven't noticed 
>> it yet...
>>
>> On Tuesday, March 15, 2016 at 7:23:35 AM UTC-4, Gert wrote:
>>>
>>> https://code.google.com/p/googleappengine/issues/detail?id=12819
>>>
>>> Can this be a higher priority please then medium. Not be able to 
>>> send confirmation mails is critical to my app
>>>
>>> On Friday, March 11, 2016 at 1:59:56 AM UTC+1, Nick (Cloud Platform 
>>> Support) wrote:

 Hey Mark,

 We continue to look into this issue. The best thing to do would be 
 to create a Public Issue Tracker thread with your specific information 
 so 
 that we can have a focused and clear context in which to track your 
>

Re: [google-appengine] Re: Cannot send mail

2016-04-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Jeff,

While in this case, failure of sending was coming from an unexpected 
direction, prompting engineering action to fix the issue, and leading to 
our recommendations to run test emails before any campaigns, there does 
exist a bounce notification feature 
 which can be 
used to detect the most common email failures. I hope this helps ease your 
concerns. 

Best wishes,

Nick
Cloud Platform Community Support

On Sunday, April 3, 2016 at 12:04:12 PM UTC-4, Jeff Schnitzer wrote:
>
> On Mon, Mar 28, 2016 at 8:24 AM, Rob Williams  
> wrote:
>
>>
>> The App Engine Mail API is fully featured and fully documented. 
>>
>
>
> I hate hearing people say things like this. The _bare minimum_ expected of 
> a service that delivers email is some tracking of whether or not that email 
> was delivered. If you actually care about whether your customers receive 
> the email you are sending, you should not be using the App Engine Mail API. 
> It is not “fully featured”.
>
> Jeff
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/b7c35145-9b6d-48f3-8834-c8b78a31e590%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cannot ENABLE any API when there is a pending request to DISABLE any API

2016-04-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Jacob,

I understand you've run into some kind of issue when using the Developers 
Console. 

The correct way to report an issue in the Developers Console is to either 
use the console's own feedback links, or, better, to capture a HAR 
recording of the tab's activity while experiencing whatever failure action, 
and post this to the Cloud Platform Public Issue Tracker 
. If the issue 
is not so much an action which can be captured in a HAR, screenshots might 
help. 

Google Groups is meant for more high level general discussion of the 
platform and services, and if you post in the issue tracker, you'll be much 
more likely to find assistance and have the issue looked at. Feel free to 
post back here with the link to the thread once it's created, and I'll be 
happy to help take a look.

Best wishes,

Nick
Cloud Platform Community Support

On Sunday, April 3, 2016 at 5:45:47 PM UTC-4, Jacob Ferrero wrote:
>
> My project got stuck in a state where it thinks it's disabling an API. 
>  This means I cannot enable any API! I can't continue developing until this 
> is resolved. :(
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/835fdba4-c00f-414d-94d9-24a2a0059f8a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cloud SQL in App Engine Flexible Environment + Custom Docker

2016-04-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
This is interesting. It appears possible, but I can't confirm (and I'm not 
sure if you can, any longer), that even after enabling the beta_setting and 
attempting a socket connection, the IP of the Managed VM instance had 
changed, not being a static IP but ephemeral, resulting in the instance 
refusing connection. If possible, could you share the logs of the errors 
you saw? To answer your posts' ending question, Cloud SQL with Flexible 
Environment  apps is 
supported as a beta feature for now in Python, Node.js, and Go, while Java 
is not yet supported 
.



On Monday, April 4, 2016 at 2:59:12 AM UTC-4, Prashant V wrote:
>
> I was trying to get a cloud sql instance working inside of a container 
> running on App Engine Flexible Environment, and hit a few issues:
>
> First, I couldn't find /cloudsql directory containing unix sockets at all. 
> I'm not sure if this is in custom containers by default?
> https://cloud.google.com/appengine/docs/python/cloud-sql/
>
> I managed to get something working by finding a beta_settings key in 
> app.yaml and set it to:
>
> beta_settings:
> │
>
>   cloud_sql_instances: ::
>
>
> This led to the /cloudsql directory existing, but the contents didn't 
> match what I expected, I expected /cloudsql/:, but it 
> had  in the middle.
>
>
> After all that, it still failed to connect, giving me errors that the 
> remote mysql had gone away (even though the app was definitely in the 
> authorized list).
>
>
> I ended up connecting via IP as a workaround, but I'd like to get this 
> working with the socket. Is Cloud SQL supported in the Flexible Environment?
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/3b5721e2-e6a8-4521-a8aa-6ad0afd6e42e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Google App Engine instances stuck when using disable/enable from Settings

2016-04-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Su-Au,

I understand you're experiencing some issues with Managed VMs (now "Flexible 
Environment "). You have 
experienced several errors and are seeing some different symptoms in the 
Developers Console. The best way to report an issue is to make a thread in 
the Cloud Platform Public Issue Tracker 
, providing 
all relevant information such as the errors you've seen, what you have done 
in chronological order, possibly relevant screenshots, and any other 
details you think might be relevant. 

The reason you should post to the Public Issue Tracker (PIT) rather than in 
this Groups forum is because the PIT is explicitly designed for issue 
reporting and is regularly triaged by engineering and support. This forum 
(Groups) is meant for more high level and general discussion of the 
platform, rather than specific issue technical support.

When you post to the Public Issue Tracker, feel free to reply back to this 
thread with the link to the thread, and I'll be happy to look into this 
thread. 

Best wishes,

Nick
Cloud Platform Community Support

On Monday, April 4, 2016 at 5:54:17 AM UTC-4, Su-Au Hwang wrote:
>
> Hi,
> I disabled my App Engine Application last night, and today tried to 
> re-enable it using the settings in at console.cloud.google.com. This is 
> when the instances get stuck though.
> I have 2 modules, the default module is a PHP MVM and the api module is a 
> NodeJS module, both on autoscale.
> App Engine correctly starts up 2 instances for each, but they are stuck 
> and never reachable. The name from the console > instances never appears.
> I tried twice, each time waiting over 30 minutes to no avail.
> I have been able to get the api module back working by redeploying with 
> gcloud from my local machine. Re-deployment for the default app has failed 
> twice already, with different errors, so i'll keep on trying.
>
> Did anyone experience similar issues with MVM ?
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/1c9aeddd-4f24-42c4-b31a-5b8d08709ace%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: I'm a Devops Engineer - I must wrestle GAE to the ground - Hints and Tips Please

2016-04-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Mister Guru,

The subreddit is not actively monitored by Cloud Platform Community Support 
as far as I know, so it's natural that it'd be quite inactive. However, we 
do actively monitor:

* this forum and a handful of other Google Groups related to the Cloud 
Platform, 

* a whole lot of relevant tags on Stack Overflow  
/ Severfault , and 

* a bunch of Public Issue Trackers (App Engine 
, Cloud Platform 
, Google Cloud 
SDK , Cloud SQL 
, BigQuery 
, to name a few)

So you definitely aren't alone if you want to discuss high level and 
general topics, get help with technical questions, or report issues (to go 
in order of the above by their purposes).

As far as deploying WAR files, you can deploy *unpacked *war files (a war 
folder) using the appcfg 
 tool. 
In getting used to the platform in general, you should make use of the 
mountains of documentation on all kinds of topics that you might want to 
learn about. For someone new to the platform, I'd recommend going through 
some tutorials 
, 
or reading some of the main docs from the side-bar of the docs site.

I hope this has been a helpful introduction to the community at a glance 
and a quick response to your question about maven deployments and war 
files. Let me know if there's anything else I can help with!

Cheers,

Nick
Cloud Platform Community Support

On Monday, April 4, 2016 at 10:18:31 AM UTC-4, Mister Guru wrote:
>
> I'm trying to do some research on GAE - I've inherited the responsibility 
> of maintenance of the infrastructure, and to my delight, (or horror, 
> depending on how you see it), not much documentation existed regarding 
> setup, configuration etc. This means that I have to take the time to learn, 
> document, and script using GAE.
>
> I checked out reddit - https://www.reddit.com/r/gae/ - Which made me very 
> sad, I was hoping for a vibrant community of users.
>
> I'm not a developer, I'm a system admin person - the one thing that is 
> grinding my gears at the moment, is deployments.
>
> I'm a little upset that I can't just go  run it> From what the devs have told me, deployments are integrated into 
> Maven build process ... already I was like ... *huh* - I don't even know 
> what that means. anyway, I digress,
>
> I'd like to know *Is the only way to deploy to GAE via the maven build 
> job*? It would be a 'shame' if that's the case, but as I'm not up to 
> speed with how java apps are suppose to work, best practices and such, I'm 
> not sure if I'm the one looking at it incorrectly. I've also got a few 
> other questions, but I'm testing the water with this first. I could easily 
> run our workloads on Kubernetes or Mesos, so I'm judging GAE purley on the 
> people who use it! (very professional and scientific, I know!)
>
> If there are any other devops guys in here specifically working on 
> deployments and scripting around GAE, I would like to have a word with you 
> - maybe exchange ideas etc
>
> Thanks,
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/f25cb2f9-4245-4f5f-b12c-ddfd0b93d732%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: How many requests can GAE Datastore handle simultaneously?

2016-04-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey TH,

The Datastore does have restrictions on concurrent modifications 
, but as 
far as read operations, there is an unlimited quota 
 when billing is 
enabled. As long as you can provision enough reading apps, you should be 
able to successfully run the script without hitches, although you'll want 
to experiment and profile with the system to determine what bottlenecks 
might exist in your script's logic. You could look into Memcache as well, 
as a potential middle layer to speed up the reads. 

Let me know if you still have questions and I'll be happy to help.

Sincerely,

Nick
Cloud Platform Community Support



On Monday, April 4, 2016 at 10:59:19 AM UTC-4, TH TH wrote:
>
>
> So I have 25,000 .py scripts running at the same time every 2 minutes as 
> CRON jobs (distributed equally over 1000 servers)
>
> They all have to access the same DB at the same time, ONLY to READ from 
> db, not to write.
>
> So I was wondering if Google Datastore (for example) could handle this? 
> 25000 requests to the same DB at the same time just to read?
>
> I couldnt find this in Google's AE docs.
>
> Best Regards
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/52eed60f-a8ce-4a9a-bb11-792abbf72187%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: NPE when calling getLogger().info() from my application

2016-04-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
This certainly looks like an internal issue. While it would have been best 
to post to the Public Issue Tracker, we can use this thread to work on the 
issue until it's clarified. Can somebody post code which will be able to 
reproduce the issue? I've attempted to simply run Logger.info() and have 
not observed the behaviour.

Regards,

Nick
Cloud Platform Community Support

On Friday, April 1, 2016 at 3:19:43 AM UTC-4, Jean-Remi Malzieu wrote:
>
> Hi,
>
> Everything was working properly until this morning. I didn't update my 
> application.
> It seems that the logging mechanism has been broken since when I 
> call Logger.getLogger().info() I get the following stacktrace :
>
> java.lang.NullPointerException
>   at 
> com.google.apphosting.api.source.SourcePb$SourceLocation.setFile(SourcePb.java:139)
>   at 
> com.google.apphosting.runtime.AppLogsWriter.getSourceLocationProto(AppLogsWriter.java:380)
>   at 
> com.google.apphosting.runtime.AppLogsWriter.addLogRecordAndMaybeFlush(AppLogsWriter.java:183)
>   at 
> com.google.apphosting.runtime.ApiProxyImpl$EnvironmentImpl.addLogRecord(ApiProxyImpl.java:993)
>   at com.google.apphosting.runtime.ApiProxyImpl.log(ApiProxyImpl.java:660)
>   at com.google.apphosting.runtime.ApiProxyImpl.log(ApiProxyImpl.java:73)
>   at com.google.apphosting.api.ApiProxy.log(ApiProxy.java:208)
>   at 
> com.google.apphosting.runtime.security.shared.intercept.java.util.logging.DefaultHandler.publish(DefaultHandler.java:51)
>   at java.util.logging.Logger.log(Logger.java:616)
>   at java.util.logging.Logger.doLog(Logger.java:641)
>   at java.util.logging.Logger.log(Logger.java:664)
>   at java.util.logging.Logger.info(Logger.java:1182)
>
>
> Am I the only one having this issue? So far, I disabled the traces from 
> the application, and it seems everything else is working. 
>
> Thank you for your help
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/339cb8cb-0e68-4c56-b1ad-b07e5de719ef%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: GAE Devlopment server binding LAN IP adress

2016-04-04 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Prakash,

It's not clear to me exactly what's happening here, from the description. 
I'm willing to assist with some useful questions, but first I must clarify 
that this forum isn't really the right place for specific-issue technical 
support. Your question seems suited to Stack Overflow 
, and should be posted there, but with enough 
information that someone on the other side of the net can understand the 
system through the description and information provided. 

We monitor many tags on Stack Overflow quite closely, and more than this, 
there's an entire user-base of people willing to help who might have seen 
the same issue as you're describing and solved it. If you post there, feel 
free to post the link here and I can take a look. Now, as to the 
information which is missing, it's mostly because I'm not familiar with 
exactly what process you're using to develop the app and run the devserver. 
If you'd like, you could upload an example skeleton application to github 
with instructions on how to reproduce, which is a best practice for 
reporting issues to other users online.

If you have any questions or comments, don't hesitate to ask and I'll be 
happy to assist in any way I can. Cheers!

Nick
Cloud Platform Community Support


On Monday, April 4, 2016 at 11:17:42 AM UTC-4, Prakash A wrote:
>
> Thanks for your reply, Thomas.
>
> Answer provided by you is the main objective of the need. However, the way 
> it shall be done is the problem comes in Eclipse.
>
> If you provide the --address=x.x.x.x, it will be stripped in the VM 
> arguments. Solution, they provided an option text box, where the IP address 
> can be entered. See image. when you enter the IP address, you can see the 
> --address argument is added in the VM arguements. Upto now is perfect.
>
> When we start the server, with LAN IP address entered, "start operation" 
> starts, development server started message is displayed. However, the 
> operation is not completed (I mean to say the process bar is running at 
> 100% display). After some time, operation time exceeds the time limit, and 
> the server stopped throwing an error.
>
> Thats the story. Hope, now you understand the problem, and where I am 
> facing the issue.
>
>
> 
>
>
>
> On Saturday, April 2, 2016 at 5:37:25 PM UTC+5:30, Thomas Taschauer wrote:
>>
>> Sounds like you want to expose your development server to your LAN, is 
>> that correct? If so, try this: 
>> https://cloud.google.com/appengine/docs/java/tools/devserver#Command_Line_Arguments
>>  
>> and http://stackoverflow.com/a/30578856/198996
>>
>> On Friday, April 1, 2016 at 2:05:40 PM UTC+2, Prakash A wrote:
>>>
>>> Developing an Web App Dynamic Module using core Java. Created the 
>>> development server appropriately.
>>>
>>> When I start the server, it runs perfectly.
>>>
>>> However, when I set the "Local Interface address to bind to" value (I 
>>> have entered a proper value), the server starts (I can see "Dev App Server 
>>> is now running" in the console), and then the process shows an error with 
>>> timeout. 
>>>
>>> I see this happening, when I enter the bind to IP address value.
>>>
>>> I try to increase the Start Timeout from 240s to 480s. Still same issue.
>>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/1ad0f5b2-7920-4d3f-9cbf-ee505ddc18e5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: How many requests can GAE Datastore handle simultaneously?

2016-04-05 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey TH,

I'm not sure what you mean by "install and load modules". Perhaps this docs 
page  on 
libraries in python27 will help you with that question, although feel free 
to clarify if I missed your meaning. There shouldn't be any differences for 
python3, given the differences between 3.x and 2.x 
 wouldn't 
impact anything in the doc.

As to using Datastore with python, this is definitely possible, via the 
Cloud Datastore REST API 
, or via the gcloud 
 python library, or 
via the google api client library 
 for python to 
connect to the API, or via the ndb 
 package. There are 
many means of connecting to Datastore.

I hope this has been helpful. Feel free to let me know if you have any 
further questions.

Regards,

Nick
Cloud Platform Community Support

On Monday, April 4, 2016 at 5:08:04 PM UTC-4, TH TH wrote:
>
> Is there a way to use Datastore inside Python 3? If so, how can install 
> and load modules?
>
> On Monday, April 4, 2016 at 8:49:43 PM UTC+2, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey TH,
>>
>> The Datastore does have restrictions on concurrent modifications 
>> , but as 
>> far as read operations, there is an unlimited quota 
>>  when billing 
>> is enabled. As long as you can provision enough reading apps, you should be 
>> able to successfully run the script without hitches, although you'll want 
>> to experiment and profile with the system to determine what bottlenecks 
>> might exist in your script's logic. You could look into Memcache as well, 
>> as a potential middle layer to speed up the reads. 
>>
>> Let me know if you still have questions and I'll be happy to help.
>>
>> Sincerely,
>>
>> Nick
>> Cloud Platform Community Support
>>
>>
>>
>> On Monday, April 4, 2016 at 10:59:19 AM UTC-4, TH TH wrote:
>>>
>>>
>>> So I have 25,000 .py scripts running at the same time every 2 minutes as 
>>> CRON jobs (distributed equally over 1000 servers)
>>>
>>> They all have to access the same DB at the same time, ONLY to READ from 
>>> db, not to write.
>>>
>>> So I was wondering if Google Datastore (for example) could handle this? 
>>> 25000 requests to the same DB at the same time just to read?
>>>
>>> I couldnt find this in Google's AE docs.
>>>
>>> Best Regards
>>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/4477bccf-1fbf-4477-94b9-27b827dc70b9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Google App Engine instances stuck when using disable/enable from Settings

2016-04-05 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Su-Au,

Just read the issue now, and I'm glad to hear you have a workaround. We'll 
be active on the issue thread shortly to investigate and add a tracking 
number. Thanks for your report!

Nick
Cloud Platform Community Support

On Tuesday, April 5, 2016 at 1:08:07 AM UTC-4, Su-Au Hwang wrote:
>
> Thank you Nick for the help,
>
> here is the link: 
> https://code.google.com/p/google-cloud-platform/issues/detail?id=53&thanks=53&ts=1459832530
> as mentioned earlier I've successfully redeployed my application using 
> gcloud, but I wonder if auto scaling works properly or instance provision 
> is buggy in it self.
> Hopefully we can get the kinks out of the beta and go GA asap.
>
> Su-Au
>
> On Tuesday, April 5, 2016 at 12:47:23 AM UTC+8, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Su-Au,
>>
>> I understand you're experiencing some issues with Managed VMs (now "Flexible 
>> Environment "). You 
>> have experienced several errors and are seeing some different symptoms in 
>> the Developers Console. The best way to report an issue is to make a thread 
>> in the Cloud Platform Public Issue Tracker 
>> , providing 
>> all relevant information such as the errors you've seen, what you have done 
>> in chronological order, possibly relevant screenshots, and any other 
>> details you think might be relevant. 
>>
>> The reason you should post to the Public Issue Tracker (PIT) rather than 
>> in this Groups forum is because the PIT is explicitly designed for issue 
>> reporting and is regularly triaged by engineering and support. This forum 
>> (Groups) is meant for more high level and general discussion of the 
>> platform, rather than specific issue technical support.
>>
>> When you post to the Public Issue Tracker, feel free to reply back to 
>> this thread with the link to the thread, and I'll be happy to look into 
>> this thread. 
>>
>> Best wishes,
>>
>> Nick
>> Cloud Platform Community Support
>>
>> On Monday, April 4, 2016 at 5:54:17 AM UTC-4, Su-Au Hwang wrote:
>>>
>>> Hi,
>>> I disabled my App Engine Application last night, and today tried to 
>>> re-enable it using the settings in at console.cloud.google.com. This is 
>>> when the instances get stuck though.
>>> I have 2 modules, the default module is a PHP MVM and the api module is 
>>> a NodeJS module, both on autoscale.
>>> App Engine correctly starts up 2 instances for each, but they are stuck 
>>> and never reachable. The name from the console > instances never appears.
>>> I tried twice, each time waiting over 30 minutes to no avail.
>>> I have been able to get the api module back working by redeploying with 
>>> gcloud from my local machine. Re-deployment for the default app has failed 
>>> twice already, with different errors, so i'll keep on trying.
>>>
>>> Did anyone experience similar issues with MVM ?
>>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/5eaeaded-8d95-4327-90e1-0923428e82a3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Cloud SQL in App Engine Flexible Environment + Custom Docker

2016-04-05 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Prashant,

Usually issues are reported in the Public Issue Tracker 
, rather than in 
Groups as here, but it turns out that the information you've provided is 
very close to adequate for a Public Issue Tracker report, and I can just go 
ahead and use it to create an issue tracker thread, once I reproduce the 
behaviour. In order to make sure I do so properly, however, could you just 
let me know what changes you'd made to the example app before deploying?

Once I've got that information and got the issue reproduced and a tracking 
thread made in the Public Issue Tracker, I'll post it back here so you can 
star the issue to follow it.

Cheers!

Nick
Cloud Platform Community Support

On Tuesday, April 5, 2016 at 12:07:41 AM UTC-4, Prashant V wrote:
>
> I treid out a python app to see whether it was a runtime specific issue. I 
> created a simple app based on the sample app here: 
> https://github.com/GoogleCloudPlatform/python-docs-samples/tree/master/managed_vms/cloudsql
>
> It also failed with a similar error which leads me to believe that this is 
> just an issue with the App Engine flexible environment when trying to 
> access CloudSQL. 
>
> Exception from python:
>
> Traceback (most recent call last):
>>
>>   File "/env/lib/python3.4/site-packages/sqlalchemy/engine/base.py", line 
>> 2074, in _wrap_pool_connect
>> return fn()
>>   File "/env/lib/python3.4/site-packages/sqlalchemy/pool.py", line 376, 
>> in connect
>> return _ConnectionFairy._checkout(self)
>>   File "/env/lib/python3.4/site-packages/sqlalchemy/pool.py", line 713, 
>> in _checkout
>> fairy = _ConnectionRecord.checkout(pool)
>>   File "/env/lib/python3.4/site-packages/sqlalchemy/pool.py", line 480, 
>> in checkout
>> rec = pool._do_get()
>>   File "/env/lib/python3.4/site-packages/sqlalchemy/pool.py", line 1060, 
>> in _do_get
>> self._dec_overflow()
>>   File "/env/lib/python3.4/site-packages/sqlalchemy/util/langhelpers.py", 
>> line 60, in __exit__
>> compat.reraise(exc_type, exc_value, exc_tb)
>>   File "/env/lib/python3.4/site-packages/sqlalchemy/util/compat.py", line 
>> 184, in reraise
>> raise value
>>   File "/env/lib/python3.4/site-packages/sqlalchemy/pool.py", line 1057, 
>> in _do_get
>> return self._create_connection()
>>   File "/env/lib/python3.4/site-packages/sqlalchemy/pool.py", line 323, 
>> in _create_connection
>> return _ConnectionRecord(self)
>>   File "/env/lib/python3.4/site-packages/sqlalchemy/pool.py", line 449, 
>> in __init__
>> self.connection = self.__connect()
>>   File "/env/lib/python3.4/site-packages/sqlalchemy/pool.py", line 607, 
>> in __connect
>> connection = self.__pool._invoke_creator(self)
>>   File 
>> "/env/lib/python3.4/site-packages/sqlalchemy/engine/strategies.py", line 
>> 97, in connect
>> return dialect.connect(*cargs, **cparams)
>>   File "/env/lib/python3.4/site-packages/sqlalchemy/engine/default.py", 
>> line 385, in connect
>> return self.dbapi.connect(*cargs, **cparams)
>>   File "/env/lib/python3.4/site-packages/pymysql/__init__.py", line 88, 
>> in Connect
>> return Connection(*args, **kwargs)
>>   File "/env/lib/python3.4/site-packages/pymysql/connections.py", line 
>> 679, in __init__
>> self.connect()
>>   File "/env/lib/python3.4/site-packages/pymysql/connections.py", line 
>> 890, in connect
>> self._get_server_information()
>>   File "/env/lib/python3.4/site-packages/pymysql/connections.py", line 
>> 1190, in _get_server_information
>> packet = self._read_packet()
>>   File "/env/lib/python3.4/site-packages/pymysql/connections.py", line 
>> 946, in _read_packet
>> packet_header = self._read_bytes(4)
>>   File "/env/lib/python3.4/site-packages/pymysql/connections.py", line 
>> 982, in _read_bytes
>> 2013, "Lost connection to MySQL server during query")
>> pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server 
>> during query')
>>
>>
> On Monday, 4 April 2016 20:52:48 UTC-7, Prashant V wrote:
>>
>> Thanks for the reply Nick. Here's the exact error from the container,
>>
>>> Warning: mysqli::mysqli(): MySQL server has gone away in 
>>> /var/www/html/test.php on line 2
>>> Warning: mysqli::mysqli(): Error while reading greeting packet. PID=222 
>>> in /var/www/html/test.php on line 2
>>> Warning: mysqli::mysqli(): (HY000/2006): MySQL server has gone away in 
>>> /var/www/html/test.php on line 2
>>
>>
>> I'm using a custom docker container for Wordpress (so PHP), and tried a 
>> manual PHP script which produced that.
>>
>> I changed my database settings to allow all (0.0.0.0/0), and tried a 
>> user that can connect remotely (verified from my local machine).
>>
>> It doesn't really give a very helpful error, I think the error logs are 
>> on the server side. I can give you the database ID off-thread if you'd like.
>>
>> On Monday, 4 April 2016 09:21:06 UTC-7, Nick (Cloud Platform Support) 
>> wrote:
>>>
>>> This is interesting. It appea

[google-appengine] Re: Clarifying projection query cost?

2016-04-06 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hi Alex,

I believe this old App Engine Groups thread 

 
answers your question adequately. Let me know if you have any questions 
after reading.

Cheers,

Nick
Cloud Platform Community Support 

On Wednesday, April 6, 2016 at 10:12:15 AM UTC-4, Alex Kerr wrote:
>
> Hi,
>
> Can anyone clarify the cost of projection queries please? (both in 
> operations and financially)
>
> Datastore pricing page at: https://cloud.google.com/datastore/docs/pricing 
> says a regular query (is that "SELECT * " ?) is 1 read + 1 read per entity 
> retrieved. I get that, but then projection queries are just "1 read" - 
> which implies a cost of 1 read total regardless of the number of results 
> returned and the number of properties projected - that can't be right?
>
> Also I note the new pricing section from July but still not clear on 
> projection query cost!
>
> Many thanks
> Alex
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/48249ab8-29d6-4362-9ba2-5f628f794fc6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: New Datastore Pricing July 1st 2016

2016-04-06 Thread &#x27;Nick (Cloud Platform Support)&#x27; via Google App Engine
Hey Marcel,

While I can't authoritatively comment on why the price structure is the way 
it is, as a humble Community Support team member, I *can *attempt to 
provide some assistance if you'd like to discuss some issues related to 
this situation. I'm curious what it is about your app which has it using 
Datastore on the order of TB's of storage? I'd love to see if we can 
determine whether there might be a more efficient way to store the data 
which is currently going into Datastore. Feel free to reply with a 
description of your data and requirements and perhaps I can help guide a 
migration to a cheaper service for your needs.

Cheeers,

Nick
Cloud Platform Community Support

On Monday, April 4, 2016 at 11:42:22 AM UTC-4, Marcel Manz wrote:
>
> Hello
>
> We're glad to see that Google announced a reduced Datastore pricing, 
> starting July 1st 2016:
>
>
> https://cloudplatform.googleblog.com/2016/03/Google-Cloud-Datastore-simplifies-pricing-cuts-cost-dramatically-for-most-use-cases.html
>
> Finally the costs are entity based, regardless of amount of properties and 
> indexes involved. Big Kudos also on the newly introduced 'Entity deletes' 
> pricing, to finally enable us to delete / offload entities no longer used, 
> an operation which after years of operation was becoming for many use cases 
> too expensive.
>
> Unfortunately Google decided to keep the pricing per Stored GB at $0.18 
> month, which still means $180 monthly per TB stored. We're having a bit of 
> concern seeing no cost reduction on this part, especially as announcements 
> on BigQuery side are made where 'historical data storage' now costs as less 
> as $0.01 per month, 18x cheaper than DataStore, with no performance 
> reduction:
>
>
> https://cloud.google.com/blog/big-data/2016/03/google-bigquery-cuts-historical-data-storage-cost-in-half-and-accelerates-many-queries-by-10x
>
> https://cloud.google.com/bigquery/pricing#long-term-storage
>
> Can Google please comment on what justifies a 9 to 18 times higher storage 
> pricing on Datastore compared to BigQuery? I assume both systems are highly 
> distributed and make use of similar storage layers on Google side. How come 
> BigQuery became so cheap, while Datastore Storage is still incredibly 
> expensive? Not to mention that loading operations are even free on BigQuery 
> side.
>
> We would love to store a massive amount of data in our App Engine 
> Datastore, but at a price of $180 per Terabyte we will be forced to offload 
> data from Datastore to some cheaper storage system for long-term retrieval.
>
> A reduction of Datastore Storage Pricing would be highly appreciated.
>
> Best regards,
> Marcel
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/9b11830c-bd6e-46b9-8bb5-de00e587d684%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


  1   2   3   4   5   6   >