[google-appengine] How to change the version of Jetty in my Google App Engine

['Mike Wallace' via Google App Engine]

Within IntelliJ I have a Google App Engine Standard Local Server running. 
I'm in the process of updating to Java 17 and also all of my 3rd party 
libraries and have moved to GAE 2.0.5 and Jetty 11.0.11 in all of my 
project's pom files. However, when I start up the server I see: 

INFO:oejs.Server:main: jetty-9.4.46.v20220331 

and I'm getting failures that seem to confirm the above, that an older 
version of Jetty is being used. Where can I update the Jetty version that 
the app engine uses? 

Here's the stack trace. The latest versions should be using 
jakarta.ws.rs.Path instead of javax.

java.lang.TypeNotPresentException: Type javax.ws.rs.Path not present at 
java.base/sun.reflect.annotation.TypeNotPresentExceptionProxy.generateException(TypeNotPresentExceptionProxy.java:47)
 
at 
java.base/sun.reflect.annotation.AnnotationInvocationHandler.invoke(AnnotationInvocationHandler.java:89)
 
at jdk.proxy2/jdk.proxy2.$Proxy2.value(Unknown Source) at 
org.eclipse.jetty.annotations.AnnotationConfiguration.createServletContainerInitializerAnnotationHandlers(AnnotationConfiguration.java:579)
 
at 
org.eclipse.jetty.annotations.AnnotationConfiguration.configure(AnnotationConfiguration.java:343)
 
at org.eclipse.jetty.webapp.WebAppContext.configure(WebAppContext.java:498) 
at 
org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1409) 
at 
org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:916)
 
at 
org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:288)
 
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524) 
at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
 
at 
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
 
at 
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
 
at 
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
 
at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
 
at 
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
 
at org.eclipse.jetty.server.Server.start(Server.java:423) at 
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
 
at 
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
 
at org.eclipse.jetty.server.Server.doStart(Server.java:387) at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
 
at 
com.google.appengine.tools.development.jetty9.JettyContainerService.startContainer(JettyContainerService.java:366)

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/3ec6a90b-9617-480e-9771-3a39f941c576n%40googlegroups.com.

[google-appengine] Usage Reports On GAE Network Utilization

['Mike Berman' via Google App Engine]

Trying to do some network estimation per user. We are having troubles 
tracking down network utilization broken down by GAE service. I have 
enabled daily usage reports, however, not seeing anything specific to GAE 
services. Does anyone know how to access?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/527864ef-cf5c-4df2-abcd-c56ba0587dbbn%40googlegroups.com.

[google-appengine] ImportError OpenCV libraries when deploying application via Google App

[Mike Borisov]

Hi!

I'm tried to deploy my flask+opencv (python 3.8) application via GoogleApp, 
but recieve strange error: 

ERROR: (gcloud.app.deploy) Error Response: [9] 
Application startup error! Code: APP_CONTAINER_CRASHED
Traceback (most recent call last):
  File "app.py", line 6, in 
from video_proc import *
  File "/home/vmagent/app/video_proc.py", line 1, in 
import cv2
  File "/env/lib/python3.7/site-packages/cv2/__init__.py", line 5, in 

from .cv2 import *
ImportError: libGL.so.1: cannot open shared object file: No such file or 
directory


Looks like docker container in GoogleApp havent needed library for OpenCv. 
Any ideas, how to fix it? 
Thanks

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/1ed3aeba-b98a-4a97-acc9-dc243588cbbfn%40googlegroups.com.

[google-appengine] Why would the same exact Firebase Function take 10x as long to run using a schedule/onRun trigger than a HTTP onRequest trigger?

[Mike CS]

I have 2 identical Firebase functions that batch write data to Firestore. One 
is wrapped in a scheduled/onRun trigger, and the other is a HTTP onRequest 
trigger. Other than that, both functions are exactly the same, copy & pasted.

They have the same amount of memory and timeout as well.

When invoking the http trigger, the function runs through and completes in 
about 30 seconds.

When invoking the scheduled onRun trigger, the function takes 5+ minutes to 
complete.

I have tried console logging every single step of the process and there is no 
difference in anything other than the scheduled function taking 10x longer.

Is there something different about the runtimes that is not documented or 
something?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/b30e8d42-c633-409e-a1a7-1152ae571770%40googlegroups.com.

[google-appengine] Why would the same exact Firebase Function take 10x as long to run using a schedule/onRun trigger than a HTTP onRequest trigger?

[Mike CS]

I have a 2 identical Firebase functions that batch write data to Firestore. 
One is wrapped in a scheduled/onRun trigger, and the other is a HTTP 
onRequest trigger. Other than that, both functions are exactly the same, 
copy & pasted.

They have the same amount of memory and timeout as well.

When invoking the http trigger, the function runs through and completes in 
about 30 seconds.

When invoking the scheduled onRun trigger, the function takes 5+ minutes to 
complete.

I have tried console logging every single step of the process and there is 
no difference in anything other than the scheduled function taking 10x 
longer.

Is there something different about the runtimes that is not documented or 
something?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a840f5fd-4fa7-4c31-b33e-869908fd07be%40googlegroups.com.

[google-appengine] After upgrading App Engine from PHP 5.5 tot 7.2/7.3 "glob()" no longer works, any way to get it to work?

[Mike Hergaarden]

After upgrading App Engine from the PHP 5.5 runtime to PHP 7.2 or PHP 7.3 
the PHP function glob (https://www.php.net/manual/en/function.glob.php) no 
longer works and this is a big problem for our systems.
We used to search in the Cloud Storage files a lot, glob was very quick, 
but using the Google Cloud Storage PHP API directly only gives my a prefix 
to filter fields and yields much slower searches (resulting in timeouts).

Is there any way to get glob() working on App Engine PHP 7.3?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/29dc1ee2-19bf-4792-977e-0629f77ff4b1%40googlegroups.com.

[google-appengine] Project Missing from Dashboard

[Mike Wood]

I've a Google Job Search API  project which a previous employee created 
that I need to update - but it's not appearing in the dashboard. 
I know the project exists, as I'm the billing contact for it (so I pay for 
it), and google send me an email to say it needs migrating to the latest
I know the project name / ID, but for the life of me, I cant see where it 
is!
I'm assuming it's a permissions thing, but I'm and admin, and would assume 
I could see every project.

Any pointers would be very much appreciated.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/dd2a309e-1c64-4cb8-aa07-14c8c83a0f95%40googlegroups.com.

[google-appengine] Re: Laradock / Laravel deploy to App Engine Flexible not working

[Mike P]

Well. After hours of trying a bunch of different things, I emptied my head, 
sat down again and started at the beginning. It was then I realized how 
stupid I've been.

Anyhow, the extension bcmath was missing. I thought I read somewhere that 
by default, the bcmath extension was turned on in the Google App Engine's 
PHP runtime. This was not the case.

So after slowly reading this 
https://cloud.google.com/appengine/docs/flexible/php/runtime I figured out 
that all I needed to do was enable the bcmath extension in my composer.json 
as Google Cloud reads from this file.

"name": "laravel/laravel",
"description": "The Laravel Framework.",
"keywords": ["framework", "laravel"],
"license": "MIT",
"type": "project",
"require": {
"php": "^7.1.3",
"fideloper/proxy": "^4.0",
"laravel/framework": "5.7.*",
"laravel/telescope": "^1.0",
"laravel/tinker": "^1.0",
"ext-bcmath": "*"
},

I added the "ext-bcmath", deployed the app and it worked!

On Monday, January 14, 2019 at 11:10:21 PM UTC+1, Mike P wrote:
>
> I'm trying to deploy my new Laravel project, however it fails as apparently 
> 'bcmath' is missing.
>
>
> I tried copying laradock's php.ini in the root of my project, but it doesn't 
> seem to work. Any clue on how I can fix this? I've been at this for a couple 
> of hours.
>  
>
> *This is the log:*
>
> starting build "bf1c72af-78f7-488b-bf02-8d0277ffbafe"
>
> FETCHSOURCE
> Fetching storage object: 
> gs://staging.wab-taco.appspot.com/eu.gcr.io/wab-taco/appengine/default.20190114t151355:latest#1547475265031675
> Copying 
> gs://staging.wab-taco.appspot.com/eu.gcr.io/wab-taco/appengine/default.20190114t151355:latest#1547475265031675...
> / [0 files][ 0.0 B/ 20.2 MiB] 
> / [0 files][264.0 KiB/ 20.2 MiB] 
> -
> - [0 files][ 4.1 MiB/ 20.2 MiB] 
> \
> \ [1 files][ 20.2 MiB/ 20.2 MiB] 
> Operation completed over 1 objects/20.2 MiB. 
> BUILD
> Starting Step #0
> Step #0: Pulling image: 
> gcr.io/gcp-runtimes/php/gen-dockerfile@sha256:d699fc436cdad6ca70ba189f792e9a38baefd5339ee7145570c569aefcc45a36
> Step #0: 
> sha256:d699fc436cdad6ca70ba189f792e9a38baefd5339ee7145570c569aefcc45a36: 
> Pulling from gcp-runtimes/php/gen-dockerfile
> Step #0: Digest: 
> sha256:d699fc436cdad6ca70ba189f792e9a38baefd5339ee7145570c569aefcc45a36
> Step #0: Status: Downloaded newer image for 
> gcr.io/gcp-runtimes/php/gen-dockerfile@sha256:d699fc436cdad6ca70ba189f792e9a38baefd5339ee7145570c569aefcc45a36
> Step #0: + php /builder/create_dockerfile.php create --php72-image 
> gcr.io/google-appengine/php72@sha256:0f0d6c07035fd5138d917b4d539f4473ca13528f11c26c92be54b9e33c0f722b
>  --php71-image 
> gcr.io/google-appengine/php71@sha256:5531e7edb33a0337440311e9ff8f012f1cd554c50bb9788eea3f96405004cfd3
>  --php70-image 
> gcr.io/google-appengine/php70@sha256:99731221e941d57a6807d9eb5491474d06488c2e8fcd9552227fb2d120e35c89
>  --php56-image 
> gcr.io/google-appengine/php56@sha256:70ac0d926c59517ea94897409dfa7c72a12c0e38d59f4a60794e910cdb2cdb02
> Finished Step #0
> Starting Step #1
> Step #1: Pulling image: 
> gcr.io/kaniko-project/executor@sha256:f87c11770a4d3ed33436508d206c584812cd656e6ed08eda1cff5c1ee44f5870
> Step #1: 
> sha256:f87c11770a4d3ed33436508d206c584812cd656e6ed08eda1cff5c1ee44f5870: 
> Pulling from kaniko-project/executor
> Step #1: 042c12654203: Pulling fs layer
> Step #1: e623e7f7d83e: Pulling fs layer
> Step #1: 4a78c04d4eaa: Pulling fs layer
> Step #1: bf1e1a1d843a: Pulling fs layer
> Step #1: bde2bd8edab4: Pulling fs layer
> Step #1: 9c94fd449ba4: Pulling fs layer
> Step #1: c1edeb5aef20: Pulling fs layer
> Step #1: bf1e1a1d843a: Waiting
> Step #1: bde2bd8edab4: Waiting
> Step #1: 9c94fd449ba4: Waiting
> Step #1: c1edeb5aef20: Waiting
> Step #1: e623e7f7d83e: Verifying Checksum
> Step #1: e623e7f7d83e: Download complete
> Step #1: 4a78c04d4eaa: Verifying Checksum
> Step #1: 4a78c04d4eaa: Download complete
> Step #1: 042c12654203: Verifying Checksum
> Step #1: 042c12654203: Download complete
> Step #1: bde2bd8edab4: Verifying Checksum
> Step #1: bde2bd8edab4: Download complete
> Step #1: c1edeb5aef20: Verifying Checksum
> Step #1: c1edeb5aef20: Download complete
> Step #1: bf1e1a1d843a: Verifying Checksum
> Step #1: bf1e1a1d843a: Download complete
> Step #1: 9c94fd449ba4: Verifying Checksum
> Step #1: 9c94fd449ba4: Download complete
> Step #1: 042c12654203: Pull complete
> Step #1: e623e7f7d83e: Pull complete
> Step #1: 4a78c04d4eaa: Pull complete
> Step #1: bf1e1a1d843a

[google-appengine] Laradock / Laravel deploy to App Engine Flexible not working

[Mike P]

I'm trying to deploy my new Laravel project, however it fails as apparently 
'bcmath' is missing.


I tried copying laradock's php.ini in the root of my project, but it doesn't 
seem to work. Any clue on how I can fix this? I've been at this for a couple of 
hours.
 

*This is the log:*

starting build "bf1c72af-78f7-488b-bf02-8d0277ffbafe"

FETCHSOURCE
Fetching storage object: 
gs://staging.wab-taco.appspot.com/eu.gcr.io/wab-taco/appengine/default.20190114t151355:latest#1547475265031675
Copying 
gs://staging.wab-taco.appspot.com/eu.gcr.io/wab-taco/appengine/default.20190114t151355:latest#1547475265031675...
/ [0 files][ 0.0 B/ 20.2 MiB] 
/ [0 files][264.0 KiB/ 20.2 MiB] 
-
- [0 files][ 4.1 MiB/ 20.2 MiB] 
\
\ [1 files][ 20.2 MiB/ 20.2 MiB] 
Operation completed over 1 objects/20.2 MiB. 
BUILD
Starting Step #0
Step #0: Pulling image: 
gcr.io/gcp-runtimes/php/gen-dockerfile@sha256:d699fc436cdad6ca70ba189f792e9a38baefd5339ee7145570c569aefcc45a36
Step #0: 
sha256:d699fc436cdad6ca70ba189f792e9a38baefd5339ee7145570c569aefcc45a36: 
Pulling from gcp-runtimes/php/gen-dockerfile
Step #0: Digest: 
sha256:d699fc436cdad6ca70ba189f792e9a38baefd5339ee7145570c569aefcc45a36
Step #0: Status: Downloaded newer image for 
gcr.io/gcp-runtimes/php/gen-dockerfile@sha256:d699fc436cdad6ca70ba189f792e9a38baefd5339ee7145570c569aefcc45a36
Step #0: + php /builder/create_dockerfile.php create --php72-image 
gcr.io/google-appengine/php72@sha256:0f0d6c07035fd5138d917b4d539f4473ca13528f11c26c92be54b9e33c0f722b
 --php71-image 
gcr.io/google-appengine/php71@sha256:5531e7edb33a0337440311e9ff8f012f1cd554c50bb9788eea3f96405004cfd3
 --php70-image 
gcr.io/google-appengine/php70@sha256:99731221e941d57a6807d9eb5491474d06488c2e8fcd9552227fb2d120e35c89
 --php56-image 
gcr.io/google-appengine/php56@sha256:70ac0d926c59517ea94897409dfa7c72a12c0e38d59f4a60794e910cdb2cdb02
Finished Step #0
Starting Step #1
Step #1: Pulling image: 
gcr.io/kaniko-project/executor@sha256:f87c11770a4d3ed33436508d206c584812cd656e6ed08eda1cff5c1ee44f5870
Step #1: 
sha256:f87c11770a4d3ed33436508d206c584812cd656e6ed08eda1cff5c1ee44f5870: 
Pulling from kaniko-project/executor
Step #1: 042c12654203: Pulling fs layer
Step #1: e623e7f7d83e: Pulling fs layer
Step #1: 4a78c04d4eaa: Pulling fs layer
Step #1: bf1e1a1d843a: Pulling fs layer
Step #1: bde2bd8edab4: Pulling fs layer
Step #1: 9c94fd449ba4: Pulling fs layer
Step #1: c1edeb5aef20: Pulling fs layer
Step #1: bf1e1a1d843a: Waiting
Step #1: bde2bd8edab4: Waiting
Step #1: 9c94fd449ba4: Waiting
Step #1: c1edeb5aef20: Waiting
Step #1: e623e7f7d83e: Verifying Checksum
Step #1: e623e7f7d83e: Download complete
Step #1: 4a78c04d4eaa: Verifying Checksum
Step #1: 4a78c04d4eaa: Download complete
Step #1: 042c12654203: Verifying Checksum
Step #1: 042c12654203: Download complete
Step #1: bde2bd8edab4: Verifying Checksum
Step #1: bde2bd8edab4: Download complete
Step #1: c1edeb5aef20: Verifying Checksum
Step #1: c1edeb5aef20: Download complete
Step #1: bf1e1a1d843a: Verifying Checksum
Step #1: bf1e1a1d843a: Download complete
Step #1: 9c94fd449ba4: Verifying Checksum
Step #1: 9c94fd449ba4: Download complete
Step #1: 042c12654203: Pull complete
Step #1: e623e7f7d83e: Pull complete
Step #1: 4a78c04d4eaa: Pull complete
Step #1: bf1e1a1d843a: Pull complete
Step #1: bde2bd8edab4: Pull complete
Step #1: 9c94fd449ba4: Pull complete
Step #1: c1edeb5aef20: Pull complete
Step #1: Digest: 
sha256:f87c11770a4d3ed33436508d206c584812cd656e6ed08eda1cff5c1ee44f5870
Step #1: Status: Downloaded newer image for 
gcr.io/kaniko-project/executor@sha256:f87c11770a4d3ed33436508d206c584812cd656e6ed08eda1cff5c1ee44f5870
Step #1: INFO[] Removing ignored files from build context: [.dockerignore 
Dockerfile .git .hg .svn *~ .\#* app.yaml] 
Step #1: INFO[0001] Downloading base image 
gcr.io/google-appengine/php72@sha256:0f0d6c07035fd5138d917b4d539f4473ca13528f11c26c92be54b9e33c0f722b
 
Step #1: INFO[0013] Taking snapshot of full filesystem... 
Step #1: INFO[0020] ENV DOCUMENT_ROOT='/app/public' APP_LOG='errorlog' 
APP_KEY='base64:ak4/ZLdvSpRF3JDRPuR8mgzzGB8GXGuLVF/PP8qnTH4=' 
STORAGE_DIR='/tmp' FRONT_CONTROLLER_FILE='index.php' COMPOSER_FLAGS='--no-dev 
--prefer-dist' DETECTED_PHP_VERSION='7.2' 
Step #1: INFO[0020] Using files from context: [/workspace] 
Step #1: INFO[0020] COPY . $APP_DIR 
Step #1: INFO[0022] Taking snapshot of files... 
Step #1: INFO[0024] RUN chown -R www-data.www-data $APP_DIR 
Step #1: INFO[0024] cmd: /bin/sh 
Step #1: INFO[0024] args: [-c chown -R www-data.www-data $APP_DIR] 
Step #1: INFO[0024] Taking snapshot of full filesystem... 
Step #1: INFO[0032] RUN /build-scripts/composer.sh 
Step #1: INFO[0032] cmd: /bin/sh 
Step #1: INFO[0032] args: [-c /build-scripts/composer.sh] 
Step #1: Using PHP version: 7.2
Step #1: Install PHP extensions...
Step #1: Running composer...
Step #1: Loading composer repositories with package information
Step #1: Installing dependencies from lock file
Step #1: Your requirements could not be resolved to an installable 

[google-appengine] Help with Server Error 500 for node js app. But works fine locally?!

[Mike C]

I got the following error:

Error: Cannot find module '/srv/server.js'
at Function.Module._resolveFilename (module.js:548:15)
at Function.Module._load (module.js:475:25)
at Function.Module.runMain (module.js:694:10)
at startup (bootstrap_node.js:204:16)
at bootstrap_node.js:625:3

=
my package.json has  "main": "app.js",...
It ran no problem locally. It is using 'runtime: nodejs8' in app.yaml

*What did I do wrong ?!*

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/db3a1f8a-662e-4446-a2f8-6f6b60b1fd4f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Cloud IAP with Standard second generation runtimes?

['Mike McDonald' via Google App Engine]

Parth,

Good questions. I've answered them inline below.

Thanks,
--Mike

On Friday, September 7, 2018 at 12:24:10 PM UTC-7, Parth Mishra wrote:
>
> Follow up: what's the difference between this and say, Cloud Endpoints 
> authentication via OpenAPI? 
>

Endpoints:

   - Pros:
  - Can do Google or non-Google auth (e.g. Firebase Auth, or any other 
  OIDC JWT)
  - Can do per-path authentication
   - Cons:
  - Doesn't provide login/logout URLs for web apps (e.g. won't initiate 
  3LO OAuth flow, refresh tokens)
  - Not integrated with Cloud IAM for authorization (e.g. can't grant a 
  single user access)
  - Not a fully managed system (deployed with your GAE app)
  - Doesn't work with Gen 2 runtimes
   
IAP

   - Pros:
  - Designed to handle 2LO and 3LO flows (will handle token refresh for 
  web apps)
  - Integrated with Cloud IAM
  - Works with GAE Gen 1 and 2
   - Cons:
  - Whole app only (no per-path auth yet)
  - Google Auth only
  - Somewhat annoying way to generate tokens (though compute metadata 
  
<https://cloud.google.com/compute/docs/instances/verifying-instance-identity#request_signature>
 
  makes this easier)
   
Probably missing some things, but that's the gist :)
 

>
> On Tuesday, September 4, 2018 at 7:54:40 PM UTC-4, Parth Mishra wrote:
>>
>>
>> I was wondering what the status of Cloud Identity Aware Proxy integration 
>> with the second gen runtimes (specifically Python 3.7). I would like to 
>> authenticate a Service Account to invoke my application from an on-premise 
>> server and it seems like IAP is good method for doing this (in addition to 
>> restricting firewall). 
>>
>
I just tried it and it works.
 

>
>> However, the documentation doesn't make it clear what approach to take to 
>> integrate since it requires Users API for standard environment (which isn't 
>> supported by Python 3.7). Do I need to use either first-gen Standard or 
>> switch to Flexible? 
>>
>
Instead of using the user's service, you'll have to grab the headers 
<https://cloud.google.com/iap/docs/signed-headers-howto> which have the 
userID and email (or the full JWT). Note that the IAP site claims this 
doesn't work for Standard, but it does for Gen 2.

Here's my example: 
https://gist.github.com/mcdonamp/366e05d86ec9c48108719a5a9b37eeda
 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/94cfb473-ce73-4fe7-880b-e5c447b07496%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: What is the best way to manage env vars in App Engine (flexible environment)?

[Mike Hardy]

Bumping this. We've been storing our env_variables in app.yaml but we're 
adding more team members and we don't want to expose these variables to 
everyone. Does anyone have a suggestion for storing secrets in App Engine 
Flexible?

On Saturday, September 9, 2017 at 7:20:44 AM UTC-7, Alex G wrote:
>
> Moving our apps from Heroku to App Engine has been great, but there are a 
> few things that we miss. In particular, having a way to define config 
> variables  in Cloud 
> Console would be great. We have tried a couple of approaches but none are 
> optimal:
>
>- Place config within env_variables 
>
> 
>  
>in the app.yaml file. Not ideal to store secrets since anyone deploying 
> the 
>app has access to the app.yaml and those secrets.
>- Place config in Cloud Storage. Hard to edit, prone to errors (e.g. 
>breaking the JSON file that might contain them) and it doesn't trigger an 
>app restart with the updated config (I believe Heroku restarts the app 
>every time you change a config variable).
>
> Are there any ideas on implementing a similar feature in App Engine?
> Is there a better way of currently handling those config vars?
>
> Thanks
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/e279cb2c-cfdf-4da0-abb2-f4c86fd21de4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: App Engine Flexible -> Random 503 Errors

[Mike Hardy]

It just happened again but on a different App Engine Flexible service. This 
one had been running perfectly fine, and like the previous case this 
service just inexplicably stopped working after 6 days. Not a good 
experience.

On Thursday, April 12, 2018 at 4:23:59 PM UTC-7, Digil(Google Cloud 
Platform Support) wrote:
>
> As of now there isn't knows issue reported on the App Engine.Looks like it 
> could just be a transient issue. Let us know, if it still persists.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/81b6ec02-3519-470f-bdae-896d80665120%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] App Engine Flexible -> Random 503 Errors

[Mike Hardy]

Hi, we have a python app using App Engine Flexible, and for some reason, it 
just started throwing 503 errors and failing. 

There was no spike in traffic and this version had been deployed for the 
last 6 days with no issues. Basically, nothing changed. 

We tried to let the version self-heal, but it wasn't working. The version 
entered a loop where it would start and then shutdown continuously.

Finally, I gave up and deployed a fresh version, which works as expected.

Can someone help explain why this might have happened and how to prevent it 
in the future?

Thanks!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/34fda84f-6391-4269-93fd-fc34f3044417%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Google App Engine is slow to deploy, hangs on "Updating service [someproject]..."

[Mike Hardy]

DeWitt, thanks for informing us but I see a few potential problems.

1. we've been passing `--version` in our gcloud app deploy command for the 
last 6 months to name the new release. Isn't this going to conflict with 
users like us who want to name the newest version?

2. I tested the solution and it just deploys to the previous version. It 
doesn't actually shut down the previous version and create a new one. In my 
opinion, one of the biggest features of app engine is rolling back to a 
previous version. It looks like this deployment method eliminates that 
feature.

On Monday, February 12, 2018 at 8:09:54 PM UTC-8, Samuel Woo wrote:
>
> I can't make a new deployment and I can't event start a previously 
> deployed (and working) version. The server appears to start, but it does 
> not respond to web requests.
>
> On Monday, February 12, 2018 at 6:02:54 PM UTC-8, Justin Yip wrote:
>>
>> Hello,
>>
>> My team is not able to deploy anything to appengine since 4pm (PST). The 
>> following message spins forever:
>>
>> Updating service [] (this may take several minutes)
>>
>> Has anyone experienced similar problem?
>>
>> Justni
>>
>>
>> On Monday, February 12, 2018 at 4:07:10 PM UTC-8, DeWitt Clinton wrote:
>>>
>>> Hi all,
>>>
>>> Thanks for being patient, everyone. I waited to reply here until the 
>>> experiment was fully ramped-up and verified in prod, but all projects 
>>> should now be eligible to start using the faster in-place version updates.
>>>
>>> To perform an in-place update, please pass the --version flag to the 
>>> deploy command and specify the version you would like to deploy over. 
>>> Additionally, you’ll likely want to prevent that version from becoming the 
>>> default, so be sure to include the --no-promote flag. For example:
>>>
>>>   $ gcloud app deploy --version  
>>> --no-promote 
>>>
>>> We recommend you use this flow only for development purposes, and 
>>> continue to deploy full versions for any production traffic.
>>>
>>> Thanks to everyone who tested this out so far, and please let me know if 
>>> you run into any issues or concerns along the way.
>>>
>>> -DeWitt
>>>
>>> On Mon, Feb 12, 2018 at 11:55 AM Mike Hardy <mha...@localinsights.io> 
>>> wrote:
>>>
>>>> Same boat as Franck and others - this is unusable
>>>>
>>>> On Thursday, February 8, 2018 at 12:23:23 PM UTC-8, Franck Diédrich 
>>>> wrote:
>>>>>
>>>>> Hello,
>>>>>
>>>>> I'm experiencing serious latency too on a flexible env.
>>>>>
>>>>> Deployments used to last around 9 minutes (which is quite long) and 
>>>>> now they time out without explicit reason.
>>>>>
>>>>> When will deployement improvement flow be available?
>>>>>
>>>>> Le jeudi 29 septembre 2016 21:48:26 UTC+2, Kevin Lau a écrit :
>>>>>>
>>>>>>
>>>>>> Is there a faster way to deploy an app? Google App Engine is slow to 
>>>>>> deploy, hangs on "Updating service [someproject]..." I am using a 
>>>>>> flexible 
>>>>>> environment with PHP.
>>>>>>
>>>>> -- 
>>>> You received this message because you are subscribed to a topic in the 
>>>> Google Groups "Google App Engine" group.
>>>> To unsubscribe from this topic, visit 
>>>> https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe
>>>> .
>>>> To unsubscribe from this group and all its topics, send an email to 
>>>> google-appengi...@googlegroups.com.
>>>> To post to this group, send email to google-a...@googlegroups.com.
>>>> Visit this group at https://groups.google.com/group/google-appengine.
>>>> To view this discussion on the web visit 
>>>> https://groups.google.com/d/msgid/google-appengine/1514f6e9-35dc-46a9-ae0b-383c94529263%40googlegroups.com
>>>>  
>>>> <https://groups.google.com/d/msgid/google-appengine/1514f6e9-35dc-46a9-ae0b-383c94529263%40googlegroups.com?utm_medium=email_source=footer>
>>>> .
>>>> For more options, visit https://groups.google.com/d/optout.
>>>>
>>>
>>>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a6de923a-d6d7-41f2-9789-f4360fcadf7d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Google App Engine is slow to deploy, hangs on "Updating service [someproject]..."

[Mike Hardy]

Same boat as Franck and others - this is unusable

On Thursday, February 8, 2018 at 12:23:23 PM UTC-8, Franck Diédrich wrote:
>
> Hello,
>
> I'm experiencing serious latency too on a flexible env.
>
> Deployments used to last around 9 minutes (which is quite long) and now 
> they time out without explicit reason.
>
> When will deployement improvement flow be available?
>
> Le jeudi 29 septembre 2016 21:48:26 UTC+2, Kevin Lau a écrit :
>>
>>
>> Is there a faster way to deploy an app? Google App Engine is slow to 
>> deploy, hangs on "Updating service [someproject]..." I am using a flexible 
>> environment with PHP.
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/1514f6e9-35dc-46a9-ae0b-383c94529263%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Google App Engine is slow to deploy, hangs on "Updating service [someproject]..."

[Mike Hardy]

Same with us. Our deployment hangs at `updating service` and eventually 
fails.

On Thursday, February 1, 2018 at 9:14:52 AM UTC-8, Yuri Bürger wrote:
>
> I've noticed huge decrease in deployment time today. It was not fast 
> before, but now it is very slow. Also, it seems randomly fail with "time 
> out"
>
> четвер, 1 лютого 2018 р. 15:58:40 UTC+2 користувач Dinçer Kavraal написав:
>>
>> I don't know about the experimentation but deployments are failing for 
>> the last a few days and taking hours.
>> Has anyone noticed that?
>>
>> Also I am not on the whitelist.
>>
>>
>> On Friday, 26 January 2018 04:17:32 UTC+3, DeWitt Clinton wrote:
>>>
>>> Hi all,
>>>
>>> I've whitelisted everyone who filled out the form, and the experiment is 
>>> going well so far. I hope to see it rolled out to all projects and publicly 
>>> documented in the next several weeks.
>>>
>>> Thanks for your help and feedback!
>>>
>>> -DeWitt
>>>
>>>
>>> On Tue, Jan 23, 2018 at 1:04 PM AntoineA  wrote:
>>>
 +1 - Also interested

 On Thursday, 18 January 2018 09:03:39 UTC-5, Ivan Aguirre wrote:
>
> Hi DeWitt,
>
> Do you have updates on this? Is there an issue tracker I can follow?
>
> best regards!!
>
> Em terça-feira, 19 de dezembro de 2017 07:59:08 UTC-2, Filipe Caldas 
> escreveu:
>>
>> Hi DeWitt,
>>
>>   Will this also impact the deploy time on managed Appengine 
>> applications?
>>
>> Best,
>>
>> On Tuesday, 12 December 2017 17:37:43 UTC, DeWitt Clinton wrote:
>>>
>>> Hi all,
>>>
>>> I’m on the App Engine team and I agree, flexible deployments are 
>>> currently too slow. The observations in this thread generally match our 
>>> own: Deploying a new version of an app takes around six minutes median 
>>> (50th percentile), with tail spikes several times that (99th 
>>> percentile). 
>>> Language choice or app size isn’t a factor, as these setup costs are 
>>> independent of the runtime or code being deployed. 
>>>
>>> For many apps, where production versions are pushed via 
>>> long-running, asynchronous CI/CD pipelines, the exact timing may not 
>>> matter 
>>> so much. But for everyone who depends on app deployments for 
>>> development 
>>> purposes, this is too much.
>>>
>>> For those cases, we are testing an improved deployment flow that 
>>> will let you update an existing version in-place in around 150 seconds 
>>> median. We hope to release the fast in-place updates for everyone next 
>>> month, but if you’d like to help us test it out a little sooner please 
>>> tell 
>>> me your project id here 
>>> 
>>>  
>>> and I’ll whitelist it.
>>>
>>> If you miss this signup, don’t worry, we plan to turn faster 
>>> in-place updates on for all projects by default in the new year.
>>>
>>> Thanks!
>>>
>>> -DeWitt
>>>
>>>
>>> On Tuesday, November 21, 2017 at 12:46:32 PM UTC-8, Gunar Cassiano 
>>> Gessner wrote:

 Speaking from experience here.
 Just move on.
 Google App Engine (esp. Flexible Engine) is not worthy of your time.

 Take care,
 @gunar

 On Tue, Nov 21, 2017 at 1:24 AM, Vijay M  
 wrote:

> I have been struggling with the same issue. I tried deploying a 
> very simple app and waited for several minutes before the process 
> timed 
> out. I even ran into the same timeout issue with Google's own samples 
> from  
>
> https://github.com/GoogleCloudPlatform/python-docs-samples/
> appengine/flexible/hello_world
>
> Coming from AWS, it has been very frustrating working with GCP. 
> One more day of this and I am going back to AWS. 
>
> On Thursday, September 29, 2016 at 12:48:26 PM UTC-7, Kevin Lau 
> wrote:
>>
>>
>> Is there a faster way to deploy an app? Google App Engine is slow 
>> to deploy, hangs on "Updating service [someproject]..." I am using a 
>> flexible environment with PHP.
>>
> -- 
> You received this message because you are subscribed to a topic in 
> the Google Groups "Google App Engine" group.
> To unsubscribe from this topic, visit 
> https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe
> .
> To unsubscribe from this group and all its topics, send an email 
> to google-appengi...@googlegroups.com.
> To post to this group, send email to google-a...@googlegroups.com.
> Visit this group at 
> https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit 

[google-appengine] Re: Trouble with dispatch.yaml

[Mike Hardy]

Nailed it - thanks for the help Jeremy

On Wednesday, January 17, 2018 at 10:36:53 AM UTC-8, Jeremy D wrote:
>
> First thought here is that because dispatch checks these routes *in 
> order,* you have a "/*" route ahead of "/notifications", so 
> no routes will ever reach notifications, because your wildcard hits it 
> first. Move the notification route ahead of the wildcard, and you should be 
> good.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/2ff6f5f7-4993-4149-94d3-de1c36c57137%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Trouble with dispatch.yaml

[Mike Hardy]

Hi There, we're having issues with dispatch.yaml. We have two environments 
(staging and production) with 3 services each.

The staging dispatch.yaml has no issues, and the production dispatch.yaml 
is working for all services, except li-notifications. When visiting 
li-notifications, the default GAE domain works but the custom route 
doesn't. The only difference between the two environments is the base url. 
The staging environment is `staging..com` and the production is just 
`.com`.

What are we doing wrong?

Dispatch.yaml
dispatch:
  - url: "/backend/*"
service: li-django


  - url: "/*"
service: li-frontend


  - url: "www./*"
service: li-frontend


  - url: "/notifications/*"
service: li-notifications


Gcloud app describe output:

dispatchRules:

- domain: 

  path: /backend/*

  service: li-django

- domain: 

  path: /*

  service: li-frontend

- domain: www.

  path: /*

  service: li-frontend

- domain: 

  path: /notifications/*

  service: li-notifications

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/0127ce6c-6348-4fde-b5a8-ccc29c015685%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Elasticsearch on App Engine

[Mike Hardy]

Hi, we have an application that runs on App Engine Flexible. This 
application uses Elasticsearch, which runs on a compute engine instance, 
but we want to GAEize the elasticsearch component to run as a managed 
service; however, we're not quite sure if this is even possible.

1. Is it possible to run elasticsearch as a service on GAE?
2. If it is possible, how would one connect to Elasticsearch from other GAE 
services given that GAE has ephemeral IP addresses?

Thanks!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/d1f42fab-0a8a-485a-a2cb-33ccc3f2807c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Fwd: Us congress hearing of maan alsaan Money laundry قضية الكونغجرس لغسيل الأموال للمليادير معن الصانع

[mike a]

YouTube videos of



 U.S. Congress money laundering hearing


of

Saudi Billionaire  " Maan  Al sanea"

 with *bank of America*


and  The  owner of Saad Hospital and  Schools

 in the Eastern Province in *Saudi Arabia*



and the Chairman of the Board of Directors of Awal Bank  in *Bahrain*


With Arabic Subtitles





*موقع اليوتيوب الذي عرض جلسة استماع الكونجرس الأمريكي *

* لمتابعة نشاطات غسل الأموال ونشاطات*



*السعودي معن عبدالواحد الصانع*



*مالك مستشفى  وشركة سعد  ومدارس سعد بالمنطقة الشرقية بالسعودية   ورئيس مجلس
ادارة بنك اوال البحريني*



*مترجم باللغة العربية*



http://www.youtube.com/watch?v=mIBNnQvhU8s







-- 
You received this message because you are subscribed to the Google Groups
"Pakistan Human Resource Professionals" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to phrpro+unsubscr...@googlegroups.com.
To post to this group, send email to phr...@googlegroups.com.
Visit this group at https://groups.google.com/group/phrpro.
For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAJ1B9PRe9nh35CzGH6aGLPWDf3aOD%3DGTAo0tvZcWbBHnJHecow%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Connect multiple cloud sql databases to one app engine service

[Mike Hardy]

Hi Jun, thanks for your response, but I am a little confused here. When 
deployed, GAE uses a built in cloud sql proxy connection with Cloud SQL so 
there is no way to specify the instance or any other parameter for cloud 
sql proxy. I think any fix will need to use app.yaml but please correct me 
if I'm wrong. Would love to solve this.

On Friday, November 17, 2017 at 12:59:04 PM UTC-8, Jun (Cloud Platform 
Support) wrote:
>
> Hi Mike,
>
> You should be able to connect to multiple Cloud SQL instances through 
> Cloud SQL Proxy, and you can specify multiple instances in the instances 
> parameter (comma separated). Please take a look at these two posts for more 
> details: "A GCE instance connecting to two (or more) Cloud SQL databases 
> via multiple cloud-sql-proxy-instances 
> <https://groups.google.com/forum/#!msg/google-cloud-sql-discuss/_GH4b6Uxz9I/pRE0Z9aTAgAJ>"
>  
> and "Connecting to multiple CloudSQL instances using Cloud sql proxy? 
> <https://stackoverflow.com/questions/40793222/connecting-to-multiple-cloudsql-instances-using-cloud-sql-proxy>",
>  
> which have the similar questions. 
>
> - Jun
>
>
> On Friday, November 17, 2017 at 12:06:49 AM UTC-5, Mike Hardy wrote:
>>
>> Hi, we have an app that utilizes two databases. Previously, we had the 
>> two databases on the same instance in Cloud SQL, but we want to split the 
>> databases into separate instances. We're having issues connecting the 
>> databases to our Django app engine service. Is this even possible? If so, 
>> how would the app.yaml look?
>>
>> old app.yaml
>> runtime: custom
>> env: flex
>> entrypoint: gunicorn --timeout 360 --graceful-timeout 360 -b :$8080 
>> localinsights.wsgi
>>
>> beta_settings:
>> cloud_sql_instances: 
>>
>> runtime_config:
>>   python_version: 3.6
>>
>> env_variables:
>>   SQLALCHEMY_DATABASE_URI: >-
>>   
>> postgresql+psycopg2://:/?host=/cloudsql/
>>
>>
>> settings.py
>> DATABASES['default'] = {
>> 'HOST': '/cloudsql/',
>> 'ENGINE': 'psqlextra.backend',
>> 'NAME': '',
>> 'USER': '',
>> 'PASSWORD': ''
>> }
>> DATABASES['NUMBER_2'] = {
>> 'HOST': '/cloudsql/',
>> 'ENGINE': 'psqlextra.backend',
>> 'NAME': 'NUMBER_2',
>> 'USER': '',
>> 'PASSWORD': ''
>> }
>>
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/ca645dae-b554-494b-a638-e2f6acdab6a0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Connect multiple cloud sql databases to one app engine service

[Mike Hardy]

Hi, we have an app that utilizes two databases. Previously, we had the two 
databases on the same instance in Cloud SQL, but we want to split the 
databases into separate instances. We're having issues connecting the 
databases to our Django app engine service. Is this even possible? If so, 
how would the app.yaml look?

old app.yaml
runtime: custom
env: flex
entrypoint: gunicorn --timeout 360 --graceful-timeout 360 -b :$8080 
localinsights.wsgi

beta_settings:
cloud_sql_instances: 

runtime_config:
  python_version: 3.6

env_variables:
  SQLALCHEMY_DATABASE_URI: >-
  
postgresql+psycopg2://:/?host=/cloudsql/


settings.py
DATABASES['default'] = {
'HOST': '/cloudsql/',
'ENGINE': 'psqlextra.backend',
'NAME': '',
'USER': '',
'PASSWORD': ''
}
DATABASES['NUMBER_2'] = {
'HOST': '/cloudsql/',
'ENGINE': 'psqlextra.backend',
'NAME': 'NUMBER_2',
'USER': '',
'PASSWORD': ''
}


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/74d7e99d-daf1-452b-8882-fcc9f5f1ada1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: dispatch.yaml troubleshooting

[Mike Hardy]

Thanks Kenworth - your dispatch.yaml file solved the problem :)

On Thursday, November 16, 2017 at 2:50:37 PM UTC-8, Kenworth (Google Cloud 
Platform) wrote:
>
> I was able to reproduce your issue. As such, here are my takeaways:
>
> 1- Make sure you added the CNAME for "www.somedomain.com"
> 2- The use of the following element without the asterisk (*) should be 
> fine: 
>
> url: "somedomain.com/*"
>
> 3- Alternatively, you can add both routing rules as follows:
>
> dispatch:
>   - url: "www.somedomain.com/*"
> service: frontend
> 
>   - url: "somedomain.com/*"
> service: frontend
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/89fa1e1b-5f4d-45e4-8f3a-cabe280dad66%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] dispatch.yaml troubleshooting

[Mike Hardy]

Hi, I am trying add www to our frontend service so that we can have both 
`www.somedomain.com` and `somedomain.com` work with the frontend service.

This is our dispatch.yaml
dispatch:
  - url: "*somedomain.com/*"
service: frontend

I've used GAE settings to set a custom url and added the cname record to 
our DNS but we continue to get a server not available error. What could I 
be doing wrong?

Thanks!
Mike

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a4ce0639-9e63-48d8-9e46-2947540e53a2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: App Engine closed local connection on Cloud sql

[Mike Hardy]

Hi George, we removed our scaling restrictions that limited our dev machine 
to 1 instance and increased our cloud sql instance to 2 cores + 7.5GB. Hope 
that helps.

On Friday, November 3, 2017 at 11:44:00 AM UTC-7, George (Cloud Platform 
Support) wrote:
>
> Hello Mike, 
>
> How was this issue solved exactly? A more detailed description might 
> benefit Group members in future, and increase the value of your posting. 
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/70b50b42-1a23-4bef-bc4d-1fdab543f24f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: App Engine closed local connection on Cloud sql

[Mike Hardy]

Hi Jordan, we're actually on GAE Flexible but we solved this problem by 
adding more resources to both postgres and GAE.

On Tuesday, October 31, 2017 at 12:05:05 PM UTC-7, Jordan (Cloud Platform 
Support) wrote:
>
> As described in the blue 'Note' in the documentation 
> , your 
> instance type is PostgreSQL and connections from App Engine to PostgreSQL 
> are not currently supported in the App Engine Standard environment. 
>
> Our engineering team is aware of this 
>  and are currently working on 
> supporting this. You may actually have luck if you are making connections 
> from the new Java 8 App Engine standard runtime 
> .
>
> - Since Google Groups is meant for general product discussions and not for 
> technical support or for reporting issues or feature requests, it is 
> recommended in the future to report Google-end issues and feature requests 
> to the Public Issue Tracker 
>  and to seek 
> technical support on Stack Overflow 
>  using the supported 
> Cloud tags.  
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/3fec6130-b983-4756-b48b-07e70b3aa28a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] App Engine closed local connection on Cloud sql

[Mike Hardy]

Hi, we have an app on app engine + cloud sql. To sync up our production and 
staging environments, we dumped our production database and restored our 
staging database with this dump. Both databases have the same permissions 
and table owners but now our app is unable to access this database and 
we're consistently getting this error from the app engine logs. What could 
be causing this?

3:55:11.0002017/10/30 20:55:11 Client closed local connection on 
/cloudsql//.s.PGSQL.5432
Expand all | Collapse all
{
insertId: "1iy1i8ig25r7zmm"  
labels: {
 appengine.googleapis.com/instance_name: "aef-default-dev--34a56a4-57vh"   
  compute.googleapis.com/resource_id: "2868526200192389103"   
  compute.googleapis.com/resource_name: "266b95872058"   
  compute.googleapis.com/zone: "us-central1-b"   
 }
logName: 
"projects/localinsights-staging/logs/appengine.googleapis.com%2Fstderr"  
receiveTimestamp: "2017-10-30T20:55:16.522269142Z"  
resource: {
 labels: {
  module_id: "default"
  project_id: ""
  version_id: "dev-34a56a4"
 }
 type: "gae_app"   
 }
textPayload: "2017/10/30 20:55:11 Client closed local connection on 
/cloudsql/.s.PGSQL.5432
"  
timestamp: "2017-10-30T20:55:11Z"  
}



-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/32a88d04-a481-4689-9f0d-669a7c7e61ce%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] project-wide metadata 404 error

[Mike Hardy]

Hi, we're trying to set our GAE environment variables by getting the 
secrets from the project-wide metadata, but we're getting a 404 not found 
error. I can visually confirm that the project-wide metadata is set in the 
compute engine section of the same project. What are we doing wrong here?

*Command*
wget -d --header="Metadata-Flavor: Google" http:
//metadata.google.internal/computeMetadata/v1/GOOGLE_CLIENT_ID

*Output*























*mhardy:~$ wget -d --header="Metadata-Flavor: Google" 
http://metadata.google.internal/computeMetadata/v1/GOOGLE_CLIENT_IDSetting 
--header (header) to Metadata-Flavor: GoogleDEBUG output created by Wget 
1.16 on linux-gnu.URI encoding = ‘UTF-8’--2017-09-20 09:13:38-- 
 http://metadata.google.internal/computeMetadata/v1/GOOGLE_CLIENT_ID 
Resolving 
metadata.google.internal (metadata.google.internal)... IPCaching 
metadata.google.internal => IPConnecting to metadata.google.internal 
(metadata.google.internal)|IP|:80... connected.Created socket 4.Releasing 
0x020b0a40 (new refcount 1).---request begin--request 
begin---GET /computeMetadata/v1/GOOGLE_CLIENT_ID HTTP/1.1User-Agent: 
Wget/1.16 (linux-gnu)Accept: */*Host: metadata.google.internalConnection: 
Keep-AliveMetadata-Flavor: Google---request end---HTTP request sent, 
awaiting response...---response begin---HTTP/1.0 404 Not FoundServer: 
BaseHTTP/0.3 Python/2.7.9Date: Wed, 20 Sep 2017 16:13:39 GMTContent-Type: 
text/html; charset=UTF-8Metadata-Flavor: Google---response end---404 Not 
FoundRegistered socket 4 for persistent reuse.URI content encoding = 
‘UTF-8’] done.2017-09-20 09:13:39 ERROR 404: Not Found.*

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/4adaac24-3a79-4960-a7cc-e7f263f41e65%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: ? How to implement managed SSL for a pre-existing domain mapping.

[Mike Hardy]

Likewise. I posted it here 
.

On Saturday, September 16, 2017 at 6:24:25 PM UTC-7, timh wrote:
>
> Hi
>
> Thanks have done so.
> Other than it not working there isn't much to report, there are no error 
> messages as such, just the forever spinning circle.
> The main bit of info will of course be the appid.
>
> Cheers
>
> T
>
>
> On Sunday, September 17, 2017 at 5:58:40 AM UTC+8, Kamran (Google Cloud 
> Support) wrote:
>>
>>
>> Hello Tim,
>>
>> I'd recommend filing an issue on Google Issue Tracker 
>>  include reproduction 
>> steps, the error messages that you receive or a redacted screenshot of the 
>> error, your Project ID and any other information that could help us to 
>> investigate this issue further.
>>
>>
>>
>> On Saturday, September 16, 2017 at 12:47:38 AM UTC-4, timh wrote:
>>>
>>> So I re-verified the same domain which appeared to work.
>>> It's details now look different but everything still working.
>>>
>>> I then "Enable Managed Security", and it started to show "Google-managed, 
>>> auto-renewing " under SSL Security.
>>> However an hour later the adjacent spinning gif is still spinning, have 
>>> disabled and tried again to no avail.
>>>
>>> Not sure how to progress now.
>>>
>>> T 
>>>
>>>
>>> On Saturday, September 16, 2017 at 11:24:31 AM UTC+8, timh wrote:

 Hi

 Managed SSL - fantastic.

 However I have an existing domain mapped, (for many years) and you 
 don't seem to be able to add a certificate to this.

 Not sure what the strategy would be to resolve this without potential 
 downtime for the domain.

 The only thing would be drop the existing domain mapping and re-add, 
 but that will mean downtime for the service for that domain.

 Any ideas on how one might approach this without the potential downtime 
 ?

 Thanks

 Tim

>>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/1bfbe790-266e-48f6-aaf8-f9d4da550be2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: ? How to implement managed SSL for a pre-existing domain mapping.

[Mike Hardy]

+1

I've got the same problem.

On Friday, September 15, 2017 at 9:47:38 PM UTC-7, timh wrote:
>
> So I re-verified the same domain which appeared to work.
> It's details now look different but everything still working.
>
> I then "Enable Managed Security", and it started to show "Google-managed, 
> auto-renewing " under SSL Security.
> However an hour later the adjacent spinning gif is still spinning, have 
> disabled and tried again to no avail.
>
> Not sure how to progress now.
>
> T 
>
>
> On Saturday, September 16, 2017 at 11:24:31 AM UTC+8, timh wrote:
>>
>> Hi
>>
>> Managed SSL - fantastic.
>>
>> However I have an existing domain mapped, (for many years) and you don't 
>> seem to be able to add a certificate to this.
>>
>> Not sure what the strategy would be to resolve this without potential 
>> downtime for the domain.
>>
>> The only thing would be drop the existing domain mapping and re-add, but 
>> that will mean downtime for the service for that domain.
>>
>> Any ideas on how one might approach this without the potential downtime ?
>>
>> Thanks
>>
>> Tim
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/32a01039-fca3-451e-91a2-307b53c3bd58%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Updated health checks failing on GAE with custom runtime

[Mike Hardy]

Hi There, we're having problems getting our app to function correctly using 
a custom runtime and updated health checks. We're using the custom runtime 
to add tests + migrations to our deployment. Below are our Dockerfile, 
urls.py, and app.yaml. I'm also including a snapshot of the logs Where are 
we going wrong? Any suggestions? Note: if we use the standard python 
runtime with legacy checks, the app works fine, but no tests/migrations.

Dockerfile

FROM gcr.io/google-appengine/python

# Use python 3 version of GAE base image
LABEL python_version python3.5
RUN virtualenv --no-download /env -p python3.5
ENV VIRTUAL_ENV /env
ENV PATH /env/bin:$PATH

# Install all dependencies in requirements.txt
ADD requirements.txt /app/requirements.txt
RUN pip install -r /app/requirements.txt

# Add the application source code.
ADD . /app

# Run staging migrations then tests. Then run the gunicorn server
WORKDIR /app
EXPOSE 8080
CMD python manage.py migrate --settings app.settings.staging && \
gunicorn -b :8080 app.wsgi


app.yaml
runtime: custom
env: flex
entrypoint: gunicorn -b :8080 app.wsgi

beta_settings:
cloud_sql_instances: CONNECTION

runtime_config:
  python_version: 3

automatic_scaling:
  min_num_instances: 1
  max_num_instances: 1

resources:
  cpu: 1
  memory_gb: 0.90
  disk_size_gb: 10

liveness_check:
  path: '/liveness_check'
  timeout_sec: 4
  check_interval_sec: 30
  failure_threshold: 4
  success_threshold: 2
  initial_delay_sec: 3600

readiness_check:
  path: '/readiness_check'
  timeout_sec: 4
  check_interval_sec: 5
  failure_threshold: 2
  success_threshold: 2
  app_start_timeout_sec: 3600

urls.py
url(r"/readiness_check", lambda r: HttpResponse("OK", status=200)),
url(r"/liveness_check", lambda r: HttpResponse("OK", status=200)),

log
{
httpRequest: {
referer: "-"  
remoteIp: "130.211.3.140"  
requestMethod: "GET"  
requestUrl: "/readiness_check"  
responseSize: "3884"  
status: 404  
userAgent: "GoogleHC/1.0"  
}
insertId: "17auvqqf74e9ms"  
jsonPayload: {
latencySeconds: "0.009"  
time: null  
trace: "-"  
}

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/21e53684-a135-4540-aa1c-f5d5e243a287%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: [Google Cloud Insiders] Google App Engine apps blocked by an organization, any suggestions?

[Mike Schlanser]

Why not just whitelist the ip range for app engine from inside the orgs
network and have it ignore the rule for too much traffic?

Thanks,
Mike


Mike Schlanser | Senior Engineer | Promevo
1720 Wildcat Blvd. Suite 200 | Burlington, KY | 41005
Promevo.com <http://www.promevo.com> | mike.schlan...@promevo.com
Phone: 513.731.3303 x709  | Mobile: 859.609.2995 | Fax: 859-963-3515




On Fri, Sep 8, 2017 at 8:13 PM, PK <p...@gae123.com> wrote:

> This is related to another thread I initiated today. I am pretty convinced
> now that the following is happening:
>
> 1. My customer tries to access my GAE standard app from inside an
> organization’s network. The organization has some rules in some networking
> device, that state: If too much traffic goes to an IP address block this IP
> address for 1 hour.
> 2. Since we share IP addresses on GAE Standard, if a lot of traffic goes
> to any of us, by any user in that org, the device is blocking everybody
> else sharing this IP address
> 3. Or course my customer just sees that my app does not work and complains
> to me :-(
>
> This is a pretty big org with layers of admins etc., trying to prove to
> them that what they are doing is wrong and too draconian, let alone change
> it in a reasonable amount of time, is probably futile.
>
> I am about to loose a major deal, that I worked really hard to get to this
> point, any ideas how to go around this problem?? I looked at Cloudflare but
> they will probably have the same problem since they do not seem to give
> their customers their own IP either.
>
> Any other suggestions?
>
> Thanks,
> PK
> www.gae123.com
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google Cloud Insiders" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-cloud-insiders+unsubscr...@googlegroups.com.
> To post to this group, send email to google-cloud-insiders@
> googlegroups.com.
> Visit this group at https://groups.google.com/group/google-cloud-insiders.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-cloud-insiders/D180790F-A887-46C7-AD99-
> F2450B8D4A21%40gae123.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAPYiJJgrRZEnu1g_KQBL2%2BnakUyd%3DyXQ%3Dq%2Bj%3DCUDfSVjMm0_8A%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Enabling CORS on Google App Engine Flexible environment for a Django Application

[Mike Hardy]

Based on the comments of this post 
,
 
it looks like `static_dir` is required for using `http_headers`. It could 
be some outdated/bad documentation causing some confusion.

On Wednesday, August 30, 2017 at 9:51:02 AM UTC-7, Swapnil Tiwari wrote:
>
> Hi,
>
> I have been trying to enable CORS on my Django application deployed on 
> Google App Engine flexible environment but no luck. Here is my question on 
> stack overflow with a lot more details - 
> https://stackoverflow.com/questions/45934384/enabling-cors-on-google-app-engine-for-a-django-application
>
> I have followed the January 2017 release notes over here - 
> https://cloud.google.com/endpoints/docs/release-notes but no luck so far
>
> Kindly help me
>
> Regards,
> Swapnil
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/5a2403cb-091d-45cd-bc62-0d2f93e02e0b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] GAE CI/CD Service Account Permissions

[Mike Hardy]

Hi, we are using Bitbucket Pipelines for our CI/CD engine, and it works 
great with Google App Engine. However, there appears to be one significant 
security flaw with GCP. 

We need to permission a service account to deploy our application and the 
only permission that appears to work is Project Owner. The keys are 
secured, but if, somehow, someone were to gain access to this service 
account, they could delete our entire project, which also includes our 
database and a few other mission critical resources. 

It would be much safer if we could deploy our application with granular 
permissions like GAE Deployer and GCS Admin, which we have tried to use 
unsuccessfully. We also tried to create a custom App Engine role, which 
granted all permissions, but the permissions still failed us. Does anyone 
have any suggestions?

Thanks,
Mike

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/fe9ad4dd-ce58-4eb8-b500-2d35674c6c74%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Create Django Superuser in GAE Flexible

[Mike Hardy]

Thanks Kenworth. Yes, we're using Cloud SQL. The djangoappengine package 
hasn't been maintained in multiple years. I don't know that that's 
something we want to add to our project. Surely there is a simple way to 
SSH into the GAE instance and run a command or some other method?

On Thursday, August 3, 2017 at 8:38:57 PM UTC-7, Kenworth (Google Cloud 
Platform) wrote:
>
> qq: What is your Database? Is it Google Cloud SQL? Can you try "manage.py 
> remote createsuperuser" as per this docs 
> ?
>
>
>
>
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/6f38580e-16b8-48ff-b289-a69d5d3dcb07%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Create Django Superuser in GAE Flexible

[Mike Hardy]

Thanks for the reply. That's for creating the superuser on your local 
machine. How do you createsuperuser on the deployed version?

On Wednesday, August 2, 2017 at 4:05:33 PM UTC-7, Kenworth (Google Cloud 
Platform) wrote:
>
> You can find the details of how to "createsuperuser" here 
> 
> . 
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/34a67b56-3363-454f-9d57-9168666fccc7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Create Django Superuser in GAE Flexible

[Mike Hardy]

Hi There, I've been scouring the internet trying to figure out how to 
create a Django superuser in GAE Flexible environment, but there aren't 
many answers, so it leads me to believe that it is very simple and I am 
just completely lost. Can some kind soul tell me where/how to 
createsuperuser?

Thanks!
Mike

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/f70f2126-16ad-490a-9fc2-e19b302f1dba%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Is Google App Engine Launcher being deprecated? Why??

[Mike Elugelab]

I can't tell you how valuable the Launcher is.  I want to write code -- I 
don't want to get entwined in the tortured world of devops scripting.  Yes, 
understand Google wants us to use Cloud SDK, but the Launcher is such a 
great front door to get in.  If you didn't have Launcher I'd change to 
Heroku and never again think about App Engine again or tell my friends how 
good it is/was.

@Justin: please keep supporting (unofficially, of course) your GUI.  Maybe 
Google will make it official.

Meanwhile, a discussion on Stack Overflow pointed to this link where the 
original App Engine Launcher can still be downloaded:

https://cloud.google.com/appengine/docs/standard/python/download#appengine_sdk

http://stackoverflow.com/questions/38982261/has-the-google-app-engine-launcher-for-mac-osx-been-deprecated


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/bbb22cd1-bda2-40a9-87d9-8b34fe8c4a4c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Image API for Flexible Environment

[Mike Brewster]

I have an application I'm running on node in an App Engine Flexible 
Environment. Currently the Image service is unavailable in flex envs, but I 
have 3 separate features that'd greatly benefit by its availability.

I'm curious to know how many others would love to see the Image API on 
Flexible Environments.

(Standard Environment Python docs for reference: 
https://cloud.google.com/appengine/docs/python/refdocs/google.appengine.api.images)

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/7a9abcc3-c33e-4216-8fcd-66362667bfd9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Reading DBF records from blobstore object is VERY SLOW

[Mike Lucente]

I've changed the app to read from a flat file instead of a DBF and am now
processing 100 insert/updates at a time vs MySQL. All good now.

On Mon, Dec 12, 2016 at 2:30 PM, 'Nicholas (Google Cloud Support)' via
Google App Engine <google-appengine@googlegroups.com> wrote:

> Every call to FetchData is issuing a small network request to the
> blobstore.  This will most certainly take time when scaling to 24,000
> fetches.  The reason this is not encountered when testing in the
> development environment (dev_appserver.py) is that the dev blobstore there
> is hosted locally on you rmachine.  As such, the fetch takes as much time
> as a local file read, not as long as a proper network request.  This
> latency is in this way definitely reasonable and to be expected.
>
> To solve this issue, you would need to either reduce the latency of these
> network calls or reduce the volume of them per request to this module.
>  56ms for these Blobstore internal calls is entirely expected so you won't
> really be able to cut that down.  Thus, we are left with reducing how many
> of these calls are made with each request.
>
>- What is this task queue-issued request doing during it's lifespan
>that affects thousands of records?
>- Is it possible for this request to instead be broken up into
>multiple requests affecting fewer records?
>- If not, why must all records be processed in a single request?
>
> To provide some more practical advice, I would need to know more about
> your implementation as with the questions above.
>
> On Thursday, December 8, 2016 at 11:12:44 AM UTC-5, Mike Lucente wrote:
>>
>> Yes, stackdriver shows that the blobstore file is being accessed for
>> every record (/blobstore.FetchData (56 ms) for example). But it works
>> fine when run locally(?) I would have expected that the blobstore would
>> function just as a regular file would where opening a file and reading
>> records is a non-issue. Why is this so painfully slow when accessing
>> blobstore? Do I have to slurp the entire file into memory and parse it??
>>
>>
>>
>>
>> On Wed, Dec 7, 2016 at 4:57 PM, 'Nicholas (Google Cloud Support)' via
>> Google App Engine <google-appengine@googlegroups.com> wrote:
>>
>>> Hey Mike,
>>>
>>> I'm not familiar with dbfpy <https://pypi.python.org/pypi/dbfpy/2.3.1>
>>> or how it implements iteration but if no other point in your example
>>> consumes much time, it seems iterating through *dbf_in* might be the
>>> issue.  As it implements __getitem__
>>> <http://dbfpy.bzr.sourceforge.net/bzr/dbfpy/annotate/head%3A/dbfpy/dbf.py#L258>
>>> to serve as a stream, it's possible that this is what costs cycles by
>>> issuing many requests to the blob reader.  I would strongly recommend using 
>>> Stackdriver
>>> Trace <https://cloud.google.com/trace/docs/trace-overview> to see the
>>> life of a request and where it spends the bulk of its time.  Let me know
>>> what you find.
>>>
>>> Nicholas
>>>
>>> On Tuesday, December 6, 2016 at 1:45:09 PM UTC-5, Mike Lucente wrote:
>>>>
>>>> I'm using dbfpy to read records from a blobstore entry and am unable to
>>>> read 24K records before hitting the 10 minute wall (my process is in a task
>>>> queue). Here's my code:
>>>>
>>>> def get(self):
>>>> count = 0
>>>> cols = ['R_MEM_NAME','R_MEM_ID','R_EX
>>>> P_DATE','R_STATE','R_RATING1','R_RATING2']
>>>>
>>>> blobkey = self.request.get('blobkey')
>>>> blob_reader = blobstore.BlobReader(blobkey)
>>>>
>>>> dbf_in = dbf.Dbf(blob_reader, True)
>>>>
>>>> try:
>>>> if dbf_in.fieldNames[0] == 'R_MEM_NAME':
>>>> pass
>>>> except:
>>>> logging.info("Invalid record type: %s",
>>>> dbf_in.fieldNames[0])
>>>> return
>>>>
>>>> mysql = mysqlConnect.connect('ratings')
>>>> db = mysql.db
>>>> cursor = db.cursor()
>>>>
>>>> for rec in dbf_in:
>>>> count = count + 1
>>>> if count == 1:
>>>> continue
>>>>
>>>> continue
>>>>
>>>> ---
>>>> This simple loop should finish in seconds. Instead it gets through a
>>>> few thousand records and then hits the wall.
>>>>

Re: [google-appengine] Re: Reading DBF records from blobstore object is VERY SLOW

[Mike Lucente]

Yes, stackdriver shows that the blobstore file is being accessed for every
record (/blobstore.FetchData (56 ms) for example). But it works fine when
run locally(?) I would have expected that the blobstore would function just
as a regular file would where opening a file and reading records is a
non-issue. Why is this so painfully slow when accessing blobstore? Do I
have to slurp the entire file into memory and parse it??




On Wed, Dec 7, 2016 at 4:57 PM, 'Nicholas (Google Cloud Support)' via
Google App Engine <google-appengine@googlegroups.com> wrote:

> Hey Mike,
>
> I'm not familiar with dbfpy <https://pypi.python.org/pypi/dbfpy/2.3.1> or
> how it implements iteration but if no other point in your example consumes
> much time, it seems iterating through *dbf_in* might be the issue.  As it 
> implements
> __getitem__
> <http://dbfpy.bzr.sourceforge.net/bzr/dbfpy/annotate/head%3A/dbfpy/dbf.py#L258>
> to serve as a stream, it's possible that this is what costs cycles by
> issuing many requests to the blob reader.  I would strongly recommend using 
> Stackdriver
> Trace <https://cloud.google.com/trace/docs/trace-overview> to see the
> life of a request and where it spends the bulk of its time.  Let me know
> what you find.
>
> Nicholas
>
> On Tuesday, December 6, 2016 at 1:45:09 PM UTC-5, Mike Lucente wrote:
>>
>> I'm using dbfpy to read records from a blobstore entry and am unable to
>> read 24K records before hitting the 10 minute wall (my process is in a task
>> queue). Here's my code:
>>
>> def get(self):
>> count = 0
>> cols = ['R_MEM_NAME','R_MEM_ID','R_EX
>> P_DATE','R_STATE','R_RATING1','R_RATING2']
>>
>> blobkey = self.request.get('blobkey')
>> blob_reader = blobstore.BlobReader(blobkey)
>>
>> dbf_in = dbf.Dbf(blob_reader, True)
>>
>> try:
>> if dbf_in.fieldNames[0] == 'R_MEM_NAME':
>> pass
>> except:
>> logging.info("Invalid record type: %s", dbf_in.fieldNames[0])
>> return
>>
>> mysql = mysqlConnect.connect('ratings')
>> db = mysql.db
>> cursor = db.cursor()
>>
>> for rec in dbf_in:
>> count = count + 1
>> if count == 1:
>> continue
>>
>> continue
>>
>> ---
>> This simple loop should finish in seconds. Instead it gets through a few
>> thousand records and then hits the wall.
>>
>> Note the last "continue" that I added to bypass the mysql inserts (that I
>> previously thought were the culprit).
>>
>> I'm stumped and stuck.
>>
>> --
> You received this message because you are subscribed to a topic in the
> Google Groups "Google App Engine" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/
> topic/google-appengine/L-qePUVWekU/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/ba5b7252-e820-403d-9e60-
> df3ad1e02cbb%40googlegroups.com
> <https://groups.google.com/d/msgid/google-appengine/ba5b7252-e820-403d-9e60-df3ad1e02cbb%40googlegroups.com?utm_medium=email_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CACRLM0UjgnP2qiPB96K9%3DY6FgXOFAGLE1_12bR-pdonSEHEkQw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Reading DBF records from blobstore object is VERY SLOW

[Mike Lucente]

Note also that this works fine when running locally (dev).

On Tuesday, December 6, 2016 at 1:45:09 PM UTC-5, Mike Lucente wrote:
>
> I'm using dbfpy to read records from a blobstore entry and am unable to 
> read 24K records before hitting the 10 minute wall (my process is in a task 
> queue). Here's my code:
>
> def get(self):
> count = 0
> cols = 
> ['R_MEM_NAME','R_MEM_ID','R_EXP_DATE','R_STATE','R_RATING1','R_RATING2']
>
> blobkey = self.request.get('blobkey')
> blob_reader = blobstore.BlobReader(blobkey)
>
> dbf_in = dbf.Dbf(blob_reader, True)
>
> try:
> if dbf_in.fieldNames[0] == 'R_MEM_NAME':
> pass
> except:
> logging.info("Invalid record type: %s", dbf_in.fieldNames[0])
> return
>
> mysql = mysqlConnect.connect('ratings')
> db = mysql.db
> cursor = db.cursor()
>
> for rec in dbf_in:
> count = count + 1
> if count == 1:
> continue
>
> continue
>
> ---
> This simple loop should finish in seconds. Instead it gets through a few 
> thousand records and then hits the wall.
>
> Note the last "continue" that I added to bypass the mysql inserts (that I 
> previously thought were the culprit).
>
> I'm stumped and stuck.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/3c931b56-c721-4d55-9463-f0d460542201%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Reading DBF records from blobstore object is VERY SLOW

[Mike Lucente]

I'm using dbfpy to read records from a blobstore entry and am unable to 
read 24K records before hitting the 10 minute wall (my process is in a task 
queue). Here's my code:

def get(self):
count = 0
cols = 
['R_MEM_NAME','R_MEM_ID','R_EXP_DATE','R_STATE','R_RATING1','R_RATING2']

blobkey = self.request.get('blobkey')
blob_reader = blobstore.BlobReader(blobkey)

dbf_in = dbf.Dbf(blob_reader, True)

try:
if dbf_in.fieldNames[0] == 'R_MEM_NAME':
pass
except:
logging.info("Invalid record type: %s", dbf_in.fieldNames[0])
return

mysql = mysqlConnect.connect('ratings')
db = mysql.db
cursor = db.cursor()

for rec in dbf_in:
count = count + 1
if count == 1:
continue

continue

---
This simple loop should finish in seconds. Instead it gets through a few 
thousand records and then hits the wall.

Note the last "continue" that I added to bypass the mysql inserts (that I 
previously thought were the culprit).

I'm stumped and stuck.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/51305160-c82e-412f-9c3d-a4aad8fb9755%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Major Cloud SQL latency for INSERT's

[Mike Lucente]

Turns out that this has nothing to do with MySQL. After removing mysql from 
the equation I'm now simply using dbfpy to read DBF records from a 
blobstore object and cannot read 24K records before the 10 minute window 
boots me out of my task.

I'll repost my issue.

On Sunday, December 4, 2016 at 11:38:32 AM UTC-5, Mike Lucente wrote:
>
> I'm inserting 24K records into a table and seeing some major latency. I 
> was running the same process about a month ago (I get a new batch of 
> records every month) without a problem. Now the process craps out after 10 
> minutes with "Deadline exceeded". The same process runs without issue on my 
> laptop (local dev app engine). I would expect that the cloud instance would 
> perform better, not worse!
>
> While trying to diagnose I switched to inserting into an empty temp table 
> -- same problem. So inserting 24K rows into a clean table appears to be a 
> "no-go" for Cloud SQL.
>
> How do I get this resolved or is Cloud SQL just dog slow?
>
> BTW, my app engine and cloud sql instances are in the same region and I'm 
> connecting via unix socket.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/78b11aaa-2f75-4615-8ed0-4fbfb53d715f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Can't write to local GCS file (python)

[Mike Lucente]

I've tabled this effort for now (though it's still a problem). I was trying 
to save a file so that I could then do a "LOAD DATA INFILE" to improve 
performance. But I think that there's a bigger issue with latency of my 
cloud sql instance.

Please see the 
following: https://groups.google.com/forum/#!topic/google-appengine/07f3QCOT7qQ

Thanks.

On Saturday, December 3, 2016 at 7:48:02 PM UTC-5, Adam (Cloud Platform 
Support) wrote:
>
> Interestingly, your code works fine for me on the development server 
> without any application default credentials set, or when setting 
> GOOGLE_APPLICATION_CREDENTIALS to a service account key without any role 
> set.
>
> The name app_default_bucket would be the bucket name returned on the 
> development server with app_identity.get_default_gcs_bucket_name(), but 
> it appears that gcs.open() is calling the production GCS XML API. Could 
> you share the full contents of the source file and the steps you're using 
> to run the app?
>
> On Saturday, December 3, 2016 at 12:34:39 PM UTC-5, Mike Lucente wrote:
>>
>> I'm getting "Access Denied" trying to open a GCS file for writing. I'm 
>> using these instructions: 
>> https://cloud.google.com/appengine/docs/python/googlecloudstorageclient/read-write-to-cloud-storage.
>>  
>> Googling not helping much. Thanks in advance.
>>  
>> Here's my code and the error:
>>
>> bucket_name = os.environ.get('BUCKET_NAME', 
>> app_identity.get_default_gcs_bucket_name())
>> filename = '/' + bucket_name + '/' + 'myfile'
>> print filename
>> gcs_file = gcs.open(filename,
>> 'w',
>> content_type='text/plain')
>>
>> ForbiddenError: Expect status [201] from Google Storage. But got status 
>> 403.
>> Path: '/app_default_bucket/myfile'.
>> Request headers: {'accept-encoding': 'gzip, *', 'content-type': 
>> 'text/plain', 'x-goog-api-version': '2', 'x-goog-resumable': 'start'}.
>> Response headers: {'server': 'UploadServer', 'vary': 'Origin', 
>> 'content-length': '210', 'x-guploader-uploadid': 
>> 'AEnB2UrEb9QG7lLMhN-Fu_kjPLbVwSuKfufgxIufy37ENZq0bK97IMaPdIuxA0ao4pTfuGAhZyi5hWzG5eqvBKEFk0nwheghJbkH4MlUSgFdKVzkFgt6rO8',
>>  
>> 'content-type': 'application/xml; charset=UTF-8', 'alt-svc': 'quic=":443"; 
>> ma=2592000; v="36,35,34"', 'date': 'Sat, 03 Dec 2016 17:33:41 GMT'}.
>> Body: "> encoding='UTF-8'?>AccessDeniedAccess 
>> denied.Caller does not have storage.objects.create 
>> access to bucket app_default_bucket.".
>> Extra info: None.
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/2d61a8d4-ac3b-47ec-8e54-35d7b96f4a92%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Major Cloud SQL latency for INSERT's

[Mike Lucente]

I'm inserting 24K records into a table and seeing some major latency. I was 
running the same process about a month ago (I get a new batch of records 
every month) without a problem. Now the process craps out after 10 minutes 
with "Deadline exceeded". The same process runs without issue on my laptop 
(local dev app engine). I would expect that the cloud instance would 
perform better, not worse!

While trying to diagnose I switched to inserting into an empty temp table 
-- same problem. So inserting 24K rows into a clean table appears to be a 
"no-go" for Cloud SQL.

How do I get this resolved or is Cloud SQL just dog slow?

BTW, my app engine and cloud sql instances are in the same region and I'm 
connecting via unix socket.


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/82328ba4-4c68-456e-91c5-f5856f68cb6a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Can't write to local GCS file (python)

[Mike Lucente]

I'm getting "Access Denied" trying to open a GCS file for writing. I'm 
using these 
instructions: 
https://cloud.google.com/appengine/docs/python/googlecloudstorageclient/read-write-to-cloud-storage.
 
Googling not helping much. Thanks in advance.
 
Here's my code and the error:

bucket_name = os.environ.get('BUCKET_NAME', 
app_identity.get_default_gcs_bucket_name())
filename = '/' + bucket_name + '/' + 'myfile'
print filename
gcs_file = gcs.open(filename,
'w',
content_type='text/plain')

ForbiddenError: Expect status [201] from Google Storage. But got status 403.
Path: '/app_default_bucket/myfile'.
Request headers: {'accept-encoding': 'gzip, *', 'content-type': 
'text/plain', 'x-goog-api-version': '2', 'x-goog-resumable': 'start'}.
Response headers: {'server': 'UploadServer', 'vary': 'Origin', 
'content-length': '210', 'x-guploader-uploadid': 
'AEnB2UrEb9QG7lLMhN-Fu_kjPLbVwSuKfufgxIufy37ENZq0bK97IMaPdIuxA0ao4pTfuGAhZyi5hWzG5eqvBKEFk0nwheghJbkH4MlUSgFdKVzkFgt6rO8',
 
'content-type': 'application/xml; charset=UTF-8', 'alt-svc': 'quic=":443"; 
ma=2592000; v="36,35,34"', 'date': 'Sat, 03 Dec 2016 17:33:41 GMT'}.
Body: "AccessDeniedAccess 
denied.Caller does not have storage.objects.create 
access to bucket app_default_bucket.".
Extra info: None.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a96bfd09-73cb-4207-8c81-6358c35bea97%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Access-Control-Allow-Origin Issue with API

[Mike Tickle]

Hey Adam,

In my PHP file, I set:

header('Content-Type: application/json');

But when I look at the output of the file in something like Postman, it 
says it is a gzip encoding with an html/text content type. It appears that 
the content type header is being stripped from the PHP output.

-Mike


On Saturday, November 12, 2016 at 12:36:41 PM UTC-5, Adam (Cloud Platform 
Support) wrote:
>
> You should be able to set any response header in your handler code. Can 
> you elaborate on how you're trying to set it in your PHP script, and what 
> you mean by "doesn't work in the file because of the compression" ?
>
> On Wednesday, November 9, 2016 at 4:15:38 PM UTC-5, Mike Tickle wrote:
>>
>> Hello everyone,
>>
>> I have written a pretty simple API in PHP and am running it as a service (
>> https://protoapi-dot-rehash-148415.appspot.com/events/).
>>
>> When I try to load a data grid with the JSON from the API, I am getting 
>> the dreaded "No 'Access-Control-Allow-Origin' header is present on the 
>> requested resource." error on the page on which I want to consume the JSON. 
>> (http://proto-angular-dot-rehash-148415.appspot.com/events.php)
>>
>> I've tried a couple of different methods to add 
>> Access-Control-Allow-Origin: "*" to the app.yaml file and to the header in 
>> the PHP file that produces the API. I think it doesn't work in the yaml 
>> because you cannot apply http_headers to dynamic files, and it doesn't work 
>> in the file because of the compression.
>>
>> Is there any other way to make this work, short of putting the API and 
>> the app in the same service? I'd hate to do that because I am using 
>> mod_rewrite for the API and it will probably cause chaos on my app.
>>
>> Any insights would be greatly appreciated!
>>
>> -Mike
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/4fdae6ff-d463-439f-879e-a1774cad2bc3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Access-Control-Allow-Origin Issue with API

[Mike Tickle]

Hello everyone,

I have written a pretty simple API in PHP and am running it as a service 
(https://protoapi-dot-rehash-148415.appspot.com/events/).

When I try to load a data grid with the JSON from the API, I am getting the 
dreaded "No 'Access-Control-Allow-Origin' header is present on the 
requested resource." error on the page on which I want to consume the JSON. 
(http://proto-angular-dot-rehash-148415.appspot.com/events.php)

I've tried a couple of different methods to add 
Access-Control-Allow-Origin: "*" to the app.yaml file and to the header in 
the PHP file that produces the API. I think it doesn't work in the yaml 
because you cannot apply http_headers to dynamic files, and it doesn't work 
in the file because of the compression.

Is there any other way to make this work, short of putting the API and the 
app in the same service? I'd hate to do that because I am using mod_rewrite 
for the API and it will probably cause chaos on my app.

Any insights would be greatly appreciated!

-Mike

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/47a52c10-0fdc-4eed-8fa5-95e67d0cb1fb%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Unable to restore datastore backup

[Mike Lucente]

Please do. Thanks.

On Tue, Nov 8, 2016 at 12:11 PM, 'Josh Moore' via Google App Engine <
google-appengine@googlegroups.com> wrote:

> This is likely app/project-specific, based on your other posts in this
> group.  Let me follow up with you off-thread for some additional details.
>
> On Tue, Nov 8, 2016 at 9:05 AM, Mike Lucente <motoadd...@gmail.com> wrote:
>
>> I've created a backup from a project that I'd like to import into a new
>> project. I'm getting the following error:
>>
>> Requested path https://storage.googleapis.com
>> /backup-bocachessclub/ag9zfm.backup_info is not accessible/access
>> denied
>>
>> I added the following permissions (referencing the target application) to
>> the bucket BEFORE creating the backup:
>>
>> Projectowners-Owner
>> Userapp...@appspot.gserviceaccount.comOwner
>>
>> I'm becoming very frustrated with GAE and it's cloud relationship. I'm
>> only trying to move my datasore because I cannot upload to the blobstore
>> and I cannot use v2 SQL instances in my old app and I've no way to get
>> resolution from google. See my other recent posts.
>>
>> Maybe google is discouraging app engine? I know that I'm discouraged.
>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to google-appengine+unsubscr...@googlegroups.com.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> Visit this group at https://groups.google.com/group/google-appengine.
>> To view this discussion on the web visit https://groups.google.com/d/ms
>> gid/google-appengine/789abe5d-4976-4d77-a0f4-c9c08d981539%
>> 40googlegroups.com
>> <https://groups.google.com/d/msgid/google-appengine/789abe5d-4976-4d77-a0f4-c9c08d981539%40googlegroups.com?utm_medium=email_source=footer>
>> .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
>
> --
>
> Josh Moore |  Cloud Solutions Engineer |  joshu...@google.com |
>
> --
> You received this message because you are subscribed to a topic in the
> Google Groups "Google App Engine" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/
> topic/google-appengine/BGre6ZWoZug/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/CAOvpJmXJj880ZLMPc4WTH4SC5RxCY
> JyhRSMKJMB1gBpk%3D8RoYw%40mail.gmail.com
> <https://groups.google.com/d/msgid/google-appengine/CAOvpJmXJj880ZLMPc4WTH4SC5RxCYJyhRSMKJMB1gBpk%3D8RoYw%40mail.gmail.com?utm_medium=email_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CACRLM0Vi4%3Dv4T3%2BtoLonRzgZ7RsYu0u5v%3Dmktby2FH09OedamQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Unable to restore datastore backup

[Mike Lucente]

I've created a backup from a project that I'd like to import into a new 
project. I'm getting the following error:

Requested path 
https://storage.googleapis.com/backup-bocachessclub/ag9zfm.backup_info 
is not accessible/access denied

I added the following permissions (referencing the target application) to 
the bucket BEFORE creating the backup:

Projectowners-Owner
Userapp...@appspot.gserviceaccount.comOwner

I'm becoming very frustrated with GAE and it's cloud relationship. I'm only 
trying to move my datasore because I cannot upload to the blobstore and I 
cannot use v2 SQL instances in my old app and I've no way to get resolution 
from google. See my other recent posts.

Maybe google is discouraging app engine? I know that I'm discouraged.


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/789abe5d-4976-4d77-a0f4-c9c08d981539%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] 503 error trying to upload to blobstore using old project -- works fine in new project

[Mike Lucente]

Really struggling to get resolution on this issue and it would appear to be 
on google's end.

My app is a few years old and am trying to add capability to upload files 
to the blobstore. Works fine locally and works fine in a new project. I 
would prefer not to have to migrate to a new project but it's looking like 
my only option at this point. Also am unable to use mysql v2 (v1 works) 
which further leads me to believe that this is a config issue on google's 
end.

Anyway, standard upload to default bucket and I get a 503. Have read all 
other posts and tried mucking around with service accounts, etc. to no 
avail. 503 means no log entries so there's really no way for me to debug.

Would be cool if google would lend a bit of support here and save me from 
some pain. Long time user.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/b207ce00-68be-48d4-a5d3-aedb74496792%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Unable to connect to Cloud SQL from app engine (python)

[Mike Lucente]

They are (or were) part of the same project. I've since reverted to mysql 
v1 which works fine. I've removed the v2 instance since then but could 
easily recreate it if I thought it might work.

I did notice that my project did NOT have an @appspot.gserviceaccount.com 
service account. I've added it by hand but don't know if that might help(?)

I was hoping that it would help to resolve yet another app engine/storage 
issue that I've recently encountered -- I'm unable to upload to the 
blobstore with my old app. I get an HTTP 503 as soon as I hit the upload 
button and the logs record nothing. If I try the same upload in a new 
project it works fine. Adding the @appspot.gserviceaccount.com entry did 
not help with this issue.

There's something not right with my project and I appear to have no ability 
to fix it. Appreciate your help.

On Sunday, November 6, 2016 at 4:14:53 PM UTC-5, Adam (Cloud Platform 
Support) wrote:
>
> I noticed you mentioned that the App Engine app and Cloud SQL instance are 
> in the same region, but are they part of the same project?
>
> If they are in the same project, no authorization is needed, otherwise you 
> still need to go to 'Access control' -> 'Authorization' -> 'App Engine 
> authorization' in the instance details and follow the steps to add the App 
> Engine default service account for the App Engine project as an Editor in 
> the Cloud SQL instance project.
>
> Even if they're in the same project, you may still have a problem if the 
> App Engine default service account is missing from the 'IAM & Admin' 
> section of the project. If it was deleted, usually you need to recreate the 
> project. However, there's a workaround which you can try 
> <https://code.google.com/p/googleappengine/issues/detail?id=13085> to 
> recover it in the Cloud Console.
>
> On Friday, November 4, 2016 at 3:40:09 PM UTC-4, Mike Lucente wrote:
>>
>> I'm getting the following when trying to connect to Cloud SQL from app 
>> engine using python:
>>
>> super(Connection, self).*init*(*args, **kwargs2) OperationalError: 
>> (2013, "Lost connection to MySQL server at 'reading initial communication 
>> packet', system error: 38")
>>
>>
>> I've posted this on stackoverflow:
>>
>>
>> http://stackoverflow.com/questions/40425349/unable-to-connect-to-cloud-sql-from-app-engine-python
>>
>>
>> No luck so far. My appengine app is a few years old and I'm concerned 
>> that google may need to get involved. Unfortunately I'm a bronze customer 
>> and have no way to ask for technical support.
>>
>>
>> Thought I'd drop it in here too in case someone has an answer. If I'm 
>> unable to resolve I may have set up my database elsewhere.
>>
>>
>> Hoping someone has a solution.
>>
>>
>> Thanks.
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/c29e4d90-bf4e-4e52-8cf4-c89147b11871%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Unable to connect to Cloud SQL from app engine (python)

[Mike Lucente]

I'm getting the following when trying to connect to Cloud SQL from app 
engine using python:

super(Connection, self).*init*(*args, **kwargs2) OperationalError: (2013, 
"Lost connection to MySQL server at 'reading initial communication packet', 
system error: 38")


I've posted this on stackoverflow:

http://stackoverflow.com/questions/40425349/unable-to-connect-to-cloud-sql-from-app-engine-python


No luck so far. My appengine app is a few years old and I'm concerned that 
google may need to get involved. Unfortunately I'm a bronze customer and 
have no way to ask for technical support.


Thought I'd drop it in here too in case someone has an answer. If I'm 
unable to resolve I may have set up my database elsewhere.


Hoping someone has a solution.


Thanks.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/bd443cf8-f5b1-426c-ae9c-ddef983ecdce%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Error: "This operation is not possible because no App Engine application was found for this project"

[Purn Mike]

Hello i could not find the support on swedish so im trying here im getting 
the same problem and i just created new project for my small store i did 
take free version because i want to learn before i buy this program can i 
get some info? how its work?=

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/406e66a7-14e4-4796-8daa-09c82e87a712%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Flexible environment: Manual scaling doesn't work

[Mike Chang]

I need a worker node that is always on. From my understanding Google 
managed is the only option on Google Cloud as the servers are always on.

In the beginning I ran google preview app deploy, and 20 or so instances 
pop up. I then have this with the node on docker image:

runtime: custom
vm: true
api_version: 2
env_variables:
  runLocal: false
manual_scaling:
  instances: 1

Now only one instance shows up after deploy, but as soon as the server gets 
the first web request all 20 starts spawning again. This is not what I 
expected of the manual_scaling config. What am I missing?
Thanks

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/6a1bc2b3-7a36-4c21-a7f9-776154105894%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: New Cloud Console

[mike]

Please keep the old console for longer!

I really like the old console, way better than the new console. Old console 
is clean and fast, new console slow and trying to offer too much.

On Tuesday, February 23, 2016 at 6:46:19 PM UTC-5, johnP wrote:
>
> Just got email that old appengine console will be shut off in 6 weeks. 
>  The new cloud console does not have a "migrate traffic" option in the 
> Versions screen.  This was my absolute favorite new feature in a long, long 
> time.  Will it be available in the new console?
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/1de9db2e-505c-44dd-90e5-b066d0387862%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Issues with Appengine Search API?

[Mike Schlanser]

Hi,

We're getting a ton of errors with the search API ( Error below ) when 
adding sorting to the call.  Anyone else experiencing this?

com.google.appengine.api.search.SearchException: Failed to complete request 
 in 9499ms


Thanks,
Mike

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/11c67653-c5cd-4995-b15d-2402cb64ec6b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Issues with Appengine Search API?

[Mike Schlanser]

Yeah, same here.  Seems to be back to normal now.

On Wednesday, August 12, 2015 at 2:46:53 PM UTC-4, David Fischer wrote:

 As of 11:46 PST, my searches are back to normal.


 On Wednesday, August 12, 2015 at 11:42:29 AM UTC-7, David Fischer wrote:

 Yes, I am seeing exactly the same. It started at 11:10 PST. Most of our 
 searches are failing but some are succeeding. It seems to apply to certain 
 indexes. We have some search indexes where we are seeing ~100% success rate 
 and some where we are seeing 100% failure.

 On Wednesday, August 12, 2015 at 11:38:42 AM UTC-7, Mike Schlanser wrote:


 Hi,

 We're getting a ton of errors with the search API ( Error below ) when 
 adding sorting to the call.  Anyone else experiencing this?

 com.google.appengine.api.search.SearchException: Failed to complete 
 request in 9499ms


 Thanks,
 Mike



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/0d01bf6e-e3d3-42fb-8f8d-cece9b97a517%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Push Task Queue: Process terminated because the request deadline was exceeded during a loading request.

[Mike D]

As of this morning none of our apps (test, demo, production) are running. 
 Nothing changed over night.  Could this be the reason why?  Even now our 
apps won't run.  The GAE log shows: Process terminated because the request 
deadline was exceeded. (Error code 123).

There are multiple instances running.  We shut them all down and try 
accessing the app and the browser just waits and multiple instances start 
up again.

On Wednesday, June 17, 2015 at 6:50:21 AM UTC-7, Michael (Cloud Platform 
Support) wrote:

 Hi Clint,

 There was a known issue that occurred yesterday within your timeframe 
 involving application deployment difficulties and large task queue latency 
 spikes. This has since been resolved and you should be good to go from 
 here. You can find more info in this incident report 
 https://status.cloud.google.com/incident/appengine/15019.

 Cheers!

 On Tuesday, June 16, 2015 at 7:55:51 PM UTC-4, Clint Doriot wrote:


 I have a push task queue that, even with relatively small load, produces 
 a lot of the following error: Process terminated because the request 
 deadline was exceeded during a loading request.

 Tasks that produce these errors run the full 600s before they time out, 
 tie up the task queue, and don't seem to call any of my handler code*. When 
 they do finally run, they typically take 1-60 seconds (probably average 
 closer to 20s).

 * I'm assuming its not running any of my main handler code because the 
 first line of my handler code is a print statement, and it never gets 
 logged. Also one of the early steps is hitting an external server, which 
 also never logs the hit.

 I'm also noticing that these errors seem to be generated by a subset of 
 the same instances. Its like the instance gets tripped up and doesn't 
 process any of the requests that get sent to it. Those instances seem to 
 have no valid requests that have gone through.


 This is the main error I'm seeing:

 E 2015-06-16 17:42:27.108 500 0 B 605.3s E 17:42:27.105 
 /tasks/sync-twitter/friends/tw:944039 0.1.0.2 - - [16/Jun/2015:14:42:27 
 -0700] POST /tasks/sync-twitter/friends/tw:944039 HTTP/1.1 500 0 
 https://my-app.appspot.com/api/user; AppEngine-Google; 
 (+http://code.google.com/appengine) sync-twitter.my-app.appspot.com 
 ms=605304 cpu_ms=2 queue_name=sync-twitter-1 task_name=873919997852904174 
 pending_ms=5754 exit_code=125 
 instance=00c61b117cfd2005f05f45857103617298e8e508 app_engine_release=1.9.22 
 E 17:42:27.105 Process terminated because the request deadline was exceeded 
 during a loading request.


 But I also get a lot of similar deadline errors from seemingly random 
 points in the code:

 Traceback (most recent call last): File 
 /base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py,
  
 line 240, in Handle handler = 
 _config_handle.add_wsgi_middleware(self._LoadHandler()) File 
 /base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py,
  
 line 299, in _LoadHandler handler, path, err = LoadObject(self._handler) 
 File 
 /base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py,
  
 line 85, in LoadObject obj = __import__(path[0]) File 
 /base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/sync_twitter.py,
  
 line 18, in module from project.tasks import 
 queue_sync_twitter_network File 
 /base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/common/project/tasks.py,
  
 line 12, in module import project.models File 
 /base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/common/project/models/__init__.py,
  
 line 3, in module import leaderboards File 
 /base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/common/project/models/leaderboards.py,
  
 line 16, in module import project.game_date as game_date File 
 /base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/common/project/game_date.py,
  
 line 11, in module PROJECT_TZ_INFO = pytz.timezone('Pacific/Honolulu') 
 File 
 /base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/lib/pytz/__init__.py,
  
 line 171, in timezone _tzinfo_cache[zone] = build_tzinfo(zone, 
 open_resource(zone)) File 
 /base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/lib/pytz/__init__.py,
  
 line 86, in open_resource return loader.open_resource(name) 
 DeadlineExceededError

 ...or...

 Traceback (most recent call last): File 
 /base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py,
  
 line 240, in Handle handler = 
 _config_handle.add_wsgi_middleware(self._LoadHandler()) File 
 /base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py,
  
 line 299, in _LoadHandler handler, path, err = LoadObject(self._handler) 
 File 
 /base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py,
  
 line 85, in LoadObject obj = __import__(path[0]) File 

[google-appengine] Authenticating Users with HTTP Authentication in PHP

[Mike Dorfman]

Hello,

I'm hoping to have a members only section of my appspot page, but am 
hoping to use instead of authenticating with Google credentials.  I was 
hoping to use HTTP Authentication with PHP, but am having trouble.  I found 
that the PHP global variable 'PHP_AUTH_USER' is not set after submitting 
authentication credentials, making the authentication pop-up come back up 
until I hit cancel.  You can see an example of this page here: 
http://xmountwashington.appspot.com/cscTesting.php and the php code behind 
it below.

if (!isset($_SERVER['PHP_AUTH_USER'])) {
header('WWW-Authenticate: Basic realm=Please enter your email in the 
username box and member ID in the password box');
header('HTTP/1.0 401 Unauthorized');
echo 'Login credentials required for this Premium Content page.';
exit;
} else {
//Verify that the user has the proper credentials
}

I've heard if you have the CGI version of PHP running, this type of user 
authentication won't work too easily.  According to the manual:

In order to get HTTP Authentication to work using IIS server with the CGI 
 version of PHP you must edit your IIS configuration *Directory Security*. 
 Click on *Edit* and only check *Anonymous Access*, all other fields 
 should be left unchecked.


Does GAE PHP automatically run in CGI mode?  How can I get HTTP 
authentication working in GAE?  More generally, is there an easier way to 
authenticate users with a username/password table in MySQL than to use HTTP 
Authentication?

Thank you,
Mike

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/259040db-c766-4b17-97ba-0108fa86edae%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Can't log in to deploy with GAE

[Mike Serfas]

I was trying to upgrade a site msserfas.appspot.com that I set up in 2013 
and last accessed in May 2014.  However, I can't log in to deploy using 
the current GAE Python application on Windows -- even though I can log in 
to Google and view the failed login attempts, database, memcache, etc.  
I've tried every form of my email, and a few of my old Google passwords 
though I doubt I remember all; the current one certainly doesn't work.  
Always the outcome is something like

Password for [whatever]: Invalid username or password.
2015-01-06 11:18:50,740 ERROR appcfg.py:2413 An error occurred processing 
file '': HTTP Error 401: Unauthorized. Aborting. 

In the process of trying to get help, I found that I don't get a contact 
link unless I log into an administrator account that I don't have (that I 
know of).  To create it, I went to 
https://www.google.com/a/cpanel/standard/setup/msserfas but that gets me a 
server error.  In theory this means that the project is deleted or aliased, 
but the project is still online at msserfas.appspot.com, and it's the only 
project I have as listed under 
https://console.developers.google.com/project .

To be sure, this is a free site and I can't expect much, but what is also 
confusing is that I read elsewhere Google stopped setting up free app 
engine sites in 2012... so I'm not actually even sure this site is allowed 
at this point, whether the login failures are a bug or a feature.

Is there a fix for this?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Server Error when Opening App in Console

[Mike Apotheosis]

The issue was my YAML file contained:-

- url: /.*
  script: about.application

Once I changed this so that the about page wasn't so greedy, it has 
worked.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Server Error when Opening App in Console

[Mike Apotheosis]

When I open up the Google App Engine console and click on one particular 
app I get:-

Server Error (500)
A server error has occurred.

Additional info:-

   - This only happens for one app (I have 8 in total).
   - The app is deployed and I can view it no dramas via the appspot URL.
   - It happens as soon as I click the app name in the Applications 
   Overview page - I am unable to view the console for that app at all.
   - There are no errors when deploying from the GAE Launcher and I've 
   tried re-deploying several times.
   - I was able to login at one point but I have been receiving this error 
   for a few days now.
   - The app is Python (as are all my apps).
   - I tried logging in incognito and on a different PC without success.
   - I also tried deleting all the *.pyc files and re-compiling them but it 
   made no difference.
   
Has anyone else come across this issue? Any suggestions on how to resolve 
it?

At this stage I would be happy if someone could tell me how I might remove 
the app, and I'll re-create it under another name. I've tried going 
to https://appengine.google.com/disabling?app_id=s~my-app-name but I just 
get the above error.

Thanks.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Server Error when Opening App in Console

[Mike Apotheosis]

I was able to delete the app via http://console.developers.google.com 
rather than http://appengine.google.com. I've been able to re-create it 
under another name; all is now working fine.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Google Cloud Endpoint initialization

[Mike D]

I have some initialization stuff that I'd like to do before GCE can be 
used.  How would I do this?  I tried creating a ServletContextListener and 
then calling a static method on my GCE but that doesn't work.  In debugging 
I can see that the GCEs static variables are not set when a method is 
invoked.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Request to not use Maven in GAE

[Mike D]

It seems like Maven is working its way into GAE.  I would like to make my 
preference known to the GAE team.  I prefer to not use Maven.  I find it 
better to expand upon the GPE and simply provide documentation for how to 
set up a configuration.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Is there a better tutorial on how to Retrieve all users in a domain

[Mike Ellis]

I'm using PHP. link 
https://developers.google.com/admin-sdk/directory/v1/guides/manage-users#get_all_domain_users

For reference, a PHP tutorial for pulling Calendar data from Google Apps,

https://developers.google.com/appengine/docs/php/appidentity/

-- 


The materials in this e-mail are private and may contain protected Health 
Information. If you are not the intended recipient be advised that any 
unauthorized use, disclosure copying, distribution or the taking of any action 
in reliance on the contents of this information is strictly prohibited. If you 
have received this email in error, please immediately notify the sender by 
return e-mail.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Google Apps for Business + Google App Engine + PHP = Retrieve all users in a domain?

[Mike Ellis]

(Please let me know if there is a better forum to post this question)

Here's the setup,

   1. Google Apps for Business account setup with Google App Engine 
   setup/linked under App Engine Apps.
   2. Using PHP/CloudSQL in Google App Engine, both setup and working.
   3. Google App Engine API's, Admin SDK enabled
   4. Google App Engine Authentication Domain: enabled for just one 
   domain.
   5. Google Apps - Admin Console - Security - Enable API Access 
   checked

I want to be able to Retrieve all users in a 
domainhttps://developers.google.com/admin-sdk/directory/v1/guides/manage-users#get_all_domain_users
 so 
I can pull up a list of users in the authenticated domain. The following is 
a snippet from the page,

// Is this the correct command, simply change the domain?
GET 
https://www.googleapis.com/admin/directory/v1/users?domain=example.commaxResults=2
 



I'm using the App Identity PHP API 
Overviewhttps://developers.google.com/appengine/docs/php/appidentity/ to 
try and understand the process but it's a little vague and I could really 
use some help. Here's a code snippet from the API Overview page,

function setAuthHeader() {
  $access_token = 
AppIdentityService::getAccessToken(https://www.google.com/m8/feeds;); // 
m8/feeds what does this reference and what would need to be changed for a 
user list?
  return [ sprintf(Authorization: OAuth %s, $access_token[access_token]) ];
}

$get_contacts_url = https://www.google.com/m8/feeds/contacts/default/full;; // 
Again, what address would need to be here?


Any help would be much appreciated. I would also like to be able to add and 
remove users as well. My ultimate goal is to be able to put users into a 
database so I can track other variables.



-- 


The materials in this e-mail are private and may contain protected Health 
Information. If you are not the intended recipient be advised that any 
unauthorized use, disclosure copying, distribution or the taking of any action 
in reliance on the contents of this information is strictly prohibited. If you 
have received this email in error, please immediately notify the sender by 
return e-mail.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Is GAE the right choice for e-commerce?

[Mike Knapp]

Hi Umesh

We use Adyen to process our payments. However there are many solution 
providers on the market you could use, e.g. Stripe or Braintree.

Mike :) 

On Saturday, November 2, 2013 11:02:59 AM UTC+11, Kaan Soral wrote:

 What do you mean by that question - are you looking for payment solutions?

 By the way, unrelated, I had the youtube success story bookmarked, 
 stumbled upon it not so long ago, envied the result a lot :)
 I'm also struggling acquiring an initial user-base, reached out to 1-2 
 tumblr celebrities without any luck, might take this bump as a sign and 
 reach out to some youtube celebrities too :)

 On Wednesday, October 30, 2013 5:50:50 AM UTC+2, Umesh Veerasingam wrote:

 Hi Mike,

 Do you have any documentation/API (links) about the visa/credit card 
 payment option on your site(Shoes of Prey)?

 Thanks.

 On Monday, February 1, 2010 7:19:04 AM UTC-6, Mike wrote:

 Hi NG

 We are running our business on AppEngine. (Search Shoes of Prey on
 Google to find us.)

 So far, it is going really well. AppEngine is a delight to develop on,
 and you can't argue with the cost. (I've only been charged $0.01 so
 far. Although, as I've posted in another thread, the small charge by
 itself was problematic for me.) :)

 I had to write the entire ecommerce platform from scratch - which
 suited me given the very custom nature of our business - however you
 may not be as keen as me. It really depends on your business.

 We choose AppEngine primarily because a) 2 of us used to work at
 Google, and we love AppEngine b) if we start serving a lot of traffic/
 bandwidth we want something scalable. As I said earlier as well, the
 API is really nice and makes developing a breeze.

 The only thing I wish AppEngine had was HTTPS support for custom
 domains, and I'm hopeful that one day it will be supported. There are
 workarounds too. Once AppEngine has HTTPS support and a few open-
 source ecommerce software packages, it will be a really great platform
 I would think.

 Good luck.

 Mike

 On Jan 31, 4:31 pm, decuman ngn...@gmail.com wrote:
  Hello,
 
  At the moment I'm thinking of building a small/medium online selling
  business and before investing more of my time (and money) into GAE
  based development it would be just great to know some experienced
  users and expert thoughts and opinions on it.
 
  As far as I can see (after reading related books, articles and message
  group threads) GAE is just a perfect solution for prototyping and
  building a social networking applications (Blogs, Chats, Galleries,
  Message boards etc.) which requires tracking a lot of users and
  storing data... which is great. But there is quite a few (literally
  none) of nice business/e-commerce applications with decent product
  galleries, shopping carts and checkout functionality and payment
  service integration. Also there are lots of complains and negative
  responses pointing to big GAE functional limitations (which are not
  going to improve soon or ever) and overall practicability of using it
  as a reliable e-commerce platform. In particular (PayPal, Google
  Checkout integration)
 
  It wasn't a very deep and thoughtful investigation but the outlined
  above is just my personal subjective feeling so far. I would really
  love to know the opinion and thoughts on this matter from GAE experts.
  Shell I move forward with Google App Engine development or it would be
  move wise to consider some other solution?
 
  Thanks in advance!
  NG



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Large numbers of Error 500 - log says (Error code 121) after only a few seconds.

[Mike Knapp]

We are seeing this too. Our app (shoesofprey-hrd) is completely unreliable 
at the moment.



On Thursday, September 26, 2013 9:57:11 AM UTC+8, Cesium wrote:

 I'm seeing this too.

 The latest update from the downtime notify group says that they have fixed 
 the problem.

 I reply, Sir, you are mistaken. The problem persists!

 Wtf?
 David



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Unable to load application due to HardDeadlineExceededError

[Mike Marich]

As of about noon today, my app has been unable to initialize due to 
instances of HardDeadlineExceededError. It looks like the issue is due to 
IO calls from the class loader, but I am not 100% sure. This application 
has been deployed and running for some time, and I am not sure where the 
issue could lie. For reference, this is a Spring MVC app.I have tries 
re-deploying my app, switching versions, and no luck. Below is the stack 
trace. Any suggestions are appreciated, thanks.

2013-08-30 23:30:25.527

Uncaught exception from servlet
com.google.apphosting.runtime.HardDeadlineExceededError: This request 
(2d71f7fff73820d4) started at 2013/08/31 06:29:24.565 UTC and was still 
executing at 2013/08/31 06:30:25.315 UTC.
at 
com.google.appengine.runtime.Request.process-2d71f7fff73820d4(Request.java)
at java.util.zip.ZipFile.read(Native Method)
at java.util.zip.ZipFile.access$1400(ZipFile.java:68)
at java.util.zip.ZipFile$ZipFileInputStream.read(ZipFile.java:692)
at 
java.util.zip.ZipFile$ZipFileInflaterInputStream.fill(ZipFile.java:426)
at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:158)
at java.io.FilterInputStream.read(FilterInputStream.java:133)
at java.io.FilterInputStream.read(FilterInputStream.java:107)
at java.lang.ClassLoader.loadClass(ClassLoader.java:359)
at 
org.apache.commons.logging.LogFactory.getResourceAsStream(LogFactory.java:1355)
at org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:544)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:685)
at 
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:270)
at 
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at 
org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:548)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at 
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
at 
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
at 
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
at 
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at 
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:435)
at 
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:442)
at 
com.google.tracing.CurrentContext.runInContext(CurrentContext.java:186)
at 
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:306)
at 
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:298)
at 
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:439)
at java.lang.Thread.run(Thread.java:722)

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] SDK running reeeeeallly slow

[Mike Knapp]

Has anyone else noticed the SDK consuming a lot of system resources 
recently? My computer is grinding to a halt, with the local dev server 
taking 60% of the CPU even when it's just sitting idle. It's painful to use.

This seems to be a recent issue after upgrading. I'm on a Mac.

Mike

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Running App Engine Instance 1.8.2

[Mike Johnson]

Yup, and they seem to have changed the api in this point release.

My logs are full of this:

   import google.appengine.api.servers
ImportError: No module named servers


Funny, that worked yesterday.

On Monday, July 8, 2013 11:57:39 PM UTC-7, Nikhil Jain wrote:

 Hi GAE fellow,

 Few of my appengine application instance running on 1.8.1 and others are 
 on 1.8.2.
 Is 1.8.2 been released or its pre-released version?

 

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: 1.8.1 Pre-release SDKs Available.

[Mike]

Hi Chris

That would work for me, provided there was an easy way to get a 
public Picasa URL for an uploaded image, etc. Thanks :)

Mike


On Saturday, June 8, 2013 2:04:23 PM UTC+8, Chris Ramsdale wrote:

 hey Chris, et al.--

 a bunch of great feedback that we'll continue to address.  in regards to 
 timeline, we have no plans of decommissioning this API before end of year. 
 that said, assuming the following:

- App Engine = Google Cloud Storage performance is equivalent to (if 
not better than) App Engine = Blobstore
- all blobs were auto-migrated over to Cloud Storage (free of charge)
- all existing URLs just worked

 what would keep you from migrating over to a Cloud Storage-based solution?

 -- Chris


 On Fri, Jun 7, 2013 at 6:00 PM, Chris ritte...@gmail.com javascript:wrote:

 Jon,

 Any word on the timeline?

 - Chris

 --
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To unsubscribe from this group and stop receiving emails from it, send an 
 email to google-appengi...@googlegroups.com javascript:.
 To post to this group, send email to 
 google-a...@googlegroups.comjavascript:
 .
 Visit this group at http://groups.google.com/group/google-appengine?hl=en
 .
 For more options, visit https://groups.google.com/groups/opt_out.





-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: 1.8.1 Pre-release SDKs Available.

[Mike]

Hi Max

The issue for us would be that we now have millions of images written to 
Blobstore, all with publicly facing URLs... moving those to Cloud Storage 
would likely be expensive and disruptive unless Google can automatically 
manage that for us.

What I would hate is to have to run 2 systems in parallel: 1 legacy, 1 
shiny new object.

Mike :-)





On Friday, June 7, 2013 5:18:02 AM UTC+8, Max Ross wrote:

 Hi Jon,

 The alternative is to programmatically write to Google Cloud Storage. Can 
 you tell me why it's important to write to Blobstore versus GCS?

 Thanks,
 Max


 On Thu, Jun 6, 2013 at 1:41 AM, jon jonni...@gmail.com javascript:wrote:

 Chris and Tom,

 I absolutely need programmatic write access to Blobstore, and the Files 
 API is what I'm using at the moment. What alternative will we have?

  -- 
 You received this message because you are subscribed to a topic in the 
 Google Groups Google App Engine group.
 To unsubscribe from this topic, visit 
 https://groups.google.com/d/topic/google-appengine/zzpFI5PQbLI/unsubscribe?hl=en
 .
 To unsubscribe from this group and all its topics, send an email to 
 google-appengi...@googlegroups.com javascript:.
 To post to this group, send email to 
 google-a...@googlegroups.comjavascript:
 .
 Visit this group at http://groups.google.com/group/google-appengine?hl=en
 .
 For more options, visit https://groups.google.com/groups/opt_out.
  
  




-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Huge increase in datastore reads - hit $1,000 a day

[Mike]

Hi guys

Today our app went offline for 30 minutes because we hit our daily budget 
of $1,000. The cost was primarily in database reads. Normally we'd be 
expecting $100 - $200.

There were some database timeouts just before we went offline. One initial 
theory is that the database failing caused many tasks to continually retry. 
Unfortunately I think, at the time, were were doing a full backup and also 
syncing our customer records with MailChimp.

Did anyone else notice another similar? Anyone got any ideas about how to 
limit costs blowouts like this when there is some problem with the 
underlying infrastructure and you have a lot of failing tasks basically 
DoS'ing your own site? The only solution I can think of is to have a 
really really high daily budget, and try to periodically detect abnormal 
usage... That's quite risky though if you don't detect it in time.

It's hard to know who should fix this. Is it AppEngine's job because the 
infrastructure (potentially) failed? Or is it our fault for not trying to 
detect that? That's really hard when you're running a really big MapReduce, 
for example, where you expect a few errors, but you don't want errors to 
continue to fester and then take your site offline.

Maybe there could be a setting to automatically pause a task queue and 
email the administrators if X% of tasks fail within a certain timeframe?

Cheers
Mike

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] SSL configuration issue (GAE/Java)

[Mike Dougherty]

I'm having a little trouble getting SSL to work correctly with my Java 
application. I've configured it according to the information found here:

https://developers.google.com/appengine/docs/java/config/webxml#Secure_URLs

And it appears to work, however it is requiring the user login with a 
Google account before redirecting back to the SSL URL. How in the world do 
I configure this application to force SSL without requiring the user be 
logged in to a Google Account? 

Thanks,
Mike

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: SSL configuration issue (GAE/Java)

[Mike Dougherty]

Hey Thomas,

Thank you for the reply. I could have sworn I had configured an app in the 
past, via the web.xml to use SSL (without login), but I must be remembering 
wrong. I will add a simple redirect in my application code as you suggest. 

Thanks,
Mike


On Sunday, May 26, 2013 6:34:09 AM UTC+3, Thomas Wiradikusuma wrote:

 Hi Mike,

 SSL for MYAPP.appspot.com is automatic, you don't need to do anything 
 (just open https://MYAPP.appspot.com). For custom domain (e.g. MYAPP.com) 
 the doc is https://developers.google.com/appengine/docs/ssl. For both 
 cases, to force user to use https, handle in your code (e.g. if 
 request.notsecure then redirect to https version of the same URL).

 The link you gave is about securing url with Google Account (or whatever 
 you specify in Authentication Type in Application Settings in control 
 panel).


 Regards,
 Thomas Wiradikusuma



 On Sunday, 26 May 2013 04:06:55 UTC+8, Mike Dougherty wrote:


 I'm having a little trouble getting SSL to work correctly with my Java 
 application. I've configured it according to the information found here:


 https://developers.google.com/appengine/docs/java/config/webxml#Secure_URLs

 And it appears to work, however it is requiring the user login with a 
 Google account before redirecting back to the SSL URL. How in the world do 
 I configure this application to force SSL without requiring the user be 
 logged in to a Google Account? 

 Thanks,
 Mike



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Duplicate records in Backup Data?

[Mike]

Great - thanks Arie. Any idea when this will be ready? An approximation 
only would be appreciated. i.e. 1 month, 6 months, 1 year?

On Friday, May 3, 2013 6:30:34 AM UTC+10, Arie Ozarov wrote:



 On Wednesday, May 1, 2013 3:39:06 PM UTC-7, Jason Collins wrote:

 On reflection, I suspect it has more to do with Map-Reduce task retries 
 than some race condition.

 Correct. Not an issue for backup/restore but is a known issue for BigQuery 
 imports.
 We plan to eliminate duplicates in the MR level. 


 j

 On Tuesday, 30 April 2013 22:59:53 UTC-6, Jason Collins wrote:

 We have seen the same phenomenon. 

 It's likely due to some kind of race condition in the backup tool 
 itself, but is not a problem there because when restoring, one of the dups 
 will just overwrite the other. But it does become a problem once ingested 
 into BigQuery.

 j

 On Monday, 29 April 2013 20:10:34 UTC-6, Mike wrote:

 Hi there

 I've noticed there may be duplicate records in the Backup data that 
 AppEngine produces.

 I can verify this because I'm loading the Backups into BigQuery. When I 
 search one of my tables, I can see the duplicates:

 SELECT __key__.id as X_id, COUNT(__key__.id) as X_count, created FROM 
 [TableId] GROUP BY X_id, created HAVING X_count  1 ORDER BY created DESC;

 This shows there are 5,807 duplicates in a table of ~2 million entries 
 (~0.2%)

 I can give Google employees access to our BigQuery and Google Storage 
 accounts if that helps track down the issue.

 Cheers
 Mike



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Duplicate records in Backup Data?

[Mike]

I would think it would be possible for the BigQuery team to discard 
duplicates when running the import? That's probably going to be the easiest 
solution



On Thursday, May 2, 2013 8:39:06 AM UTC+10, Jason Collins wrote:

 On reflection, I suspect it has more to do with Map-Reduce task retries 
 than some race condition.

 j

 On Tuesday, 30 April 2013 22:59:53 UTC-6, Jason Collins wrote:

 We have seen the same phenomenon. 

 It's likely due to some kind of race condition in the backup tool itself, 
 but is not a problem there because when restoring, one of the dups will 
 just overwrite the other. But it does become a problem once ingested into 
 BigQuery.

 j

 On Monday, 29 April 2013 20:10:34 UTC-6, Mike wrote:

 Hi there

 I've noticed there may be duplicate records in the Backup data that 
 AppEngine produces.

 I can verify this because I'm loading the Backups into BigQuery. When I 
 search one of my tables, I can see the duplicates:

 SELECT __key__.id as X_id, COUNT(__key__.id) as X_count, created FROM 
 [TableId] GROUP BY X_id, created HAVING X_count  1 ORDER BY created DESC;

 This shows there are 5,807 duplicates in a table of ~2 million entries 
 (~0.2%)

 I can give Google employees access to our BigQuery and Google Storage 
 accounts if that helps track down the issue.

 Cheers
 Mike



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Duplicate records in Backup Data?

[Mike]

Hi there

I've noticed there may be duplicate records in the Backup data that 
AppEngine produces.

I can verify this because I'm loading the Backups into BigQuery. When I 
search one of my tables, I can see the duplicates:

SELECT __key__.id as X_id, COUNT(__key__.id) as X_count, created FROM 
[TableId] GROUP BY X_id, created HAVING X_count  1 ORDER BY created DESC;

This shows there are 5,807 duplicates in a table of ~2 million entries 
(~0.2%)

I can give Google employees access to our BigQuery and Google Storage 
accounts if that helps track down the issue.

Cheers
Mike

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Search API over quota

[Mike Dougherty]

OK, now that my quota has been reset, I can see things a bit more clearly. 
It seems the count for API calls is a bit more aggressive than I originally 
thought. My code just indexed 88 documents and accumulated about 1,200 of 
the 20,000 allotted calls. 

Document.Builder builder = Document.newBuilder();
builder.setId(id);
builder.addField(Field.newBuilder().setName(name).setText(name));
builder.addField(Field.newBuilder().setName(description).setText(description));
Document document = builder.build();
PutResponse putResponse = index.put(document);

Is that a total of 12 API calls or just 1? 

Thanks,
Mike



On Monday, April 15, 2013 12:13:30 PM UTC+3, Mike Dougherty wrote:

 Hello,

 I am using the Search API for an application. I understand that it is 
 limited to 20,000 calls per 24 hours on a free application. But I expected 
 that limit to not be a hard limit once we are using a paid application. How 
 do I remove this limit? 

 Also, it seems that the limit was not reset when the other quotas were 
 reset this morning. I am pretty confident that my application has not made 
 20,000 calls in the last 2 hours. 

 Thanks,
 Mike

  

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: Google App Engine SDK 1.7.7 is now available!

[mike]

Do you mind to share a bit on how you integrated APN ?

Did you write the APN code yourself or use existing code?
I need to implement APN in Python as well.
I was using: https://github.com/samuraisam/pyapns

Now I am thinking modify the code here: 
https://github.com/simonwhitaker/PyAPNs 


On Friday, April 12, 2013 9:50:23 PM UTC-4, Rafael Sanches wrote:

 Thanks for this guys. 

 We have integrated apple's push system and it seems to work great! 

 Eliminating an external server reduces our app development complexity by a 
 lot.

 thanks!
 rafa


 On Fri, Apr 12, 2013 at 1:32 PM, Vinny P vinn...@gmail.com 
 javascript:wrote:

 Richmond  AppEngine team,

 If you're ever in the Chicago area, look me up and I'll buy you a beer. 
 I've been waiting for outbound sockets for years!

 A quick issue though: Can you make it explicitly clear in the Sockets API 
 Overview 
 https://developers.google.com/appengine/docs/java/sockets/overview that 
 developers have to include the JavaMail JARs if they need to access 
 IMAP/POP3/SMTP via Javamail? I say this because 
 https://developers.google.com/appengine/docs/java/mail/overview#Sending_Mail_with_the_JavaMail_API
  states 
 *Do not add Oracle®'s JavaMail JARs to your app.* I realize that's an 
 entirely different section, but it makes people believe that AppEngine 
 already packages the full JavaMail library, when truly it doesn't repackage 
 the Provider classes. It would also be fine if you skipped the notice and 
 included the Provider libraries within the AppEngine SDK.

 Thanks
 -
 -Vinny P
 Technology  Media Advisor
 Chicago, IL

 @GOV on AppDotNet: https://alpha.app.net/gov


 On Tuesday, April 9, 2013 5:44:38 PM UTC-5, Richmond Manzana wrote:

 Hi everyone,

 We're happy to announce that we have released the 1.7.7 SDK.

 This release includes new features such as updates to the Maven Plugin, 
 and Outbound Sockets.  We're also happy to announce that we have removed 
 the weekly $2.10 minimum spend for billing enabled apps :)

 For more details, please read our blog post and release notes.

 Announcement:
 http://googleappengine.**blogspot.com/2013/04/app-**
 engine-177-released.htmlhttp://googleappengine.blogspot.com/2013/04/app-engine-177-released.html

 Releae notes for Python:
 http://code.google.com/p/**googleappengine/wiki/**SdkReleaseNoteshttp://code.google.com/p/googleappengine/wiki/SdkReleaseNotes

 Release notes for Java:
 http://code.google.com/p/**googleappengine/wiki/**SdkForJavaReleaseNoteshttp://code.google.com/p/googleappengine/wiki/SdkForJavaReleaseNotes

 Release notes for Go:
 https://code.google.com/p/**googleappengine/wiki/**SdkForGoReleaseNoteshttps://code.google.com/p/googleappengine/wiki/SdkForGoReleaseNotes

 Cheers!

 Richmond Manzana
 Technical Program Manager
 Google App Engine

  -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To unsubscribe from this group and stop receiving emails from it, send an 
 email to google-appengi...@googlegroups.com javascript:.
 To post to this group, send email to 
 google-a...@googlegroups.comjavascript:
 .
 Visit this group at http://groups.google.com/group/google-appengine?hl=en
 .
 For more options, visit https://groups.google.com/groups/opt_out.
  
  




-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Search API over quota

[Mike Dougherty]

Hello,

I am using the Search API for an application. I understand that it is
limited to 20,000 calls per 24 hours on a free application. But I expected
that limit to not be a hard limit once we are using a paid application. How
do I remove this limit?

Also, it seems that the limit was not reset when the other quotas were
reset this morning. I am pretty confident that my application has not made
20,000 calls in the last 2 hours.

Thanks,
Mike


-- 

*Michael J. Dougherty*
___
858.232.3635 - USA
054.445.1345 - Israel
mi...@threedev.com mi...@threedev.com
http://ThreeDev.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Is GAE the right choice for e-commerce?

[Mike]

Hi Adam and Kaan

Yes, we still use AppEngine for our website, which is written in Python. 
Our 3D shoe designer infrastructure though is hosted elsewhere for now.

We're big fans of AppEngine!! It's great not having to think about 
infrastructure, and having rich APIs already installed. (Disclosure: I'm a 
former goog software engineer, so quite biased!) :-)

Not only is the platform a pleasure to use, but it's scaled beautifully 
when we've needed it to, for example the time when a 16 year old video 
blogger sent 1/2 million people to our 
site: http://www.22michaels.com/2010/03/juicystar07-and-world-of-new-media.html

Kaan - that's interesting it was slow! Where are you based? How slow was 
it? We're also using Google's PageSpeed service, so it shouldn't be slow.

Cheers
Mike



On Thursday, March 14, 2013 8:38:15 AM UTC+11, Kaan Soral wrote:

 You can check the headers with something like Firebug yourself, the answer 
 is 99% Yes, as server seems to be Google Frontend

 Also even before seeing the headers, I was 90% sure it was still an 
 Appengine app, because it took a significant amount of time to load the app 
 initially, might not have been Appengine's fault tho

 On Wednesday, March 13, 2013 1:11:22 AM UTC+2, Adam Wooding wrote:

 Hi Mike,

 I just came across your post and had a look at your Shoes of Prey app - 
 it is fantastic!

 I am also about to begin work creating a similar app, but for custom made 
 wardrobes / closets. I'm just wondering - which language did you build your 
 app on? Are you still running it on Google App Engine?

 Any tips / advice you could give would be much appreciated.

 Thank you very much,
 Adam Wooding


 On Monday, 1 February 2010 23:19:04 UTC+10, Mike wrote:

 Hi NG

 We are running our business on AppEngine. (Search Shoes of Prey on
 Google to find us.)

 So far, it is going really well. AppEngine is a delight to develop on,
 and you can't argue with the cost. (I've only been charged $0.01 so
 far. Although, as I've posted in another thread, the small charge by
 itself was problematic for me.) :)

 I had to write the entire ecommerce platform from scratch - which
 suited me given the very custom nature of our business - however you
 may not be as keen as me. It really depends on your business.

 We choose AppEngine primarily because a) 2 of us used to work at
 Google, and we love AppEngine b) if we start serving a lot of traffic/
 bandwidth we want something scalable. As I said earlier as well, the
 API is really nice and makes developing a breeze.

 The only thing I wish AppEngine had was HTTPS support for custom
 domains, and I'm hopeful that one day it will be supported. There are
 workarounds too. Once AppEngine has HTTPS support and a few open-
 source ecommerce software packages, it will be a really great platform
 I would think.

 Good luck.

 Mike

 On Jan 31, 4:31 pm, decuman ngn...@gmail.com wrote:
  Hello,
 
  At the moment I'm thinking of building a small/medium online selling
  business and before investing more of my time (and money) into GAE
  based development it would be just great to know some experienced
  users and expert thoughts and opinions on it.
 
  As far as I can see (after reading related books, articles and message
  group threads) GAE is just a perfect solution for prototyping and
  building a social networking applications (Blogs, Chats, Galleries,
  Message boards etc.) which requires tracking a lot of users and
  storing data... which is great. But there is quite a few (literally
  none) of nice business/e-commerce applications with decent product
  galleries, shopping carts and checkout functionality and payment
  service integration. Also there are lots of complains and negative
  responses pointing to big GAE functional limitations (which are not
  going to improve soon or ever) and overall practicability of using it
  as a reliable e-commerce platform. In particular (PayPal, Google
  Checkout integration)
 
  It wasn't a very deep and thoughtful investigation but the outlined
  above is just my personal subjective feeling so far. I would really
  love to know the opinion and thoughts on this matter from GAE experts.
  Shell I move forward with Google App Engine development or it would be
  move wise to consider some other solution?
 
  Thanks in advance!
  NG



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] user sign out google app engine without sign up Google account

[mike]

Hi There,

Is there a way for user to sign out (or remove the auth) my app engine app 
without sign out Google Account?

I want to be able to use my site with multiply accounts:
https://cloudshellapp.appspot.com/

If I can just sign out my account without sign out Google Account 
completely, it would very easy to switch accounts.

Thanks,
Mike,

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] A restlet example not working

[Mike]

Hello,

  I am new to restlet, and I try to use it for my class project. However, i 
got no success when i tried this simple restlet example for two days.

In this example, I have a class called TestJsonResource. It was called by 
MyFirstRestServerServlet, and the corresponding  web.xml


The program compiled with no error , but i was not able to run it from the 
browser since it gave me a HTTP errror 503 when I tried to look up the 
http://localhost: or the 
http://localhost:/MyFirstRestServer. Please help me if you could.


Thanks so much in advance.

Tom

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Lots of user-facing loading requests

[Mike Brown]

I am experiencing this exact behavior where new instances are spun up when 
existing instances sit idle.

As as test I spun up 5 instances (set min to 5 and max to Automatic).  Then 
even then with just one user, new
instances were started while the 5 sat idle.

I will try the work arounds listed above, however, what are my options 
beyond that?
If I rewrite the backend from Java to Python (or Go) will this solve the 
problem?
Seems I may be forced to port the whole thing to AWS and manage scalability 
myself. 

I can't even demo my app effectively and now have to look into unnatural 
work arounds or even a massive migration (in terms of effort) just
because AppEngine won't use existing idle servers.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Lots of user-facing loading requests

[Mike Brown]

I'm sorry but this is *not* what the documentation says and certainly not 
expected.
It says:

- https://developers.google.com/appengine/docs/adminconsole/instances
You can specify a minimum number of idle 
instanceshttps://developers.google.com/appengine/docs/adminconsole/performancesettings#minimum.
 
Setting an appropriate number of idle instances for your application based 
on request volume allows your application to serve *every request with 
little latency*, unless you are experiencing abnormally high request 
volume.

The key word here being *every.*

The way the scheduler is currently working does not, in any situation, 
allow me to handle *every* request with little latency.
As I mentioned I started up 5 resident and *still* got 2-3 dynamics while 
the residents sat idle.

It is completely counter intuitive that I would be paying an hourly rate 
for a resident instance only for it to sit idle while dynamic instances are 
spun up to handle requests. What makes complete sense is dynamics are 
started only if the load is beyond what the residents can handle. 

What would make for a real scheduler would be for it to be predictive in 
starting up dynamics before they are needed and then not load balancing to 
them until they are completely spun up and ready. Having a calls block on 
instances starting up is just lame.

Also, I read somewhere (not sure if it was official documentation) that an 
instance should be able to handle up to 10 concurrent requests. I am not 
getting anywhere near that.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [google-appengine] Re: Lots of user-facing loading requests

[Mike Brown]

Thank you Igor. I certainly get your frustration :) 

So let me make sure I have this right.  The purpose of Residence instances 
is to serve as an always running pool of instances which are leveraged only 
at times of load spikes.
The reason this is valuable is it takes AppEngine some time to spin up 
Dynamic Instances and while these are spinning up, the Residence Instances 
are leveraged to handle any
overflow requests (requests pending while Dynamics are spun up). Once the 
load flattens out and the Dynamics have caught up, the traffic is once 
again routed away from the Residence Instances.

I think a name change and maybe UI change in the panel would help a lot to 
alleviate confusion. Currently Residence instances are termed Idle 
Instances which made me think these are the number on instances running 
when my app is idle and therefore available to handle *any* incoming 
traffic. This makes perfect sense with the notion of Always On notion but 
not with overflow.

Renaming Idle Instances to something like, Overflow Instances (or maybe 
Balance Instances, Spike Instances, Reserve Instances, something else?) I 
think would be better.

Then perhaps bring back the notion of Always On as well to help with us 
folks with minimal traffic.

So from a UI perspective change the naming to use Minimum and Overflow (or 
alike).

So Minimum would mean minimum number running and ready to serve any 
request. Once load exceeds the capacity of Minimum instances, Dynamics are 
spun up.
Overflow would mean the number of instances held in reserve to manage 
latency during spikes. The steeper your spikes the more Overflow instances 
you should have.

So in the end you have your base set of instances for your base load and 
then Dynamics and Overflow for auto-scaling.











On Thursday, January 31, 2013 3:14:49 PM UTC-8, Igor Kharin wrote:

 OK you won. This was discussed back and forth countless times ever since 
 new performance settings introduced. Every. Month. I've tried. The team 
 also did. I guess it is how this work as you can't keep explaining the same 
 things to everyone.
  

 A high minimum allows you to prime the application for rapid spikes in 
 request load. App Engine keeps that number of instances in reserve at all 
 times, so an instance is always available to serve an incoming request, but 
 you pay for those instances. This functionality replaces the deprecated 
 Always On feature, which ensured that a fixed number of instances were 
 always available for your application. Once you've set the minimum number 
 of idle instances, you can see these instances marked as Resident in the 
 Instances tab of the Admin Console. 

   

 Note: If you set a minimum number of idle instances, the pending latency 
 slider will have less effect on your application's performance. Because App 
 Engine keeps idle instances in reserve, it is unlikely that requests will 
 enter the pending queue except in exceptionally high load spikes. You will 
 need to test your application and expected traffic volume to determine the 
 ideal number of instances to keep in reserve. 

 ... 

 The second slider sets the *maximum* period of time (at most 15 seconds) 
 that the scheduler will wait before resolving to create a new instance for 
 the request.

- A high maximum means users may wait longer for their requests to be 
served (if there are pending requests and no idle instances to serve 
 them), 
but your application will cost less to run. 

 Your arguments are absolutely valid, though. Back then we all thought 
 resident instances are just more flexible version of what Always On was, 
 but they are not (and that's why engineers were forced to explain it here).

 Yes, an instance *might *be able to serve up to 10 concurrent requests, 
 but it's much more complicated. Johan Euphrosine explained it in all the 
 details:

 http://stackoverflow.com/questions/11525717/when-does-the-app-engine-scheduler-use-a-new-thread-vs-a-new-instance/11882719#11882719


 On Fri, Feb 1, 2013 at 5:04 AM, Mike Brown virtua...@gmail.comjavascript:
  wrote:


 I'm sorry but this is *not* what the documentation says and certainly 
 not expected.
 It says:

 - https://developers.google.com/appengine/docs/adminconsole/instances
 You can specify a minimum number of idle 
 instanceshttps://developers.google.com/appengine/docs/adminconsole/performancesettings#minimum.
  
 Setting an appropriate number of idle instances for your application based 
 on request volume allows your application to serve *every request with 
 little latency*, unless you are experiencing abnormally high request 
 volume.

 The key word here being *every.*

 The way the scheduler is currently working does not, in any situation, 
 allow me to handle *every* request with little latency.
 As I mentioned I started up 5 resident and *still* got 2-3 dynamics 
 while the residents sat idle.

 It is completely counter intuitive that I would be paying an hourly rate

Re: [google-appengine] Re: Urgent, Need Help: Instances are shutting down after a couple minutes of inactivity.

[Mike Brown]

I'm experiencing this problem as well and can not demo my app.

app id: gobandpass

For me each request is starting a new instance thus causing long response 
times.

I am in development and therefore the only person on the app. So I can 
clearly see for each client request
a new instance is being started.

Performance settings are (and always have been) automatic, automatic for 
both instance and latency which
always seemed to work fine until now.

Note, timing wise, I deployed an app on 12/13 and everything tested out 
fine.  Then on 1/8 I deployed again and now have this problem.
In between these dates I was working locally and therefore would not notice 
exactly when this problem cropped up. Somewhere between 12/3 and 1/8.


On Thursday, December 27, 2012 1:18:47 PM UTC-8, Saket Kumar wrote:

 Hi Carl,

 Can you let me know your app-id?

 Regards,
 Saket

 On Thursday, 27 December 2012 20:01:30 UTC+1, Carl Schroeder wrote:

 I am still seeing java instances decomissioned after sub minute quiet 
 periods.  Given that it takes 20-30 seconds to spin one java instance up, 
 you should probably leave them alive for a bit longer than a few seconds. 
 Otherwise, for low traffic profiles, page loads for GAE java can take up to 
 30 seconds. God help us if the scheduler thinks I need 2 new instances spun 
 up in series rather than parallel.

 FYI, people don't wait around for a minute for pages to load. They use 
 other services.

 Once again, due to unannounced pathological behavior of the instancing on 
 GAE, we are wasting our time re-implementing our java infrastructure on 
 AWS. At least, I hope it is a waste of our time...


 On Tuesday, December 25, 2012 4:00:26 PM UTC-8, Francois Masurel wrote:

 Hi Saket,

 Thanx for investigating the problem.

 Things seems to have improved significantly these last few days.

 On our Neustar reports, for an average page loading, we can see that we 
 went from 
 6.65shttps://monitor.wpm.neustar.biz/reports/graph_log/#/?monitorIds=8bc3b100-b372-11e1-a749-9848e1660ab3timeRange=last_24_hoursfunctionType=loadtimegraphType=line_chartview=loadtime
  (12/16) 
 to 8.94s (12/18) and back to 
 2.57shttps://monitor.wpm.neustar.biz/reports/graph_log/#/?monitorIds=8bc3b100-b372-11e1-a749-9848e1660ab3timeRange=last_24_hoursfunctionType=loadtimegraphType=line_chartview=loadtime
  (12/23).

 I can confirm that we don't see as much instance warm ups in our logs as 
 we were used before, we went from every 3-4 minutes to 20-25 minutes.

 I definitely think things have changed on Google side as we haven't 
 changed anything on our side.

 But some strange things are still going on at the moment (12/26 0:52 
 UTC+1) as a dynamic instance has been up for more than 4 hours but has 
 served only one request (cf. screenshot below).

 Thanx again Saket for your help.

 François


 https://lh6.googleusercontent.com/-ARDAA2Yu-NY/UNo-Bgn9SpI/yN8/NNC4QLzi93g/s1600/Instances+-+VinoCities+-+Google+Chrome.jpg




 On Monday, December 24, 2012 11:54:48 PM UTC+1, Saket Kumar wrote:

 Hi Francois,

 Are you still facing this issue? I did a small test for your 
 application and didn't find anything too bad from scheduler's perspective. 
 I'm trying to understand if it was a temporary glitch that was causing the 
 issue or something is wrong with scheduler's algorithm. Or if scheduler 
 doesn't spin instances properly if QPS is low.

 Here is series of events- 

 a.) Single resident was serving for 1 day, 03:26:37 minutes, serving 
 9600 request
 b.) After serving 96 requests with raised QPS, new instance was created.
 c.) QPS lowered and the new instance was allowed to die.
 d.) Again the QPS was increased and new instance was created. Both 
 instances were handling requests at this point.
 e.) QPS lowered again, newly formed instance dies and older instance 
 starts serving 100% of the requests.

 -
 Saket

 On Saturday, 22 December 2012 12:18:00 UTC+1, Francois Masurel wrote:

 Hi Christina,

 For my personal case, my production app-id is vncts1 with billing 
 enabled.

 And the related issue is : 
 https://code.google.com/p/googleappengine/issues/detail?id=7865

 As I said at the beginning of this thread, there are quite a few other 
 threads related to this problem :


 https://groups.google.com/forum/#!msg/google-appengine/cJcOrOE4JDc/uKFBbylFOxIJ

 https://groups.google.com/d/msg/google-appengine/8KiXRP-oU5I/Jf5kzcvyIiwJ

 https://groups.google.com/d/msg/google-appengine/NR_oV4znvks/KtkSmVQD2IgJ

 https://groups.google.com/d/msg/google-appengine/_znmrJwFMuM/V2epYOQ19L4J

 https://groups.google.com/d/topic/google-appengine/hg3BH8WOGWA/discussion

 https://groups.google.com/d/topic/google-appengine/UN5oCWkPsaA/discussion

 https://groups.google.com/d/topic/google-appengine/RneC9qDbeRE/discussion

 https://groups.google.com/d/topic/google-appengine/sLZcZoK-A3Y/discussion

 Thanx for you help.

 François



 On Saturday, December 22, 2012 3:15:05 AM UTC+1, Christina Ilvento 
 wrote:

 Hi All,

[google-appengine] Large backups -- using a cron -- failing

[Mike]

Hi there

Since 12/17 one of my backup jobs (run via a cron, and manually) hasn't 
been finishing.

It seems to get stuck -- with certains shards displaying 'Unknown' in the 
last work column. The backups are being sent to Cloud Storage.

The table in question has 1.7m entries.

I can email you an example MapReduce ID if that helps. Please email me 
personally for it.

Mike 

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Ic4oh48TA54J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Urgent - Production Issue with AppEngine and TaskQueue

[Mike]

Hi there

It seems there was some kind of system reset about 5 hours ago -- after 
which time my app went a little crazy.

I have hit the 100GB File Bytes Sent api limit, which is causing my site to 
fail. When I look into Blacklists, it is 0.1.0.2 (AppEngine) sending a lot 
of requests (100,000+ in 30 minutes), which has caused a huge spike in 
traffic and cost (already $100 for the day!)

It seems to be related to task queue. There are some mapreduces running, 
but *when I try purging the queue, it doesn't work.*
*
*
The status page for a while said you were investigating the task queue -- 
but now it is green again.

Without the File Bytes Sent, no one can save their designs. Can you please 
at the very least reset this limit for me? Also, if this is an AppEngine 
issue, can we please be refunded for the charges resulting from the task 
queue failing and consequently sending our site into a tail spin?

My id = shoesofprey-hrd

Thanks!

Cheers
Mike

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/kefp_dkXMksJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Urgent - Production Issue with AppEngine and TaskQueue

[Mike]

Hi Alex

Ah, awesome - yes, that worked. Cheers.

The only thing now is I need to reset the quota -- otherwise my site is 
still broken. It's a shame that there isn't an easy way to do that myself.

Appreciate the help!

Cheers
Mike 

On Sunday, December 16, 2012 7:44:05 PM UTC, alex wrote:

 If you have tasks that sort of re-enqueue themselves (or add new 
 tasks) purging the queue is not probably what you want. Try *pausing* 
 the queue instead, and then purge it if you must (keep the queue 
 paused). 

 On Sun, Dec 16, 2012 at 8:39 PM, Mike mick...@gmail.com javascript: 
 wrote: 
  Hi there 
  
  It seems there was some kind of system reset about 5 hours ago -- after 
  which time my app went a little crazy. 
  
  I have hit the 100GB File Bytes Sent api limit, which is causing my site 
 to 
  fail. When I look into Blacklists, it is 0.1.0.2 (AppEngine) sending a 
 lot 
  of requests (100,000+ in 30 minutes), which has caused a huge spike in 
  traffic and cost (already $100 for the day!) 
  
  It seems to be related to task queue. There are some mapreduces running, 
 but 
  when I try purging the queue, it doesn't work. 
  
  The status page for a while said you were investigating the task queue 
 -- 
  but now it is green again. 
  
  Without the File Bytes Sent, no one can save their designs. Can you 
 please 
  at the very least reset this limit for me? Also, if this is an AppEngine 
  issue, can we please be refunded for the charges resulting from the task 
  queue failing and consequently sending our site into a tail spin? 
  
  My id = shoesofprey-hrd 
  
  Thanks! 
  
  Cheers 
  Mike 
  
  -- 
  You received this message because you are subscribed to the Google 
 Groups 
  Google App Engine group. 
  To view this discussion on the web visit 
  https://groups.google.com/d/msg/google-appengine/-/kefp_dkXMksJ. 
  To post to this group, send email to 
  google-a...@googlegroups.comjavascript:. 

  To unsubscribe from this group, send email to 
  google-appengi...@googlegroups.com javascript:. 
  For more options, visit this group at 
  http://groups.google.com/group/google-appengine?hl=en. 


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/waDwUvma7TMJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Urgent - Production Issue with AppEngine and TaskQueue

[Mike]

Update: we're back to normal. Thanks AppEngine. :) 

On Monday, December 17, 2012 6:55:49 AM UTC+11, Mike wrote:

 Hi Alex

 Ah, awesome - yes, that worked. Cheers.

 The only thing now is I need to reset the quota -- otherwise my site is 
 still broken. It's a shame that there isn't an easy way to do that myself.

 Appreciate the help!

 Cheers
 Mike 

 On Sunday, December 16, 2012 7:44:05 PM UTC, alex wrote:

 If you have tasks that sort of re-enqueue themselves (or add new 
 tasks) purging the queue is not probably what you want. Try *pausing* 
 the queue instead, and then purge it if you must (keep the queue 
 paused). 

 On Sun, Dec 16, 2012 at 8:39 PM, Mike mick...@gmail.com wrote: 
  Hi there 
  
  It seems there was some kind of system reset about 5 hours ago -- after 
  which time my app went a little crazy. 
  
  I have hit the 100GB File Bytes Sent api limit, which is causing my 
 site to 
  fail. When I look into Blacklists, it is 0.1.0.2 (AppEngine) sending a 
 lot 
  of requests (100,000+ in 30 minutes), which has caused a huge spike in 
  traffic and cost (already $100 for the day!) 
  
  It seems to be related to task queue. There are some mapreduces 
 running, but 
  when I try purging the queue, it doesn't work. 
  
  The status page for a while said you were investigating the task queue 
 -- 
  but now it is green again. 
  
  Without the File Bytes Sent, no one can save their designs. Can you 
 please 
  at the very least reset this limit for me? Also, if this is an 
 AppEngine 
  issue, can we please be refunded for the charges resulting from the 
 task 
  queue failing and consequently sending our site into a tail spin? 
  
  My id = shoesofprey-hrd 
  
  Thanks! 
  
  Cheers 
  Mike 
  
  -- 
  You received this message because you are subscribed to the Google 
 Groups 
  Google App Engine group. 
  To view this discussion on the web visit 
  https://groups.google.com/d/msg/google-appengine/-/kefp_dkXMksJ. 
  To post to this group, send email to google-a...@googlegroups.com. 
  To unsubscribe from this group, send email to 
  google-appengi...@googlegroups.com. 
  For more options, visit this group at 
  http://groups.google.com/group/google-appengine?hl=en. 



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/dZp5880i4e0J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Create Entity timestamp error

[Mike]

Hi Nijin,

Thanks for responding! The only options i see in the dropdown for type are: 
 int  or  null?

I guess I need to get timestamp in the dropdown as an option. but how?

-Mike


On Friday, November 16, 2012 9:38:37 AM UTC-5, Nijin Narayanan wrote:

 Hi Mike,

 For saving the datetime data the filed's datatype should be datetime. It 
 seems you are using int datatype. 
 https://developers.google.com/appengine/docs/python/datastore/typesandpropertyclasses#DateTimeProperty

 -Nijin Narayanan 





 On Fri, Nov 16, 2012 at 9:40 AM, Mike rott...@gmail.com javascript:wrote:

 Hi,

 I am trying to create a user in my datastore through the GAE web 
 interface.

 I am in the Create Entity section. I am filling in the fields.

 I put something like this in the timestamp field (type: int), and it 
 throws an error...
 2012-11-15 22:51:16.668000

 I see other entries with this format for the timestamp.

 Any idea what's wrong?

 Thanks,
 Mike

 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To view this discussion on the web visit 
 https://groups.google.com/d/msg/google-appengine/-/nDerddff8r4J.
 To post to this group, send email to 
 google-a...@googlegroups.comjavascript:
 .
 To unsubscribe from this group, send email to 
 google-appengi...@googlegroups.com javascript:.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.




-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Iiky4WZ-JrgJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Create Entity timestamp error

[Mike]

Hi,

I am trying to create a user in my datastore through the GAE web interface.

I am in the Create Entity section. I am filling in the fields.

I put something like this in the timestamp field (type: int), and it throws 
an error...
2012-11-15 22:51:16.668000

I see other entries with this format for the timestamp.

Any idea what's wrong?

Thanks,
Mike

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/nDerddff8r4J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Using Java Files API for Google Cloud Storage results in corrupt files

[Mike Aizatsky]

The fix is live. We'll have more details about what has happened soon.

Can you confirm that it is now working as expected on your end?

On Friday, September 21, 2012 12:12:42 PM UTC-7, Christina Ilvento wrote:

 Hi Tim,

 We've diagnosed the issue on our side and should have a fix pushed out 
 soon. Thanks for reporting this.


 Thanks,
 Christina

 On Fri, Sep 21, 2012 at 10:20 AM, Tim Rob t...@appcoders.nl javascript:
  wrote:

 Hi,
 We are currently using the Java Files API to store generated files in 
 Google Cloud Storage. When we try to store 'larger' (1 to 15MB) generated 
 reports (CSV and Excel) or backups of a namespace in the Datastore (stored 
 as JSON text) we always end up with corrupt files. For example when writing 
 something like 'ABCDEFG', we end up with 'ABCDEAB'.
 When we switch to Blobstore this all works fine again. I know the Java 
 Files API to Google Cloud Storage is 'experimental', but I was hoping this 
 functionality would work. Is this maybe a known issue?
 PS: The main reason to prefer GCS over Blobstore is the lack of support 
 for namespaces in Blobstore. With GCS we can create a bucket per namespace.
 Thanks

 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To view this discussion on the web visit 
 https://groups.google.com/d/msg/google-appengine/-/aOnH13zhIKUJ.
 To post to this group, send email to 
 google-a...@googlegroups.comjavascript:
 .
 To unsubscribe from this group, send email to 
 google-appengi...@googlegroups.com javascript:.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.




 -- 

 Christina Ilvento | Google App Engine | cilv...@google.com javascript: |
  (650)-201-9399


  

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/yX7TPqaf0TQJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.