Re: [google-appengine] Re: zigzag merge

2018-06-29 Thread Attila-Mihaly Balazs
- There is an optional parameter to init_datastore_v3_stub which you can 
use to require indexes: require_indexes=True. In fact we initialize our 
stub like the following for our unittests:

# this needs to be re-evaluated at every initialization since it's mutable 
and tests
# might have overriden it
consistency_policy = eval(

'_datastore_stub_util_module.PseudoRandomHRConsistencyPolicy(probability=0)')
_GAE_TESTBED.init_datastore_v3_stub(
consistency_policy=consistency_policy, require_indexes=True, 
use_sqlite=True,
root_path=_gae_app_path)

(this also makes so that it simulates the worst-case consistency for the 
datastore - you then need to call 
_GAE_TESTBED._test_stub_map.GetStub(_testbed_module.DATASTORE_SERVICE_NAME).Flush()
 
explicitly when you want to have your entities visible to queries for 
example)

- There is also the --require_indexes=True parameter for the dev_appserver

- Finally, you can always have a "staging" project (ie. a separate Google 
project for testing) where you can try things out.

Attila

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/8247ffca-34e9-4abd-900d-d518bc2a1eeb%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: zigzag merge

2018-06-29 Thread Vitaly Bogomolov


> What would be the use-case for the new feature? How would you use it, 
> exactly? A good use-case, well-formulated in step-by-step manner might 
> prove a great help for Developers to determine the importance of the new 
> feature and the urgency level for its implementation. 
>

There is a large project that uses a datastore with a large number and size 
of indexes. Serving these indexes consumes a lot of resources when 
creating/modifying entries in the corresponding tables.

The project is several years old, at different times several development 
teams worked on it. The project has experienced several cycles of 
refactoring. There are reasonable suspicions that most of the existing 
indexes are no longer required for the correct operation of the project.

You need to find and delete indexes that are not used by the current 
version of the code. Static analysis of the code is laborious and 
unreliable because the project uses query.filter methods, GQL strings 
(including dynamically generated ones), indirect calls, etc.

If in the Datastore section of console.cloud.google.com you can see the 
load (in arbitrary units of measure) for active project indices, then 
identifying and removing unused indexes will be the simplest task.

In addition, the current implementation of the 
google.appengine.ext.testbed.init_datastore_v3_stub emulator does not take 
into account the contents of the project's index.yaml file. All calls to 
datastore are performed by the emulator successfully, as if all the 
necessary indexes exist. If testbed will generate errors if there are no 
necessary indexes in index.yaml, then these problems can be identified at 
the stage of automatic testing. 

WBR, Vitaly

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/85b8bd58-f363-453a-8f17-23b3d6e2ac45%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: Hey after two days I get a message the I cannot deploy my appengine becuase I already got too many version.

2018-06-29 Thread Guy Dviri

>
> I reply thanks you 2 hours ago , but I don't see the reply in the thread , 
> google groups UI must change their layout in my opinion , 
>
any way I like to ask @Ani one more thing ,  is it possible to block 
version from updating , let's say that it will be update only with special 
key,, or something like that , to prevent update by mistake.. 
do you know some way to do it?
 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/064bde80-33ee-4384-98d3-0557fad9f715%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: gcloud enhacement ?

2018-06-29 Thread 'Jordan (Cloud Platform Support)' via Google App Engine
You are correct. There is currently no API implementation or gcloud command 
for disabling/enabling Datastore writes (and this can only currently be 
done via the Cloud Console 
).
 
Since Google Groups is reserved for general product discussions, it is 
recommended to open a feature request for this in the Public Issue Tracker 
. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/5759688d-3a4e-494f-abcb-cbd521025a9d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Can app engine host a Node JS worker?

2018-06-29 Thread Ryan Sacha
I came across the recent launch of Node JS serverless option on google app 
engine.

My question is, would it be safe to host a Node JS worker app (like Kue or 
Bull) without app engine killing a running job midway to conserve server 
cost?

I'm wary of Cloud functions because they seem to be for lighter, fast 
startup scripts, not full fledged apps.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/cbed8552-2f38-4732-a0c5-8edc0ffa74bd%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Regarding Standard Environment For Node Js

2018-06-29 Thread 'George (Cloud Platform Support)' via Google App Engine
In reply to your questions: 

1) You can specify network settings in your app.yaml configuration file, 
for example:

network:
  instance_tag: TAG_NAME
  name: NETWORK_NAME
  subnetwork_name: SUBNETWORK_NAME
  forwarded_ports:
- PORT
- HOST_PORT:CONTAINER_PORT
- PORT/tcp
- HOST_PORT:CONTAINER_PORT/udp

Related details may be read on the "Configuring your App with app.yaml" 
page, "Network settings" sub-chapter 

. 

2) In fact, there are many vendors offering managed database services such 
as mLab for MongoDB. These vendors handle hosting, configuration, and 
maintenance of databases. App Engine can connect to these external services 
over the Internet, in the same way as other public clouds by using that 
service's public IP address, in particular the IP address of your MongoDB 
instance. More detail may be gathered from the "Using Third-Party 
Databases" online document 
.
 
How did you fail to connect from the standard environment, exactly? What 
were the errors returned? How did you follow the MongoDB connection 
instructions in your app? 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/c2e6bd14-9e76-46c1-ad36-f1be059d15ad%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: zigzag merge

2018-06-29 Thread 'George (Cloud Platform Support)' via Google App Engine
Fully agreed here, it would be nice. As they say, usually the problem is in 
the details. In particular here, how would one determine how often is the 
index used? What would be the use-case for the new feature? How would you 
use it, exactly? A good use-case, well-formulated in step-by-step manner 
might prove a great help for Developers to determine the importance of the 
new feature and the urgency level for its implementation. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/0c9c2750-3214-4c22-b782-61c4a852f323%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Google app engine can requests fail while shifting traffic to the new version?

2018-06-29 Thread 'Kenworth (Google Cloud Platform)' via Google App Engine
The answer is different depending on the App Engine environment. GAE 
Standard for example, supports gradual traffic migration wherein you can 
enable 'warmup request' to prepare the new instances before those instances 
serve any traffic.

In contrast, GAE Flex does not support gradual traffic migration which 
means user requests are sent to those instances before the instances get 
created. This results to delay/latency (not an outright fail) since the 
request has to wait until the instance gets up and running. It is possible 
that request may fail if the request timeouts before the instance is ready. 
See full article here 
.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/0cdab1f5-54da-46ed-b21b-8aba5edd5867%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: Hey after two days I get a message the I cannot deploy my appengine becuase I already got too many version.

2018-06-29 Thread Ani Hatzis
Hello,

when you deploy a new App Engine app version and do not specify a specific
version, App Engine will create a new version automatically. You can see
them in the Web UI under *App Engine > Versions* or in the shell:  gcloud
app versions list

Many users utilize versions using traffic split to perform A/B testing or
soft migrations. If something goes wrong during the rollout of a new
feature, they can easily direct traffic back to an older version.

If you do not want to utilize versions, you could just specify the same
version at every deployment of your App Engine app, for example:
gcloud app deploy --version=v123 .

If version *v123* already exists, App Engine will replace it, and you will
not see a growing list of versions. However, if you care for availability
of your app, I would recommend to deploy into separate versions and make
use of this feature.

On Thu, Jun 28, 2018 at 10:38 PM Guy Dviri  wrote:

> no it's just a small app ,not even up to the air  ,  i don't know why i
> have 200 version i only need one..
> what could i doing wrong..
>
> i using endpoint + sql + bigstore .
> i deploy my module using :
>
> console : appenginedeploy
>
> what do you think could trigger this behavior ?
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/17eec7eb-5203-4c27-bee0-e922010d38b7%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CALdDuQ6RVmBpUF11Mxn6nidihTfnuj4NQJdQqeqrG1ZJZy0mhA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Serving Static Files, Issue with Content Security Policy

2018-06-29 Thread 'Kenworth (Google Cloud Platform)' via Google App Engine
This thread is off-topic for Groups for which is reserved for general 
discussion of GCP products and services, not for troubleshooting and/or 
reporting issues. If you suspect this is a defect on the platform, you have 
the option to file an issue tracker via the channels detailed here 
. 

Meantime, I suggest you provide the answers my colleagues are asking on the 
StackOverflow 

 
thread, like how are you implementing Express (and the headers) so we may 
be able to take a look further on the issue at hand.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/8d3f2c3a-6551-4782-9e54-94d3957ba341%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Stackdriver: Thoughts?

2018-06-29 Thread 'Dinesh (Google Platform Support)' via Google App Engine
Hello Kaan, 

Thanks for your feedback and confirmation that the issue is resolved now. 
Just to add, you can find detailed information about Free and excluded 
logs, general tips about reducing your logs usage, Monitoring and pricing 
in this documentation[1].

This page[2] describes Logs Exclusions in detail. 
I hope it helps. 

Regards, 


[1]: https://cloud.google.com/stackdriver/pricing_v2#free_logs
[2]: https://cloud.google.com/logging/docs/exclusions


On Friday, June 29, 2018 at 1:39:42 AM UTC-4, Kaan Soral wrote:
>
> Indeed, it seems they corrected them now, I checked originally, but 
> thought maybe the reported metrics could be reduced if there are free 
> quotas I didn't know about
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/c42c3012-4295-468c-9076-4c3b51523065%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Decline requests to the one GAE instance to use for them a other GAE instance

2018-06-29 Thread Aleksander Efremov
I use "Node.js" standard.
Sometimes I need refresh "express.js" configuration. For it I should stop 
to accept a new requests, then wait while will resolved current requests 
and whether to restart the "express.js" or call "exit" GAE instance.
How I can to notify the GAE manager that a new requests impossible to 
process still on this GAE instance?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/6de31ff5-5f4b-48f2-8a1d-6f78ed272431%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.