Re: [google-appengine] Re: zigzag merge

2018-06-28 Thread Vitaly Bogomolov

>
> It would be indeed nice, if the production system kept metrics for index 
> usage, that way, it would be obvious which indexes are needed or not
>

+++

WBR, Vitaly 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/e514a0bb-d7c9-457e-a625-21299fb0a5ce%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Stackdriver: Thoughts?

2018-06-28 Thread Kaan Soral
Indeed, it seems they corrected them now, I checked originally, but thought 
maybe the reported metrics could be reduced if there are free quotas I 
didn't know about

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/51fef04c-d09e-49b6-aa28-a4c30dcf6d57%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: Stackdriver Structured Logging from App Engine Flex

2018-06-28 Thread 'Jordan (Cloud Platform Support)' via Google App Engine
For clarity, the fluentd logging agent running as a side-car container in 
the Flexible environment tails log files in /var/log/app_engine/app and 
sends them to Stackdriver via the same Stackdriver Logging API. Using the 
API directly in your application's container would be faster than if your 
application were to write the logs out to the disk, then wait for the 
fluentd agent to read it and make the same API call. 

Of course it would be much cleaner to keep everything local to stdout and 
stderr, and this is indeed a valid feature request. Since Google Groups is 
reserved for general discussions 
 (and not for reporting 
issues, feature requests, or code assistance), it is better to continue 
communicating via the already existing feature request on the Google Github 
issue tracker 
. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/c639283b-2718-4149-b777-77fe6de324f6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: Connecting Cloud SQL from App Engine with TCP.

2018-06-28 Thread 'Jordan (Cloud Platform Support)' via Google App Engine
For reference, this is an existing Feature Request 
 in the Public Issue Tracker  
for this App Engine 
limitation. Since App Engine Standard runs on containers, its current 
architecture implementation was strictly designed around HTTP interfacing, 
and not sockets. There is also an open feature requests for App Engine 
sockets support , and there is an 
early 
access request form 

 (for 
both Standard and Flex).  

If you are using App Engine Flexible, I was able to find this example 

 
working with TCP connection to Cloud SQL in .Net. All further 
communications about this request should continue in the open feature 
request . 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/594a887f-791e-425f-9d44-31a77c387a94%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: What is the difference between App Engine Firewall and a VPC Firewall?

2018-06-28 Thread 'Navi Aujla (Google Cloud Support)' via Google App Engine
Hello Parth, 

GAE flex environment is built on the Google compute engine and supports VPC 
networking environment. GCE Firewall rules 
 can be used to determine the 
target or source component to allow or restrict traffic based on instance 
network 
tags . For more 
information, can refer to this documentation 
.
 
Application access control can be managed through the flex instance network 
tags 

 in 
conjunction with the GCE firewall rules.  

On other hand, GAE firewall rules 
 
applies 
to all resources of the App Engine application including application 
serving on GAE flex instances. Here is the more detailed information on 
allowing requests from your services using GAE firewall rules 
.
 
In brief, both GCE firewall rules based on network tags for the GAE flex 
instances and GAE firewall rules would needs to pass for traffic flow to 
serve the application hosted on GAE platform. 

In addition, defining the VPC network 

 
for an GAE flex instance provides flexibility to communicate with the GCE 
instances within the same VPC network using the internal network, enables 
for the VPN scenarios and also port forwarding. Also, provide more 
granularity for access control using network instance tags in conjunction 
with the firewall rules applicable to the defined target tags. For more 
information, check this documentation 

. 

I hope it helps. 

On Monday, June 25, 2018 at 5:25:06 PM UTC-4, Parth Mishra wrote:
>
> If you launch a GAE Flex application into a VPC subnet that has its own 
> Firewall rules, how do they interact with any existing App Engine Firewall 
> rules? What is the point of being able to specify a VPC for an app engine 
> instance? 
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/759fd1b1-2aa3-4702-8b2e-945f2c931f6b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Hey after two days I get a message the I cannot deploy my appengine becuase I already got too many version.

2018-06-28 Thread Guy Dviri
no it's just a small app ,not even up to the air  ,  i don't know why i 
have 200 version i only need one..
what could i doing wrong..

i using endpoint + sql + bigstore .
i deploy my module using :

console : appenginedeploy

what do you think could trigger this behavior ? 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/17eec7eb-5203-4c27-bee0-e922010d38b7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Hey after two days I get a message the I cannot deploy my appengine becuase I already got too many version.

2018-06-28 Thread 'Kenworth (Google Cloud Platform)' via Google App Engine
We do enforce a limit of 15 (free app) and 200 (paid app) maximum versions 
per app. See article 

. 

Out of curiosity, does your business/application model require you to have 
~200 running versions or are majority of these non-serving versions?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/ef948428-1622-4e58-8bcb-c51e78b3ab74%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: My project was disappearing

2018-06-28 Thread 'Kenworth (Google Cloud Platform)' via Google App Engine


Hi Raphael, a thread like this is off-topic for Google Groups. As it may 
potentially be a defect on the platform and most likely lead to a specific 
situation which may require some exchange of project information to 
investigate the behavior you described, I highly encourage you to submit a 
defect report  as 
described in this article 
 so that proper 
attention and weight will be given to it. We monitor that issue tracker 
closely.

We look forward to this issue report.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/c28b8973-0e3f-41b7-8d61-d93f359aa495%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Webstorm debug App Engine Flexible NodeJs app.

2018-06-28 Thread 'Kenworth (Google Cloud Platform)' via Google App Engine
Thank you for trying to switch to a supported IDE. 

However, this is beyond the scope of this thread and should be posted to 
StackOverflow which we also monitor. When you do, make sure you add '
intellij-idea ' and/or '
google-cloud ' tags, 
include error logs showing the issue, and possibly provide reproducible 
steps.

Please feel free to drop the StackOverflow link here so it may possibly 
help other users experiencing the same issue.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/fbd8060f-728a-4d25-b86e-dfe2c7be001a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: wordpress multiple site giving 500 HTTP error

2018-06-28 Thread 'Kenworth (Google Cloud Platform)' via Google App Engine


On Monday, June 25, 2018 at 9:52:55 AM UTC-4, Sam Panwar wrote:
>
> Hi,
>
> On the App engine my wordpress Site giving 500 Server error after chaning 
> custom domain .
>
> So how to resolve this domain and want to know the following.
>

*500 Server error is a very general status code. This means something has 
gone wrong on the server but it can not exactly pinpoint the error. I 
suggest posting the full error log on StackOverflow 
 which we also 
monitor, as it is off-topic on this thread reserved for general discussion 
of GCP's products and services.*
 

>
> How I create app engine for wordpress multiple site with Database...some 
> time app deploy but database not create..I want to create Database .
>

> Please also update that how I can update DB through the gcloud app deploy 
> command its update files only.
>
 
*The process to deploy an application 

 is 
different from creating a database 
. These 
two are completely separate tasks. Here is a Quickstart for applications 
with CloudSQL .*


> Sam
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/b4734819-5f45-47ca-8de8-662d58625402%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Google app engine can requests fail while shifting traffic to the new version?

2018-06-28 Thread Sudhanshu Gaur


I am just wondering that as when I deploy my NodeJs app to new version on 
App Engine, now the traffic gets shifted from old app version to new app 
version. Or when I manually shift traffic to some other version.

Then is there any chances that in between shifting the traffic to the new 
server, can some requests fail or is it 100 percent Safe by default?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/1960b3b4-f345-4d72-a587-f5f7001a2c03%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: ValueError: virtualenv: cannot access lib: No such virtualenv or site

2018-06-28 Thread 'George (Cloud Platform Support)' via Google App Engine
In fact, the project structure indicated on the "Getting Started with Flask 
on App Engine Standard Environment" page 

 
is: 

flask-app project structure

app.yaml: Configure the settings of your App Engine application
main.py: Write the content of your application
static: Directory to store your static files
style.css: Basic stylesheet that formats the look and feel of your template 
files
templates: Directory for all of your HTML templates
form.html: HTML template to display your form
submitted_form.html: HTML template to display the content of a submitted 
form

How does your app.yaml 
look 
like? In particular, what stays written under the "handlers" entry? It may 
be worthwhile having a look at "Creating a request handler for your Flask 
app" sub-chapter 

. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/fbfe9028-0675-485e-8a33-836daa2714e0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: How to exporting User Explorer data?

2018-06-28 Thread 'George (Cloud Platform Support)' via Google App Engine
To see User-ID data in the report, you need to enable the User-ID feature 
in your property settings. Client IDs appear in the report by default for 
properties that aren’t enabled for User-ID. You may find more detail on the 
"User Explorer" help page 
, as well as on 
the "Google Analytics Solutions Community" page 
.
 
You may also contact Google Analytics Support 
, as 
this forum is not the appropriate one for Google Analytics, but invites to 
discussion on App Engine matters. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/88c83e58-7e6f-4c56-9ecc-ac90ddb0a0ec%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Webstorm debug App Engine Flexible NodeJs app.

2018-06-28 Thread Sudhanshu Gaur
Are you there ?

On Wednesday, June 27, 2018 at 12:41:17 AM UTC+5:30, Sudhanshu Gaur wrote:
>
> Now I am trying in Intellij-Community, tell me why I am facing the issue ??
>
> On Tuesday, June 26, 2018 at 7:45:46 PM UTC+5:30, Kenworth (Google Cloud 
> Platform) wrote:
>>
>> I apologize for not being more clearer previously. Deploying GAE Flex app 
>> is not currently supported 
>>  on IDEs other than 
>> IntelliJ IDEA - Ultimate and Community. Webstorm is not currently 
>> supported. We also do not have visibility towards the mentioned IDEs.
>>
>> Unfortunately, this is beyond the scope of Google Groups which is 
>> reserved for general discussion of GCP's products and services. For further 
>> technical assistance, I recommend you post on Stack Exchange which uses a 
>> popular question-and-answer platform and it hosts a number of sites, 
>> including StackOverflow . Please visit our 
>> community support page for list of StackOverflow tags 
>>  we monitor, or this 
>> page  showing free different support 
>> resources and paid 1-on-1 technical support option.
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/28ab9690-0011-4f94-bedf-074efe2bf3f0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Stackdriver: Thoughts?

2018-06-28 Thread Franz Matheis
I think the email they sent has the information wrong and the real amount 
of logs you are ingesting might be much lower.

Have you checked the amounts in the dashboard? 

You can see it here for each project  -->  
 https://console.cloud.google.com/logs/usage?project=XX


El jueves, 28 de junio de 2018, 14:11:39 (UTC+2), Kaan Soral escribió:
>
> I personally use App Engine as It allows (or rather, allowed) me to 
> concentrate on product (in theory), rather than itsy bitsy stuff
>
> Up to now I ignored the Stackdriver emails, and only now checked what 
> actually it was telling (Ignored because I'm here for the PaaS, If I was 
> going to use multiple services individually, I'd have invested my efforts 
> in AWS back in the day)
>
> Anyway, long story short, my 3 main projects seem to be digesting 230, 
> 460, and 1300GB's monthly, as I understand, I'll start paying $0.5 per GB 
> now, which makes $995 monthly, considering I paid ~$600/mo for everything 
> up to now, bumping that up to $1600 seems extreme, I might be doing the 
> calculation wrong, or I might be logging too much stuff
>
> Anyway, my thoughts are negative (Appreciate the very very very early 
> warnings, and the effort, yet inspecting this last email, investing 15 
> minutes into understanding things, It's not enough to grasp the change in 
> pricing, as an example, the link in the email that's supposed to bring you 
> to "Billable log volume *across a billing account* available" - directs 
> you to main billing page - Just a summarised, hey, here's what you paid, 
> and here's what you'll pay now email would be the best)
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/7bfab343-6a77-4bc1-9ffe-eef6efe0662c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Regarding Standard Environment For Node Js

2018-06-28 Thread BRIJQ Brian Oh
I am coming from NodeJs App Engine Flexible Environment and we do know that 
the burning issue with this configuration is the price.
As most of us do not really require the amount of minimum size of resources 
and instances CPU power in flexible environment, I believe that it does not 
really suit us.

As a result, I did the switch over to standard environment as I understand 
that it is still in beta version.

The following are the two concerns and question I have,

1. Networking ports aren really able to be set by us? 
2. We cannot connect to our other instances for example in compute engine 
via our private Ip-address used within Google Cloud Platform. (For example 
connection with other databases servers)

A little more information to point 2, the concern is that I have been 
trying to connect to my MongoDB database that is being hosted in Compute 
Engine. All the while, it have been communicating via the internal private 
ip-address across GCP. That is a very good feature and we do know that.
It have been working well with Flexible Environment.

However, the moment that I launch it over to standard environment, it 
stopped working. As a result, I tried to connect via public ip-address and 
it stills fails to work.

Please note that the application and same configurations to the same 
mongodb server on compute engine connection have been successfully 
establish using my own development machine with the same nodejs8 version 
and similar environment based on the standard environment.

1. Development Machine on my Mac (public ipaddress) 
2. App Engine Flexible Environment (public and internal IP address)

All have been successful.

However both ways failed in standard environment.

Does anyone have or faces the same issue?

Please advise

Thank you in advance.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/5a64f7e2-20fa-41d2-a3b8-4ef4892e912f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: Serving Static Files, Issue with Content Security Policy

2018-06-28 Thread 'Dennis Yurkevich' via Google App Engine
Hello Kenworth,

I do not think the solution is a good one. It is a workaround.

At the very least we need to have documentation explaining any additional
headers being set in the dev environment.

In an ideal scenario they should not be there.


On Wed, 27 Jun 2018 at 23:15, 'Kenworth (Google Cloud Platform)' via Google
App Engine  wrote:

> It seems you also rightfully posted this issue to StackOverflow
> 
> on tags we monitor, and provided your solution. For users experiencing the
> same issue, please follow the thread below:
>
>
> https://stackoverflow.com/questions/51040045/google-app-engine-content-security-policy-issues
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/ed29efca-2ee5-4a8c-a33c-90036701542f%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CANamN%2B59sJUuBreOKw0u0P5YtGPWqL75hZEkwbayk-Qmt8D8rA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Questions about the recent launch of standard environment for NodeJs

2018-06-28 Thread BRIJQ Brian Oh
I am coming from the flexible environment and I believe much of us have the 
same issue with the price of running in flexible environment.

I am wondering if this issue is on my end or is that related to some 
in-mature features in App Engine Standard Environment for NodeJs and I 
understand it is still in Beta Version.

1. Networking ports aren really able to be set by us. 
2. We cannot connect to our other instances for example in compute engine 
via our private Ip-address used within Google Cloud Platform. (For example 
connection with other databases servers)

In addition to point 2, I am actually trying to connect up my mongodb 
server running in Compute Engine. In flexible environment, all the while I 
am connecting using the internal IP address across Google Cloud Platform. 
However the moment I switch it into standard environment, it does not work. 
The weird thing is even I did change into public Ip-address, it does not 
work too. 

Please advise if anyone of you does faces the same issue as I did too. 

Thank You so much for the help in advance. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/448b4769-bea9-4c93-9806-47e01972b85e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Pull Queues: They can't really pull - Horizontal scaling is a must

2018-06-28 Thread Kaan Soral
About a month ago, I tested Pull Queues for a term project, attached my 
test files and the resulting paper (keep in mind that, since I allocate a 
short time for academic stuff, the quality is low :)

I chose Pull Queues, as they let me down hard in the past, I was hoping to 
be surprised this time, but I sadly wasn't

As a TL;DR, the results are:

1) Pull Queues are built to scale with push operations (add operations 
don't fail), however, each *single* task, takes 4 to 120ms+ to create (If 
you add 100 tasks in a batch, 400ms to 12000ms or more)
2) Pull Queues crumble with pull operations, per the documents, you can do 
10 lease operations per second (each with 1000 tasks, assumably), 
theoretically leasing 10.000 tasks / second, you can't, you can't even 
lease 1 task per millisecond on average, 600 tasks/second is a more 
realistic guess, the performance is unreliable, dwindles further when you 
add tasks in parallel too, it's clear the internal black box is built to 
handle add operations, but not lease operations
3) [Side Info, Suggestion] There are Interface bugs, running push queue 
tasks appear as not running, leased pull queue tasks appear as not leased, 
it's very easy to re-run an already running push queue task, it should be 
impossible to re-run an already running task

My personal result: Don't use Pull Queues, or use them by creating multiple 
queues (called horizontal scaling I assume, not very big on terms myself), 
and dividing data into queues, assumably by the modulus of your tasks' tag 
(In these tests, I haven't even included tags, I assume it will only make 
things worst, in the past, I tried using pull queues with tags, and lost 
more than 2 months of my life)

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/eaba2258-8e5f-4b29-8f2d-c3b48cb64a65%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
<>


Re: [google-appengine] Re: zigzag merge

2018-06-28 Thread Kaan Soral
It would be indeed nice, if the production system kept metrics for index 
usage, that way, it would be obvious which indexes are needed or not

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/3931eabd-023b-4650-a5d6-f8473ae26ffd%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: zigzag merge

2018-06-28 Thread Kaan Soral
I might be misunderstanding the question, and interpreting a complex 
question as a simple question (By "needing an index", if you mean, need an 
index to increase lookup performance, I do misunderstand the question)

But, to assess whether you need an index or not, run the SDK with the 
"require indexes"+"don't auto add indexes" (forgot the actual arguments) 
modes, then run the operations of your app in development, delete indexes 
one by one, if operations fail with an index error, re-add that index

It's an exhaustive process, but in any case, you need to re-understand what 
your app does now, so instead of trial error, just studying the app and 
eliminating the indexes manually could require the same effort

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/87da9789-74d4-42a1-8107-00a87c612bb1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Stackdriver: Thoughts?

2018-06-28 Thread Kaan Soral
I personally use App Engine as It allows (or rather, allowed) me to 
concentrate on product (in theory), rather than itsy bitsy stuff

Up to now I ignored the Stackdriver emails, and only now checked what 
actually it was telling (Ignored because I'm here for the PaaS, If I was 
going to use multiple services individually, I'd have invested my efforts 
in AWS back in the day)

Anyway, long story short, my 3 main projects seem to be digesting 230, 460, 
and 1300GB's monthly, as I understand, I'll start paying $0.5 per GB now, 
which makes $995 monthly, considering I paid ~$600/mo for everything up to 
now, bumping that up to $1600 seems extreme, I might be doing the 
calculation wrong, or I might be logging too much stuff

Anyway, my thoughts are negative (Appreciate the very very very early 
warnings, and the effort, yet inspecting this last email, investing 15 
minutes into understanding things, It's not enough to grasp the change in 
pricing, as an example, the link in the email that's supposed to bring you 
to "Billable log volume *across a billing account* available" - directs you 
to main billing page - Just a summarised, hey, here's what you paid, and 
here's what you'll pay now email would be the best)

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/2b08c9e3-e344-45b3-abad-c1ffc427e220%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.