We'll work to open source the launcher source. In the meantime, the default
logic looks like this:
workerCount := 8
if memoryMb <= 128 {
workerCount = 1
} else if memoryMb <= 256 {
workerCount = 2
} else if memoryMb <= 512 {
workerCount = 4
}
The number of workers to use is highly dependent on your workload, so these
are only reasonable general starting points.
On Friday, 5 November 2021 at 12:29:43 UTC-7 Joshua Smith wrote:
> I think it's telling me that since my P3.7 app has a F4_1G instance, I
> should be configuring it to run gunicorn with 8 workers. I don't see any
> information about the default number of workers. I guess I can do an
> experiment to see what explicitly setting that does...
>
> On Nov 5, 2021, at 3:17 PM, Jason Collins <jason.a...@gmail.com> wrote:
>
> It sounds like there might be some differences due to concurrency between
> 2.7 and 3.7/8/9. There are some notes on how to tweak the number of worker
> processes started for Python 3 here:
> https://cloud.google.com/appengine/docs/standard/python3/runtime#entrypoint_best_practices
>
>
> On Friday, 5 November 2021 at 11:50:52 UTC-7 George (Cloud Platform
> Support) wrote:
>
>> There is no official description, somewhere, of "how the scaling has
>> changed" or "how it has been implemented differently", as there is no
>> change in scaling behavior, and no different implementation. This is an
>> assumption while we investigate the situation described by Joshua above. I
>> could not find a similar issue in the Public Issue Tracker
>> <https://issuetracker.google.com/>, so the difference in scaling between
>> Python 2 and 3 is likely a one-time occurrence, and caused by idiosyncratic
>> settings in the project, or application-specific factors. Such issue are
>> difficult to approach in a publicly-accessible thread as this one, as
>> investigation needs particulars such as project ID, and access to other
>> private data. To have this issue properly addressed, it's better to open
>> a support case
>> <https://cloud.google.com/support/docs/manage-cases#creating_cases> or
>> an issue in the Public Issue Tracker <https://issuetracker.google.com/>.
>>
>> On Friday, 05 November 2021 at 05:50:42 UTC-4 Nicolas Fonrose (Teevity)
>> wrote:
>>
>>> Hello David,
>>>
>>> >There’s not an official way of forcing the scaling to behave like it
>>> used to be on python 2.7.
>>> Is there an official description, somewhere, of "how the scaling has
>>> changed" or "how it has been implemented differently" ?
>>> Or this change just a side effect of technical choices that were made in
>>> the new runtimes?
>>>
>>> Thanks,
>>>
>>> On Thursday, November 4, 2021 at 9:56:43 PM UTC+1 David (Cloud Platform
>>> Support) wrote:
>>>
>>>> Hello,
>>>>
>>>> Other than applying changes within your own application so it will go
>>>> easy at startup, you can try using warmup requests
>>>> <https://cloud.google.com/appengine/docs/standard/python3/configuring-warmup-requests>
>>>>
>>>> along with tweaking the min_idle_instances element
>>>> <https://cloud.google.com/appengine/docs/standard/python3/config/appref#scaling_elements>
>>>>
>>>> in your app.yaml, in order to reduce request and response latency during
>>>> the time when your app's code is being loaded to a newly created instance.
>>>> There’s not an official way of forcing the scaling to behave like it
>>>> used to be on python 2.7. However, this type of feedback can be passed to
>>>> the App Engine engineering team in the form of a feature request. You can
>>>> create such a feature request here
>>>> <https://issuetracker.google.com/issues/new?component=187191&template=1162953>.
>>>>
>>>> The App Engine engineering team would then evaluate it and decide whether
>>>> it could be implemented or not.
>>>> On Thursday, November 4, 2021 at 11:38:52 AM UTC-4 Joshua Smith wrote:
>>>>
>>>>> Thanks for sending out this update. I did, indeed, miss most of this
>>>>> news.
>>>>>
>>>>> This item, in particular, is *awesome*:
>>>>>
>>>>>
>>>>>
>>>>> -
>>>>>
>>>>> Extending support for App Engine bundled services
>>>>>
>>>>> <https://cloud.google.com/blog/products/serverless/support-for-app-engine-services-in-second-generation-runtimes>
>>>>>
>>>>> (Sep 2021)
>>>>>
>>>>>
>>>>> This sounds like it will make it so much easier to migrate to Python
>>>>> 3.7.
>>>>>
>>>>> One thing I've noticed is that my older apps on 2.7 seem to handle
>>>>> peak scaling a lot better than my newer apps on 3.7. For example, if I
>>>>> have
>>>>> a web page that hits a 2.7 app with 100 REST calls at startup (bad
>>>>> design,
>>>>> but it happens), the old app serves them all eventually. But if I do the
>>>>> same thing in a 3.7 app, it's likely to choke and fail a bunch of those
>>>>> requests with these:
>>>>>
>>>>>
>>>>> The specific pattern is that after the first couple requests, it spins
>>>>> up a new instance. That takes 5 seconds to serve its first request
>>>>> (simple
>>>>> app, so I guess that's just GAE overhead). Then it spins up a couple
>>>>> more.
>>>>> Then I start getting those errors on some of the requests, because 15s
>>>>> have
>>>>> passed. In this capture the blue ones are new instances spinning up, and
>>>>> the orange ones are timeout errors (note the 15s time on those).
>>>>>
>>>>>
>>>>> I've been designing around the issue by making sure my web apps go
>>>>> easy on the server on startup. But it is yet another concern about
>>>>> migrating.
>>>>>
>>>>> Is there a way to tune the auto-scaling for 3.7 to behave like the
>>>>> 2.7? Here's a similar set of requests to my 2.7 app, which only spins up
>>>>> one extra instance, and never throws timeout errors, ever:
>>>>>
>>>>>
>>>>> -Joshua
>>>>>
>>>>>
>>>>>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengi...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/150109bb-18a4-40b1-9efb-8b86bc60eceen%40googlegroups.com
>
> <https://groups.google.com/d/msgid/google-appengine/150109bb-18a4-40b1-9efb-8b86bc60eceen%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
>
>
>
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/google-appengine/13a53a1a-36ee-4317-8839-022666a0eb9fn%40googlegroups.com.
