[Wikitech-l] Re: Limit to the number of images in a page?

[AntiCompositeNumber]

Those are the limits for MediaWiki, but we don't render thumbnails
with MediaWiki in Wikimedia production (we use Thumbor instead). The
limits for Thumbor are in
https://phabricator.wikimedia.org/source/operations-puppet/browse/production/modules/thumbor/templates/server.conf.erb$157.
Thumbor only limits requests for new thumbnails, the limit in this
case is between 4 and 50 requests in 4 seconds per IP. (It's
implemented with poolcounter with workers=4, maxqueue=50, timeout=4).
They should all load eventually, if you refresh enough times.

On Mon, Nov 29, 2021 at 8:54 PM Brian Wolff  wrote:
>
> This isn't a per page limit but a number of thumbnails per unit time. Wait a 
> little bit and revisit the page and more pictures should load. Eventually all 
> should. As long as nobody purges the image pages, once the image loads once 
> it should always load again in the future.
>
> The current limits are 70 per 30 second, unless its a certaun "common" size 
> in which case its 700/30 seconds. This is defined in: 
> https://noc.wikimedia.org/conf/InitialiseSettings.php.txt
>
> renderfile' => [
> // 1400 new thumbnails per minute
> 'ip' => [ 700, 30 ],
> 'user' => [ 700, 30 ],
> ],
> 'renderfile-nonstandard' => [
> // 140 new thumbnails per minute
> 'ip' => [ 70, 30 ],
> 'user' => [ 70, 30 ],
> ],
>
>
>
> In practise i dont think people use those "standard" sizes all that more 
> often than other sizes.
>
> On Monday, November 29, 2021, Strainu  wrote:
>>
>> Hi,
>>
>> I have some wikipages with a large number of images (1000+). Those
>> pages never load completely, as upload.wikimedia.org starts returning
>> 429 Too many requests after a while.
>>
>> This limit does not seem to be documented on mediawiki.org, so I would
>> like to know what it the exact value and if there is a way to work
>> around it (except for splitting the pages).
>>
>> Thanks,
>>Strainu
>> ___
>> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
>> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
>> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
>
> ___
> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

[Wikitech-l] Re: Limit to the number of images in a page?

[Roy Smith]

I don't know if this is your issue, but there's been problems in the past with 
pages that had lots of small png or jpg images of national flags.  Replacing 
them with the svg and/or emoji versions solved the problem.  Described in 
https://phabricator.wikimedia.org/T267804




> On Nov 29, 2021, at 8:53 PM, Brian Wolff  wrote:
> 
> This isn't a per page limit but a number of thumbnails per unit time. Wait a 
> little bit and revisit the page and more pictures should load. Eventually all 
> should. As long as nobody purges the image pages, once the image loads once 
> it should always load again in the future.
> 
> The current limits are 70 per 30 second, unless its a certaun "common" size 
> in which case its 700/30 seconds. This is defined in: 
> https://noc.wikimedia.org/conf/InitialiseSettings.php.txt 
> 
> renderfile' => [
>   // 1400 new thumbnails per minute
>   'ip' => [ 700, 30 ],
>   'user' => [ 700, 30 ],
>   ],
>   'renderfile-nonstandard' => [
>   // 140 new thumbnails per minute
>   'ip' => [ 70, 30 ],
>   'user' => [ 70, 30 ],
>   ],
> 
> 
> In practise i dont think people use those "standard" sizes all that more 
> often than other sizes.
> 
> On Monday, November 29, 2021, Strainu  > wrote:
> Hi,
> 
> I have some wikipages with a large number of images (1000+). Those
> pages never load completely, as upload.wikimedia.org 
>  starts returning
> 429 Too many requests after a while.
> 
> This limit does not seem to be documented on mediawiki.org 
> , so I would
> like to know what it the exact value and if there is a way to work
> around it (except for splitting the pages).
> 
> Thanks,
>Strainu
> ___
> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org 
> 
> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org 
> 
> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ 
> 
> ___
> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

[Wikitech-l] Re: Limit to the number of images in a page?

[Brian Wolff]

This isn't a per page limit but a number of thumbnails per unit time. Wait
a little bit and revisit the page and more pictures should load. Eventually
all should. As long as nobody purges the image pages, once the image loads
once it should always load again in the future.

The current limits are 70 per 30 second, unless its a certaun "common" size
in which case its 700/30 seconds. This is defined in:
https://noc.wikimedia.org/conf/InitialiseSettings.php.txt

renderfile' => [
// 1400 new thumbnails per minute
'ip' => [ 700, 30 ],
'user' => [ 700, 30 ],
],
'renderfile-nonstandard' => [
// 140 new thumbnails per minute
'ip' => [ 70, 30 ],
'user' => [ 70, 30 ],
],



In practise i dont think people use those "standard" sizes all that more
often than other sizes.

On Monday, November 29, 2021, Strainu  wrote:

> Hi,
>
> I have some wikipages with a large number of images (1000+). Those
> pages never load completely, as upload.wikimedia.org starts returning
> 429 Too many requests after a while.
>
> This limit does not seem to be documented on mediawiki.org, so I would
> like to know what it the exact value and if there is a way to work
> around it (except for splitting the pages).
>
> Thanks,
>Strainu
> ___
> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
> https://lists.wikimedia.org/postorius/lists/wikitech-l.
> lists.wikimedia.org/
>
___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/