[Wikitech-l] Re: API issue

[Kavitha Appakayala]

Thanks everyone for quickly chiming in.

As suggested, was the phabricator task opened with all details for further
investigation? If so, please share the phab task id.

Thanks,
Kavitha Appakayala
Senior Manager, Site Reliability Team
Wikimedia Foundation

On Tue, Jan 9, 2024 at 10:36 PM Giuseppe Lavagetto 
wrote:

> Hi,
>
> without further details on what requests you make, what user-agent your
> script uses, and the times at which you've seen this issue, it's going to
> be hard to help you.
>
> My bet is that you've incurred into one of our throttling/anti-abuse rules.
>
> If you open a task on phabricator with details (if possible, an IP would
> also help, in that case feel free to make the task private) and point me to
> it, I can investigate what is going on. I'm pretty confident the problem is
> not the servers being overloaded.
>
> Cheers,
>
> G.
>
>
> On Wed, Jan 10, 2024 at 6:28 AM ovskmendov--- via Wikitech-l <
> wikitech-l@lists.wikimedia.org> wrote:
>
>> I know. As I said before, this literally started on the first request I
>> made.
>>
>> Sent with Proton Mail  secure email.
>>
>> On Wednesday, January 10th, 2024 at 12:23 AM, Dalba 
>> wrote:
>>
>> Maybe this is not it, but worth checking: "Make your requests in series
>> rather than in parallel, by waiting for one request to finish before
>> sending a new request."[1]
>> [1]: https://www.mediawiki.org/wiki/API:Etiquette
>>
>> On Wed, Jan 10, 2024 at 8:45 AM ovskmendov--- via Wikitech-l <
>> wikitech-l@lists.wikimedia.org> wrote:
>>
>>> >Maybe someone else is doing it from the same IP, or maybe it's a bug.
>>> You could file a report
>>>  in
>>> Phabricator with the details of what you are doing and the details from
>>> that error page.
>>>
>>> Given that I have a clean residential IPv6, that is very unlikely. Plus,
>>> it was working just a few days. And it still doesn’t work with a VPN.
>>>
>>> I don’t think it’s a bug as a few requests go through fine, based on the
>>> behavior, I think it’s server overload or something like that.
>>>
>>> Sent with Proton Mail  secure email.
>>>
>>> On Wednesday, January 10th, 2024 at 12:06 AM, Gergo Tisza <
>>> gti...@wikimedia.org> wrote:
>>>
>>> On Tue, Jan 9, 2024 at 8:53 PM ovskmendov--- via Wikitech-l <
>>> wikitech-l@lists.wikimedia.org> wrote:
>>>
 I am not sending very many requests. I haven’t sent any requests in
 several days and yet I get the error message.

>>>
>>> Maybe someone else is doing it from the same IP, or maybe it's a bug.
>>> You could file a report
>>>  in
>>> Phabricator with the details of what you are doing and the details from
>>> that error page.
>>>
>>>
>>> ___
>>> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
>>> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
>>>
>>> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
>>
>>
>> ___
>> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
>> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
>>
>> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
>
>
>
> --
> Giuseppe Lavagetto
> Principal Site Reliability Engineer, Wikimedia Foundation
> ___
> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/



--
___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

[Wikitech-l] Re: API issue

[Giuseppe Lavagetto]

Hi,

without further details on what requests you make, what user-agent your
script uses, and the times at which you've seen this issue, it's going to
be hard to help you.

My bet is that you've incurred into one of our throttling/anti-abuse rules.

If you open a task on phabricator with details (if possible, an IP would
also help, in that case feel free to make the task private) and point me to
it, I can investigate what is going on. I'm pretty confident the problem is
not the servers being overloaded.

Cheers,

G.


On Wed, Jan 10, 2024 at 6:28 AM ovskmendov--- via Wikitech-l <
wikitech-l@lists.wikimedia.org> wrote:

> I know. As I said before, this literally started on the first request I
> made.
>
> Sent with Proton Mail  secure email.
>
> On Wednesday, January 10th, 2024 at 12:23 AM, Dalba 
> wrote:
>
> Maybe this is not it, but worth checking: "Make your requests in series
> rather than in parallel, by waiting for one request to finish before
> sending a new request."[1]
> [1]: https://www.mediawiki.org/wiki/API:Etiquette
>
> On Wed, Jan 10, 2024 at 8:45 AM ovskmendov--- via Wikitech-l <
> wikitech-l@lists.wikimedia.org> wrote:
>
>> >Maybe someone else is doing it from the same IP, or maybe it's a bug.
>> You could file a report
>>  in
>> Phabricator with the details of what you are doing and the details from
>> that error page.
>>
>> Given that I have a clean residential IPv6, that is very unlikely. Plus,
>> it was working just a few days. And it still doesn’t work with a VPN.
>>
>> I don’t think it’s a bug as a few requests go through fine, based on the
>> behavior, I think it’s server overload or something like that.
>>
>> Sent with Proton Mail  secure email.
>>
>> On Wednesday, January 10th, 2024 at 12:06 AM, Gergo Tisza <
>> gti...@wikimedia.org> wrote:
>>
>> On Tue, Jan 9, 2024 at 8:53 PM ovskmendov--- via Wikitech-l <
>> wikitech-l@lists.wikimedia.org> wrote:
>>
>>> I am not sending very many requests. I haven’t sent any requests in
>>> several days and yet I get the error message.
>>>
>>
>> Maybe someone else is doing it from the same IP, or maybe it's a bug. You
>> could file a report
>>  in
>> Phabricator with the details of what you are doing and the details from
>> that error page.
>>
>>
>> ___
>> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
>> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
>>
>> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
>
>
> ___
> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/



-- 
Giuseppe Lavagetto
Principal Site Reliability Engineer, Wikimedia Foundation
___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

[Wikitech-l] Re: API issue

[ovskmendov--- via Wikitech-l]

I know. As I said before, this literally started on the first request I made.

Sent with [Proton Mail](https://proton.me/) secure email.

On Wednesday, January 10th, 2024 at 12:23 AM, Dalba  
wrote:

> Maybe this is not it, but worth checking: "Make your requests in series 
> rather than in parallel, by waiting for one request to finish before sending 
> a new request."[1]
> [1]: https://www.mediawiki.org/wiki/API:Etiquette
>
> On Wed, Jan 10, 2024 at 8:45 AM ovskmendov--- via Wikitech-l 
>  wrote:
>
>>>Maybe someone else is doing it from the same IP, or maybe it's a bug. You 
>>>could[file a 
>>>report](https://phabricator.wikimedia.org/maniphest/task/edit/form/43/)in 
>>>Phabricator with the details of what you are doing and the details from that 
>>>error page.
>> Given that I have a clean residential IPv6, that is very unlikely. Plus, it 
>> was working just a few days. And it still doesn’t work with a VPN.
>>
>> I don’t think it’s a bug as a few requests go through fine, based on the 
>> behavior, I think it’s server overload or something like that.
>>
>> Sent with [Proton Mail](https://proton.me/) secure email.
>>
>> On Wednesday, January 10th, 2024 at 12:06 AM, Gergo Tisza 
>>  wrote:
>>
>>> On Tue, Jan 9, 2024 at 8:53 PM ovskmendov--- via Wikitech-l 
>>>  wrote:
>>>
 I am not sending very many requests. I haven’t sent any requests in 
 several days and yet I get the error message.
>>>
>>> Maybe someone else is doing it from the same IP, or maybe it's a bug. You 
>>> could [file a 
>>> report](https://phabricator.wikimedia.org/maniphest/task/edit/form/43/) in 
>>> Phabricator with the details of what you are doing and the details from 
>>> that error page.
>>
>> ___
>> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
>> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
>> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

[Wikitech-l] Re: API issue

[Dalba]

 Maybe this is not it, but worth checking: "Make your requests in series
rather than in parallel, by waiting for one request to finish before
sending a new request."[1]
[1]: https://www.mediawiki.org/wiki/API:Etiquette

On Wed, Jan 10, 2024 at 8:45 AM ovskmendov--- via Wikitech-l <
wikitech-l@lists.wikimedia.org> wrote:

> >Maybe someone else is doing it from the same IP, or maybe it's a bug.
> You could file a report
>  in
> Phabricator with the details of what you are doing and the details from
> that error page.
>
> Given that I have a clean residential IPv6, that is very unlikely. Plus,
> it was working just a few days. And it still doesn’t work with a VPN.
>
> I don’t think it’s a bug as a few requests go through fine, based on the
> behavior, I think it’s server overload or something like that.
>
> Sent with Proton Mail  secure email.
>
> On Wednesday, January 10th, 2024 at 12:06 AM, Gergo Tisza <
> gti...@wikimedia.org> wrote:
>
> On Tue, Jan 9, 2024 at 8:53 PM ovskmendov--- via Wikitech-l <
> wikitech-l@lists.wikimedia.org> wrote:
>
>> I am not sending very many requests. I haven’t sent any requests in
>> several days and yet I get the error message.
>>
>
> Maybe someone else is doing it from the same IP, or maybe it's a bug. You
> could file a report
>  in
> Phabricator with the details of what you are doing and the details from
> that error page.
>
>
> ___
> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

[Wikitech-l] Re: API issue

[ovskmendov--- via Wikitech-l]

>Maybe someone else is doing it from the same IP, or maybe it's a bug. You 
>could[file a 
>report](https://phabricator.wikimedia.org/maniphest/task/edit/form/43/)in 
>Phabricator with the details of what you are doing and the details from that 
>error page.
Given that I have a clean residential IPv6, that is very unlikely. Plus, it was 
working just a few days. And it still doesn’t work with a VPN.

I don’t think it’s a bug as a few requests go through fine, based on the 
behavior, I think it’s server overload or something like that.

Sent with [Proton Mail](https://proton.me/) secure email.

On Wednesday, January 10th, 2024 at 12:06 AM, Gergo Tisza 
 wrote:

> On Tue, Jan 9, 2024 at 8:53 PM ovskmendov--- via Wikitech-l 
>  wrote:
>
>> I am not sending very many requests. I haven’t sent any requests in several 
>> days and yet I get the error message.
>
> Maybe someone else is doing it from the same IP, or maybe it's a bug. You 
> could [file a 
> report](https://phabricator.wikimedia.org/maniphest/task/edit/form/43/) in 
> Phabricator with the details of what you are doing and the details from that 
> error page.___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

[Wikitech-l] Re: API issue

[Gergo Tisza]

On Tue, Jan 9, 2024 at 8:53 PM ovskmendov--- via Wikitech-l <
wikitech-l@lists.wikimedia.org> wrote:

> I am not sending very many requests. I haven’t sent any requests in
> several days and yet I get the error message.
>

Maybe someone else is doing it from the same IP, or maybe it's a bug. You
could file a report
 in
Phabricator with the details of what you are doing and the details from
that error page.
___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

[Wikitech-l] Re: API issue

[ovskmendov--- via Wikitech-l]

Sorry I should have elaborated further.

I have had a script for a long time that gathers some information from 
Wikipedia. I only run it occasionally and it doesn’t make very many requests. I 
hadn’t run in a few days and when I ran it today, I got that error message and 
can’t seem to fix it. Weirdly, about 1% requests do actually do go through.. 
that is, until after a few minutes of running the script, when all requests 
fail with no exception.

I have tried everything and nothing seems to fix it. I don’t think it’s a rate 
limit issue either - I tried using my VPN and I still got the same error.

My personal theory has been that some process on Wikipedia’s servers is 
overloaded. That seems to explain the errors as well as the few requests that 
do go through.

Sent with [Proton Mail](https://proton.me/) secure email.

On Tuesday, January 9th, 2024 at 11:43 PM, Gergo Tisza  
wrote:

> You should probably send requests less frequently, you are hitting some sort 
> of throttling.
>
> (And we should probably show a more comprehensible error page. Filed as 
> [T354718](https://phabricator.wikimedia.org/T354718).)___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

[Wikitech-l] Re: API issue

[ovskmendov--- via Wikitech-l]

I am not sending very many requests. I haven’t sent any requests in several 
days and yet I get the error message.

Sent with [Proton Mail](https://proton.me/) secure email.

On Tuesday, January 9th, 2024 at 11:43 PM, Gergo Tisza  
wrote:

> You should probably send requests less frequently, you are hitting some sort 
> of throttling.
>
> (And we should probably show a more comprehensible error page. Filed as 
> [T354718](https://phabricator.wikimedia.org/T354718).)___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

[Wikitech-l] Re: API issue

[Gergo Tisza]

You should probably send requests less frequently, you are hitting some
sort of throttling.

(And we should probably show a more comprehensible error page. Filed as
T354718 .)
___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

[Wikitech-l] Re: API issue

[ovskmendov--- via Wikitech-l]

Action api.

Here's the full response from the server:




Wikimedia Error

* { margin: 0; padding: 0; }
body { background: #fff; font: 15px/1.6 sans-serif; color: #333; }
.content { margin: 7% auto 0; padding: 2em 1em 1em; max-width: 640px; }
.footer { clear: both; margin-top: 14%; border-top: 1px solid #e5e5e5; 
background: #f9f9f9; padding: 2em 0; font-size: 0.8em; text-align: center; }
img { float: left; margin: 0 2em 2em 0; }
a img { border: 0; }
h1 { margin-top: 1em; font-size: 1.2em; }
.content-text { overflow: hidden; overflow-wrap: break-word; word-wrap: 
break-word; -webkit-hyphens: auto; -moz-hyphens: auto; -ms-hyphens: auto; 
hyphens: auto; }
p { margin: 0.7em 0 1em 0; }
a { color: #0645ad; text-decoration: none; }
a:hover { text-decoration: underline; }
code { font-family: sans-serif; }
.text-muted { color: #777; }


https://www.wikimedia.org;>https://www.wikimedia.org/static/images/wmf-logo.png; 
srcset="https://www.wikimedia.org/static/images/wmf-logo-2x.png 2x" 
alt="Wikimedia" width="135" height="101">

Error

Our servers are currently under maintenance or experiencing a technical 
problem.

Please try again in a 
fewminutes.

See the error message at the bottom of this page for 
moreinformation.


If you report this error to the Wikimedia System 
Administrators, please include the details below.Request from 170.52.120.177 via cp1104 cp1104, Varnish 
XID 961635064Upstream caches: cp1104 intError: 429, Too many requests 
at Wed, 10 Jan 2024 00:42:36 GMT



Sent with Proton Mail secure email.

On Tuesday, January 9th, 2024 at 9:50 PM, Andre Klapper 
 wrote:


> On Wed, 2024-01-10 at 02:29 +, ovskmendov--- via Wikitech-l wrote:
> 
> > Whenever I access the API, I get "Wikimedia Error: Our servers are
> > currently under maintenance or experiencing a technical problem."
> 
> 
> Access how exactly?
> Which of the APIs (Action API, REST API, etc)?
> Via which API calls?
> On which Wikimedia server(s)?
> What's the full and complete error code?
> 
> Thanks,
> andre
> --
> Andre Klapper (he/him) | Bugwrangler
> https://blogs.gnome.org/aklapper/
> ___
> Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
> To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

[Wikitech-l] Re: API issue

[Andre Klapper]

On Wed, 2024-01-10 at 02:29 +, ovskmendov--- via Wikitech-l wrote:
> Whenever I access the API, I get "Wikimedia Error: Our servers are
> currently under maintenance or experiencing a technical problem."

Access how exactly?
Which of the APIs (Action API, REST API, etc)?
Via which API calls?
On which Wikimedia server(s)?
What's the full and complete error code?

Thanks,
andre
-- 
Andre Klapper (he/him) | Bugwrangler
https://blogs.gnome.org/aklapper/
___
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org
To unsubscribe send an email to wikitech-l-le...@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/