MisterSynergy added a comment.
Following my report in T44362#6638174 <https://phabricator.wikimedia.org/T44362#6638174>, I looked into this a little more. From Wikidata's mediawiki database, I queried page creation times for the items created during the reported time period (14 Nov, 1:42 to 21 Nov, 1:42) and quickly plotted Q-ID vs. item creation timestamp. On the upper panel of the attached figure, you can see that there are two phases where the curve increases rapidly; a finer evaluation yields steep increases from 2020-11-14, 11:54 through 2020-11-16, 20:23, and another shorter period from 2020-11-18, 20:24 through 2020-11-18, 23:53. I also plotted the item creation rate (in 10 min bins) on the lower panel. F33924179: new_items_nov2020.png <https://phabricator.wikimedia.org/F33924179> We can also compare the Grafana charts on the Wikidata edits <https://grafana.wikimedia.org/d/000000170/wikidata-edits?orgId=1&from=1605318120000&to=1605922920000> dashboard. Particularly during the first and longer period, there have been phases where not a single user has been editing at the rate limit (90/min). My findings are: - Skipped Q-IDs are not temporarily equally distributed over the one week period. It is reasonable to assume that someone triggers this with some sort of requests, and these requests are not coming in all the time. - The item creation rate (lower panel) looks perfectly sane, including during times when the curve on the upper panel increases quickly. This means that most of the Q-IDs are skipped during the steeper sections of the upper panel graph. - The two steep phases in the upper panel together comprise around 215.000 seconds. Considering we have lost ~450.000 Q-IDs mostly during that time period, it is reasonable to assume that Q-IDs are skipped/wasted at a rate of roughly 2/sec during these phases. This is above the rate limit (1.5/sec), but since no edits at all seem to go through, I think that the rate limit is likely not the cause for this problem. TASK DETAIL https://phabricator.wikimedia.org/T268625 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: MisterSynergy Cc: MisterSynergy, Tonina_Zhelyazkova_WMDE, Addshore, Pablo-WMDE, Lucas_Werkmeister_WMDE, Lydia_Pintscher, WMDE-leszek, Aklapper, Akuckartz, Iflorez, alaa_wmde, Nandana, lucamauri, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
