[Pywikipedia-bugs] [Maniphest] [Retitled] T249705: Intermittent internal API errors with Flow
cscott renamed this task from "pywikibot encounters an internal API error with Flow on testwiki (but not other wikis)" to "Intermittent internal API errors with Flow". cscott updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T249705 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: cscott Cc: Xqt, Anomie, Joe, cscott, Jdforrester-WMF, ssastry, kostajh, Aklapper, pywikibot-bugs-list, Dvorapa, Blissjay007, Oblanco79, Alter-paule, NavinRizwi, Beast1978, Un1tY, Zkhalido, Demian, Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, Kent7301, Meekrab2012, joker88john, Viztor, 94rain, DannyS712, CucyNoiD, Lens0021, NebulousIris, Wenyi, jijiki, Gaboe420, Jony, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Af420, Darkminds3113, Bsandipan, Lordiis, Adik2382, 45Jayjay1969, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, Tbscho, MayS, EnricoCNC, WSH1906, Lewizho99, Mdupont, JJMC89, Maathavan, Altostratus, Taiwania_Justo, Avicennasis, SBisson, MGChecker, mys_721tx, Jrf, Dinoguy1000, Gryllida, jeblad, jayvdb, Catrope, Masti, happy5214, Alchimista, Arlolra, Rxy, Jay8g, Krenair, Dzahn, Legoktm ___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
[Pywikipedia-bugs] [Maniphest] [Updated] T249705: pywikibot encounters an internal API error with Flow on testwiki (but not other wikis)
cscott added a comment. @joe, if this turns out to be envoy-related, T249745: Could not enqueue jobs: Unable to deliver all events: 503: Service Unavailable <https://phabricator.wikimedia.org/T249745> could be as well. TASK DETAIL https://phabricator.wikimedia.org/T249705 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: cscott Cc: Joe, cscott, Jdforrester-WMF, ssastry, kostajh, Aklapper, pywikibot-bugs-list, Dvorapa, NavinRizwi, Zkhalido, Demian, Viztor, 94rain, DannyS712, Lens0021, Wenyi, Jony, 45Jayjay1969, Jayprakash12345, Tbscho, MayS, EnricoCNC, Mdupont, JJMC89, Altostratus, Taiwania_Justo, Avicennasis, SBisson, MGChecker, mys_721tx, Jrf, Dinoguy1000, Gryllida, jeblad, jayvdb, Catrope, Masti, happy5214, Alchimista, Arlolra, Rxy, Jay8g, Krenair, Legoktm ___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
[Pywikipedia-bugs] [Maniphest] [Commented On] T249705: pywikibot encounters an internal API error with Flow on testwiki (but not other wikis)
cscott added a comment. i assume the localhost:6002 goes to envoy or some other router which actually brings it to the parsoid cluster ? <_joe_> yes <_joe_> so interestingly, I find no trace of 503 errors in the parsoid logs, but lemme check the mediawiki appservers <_joe_> actually, it's almost 8 pm <_joe_> I'll do it tomorrow <_joe_> this is not a complete breakage AFAICT TASK DETAIL https://phabricator.wikimedia.org/T249705 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: cscott Cc: Joe, cscott, Jdforrester-WMF, ssastry, kostajh, Aklapper, pywikibot-bugs-list, Dvorapa, NavinRizwi, Zkhalido, Demian, Viztor, 94rain, DannyS712, Lens0021, Wenyi, Jony, 45Jayjay1969, Jayprakash12345, Tbscho, MayS, EnricoCNC, Mdupont, JJMC89, Altostratus, Taiwania_Justo, Avicennasis, SBisson, MGChecker, mys_721tx, Jrf, Dinoguy1000, Gryllida, jeblad, jayvdb, Catrope, Masti, happy5214, Alchimista, Arlolra, Rxy, Jay8g, Krenair, Legoktm ___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
[Pywikipedia-bugs] [Maniphest] [Updated] T249705: pywikibot encounters an internal API error with Flow on testwiki (but not other wikis)
cscott added a subscriber: Joe. cscott added a comment. The full URL requested for the original 503 error should have been: http://localhost:6002/w/rest.php/test.wikimedia.org/v3/transform/html/to/wikitext/Topic%3AU5y53rn0dp6h70nw (Based on an internal VRS request of `/restbase/local/v1/transform/html/to/wikitext/Topic%3AU5y53rn0dp6h70nw`) That localhost request is then routed to the parsoid cluster; @Joe thinks that the recent envoy changes (see T249535 <https://phabricator.wikimedia.org/T249535>) might be related. TASK DETAIL https://phabricator.wikimedia.org/T249705 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: cscott Cc: Joe, cscott, Jdforrester-WMF, ssastry, kostajh, Aklapper, pywikibot-bugs-list, Dvorapa, NavinRizwi, Zkhalido, Demian, Viztor, 94rain, DannyS712, Lens0021, Wenyi, Jony, 45Jayjay1969, Jayprakash12345, Tbscho, MayS, EnricoCNC, Mdupont, JJMC89, Altostratus, Taiwania_Justo, Avicennasis, SBisson, MGChecker, mys_721tx, Jrf, Dinoguy1000, Gryllida, jeblad, jayvdb, Catrope, Masti, happy5214, Alchimista, Arlolra, Rxy, Jay8g, Krenair, Legoktm ___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
[Pywikipedia-bugs] [Maniphest] [Commented On] T249705: pywikibot encounters an internal API error with Flow on testwiki (but not other wikis)
cscott added a comment. HTTP 503 is "Service Unavailable" -- I wonder if this is actually a rate limit or something similar which is being hit? TASK DETAIL https://phabricator.wikimedia.org/T249705 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: cscott Cc: cscott, Jdforrester-WMF, ssastry, kostajh, Aklapper, pywikibot-bugs-list, Dvorapa, NavinRizwi, Zkhalido, Demian, Viztor, 94rain, DannyS712, Lens0021, Wenyi, Jony, 45Jayjay1969, Jayprakash12345, Tbscho, MayS, EnricoCNC, Mdupont, JJMC89, Altostratus, Taiwania_Justo, Avicennasis, SBisson, MGChecker, mys_721tx, Jrf, Dinoguy1000, Gryllida, jeblad, jayvdb, Catrope, Masti, happy5214, Alchimista, Arlolra, Rxy, Jay8g, Krenair, Legoktm ___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
[Pywikipedia-bugs] [Maniphest] [Updated] T249705: Internal API error with Flow on testwiki
cscott added a parent task: T247774: 1.35.0-wmf.27 deployment blockers. TASK DETAIL https://phabricator.wikimedia.org/T249705 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: cscott Cc: Jdforrester-WMF, ssastry, kostajh, Aklapper, pywikibot-bugs-list, Dvorapa, NavinRizwi, Zkhalido, Demian, Viztor, 94rain, DannyS712, Lens0021, Wenyi, Jony, 45Jayjay1969, Jayprakash12345, Tbscho, MayS, EnricoCNC, Mdupont, JJMC89, Altostratus, Taiwania_Justo, Avicennasis, SBisson, MGChecker, mys_721tx, Jrf, Dinoguy1000, Gryllida, jeblad, jayvdb, Catrope, Masti, happy5214, Alchimista, Arlolra, Rxy, Jay8g, Krenair, Legoktm ___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
[Pywikipedia-bugs] [Maniphest] [Commented On] T249705: Internal API error with Flow on testwiki
cscott added a comment. Adding as a train blocker until/unless we can prove that this isn't related to a group0 deployment. TASK DETAIL https://phabricator.wikimedia.org/T249705 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: cscott Cc: cscott, Jdforrester-WMF, ssastry, kostajh, Aklapper, pywikibot-bugs-list, Dvorapa, NavinRizwi, Zkhalido, Demian, Viztor, 94rain, DannyS712, Lens0021, Wenyi, Jony, 45Jayjay1969, Jayprakash12345, Tbscho, MayS, EnricoCNC, Mdupont, JJMC89, Altostratus, Taiwania_Justo, Avicennasis, SBisson, MGChecker, mys_721tx, Jrf, Dinoguy1000, Gryllida, jeblad, jayvdb, Catrope, Masti, happy5214, Alchimista, Arlolra, Rxy, Jay8g, Krenair, Legoktm ___ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs