Mvolz has submitted this change and it was merged. Change subject: Stop using Mozilla user agent header ......................................................................
Stop using Mozilla user agent header Mozilla user agent header was initally used because some sites required that a valid browser be used to load; however, for other sites this resulted in connection errors. This a temporary solution; in the future, we may try multiple request types on upon failure. Bug: T1174 Bug: T1173 Change-Id: I9e0cc7e1bb359cd4610048b85a7c62a77d2d2127 --- M lib/scrape.js 1 file changed, 0 insertions(+), 1 deletion(-) Approvals: Mvolz: Verified; Looks good to me, approved diff --git a/lib/scrape.js b/lib/scrape.js index 8482571..cd7be26 100644 --- a/lib/scrape.js +++ b/lib/scrape.js @@ -38,7 +38,6 @@ request( { url: url, - headers: {'user-agent': 'Mozilla/5.0'}, followAllRedirects: true }, function(error, response, html){ -- To view, visit https://gerrit.wikimedia.org/r/179435 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I9e0cc7e1bb359cd4610048b85a7c62a77d2d2127 Gerrit-PatchSet: 1 Gerrit-Project: mediawiki/services/citoid Gerrit-Branch: master Gerrit-Owner: Mvolz <mv...@wikimedia.org> Gerrit-Reviewer: Mvolz <mv...@wikimedia.org> Gerrit-Reviewer: jenkins-bot <> _______________________________________________ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits