[Bug 66989] stream.wikimedia.org throws websocket.WebSocketException: Handshake Status 502 Bad Gateway
https://bugzilla.wikimedia.org/show_bug.cgi?id=66989 --- Comment #4 from Ori Livneh o...@wikimedia.org --- Merlijn van Deen offered to look into this with me and we were able to identify the problem: the WebSocket handshake requires two round-trips to the server, and the load balancers were configured to distribute incoming requests across backends in a round-robin fashion. Because the requests that make up the initial handshake follow each other in quick succession, the most common case was for one request to be routed to one server, and the follow-up request to be routed to another server, which had not started negotiating a session with the client and was therefore not expecting the request. This also explains why it sometimes worked: if another client request intervened between the two requests, you'd get routed to the same server and the handshake would succeed. Giuseppe and I decided to temporarily fix this by simply shutting down one of the servers, causing all requests to get routed to the single remaining server. This made the errors go away, validating the diagnosis. The more permanent fix is to use a different scheduling algorithm to make sessions sticky. This is implemented in https://gerrit.wikimedia.org/r/#/c/152960/, which will be deployed in the next few days, most likely. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 66989] stream.wikimedia.org throws websocket.WebSocketException: Handshake Status 502 Bad Gateway
https://bugzilla.wikimedia.org/show_bug.cgi?id=66989 Antoine hashar Musso has...@free.fr changed: What|Removed |Added See Also|https://bugzilla.wikimedia. | |org/show_bug.cgi?id=67888 | -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 66989] stream.wikimedia.org throws websocket.WebSocketException: Handshake Status 502
https://bugzilla.wikimedia.org/show_bug.cgi?id=66989 --- Comment #1 from Merlijn van Deen valhall...@arctus.nl --- Note that it works at some point if you're persistent enough in reconnection. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 66989] stream.wikimedia.org throws websocket.WebSocketException: Handshake Status 502
https://bugzilla.wikimedia.org/show_bug.cgi?id=66989 --- Comment #2 from Krinkle krinklem...@gmail.com --- http://codepen.io/Krinkle/full/laucI/ seems to work most of the time, but about 1/20 I see the following in the network: ws://stream.wikimedia.org/socket.io/1/websocket/281487980761 Error during WebSocket handshake: Unexpected response code: 502 After that it falls back to xhr-polling with loads of paired POST/GET requests. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 66989] stream.wikimedia.org throws websocket.WebSocketException: Handshake Status 502 Bad Gateway
https://bugzilla.wikimedia.org/show_bug.cgi?id=66989 Krinkle krinklem...@gmail.com changed: What|Removed |Added Summary|stream.wikimedia.org throws |stream.wikimedia.org throws |websocket.WebSocketExceptio |websocket.WebSocketExceptio |n: Handshake Status 502 |n: Handshake Status 502 Bad ||Gateway -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 66989] stream.wikimedia.org throws websocket.WebSocketException: Handshake Status 502 Bad Gateway
https://bugzilla.wikimedia.org/show_bug.cgi?id=66989 John Mark Vandenberg jay...@gmail.com changed: What|Removed |Added See Also||https://bugzilla.wikimedia. ||org/show_bug.cgi?id=67888 --- Comment #3 from John Mark Vandenberg jay...@gmail.com --- If we want to get this up against beta, I have a WIP for that. https://gerrit.wikimedia.org/r/#/c/138312/ Ideas/code welcome for how to allow for beta in our site/family structure. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l