[Wikitech-l] recent changes stream
Hi, Gerrit change Id819246a9 proposes an implementation for a recent changes stream broadcast via socket.io, an abstraction layer over WebSockets that also provides long polling as a fallback for older browsers. Comment on https://gerrit.wikimedia.org/r/#/c/131040/ or the mailing list. Thanks, Ori ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] Feature request for any future repo system
A pre-push commit hook that keeps people from checking in giant binary blobs like gigantic 65MB jar files. That is all. -Chad ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] Bugzilla Weekly Report
MediaWiki Bugzilla Report for April 28, 2014 - May 05, 2014 Status changes this week Reports changed/set to UNCONFIRMED: 5 Reports changed/set to NEW: 23 Reports changed/set to ASSIGNED : 15 Reports changed/set to REOPENED : 13 Reports changed/set to PATCH_TO_RE: 74 Reports changed/set to RESOLVED : 269 Reports changed/set to VERIFIED : 12 Total reports still open : 14502 Total bugs still open : 8719 Total non-lowest prio. bugs still open: 8473 Total enhancements still open : 5783 Reports created this week: 337 Resolutions for the week: Reports marked FIXED : 156 Reports marked DUPLICATE : 27 Reports marked INVALID : 29 Reports marked WORKSFORME: 20 Reports marked WONTFIX : 28 Specific Product/Component Resolutions User Metrics Created reports per component Wikipedia App Generic 27 MediaWiki extensions WikidataRepo 21 Pywikibot General 18 VisualEditor Editing Tools 18 Wikimedia Site requests 14 Created reports per product MediaWiki extensions 103 Wikimedia 41 MediaWiki 36 VisualEditor 34 Wikipedia App 31 Top 5 bug report closers jforrester [AT] wikimedia.org 49 aklapper [AT] wikimedia.org 16 jrobson [AT] wikimedia.org15 matma.rex [AT] gmail.com 13 federicoleva [AT] tiscali.it 12 Most urgent open issues Product | Component | BugID | Priority | LastChange | Assignee | Summary -- Analytics | Wikimetrics | 63819 | Highest | 2014-04-18 | wikibugs-l[AT]lists. | Worker processes left hanging MediaWiki | Database | 63677 | Highest | 2014-04-20 | wikibugs-l[AT]lists. | Update script is failing midway due t MediaWiki | Database | 32551 | Highest | 2014-04-25 | gdubuc[AT]wikimedia. | Descriptionless files (Missing page_l MediaWiki | Database | 56269 | Highest | 2014-04-27 | wikibugs-l[AT]lists. | Fix Uncommitted DB writes (transacti MediaWiki | Email | 63269 | Highest | 2014-05-03 | wikibugs-l[AT]lists. | enotif_body incorrectly assumes helpp MediaWiki | Skin and page | 63351 | Highest | 2014-04-30 | wikibugs-l[AT]lists. | Document Typography refresh/update MediaWiki ext | OAuth | 57336 | Highest | 2014-04-14 | wikibugs-l[AT]lists. | Make metawiki the central OAuth wiki MediaWiki ext | Popups| 64598 | Immediate | 2014-04-30 | psaxena[AT]wikimedia | Hovercards: Completely broken without MediaWiki ext | Semantic Medi | 62856 | Highest | 2014-05-02 | wikibugs-l[AT]lists. | ContentHandler / #REDIRECT missing wh MediaWiki ext | TimedMediaHan | 64152 | Highest | 2014-04-22 | wikibugs-l[AT]lists. | Fatal error: Call to a member functio MediaWiki ext | WikibaseQuery | 64296 | Highest | 2014-04-24 | wikidata-bugs[AT]lis | Catch exception thrown when no suitab MediaWiki ext | WikidataRepo | 63224 | Highest | 2014-04-23 | wikidata-bugs[AT]lis | review backend part of entity suggest MediaWiki ext | WikidataRepo | 63228 | Highest | 2014-04-29 | wikidata-bugs[AT]lis | prevent import of items MediaWiki ext | WikidataRepo | 52385 | Highest | 2014-05-01 | wikidata-bugs[AT]lis | Query by one property and one value ( MediaWiki ext | WikidataRepo | 64600 | Highest | 2014-05-03 | wikidata-bugs[AT]lis | write script that touches every item Pywikibot | General | 63605 | Highest | 2014-04-09 | devunt[AT]gmail.com | Ignore expired cookie VisualEditor | Editing Tools | 64717 | Highest | 2014-05-02 | esanders[AT]wikimedi | VisualEditor: [Regression wmf3] Chang ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] recent changes stream
Just wondering, but has any performance testing been done on different socket.io implementations? IIRC, Python is pretty good, so I definitely approve, but I'm wondering if there are other implementations are are more performant (specifically, servers that have better parallelism and no GIL). For example, Erlang with Cowboy is supposed to be a good socket.ioimplementation, and it is truly parallel, but I've never worked with it so I cannot say for sure. *-- * *Tyler Romeo* Stevens Institute of Technology, Class of 2016 Major in Computer Science On Sun, May 4, 2014 at 10:23 PM, Ori Livneh o...@wikimedia.org wrote: Hi, Gerrit change Id819246a9 proposes an implementation for a recent changes stream broadcast via socket.io, an abstraction layer over WebSockets that also provides long polling as a fallback for older browsers. Comment on https://gerrit.wikimedia.org/r/#/c/131040/ or the mailing list. Thanks, Ori ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] recent changes stream
On May 4, 2014 10:24 PM, Ori Livneh o...@wikimedia.org wrote: an implementation for a recent changes stream broadcast via socket.io, an abstraction layer over WebSockets that also provides long polling as a fallback for older browsers. I see this is using redis. FWIW I was initially wondering if this would leverage the log aggregation infra that analytics is building. Currently we use UDP for the IRC feed which is vulnerable to silent loss in case of packet loss or other network disruption. I believe analytics will be using an eventually consistent system? Or we could just watch the UDP stream for sequence gaps and fill in the gaps with data from the RC table in the corresponding DB. (likewise we could watch for gaps in redis and backfill into redis from DB as needed) How could this work overlap with adding pubsubhubbub support to existing web RC feeds? (i.e. atom/rss. or for that matter even individual page history feeds or related changes feeds) The only pubsubhubbub bugs I see atm are https://bugzilla.wikimedia.org/buglist.cgi?quicksearch=38970%2C30245 -Jeremy ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
