[Wiki-research-l] Re: Requesting access to Revision Deletion

2022-10-03 Thread Andrew Otto
/Wikimedia_Research/Formal_collaborations and https://meta.wikimedia.org/wiki/Research:FAQ#collaborations for more information on how to contact the WMF Research team and propose a formal collaboration. I am also CCing the wiki-research-l mailing list. Good luck! -Andrew Otto On Mon, Sep 26, 2022 at 3:27 AM

[Wiki-research-l] stream.wikimedia.org - stream retention change

2022-03-21 Thread Andrew Otto
*. In the future, we would like to intentionally remove this data from streams. Doing so requires us to maintain new services that produce new streams with PII information redacted. Doing this is not a trivial thing to stand up, hence this mitigation effort for now. -Andrew Otto Wikimedia Foundation

[Wiki-research-l] Re: Wikimedia Enterprise HTML dumps available for public download

2021-10-19 Thread Andrew Otto
Wow very cool! On Tue, Oct 19, 2021 at 10:57 AM Ariel Glenn WMF wrote: > I am pleased to announce that Wikimedia Enterprise's HTML dumps [1] for > October 17-18th are available for public download; see > https://dumps.wikimedia.org/other/enterprise_html/ for more information. > We > expect to

Re: [Wiki-research-l] [Analytics] Enable Kerberos authentication for Hadoop (please read if you use Hadoop for your daily work)

2019-12-17 Thread Andrew Otto
Note! For Hive Jupyter users, there is an issue with PyHive and Kerberos, so you'll want to switch to Impyla. I've updated docs at https://wikitech.wikimedia.org/wiki/SWAP#with_Hive_(MapReduce) with instructions. ___ Wiki-research-l mailing list

[Wiki-research-l] EventStreams offset reset - June 14 2018

2018-06-12 Thread Andrew Otto
Alright, we are now ready to do this. New date: June 14 2018, around 14:00 UTC. On Tue, Jun 5, 2018 at 9:31 AM, Andrew Otto wrote: > Hi, > > We need to delay this switchover. We’ve made some changes to the plan > that require a bit more prep work. Follow https:/

Re: [Wiki-research-l] EventStreams offset reset - June 5 2018

2018-06-05 Thread Andrew Otto
Hi, We need to delay this switchover. We’ve made some changes to the plan that require a bit more prep work. Follow https://phabricator.wikimedia.org/T185225 for more details. I’ll reply with another announcement email when we set a new date. - Andrew Otto Senior Systems Engineer, WMF

[Wiki-research-l] EventStreams offset reset - June 5 2018

2018-05-15 Thread Andrew Otto
June 5 2018, at around 17:30 UTC. Let us know if you have any questions. Thanks! - Andrew Otto Senior Systems Engineer, WMF ___ Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Re: [Wiki-research-l] stat1002 and stat1003 deprecated. Please use new stat boxes

2017-09-05 Thread Andrew Otto
Alright, I just ran a final rsync of /home on stat1003 -> stat1006. Only files that did not yet exist on stat1006, or have a newer modification time on stat1003 were copied over. We will begin the decommission of stat1003 tomorrow. On Mon, Aug 28, 2017 at 12:02 PM, Andrew Otto

Re: [Wiki-research-l] stat1002 and stat1003 deprecated. Please use new stat boxes

2017-08-28 Thread Andrew Otto
Hi all! Just an update: We plan to decommission stat1003 next week. I’ll be sure to run a final home directory rsync from stat1003 -> stat1006 before we do. On Tue, Jul 18, 2017 at 1:31 PM, Andrew Otto <o...@wikimedia.org> wrote: > Hi all! > > tl;dr: Stop using stat100[23

Re: [Wiki-research-l] stat1002 and stat1003 deprecated. Please use new stat boxes

2017-07-27 Thread Andrew Otto
This is done! stat1002 is offline. Thanks all! On Thu, Jul 27, 2017 at 5:27 PM, Andrew Otto <o...@wikimedia.org> wrote: > > /a and /home on stat1002 (as they are now) will no longer be accessible > early next week. > > Welp, it turns out we need to accelerate this t

Re: [Wiki-research-l] stat1002 and stat1003 deprecated. Please use new stat boxes

2017-07-27 Thread Andrew Otto
Thu, Jul 27, 2017 at 1:57 PM, Andrew Otto <o...@wikimedia.org> wrote: > > Please be fully migrated to the new nodes by September 1st. > > Some other issues are accelerating this timeline for stat1002. > > All /home directories from stat1002 have been synced to stat1005. In >

Re: [Wiki-research-l] stat1002 and stat1003 deprecated. Please use new stat boxes

2017-07-27 Thread Andrew Otto
ces anyone. - Andrew Otto Systems Engineer Wikimedia Foundation On Tue, Jul 18, 2017 at 1:31 PM, Andrew Otto <o...@wikimedia.org> wrote: > Hi all! > > tl;dr: Stop using stat100[23] by September 1st. > > We’re finally replacing stat1002 and stat1003. These box

Re: [Wiki-research-l] EventStreams launch and RCStream deprecation

2017-07-10 Thread Andrew Otto
Alright, we’ve done it! RCStream is disabled, so any remaining socket.io service connecting to stream.wikimedia.org/rc will fail. Thanks all! On Thu, Jun 22, 2017 at 1:00 PM, Andrew Otto <o...@wikimedia.org> wrote: > Hi all, > > This is just a friendly reminder that we p

Re: [Wiki-research-l] EventStreams launch and RCStream deprecation

2017-06-22 Thread Andrew Otto
running on RCStream that hasn’t yet ported, let us know, and/or switch soon! Thanks! -Andrew Otto On Wed, Feb 8, 2017 at 9:28 AM, Andrew Otto <o...@wikimedia.org> wrote: > Hi everyone! > > Wikimedia is releasing a new service today: EventStreams > <https://wikite

[Wiki-research-l] Fwd: EventStreams launch and RCStream deprecation

2017-02-23 Thread Andrew Otto
kpm967t> - Would you like to consume streams other than RecentChanges? <https://www.mediawiki.org/wiki/Topic:Tkjk4ezxb4u01a61> (Currently available events are described the event-schemas repository <https://github.com/wikimedia/mediawiki-event-schemas/tree/master/