Re: [Analytics] SparkContext stopped and cannot be restarted

2020-02-25 Thread Nuria Ruiz
Hello: Following up on this issue, We think many of neil's issues come from the fact that a kerberos ticket expires after 24 hours and once it does your spark session would not work anymore. We will be extending expiration of tickets somewhat to 2/3 days but main point to take home is that

Re: [Analytics] Community health metrics kit: Input needed!

2020-02-25 Thread Dan Andreescu
In my last meeting with Joe they were still collecting requirements, but that was before Joe got shifted around the org and I'm guessing the project is now done. This effort is exactly what I'm talking about in my email to product-all and tech-all yesterday (subject: The Question and Answer

Re: [Analytics] Community health metrics kit: Input needed!

2020-02-25 Thread Ryan Kaldari
Anyone else know anything about the fate of the community health metrics kit? The wiki page still says it's expected to be launched in 2019. On Thu, Feb 20, 2020 at 1:19 PM Ryan Kaldari wrote: > Hey Joe, > whatever

Re: [Analytics] [Research-Internal] Tutorials on disk space usage for notebook/stat boxes

2020-02-25 Thread Goran Milovanovic
Great job Luca. Thank you very much. I have started to diversify all WMDE Analytics jobs (mainly Wikidata related things) across the stat100* machines. While I still mainly use stat1007, two modules of the WDCM system are already