[Toolserver-l] Toolserver wiki
One of two things needs to happen, we need to disable new account creation for anons, or we need to setup some anti-spam features, (abuse filter and title blacklist) Right now most of the edits are just spam John ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] CommonsDelinker
I am interested in getting this bot fixed, however I dont know what the current issues are. If I can get read into the issues Ill gladly lend a hand and get the bot back to fully functional John ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] labs migration and htaccess
I am finishing up the move and want to redirect all incoming links (which use the exact same structure) from the toolserver to labs. Ive tried several things from IRC, but am getting nowhere. does anyone have an existing .htaccess that does this? Thanks ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] labs migration and htaccess
Thanks worked like a charm On Mon, Dec 23, 2013 at 6:55 PM, Tim Landscheidt t...@tim-landscheidt.dewrote: (anonymous) wrote: I am finishing up the move and want to redirect all incoming links (which use the exact same structure) from the toolserver to labs. Ive tried several things from IRC, but am getting nowhere. does anyone have an existing .htaccess that does this? If you migrated your whole ~/public_html: | Redirect /~timl/ http://tools.wmflabs.org/$YOUR_TOOL/ If you just want to pick individual subdirectories: | Redirect /~timl/wikilint/ http://tools.wmflabs.org/wikilint/ Tim ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] sql command
I am in the process of migrating to labs and the command sql performs differently between the two platforms, Can I get the source for the toolserver version of it so that we can make the labs version work the same. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Toolserver blocked/ignored on WMF servers?
Are you sending a user agent? On Mon, Nov 25, 2013 at 10:34 AM, Danny B. toolserver.dann...@email.czwrote: Trying to wget some stuff from Wikipedia. It has been working for many years - cron was doing it 4 times a day. Now it no longer works either if ran from nightshade or from willow, either by cron or from commandline. When running wget with defaults, it requests IPv6, the result is ERROR 504: Gateway Time-out. When running wget with -4 switch, it requests IPv4, the result is ERROR 503: Service Unavailable. Problem occurs since November 11th. I just realized it today... :-/ I thought it might be wget issue, so I tried links and curl. No luck as well. Anybody knows, what's going on? Thanks. Danny B. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] Cron
Looks like cron is down again ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Cron
The last email I have is from around 0100 utc Thursday. I've also seen that reports that I have are not being updated either On Friday, September 6, 2013, DaB. wrote: Hello, Am 06.09.2013 22:23, schrieb John: Looks like cron is down again works for me. Sincerely, DaB. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Pywikipedia - xmlreader.py script
xmlreader.py is a library not a stand alone script. On Sun, Aug 4, 2013 at 2:47 PM, Automatik Wikipedia automati...@yahoo.frwrote: Hi, I would like to use the script xmlreader.py of Pywikipedia, but I have not all the informations to use it correctly. Maybe you could help me because it seems this script is used on the Toolserver. I suppose this script is the equivalent with XML of replace.py without replace but just using the search option. Does anyone know what the parameter to define the text to search on the XML dump files? If there an other important parameter except this and the parameter 'filename' (example: the 'regex' parameter of replace.py could be maybe used here to search with a regexp)? If I'm wrong on my explanations, please tell me. Thanks by advance, ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] SQL S1
I am getting a ERROR 2003 (HY000): when trying to connect. John ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Two questions about pywikipedia
I always include: import sys import os sys.path.append(PATH_TO_PYWIKIFOLDER) in all my scripts before I try to import wikipedia that should fix your issue On Fri, May 17, 2013 at 6:29 PM, Alex Brollo alex.bro...@gmail.com wrote: As I told, I'm driving a pywikipedia bot (Alebot) into willow; I installed pywikipedia at $HOME, I set PYTHONPATH=/home/alebot/pywikipedia [,.] into .environment file, and I am reviewing at my best python scripts to run them by qsub/qcronsub. Most of my scripts obviously need a statement: import wikipedia [,.] My questions: 1. Do I really need to install pywikipedia into $HOME? 2. My scripts run happily outside SGE, but when I try to run them under SGE I get an error: ImportError: No module named wikipedia I didn't find doc for this ImportError (I suppose, PYTHONPATH is wrong). Where am I going wrong? Alex ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Can't login to willow
Im getting cron errors, It looks like the file system disappeared On Sat, May 11, 2013 at 7:39 PM, Hersfold hersfoldw...@gmail.com wrote: I'm also seeing the login errors. Web services are down as well; I get 404 errors on all my pages. User:Hersfold hersfoldw...@gmail.com On 5/11/2013 7:09 PM, Casey Brown wrote: On Sat, May 11, 2013 at 7:03 PM, Shubinator shubinat...@gmail.com wrote: SSHing into willow doesn't work; SSH apparently doesn't think my key would be accepted by willow. I logged into willow three hours ago and it worked fine. Anyone else seeing issues? I've been experiencing issues as well. I tried to login around 2 hours ago and it still doesn't work now. -- Casey Brown (Cbrown1023) caseybrown.org __**_ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.**orgToolserver-l@lists.wikimedia.org ) https://lists.wikimedia.org/**mailman/listinfo/toolserver-lhttps://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/** view/Mailing_list_etiquettehttps://wiki.toolserver.org/view/Mailing_list_etiquette __**_ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.**orgToolserver-l@lists.wikimedia.org ) https://lists.wikimedia.org/**mailman/listinfo/toolserver-lhttps://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/** view/Mailing_list_etiquettehttps://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] enwiki_p corruption
enwiki_p needs dumped and re-imported. select count(*) from imagelinks where img_to = 'Flag_of_Seattle.svg'; returns 69 when it should return 2 John ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] Replag
I see s1 and s5 are extremely lagged status.toolserver shows no issues. Is this being looked into? ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] I can't login any more
What is your TS account name? On Tuesday, April 23, 2013, Alex Brollo wrote: Thanks, but server closes connection as soon as I try to login - both with PuTTY and by WinSCP. No matter; I don't want to waster your time any more; I'll search for help y some friends into it.wikisource. Alex 2013/4/23 Tim Landscheidt t...@tim-landscheidt.de javascript:_e({}, 'cvml', 't...@tim-landscheidt.de'); Alex Brollo alex.bro...@gmail.com javascript:_e({}, 'cvml', 'alex.bro...@gmail.com'); wrote: I've a Toolserver account - I remember registration procedure just like a terrible nightmare and I survived only thanks to lots of luck. Now, server refuses connection. I use Pageant, usually login is very simple - I load my key, then I open Putty, I post my username and all runs. But now it doesn't run any more. How can I get some help? Is this still current? Apparently, there was some outage that was fixed at about 15:00Z. Tim ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.orgjavascript:_e({}, 'cvml', 'Toolserver-l@lists.wikimedia.org'); ) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] Issues
I know we had maintenance about 12 hours ago, but I am unable to launch any of a half dozen IRC bots, reba and other toolserver IRC bots seem to be having similar issues. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Tool request
non-free media On Fri, Mar 22, 2013 at 3:11 PM, Magnus Manske magnusman...@googlemail.com wrote: Why would you want to upload downsized images if you can just have MediaWiki generate downsized thumbnails? On Fri, Mar 22, 2013 at 7:05 PM, John phoenixoverr...@gmail.com wrote: This is slightly outside the scope of this mailing list, But could someone write a web tool that someone can pass a filename, lang, project and the script then gets the associated image, lets the user modify the size (and has a few pre-configured resolutions including 0.1MP ) then download it so it can be re-uploaded (or uploaded via upload by url if the wiki has it enabled.) I know this would help a lot of users. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Tool request
waiting isnt an issue I have just seen multiple request for tools like this On Fri, Mar 22, 2013 at 4:58 PM, Theopolisme theopolismew...@gmail.com wrote: I can probably take this on if you can wait a few days. On Fri, Mar 22, 2013 at 2:14 PM, John phoenixoverr...@gmail.com wrote: non-free media On Fri, Mar 22, 2013 at 3:11 PM, Magnus Manske magnusman...@googlemail.com wrote: Why would you want to upload downsized images if you can just have MediaWiki generate downsized thumbnails? On Fri, Mar 22, 2013 at 7:05 PM, John phoenixoverr...@gmail.com wrote: This is slightly outside the scope of this mailing list, But could someone write a web tool that someone can pass a filename, lang, project and the script then gets the associated image, lets the user modify the size (and has a few pre-configured resolutions including 0.1MP ) then download it so it can be re-uploaded (or uploaded via upload by url if the wiki has it enabled.) I know this would help a lot of users. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette -- Theo Patt, graphic designer, web developer, and photographer extraordinaire if email == yes compose(t...@theopatt.com) elif stalk == yes goto(theopatt.com) ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] enwiki_p
I was just doing some investigating and discovered that we still have the cur table (it was removed in mediawiki v1.5) and that the jobs table isnt visible. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] No keys/indexes on wiki databases?
You are only seeing views, not the actual tables. There are the standard index plus a few TS specific indexes On Saturday, March 16, 2013, Maciej Jaros wrote: Hi. I've notice that there are no keys and so probably no indexes on toolserver databases. Is this intentional? I've used below queries - both show no keys/indexes on revision table: SHOW COLUMNS FROM plwiki_p.revision; SHOW INDEX FROM plwiki_p.revision; I've also exported the whole schema and see no indexes at all... The same for random wiki on s2 - nlwiki_p. At first I thought this might be do to the replication, but even with replication you need to select some stuff and only insert latest data. And besides those are read-only databases so selecting should occur far more frequently then inserting and so indexing is crucial for performance. Is it not? Why am I asking this? Well from a month or so I received a lot of query kills which should never be killed. Why they should never be killed? Because they are (or should be) working only on indexes: - revision.rev_id - should be PRIMARY KEY - revision.rev_page - should be KEY / FOREIGN KEY My query is: SELECT /* SLOW_OK */ MIN(rev_id) as first_rev_id FROM revision WHERE rev_page IN (2,4,6,8,12,13,15,16,18,20,21,22,23,24,25,26,28,29,...) GROUP BY rev_page I admit the IN list is rather large, but still... Regards, Nux. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] database lag issues
s1-rr-a-wd: 51s [-]; s1-user: 15h 8m 30s [-]; s1-user-wd: 53s [-]; s2-rr: 12h 29m 38s [-]; s2-user: 12h 29m 38s [-]; s2-user-c: error; s2-user-wd: 17h 5m 27s [-]; s3-user-wd: 9m 47s [-] s4-user-wd: 1d 5h 43m 16s [-]; s5-user-c: error; s6-user: 12s [-]; s6-user-wd: 28m 11s [-]; s7-user-wd: 51s [-] is the report that I just got, is there any particular reason that we have 15+ hour lags on s1,2,4 ? status just lists s5 during re-import. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Possible LDAP outtime this morning, major disruption
Looks like this is causing a serious TS wide outage On Fri, Mar 1, 2013 at 7:39 AM, Federico Leva (Nemo) nemow...@gmail.com wrote: Just tested because same LDAP problems are happening right now: ts-adm...@wikimedia.de: 554 Sorry, no mailbox here by that name. But toolserver.org works. Nemo ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] enwiki_p
There have been multiple reports of corruption and at least 4 open tickets in JIRA about issues with enwiki's database issues going back about a year. The most notable corruption can be seen in the user_editcount field. On some users I have seen it as far as 500 edits higher than their actual count... Not sure how that is occurring. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Crons overflow/server overload on Willow (other)
I dont think so,most of these are custom bots written using pywiki. I would just suggest trouting the users On Fri, Jan 11, 2013 at 12:09 PM, Danny B. wikipedia.dann...@email.cz wrote: Sounds like the right time for another rule about pywikipedia bots like we have the one about interwiki bots. Danny B. -- Původní zpráva -- Od: Wolfgang ten Weges kon...@aliceadsl.fr Datum: 11. 1. 2013 Předmět: Re: [Toolserver-l] Crons overflow/server overload on Willow (other) Le 11/01/2013 15:12, Wolfgang ten Weges a écrit : Hello, I just noticed that my welcome crons have stopped running. Looking at top, it seems that the server's CPU is fully used, all the time. Includes several instances of : -user rez : ~/pywikipedia/zzfawikipatroler.py, ~/pywikipedia/zzavanegary.py, ~/pywikipedia/zznavbox.py -user javadyou : ~/pywikipedia/radeh7.py adding : -user shuaib : 94 processes of ~/pywikipedia/welcomeur.py Wolfgang/darkoneko ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] S1
do we have an updated ETA on a non-corrupt s1? ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] dump of attribution information
That information is gathered upon your request and not all of it is stored in the database in a easily accessible manor. You might ask Magnus to run it across all files on commons, and send that to you, but otherwise just slowly use his tool On Wed, Oct 24, 2012 at 4:00 PM, Luca Libonati luca.libon...@gmail.com wrote: Hello all, I'm trying to retrive image and attribution information related to wikimedia commons images. As an example, I'm using the following url: http://toolserver.org/~magnus/commonsapi.php?image=Hoodoos_in_the_Bryce_Canyon_National_Park.jpg The issue is that server takes some times to provide information. Is not really fast. I dont't if this happen since I'm calling the server from italy. Is there any faster local server? If not, is there any dump (xml or sql) that I can download? Thank you. Luca ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] Query killer and replag
Either tsbot or the Query killer are broken I just got an email about a killed query (Not the issue) and query killer said the lag was around 14000 seconds while tsbot and the relag graph are showing almost no lag. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Query killer and replag
a MySQL-query of yours was killed because you didn't mark it as SLOW_OK and it have run for 191 seconds which was longer than allowed. You can find the query below. Please have also a look at [1] to find information how you can avoid killings of your queries. Maybe you can optimze the query too? The replication lag at kill-time was 16220s. Sincerly, Query-Killer. This eMail was sent automaticaly, please don't reply. select page_title, page_len, rev_text_id from page left join revision on page_latest = rev_id where page_is_redirect =0 and page_namespace =0 and page_len 200 ORDER BY rev_timestamp LIMIT 17520 (enwiki) ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Query killer and replag
I do some post query processing and only need about 100 results, I check them and either fix them or whitelist them, the size of the whitelist is 17420 items. On Sun, Oct 14, 2012 at 8:50 AM, Platonides platoni...@gmail.com wrote: On 14/10/12 13:53, John wrote: Either tsbot or the Query killer are broken I just got an email about a killed query (Not the issue) and query killer said the lag was around 14000 seconds while tsbot and the relag graph are showing almost no lag. The enwiki db has pretty much no lag in the user server, but a lag of 5h in the round-robin one (yes, that's quite strange). BTW, may I ask why are you using 17520 as limit? Seems an odd choice. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] [Wikitech-l] Toolserver is not opening for GU:WP
Im ccing Tparis on this, it should be running without issue On Fri, Sep 28, 2012 at 9:33 AM, Harsh Kothari harshkothari...@gmail.com wrote: when it will start working?? Thanks Harsh On 28-Sep-2012, at 12:31 AM, John wrote: ccing both lists, dab just rebooted s3 which is probably the cause On Thu, Sep 27, 2012 at 12:28 PM, Jeremy Baron jer...@tuxmachine.com wrote: On Sep 27, 2012 12:19 PM, Harsh Kothari harshkothari...@gmail.com wrote: Toolserver is not responding on GU:WP.. So that members of Gujarati Wikipedia cannot see the stats of Gu:Wp.. See this link is not opening http://toolserver.org/~tparis/pcount/index.php?name=Harsh4101991lang=guwiki=wikipedia So Kindly do something to resolve this problem. Forwarded to toolserver-l. Please send followups there. -Jeremy ___ Wikitech-l mailing list wikitec...@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l ___ Wikitech-l mailing list wikitec...@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l ___ Wikitech-l mailing list wikitec...@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Web services are down
works for me On Tue, Aug 28, 2012 at 10:01 PM, Hersfold hersfoldw...@gmail.com wrote: I'm getting a 502 Bad Gateway error when trying to access any of the toolserver websites, except for the wiki which appears to simply time out. status.toolserver.org says it's up, could someone check into this? -- User:Hersfold hersfoldw...@gmail.com ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] http://status.toolserver.org/ Down
It looks like http://status.toolserver.org/ is down ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] Replag
Due to the server outage in tampa replication needs restarted ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] Login servers
I know this may seem like whining but Nightshade was pulled out of service due to hardware issues. DaB pulled yarrow in as a linux test server, (since river left solaris maintenance is difficult), Right now willow (our only remaining login server) is extremely over stressed, I am seeing core dumps, seg-faults and many other symptoms on a more and more frequent basis. The banning of interwiki bots has done a small favor in reducing the stress. Yet we continue to add more accounts and use more resources on an already overloaded server. Is there an eta on getting Nightshade back in operation? and possibly adding yarrow as a login server? If there are things holding back this process is there anything that us users in userland can do to help expedite this process? John ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] Bugzilla database replication
https://bugzilla.wikimedia.org/show_bug.cgi?id=28339 has been just sitting their stale for quite a while. I know as a toolserver user, that there is a potential for a lot of useful tools. Who do I need to bribe or murder in order to facilitate this process? John ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Account approval
Yes service is that slow, and I am surprised that 5 accounts where created. Right now we are down a login server (Nightshade) and have seen overload symptoms on poor willow (our only other login server). Until nightshade can be brought back into commission I think adding more stress to an already overloaded server is not advisable. John On Sat, Jun 2, 2012 at 10:34 PM, Stephen James hazard...@yahoo.com wrote: The account approval requests tracker is getting messy. *18* created and *5* resolved over the last 30 days. I created a request on May 8, and have emailed ts-admins since (with no reply) over a week now. I've had no comments to my request, and am wondering if the service is usually this slow. I am aware that we are not obliged to get accounts, as it is a free service offered (etc.), but I believe that cleaning up the backlog would be good. Hazard-SJ ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] Dumps
I was taking a look at our dumps in user-store and none of them are compressed, and I was socked about that. I know a lot of people use pywikipedia to parse the dumps, and I know it can handle the bz2 files. any reason we dont just make them all bz2? John ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] UnicodeEncodeError
Can we get a example line? On Tuesday, April 3, 2012, Alchimista alchimist...@gmail.com wrote: Hi, I'm having an UnicodeEncodeError, something like: UnicodeEncodeError: 'ascii' codec can't encode characters in position 28-29: ordinal not in range(128) on print or wikipedia.output() statments when running scripts submitted on submit@ with qcronsub. Some time ago I've asked for help on irc, and was told that was an undocumented error, and pointed a solution, because has far as i remember, my LC_ALL wasn't defined. I now have set upt qcronsub to run the following sh script: #! /bin/sh LC_ALL=en_US.UTF-8 /usr/bin/python /home/alchimista/aleph/avbot.py -botnick:'Aleph Bot' -ownernick:Alchimista -newbie:100 /dev/null It worked for some weeks, but now is back again. How can i fix it? -- Alchimista http://pt.wikipedia.org/wiki/Utilizador:Alchimista ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] S1 replag
I know the schema change on S1 started the mass lag, is their any eta on getting caught back up? ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Query execution was interrupted
It's not a CPU issue. Some queries can prevent replag On Tuesday, January 31, 2012, emijrp emi...@gmail.com wrote: And why, instead kill them (that breaks the execution), aren't they put to the lowest CPU priority 0.1% until replag is low? 2012/1/31 Petr Onderka gsv...@gmail.com Hi, the email that you received should have a link to [1] that has the full explanation. In short, if the replag is low, SLOW_OK queries will never be killed. If the replag is high, SLOW_OK queries will be killed, but they are allowed to run for a longer time than normal queries. Petr Onderka [[User:Svick]] [1]: https://wiki.toolserver.org/view/Database_access#Slow_queries_and_the_query_killer On Tue, Jan 31, 2012 at 21:10, emijrp emi...@gmail.com wrote: Hi; I'm getting that error when querying English Wikipedia. I add /* SLOW_OK */ to my queries. What is the sense of adding SLOW_OK if my queries are being killed anyway? Regards, emijrp ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] Toolserver outage,
Because no one is online in IRC, im sending an email. All running bots are down, SSH into willow/nightshade/wolfsbane are all non-functioning. John ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] CrontabCr
Mine is betacommand John ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] CrontabCr
Not sure what was changed but it looks like everything is back to normal. Has anyone checked to see if willow came from the US? And if it was just taking a holiday? John ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] CrontabCr
Ive been using crontab reliably for a long time. I havent modified my crontab recently. At about 0230UTC 24 November crontab stopped working correctly on willow. My scripts no longer work correctly and I am not getting any emails from cron. Anyone have any idea what the issue is? John ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] cronie daemon down in willow and nightshade
I've been getting crontab emails less than 5 minutes ago On Saturday, November 5, 2011, Platonides platoni...@gmail.com wrote: Seems the daemon of cronie is not running in willow nor nightshade. Listing the processes with cron name, there's only /usr/sbin/cron which seems to be the daemon for sun crontab. From clematis process list (where cronie does continue running, so jobs sent from submit were probably not affected), it seems the daemon which should be running is /opt/ts/sbin/crond. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Hiphop php
The toolserver runs a Solaris John On Mon, Sep 12, 2011 at 1:44 PM, Mike Dupont jamesmikedup...@googlemail.com wrote: Hi there, I have been asked to help with the porting of media wiki to hiphopphp and setting up an example, it requires a large amount of cpu and disk and would like to know if we can use the toolserver for development? This is for compiling and testing, not a full deployment, I would like to see if it can be run with some form of stability. Ideally we would have a debian based GNU/Linux os for running on. thanks, mike -- James Michael DuPont Member of Free Libre Open Source Software Kosova http://flossk.org ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] user_properties privacy issues
gender is already public if set. John On Sat, Jun 25, 2011 at 8:05 PM, Maarten Dammers maar...@mdammers.nlwrote: Hi everyone, I just noticed https://secure.wikimedia.org/wikipedia/commons/wiki/Commons:Village_pump#User_preferences so I wondered where the data comes from. I checked the commonswiki_p database and it looks like user_properties is visible now. I always considered the user_properties information privacy sensitive information. It contains the gender, language and timezone of every user. Information I'm sure a lot of people don't want to have exposed. Please remove this table from the view. Maarten ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Changes to TS structures affecting ACC's IP recording
This is also causing problems with para's geoip tool, which is used on the projects. http://toolserver.org/~para/geoip.fcgi -- John Vandenberg ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Scheduling a pywikipedia bot
Ive been using pywiki and cronie together without any issues. Diego you have used more harddrive space than you are allowed, du -h -d1 will give you a nice breakdown of where your space is. you only have 250mb by default On Thu, Apr 21, 2011 at 11:49 PM, Diego Grez diegog...@gmail.com wrote: Like Like Like! I never figured out of to get pywikipedia to run automatically, and now my shell throws me a disk quota exceeded message. ¬¬ Diego 2011/4/22 MZMcBride z...@mzmcbride.com Junaid P V wrote: I am trying to schedule a pywikipedia bot, but could not do it.. I get the error: import wikipedia ImportError: No module named wikipedia How can I specify working directory for the program. I googled and tried several arguments but not worked. (It is first time I try to schedule a job) Could someone help me? What are you using to schedule the bot? cron? You probably just need to set your PYTHONPATH somewhere. For pywikipedia, this means that if your pywikipedia directory is at /home/user/scripts/pywikipedia, you'd put something like this in cron: 0 1 2 3 4 PYTHONPATH=$HOME/scripts/pywikipedia python $HOME/vandalize.py If you're using qsub, you can set PYTHONPATH in an .environment file in your home directory. There might be a purely Pythonic way to do this as well. Just google around a bit and you should be able to figure it out. MZMcBride ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
[Toolserver-l] recent issues
I have noticed within the last 7 days or so several issues that have cropped up without any real source. I am wondering if this is isolated or if others are having unusual issues. The two main issues that I have seen is that sendmail functionality either recently changed or broke. Ive had a script that emails me logs every day at 0100UTC via a python wrapper to sendmail, however the last emails that I received where for the 6th and after that all I received was error messages, (one about no recipient, and the second about encoding ) even though the last time that file was march 3rd. Ive gone head and fixed those issues. I also have had an issue with a db query that I've been running since July 2009 with just a few minor teaks which used to execute in 5-10 minutes its now taking over an hour for the same query to run (this started happening within the last 24 hours). Has anyone else experienced similar issues or things breaking or is it just me? Betacommand ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Privacy Violation?
He has not, and the data collected via user-compare is generated solely via data collected from the API and almost exclusively used for SPI http://en.wikipedia.org/wiki/Wikipedia:Sockpuppet_investigations where gathering and analyzing this data is standard practice. Had I been using non-public data (anything generated from the sql databases that normal users do not have access to) I would agree that there may be privacy issues, however every piece of data that is used for that tool comes from the en.wikipedia.org API. Betacommand ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Privacy Violation?
All that the tool does is merge [[Special:Contributions]] of multiple users and shows pages that multiple accounts have edited in common. Im really not sure how that could be considered a privacy issue. Betacommand On Fri, Apr 1, 2011 at 7:28 AM, Carl (CBM) cbm.wikipe...@gmail.com wrote: On Fri, Apr 1, 2011 at 7:21 AM, Daniel Kinzler dan...@brightbyte.de wrote: The fact that you are using public data for your analysis does NOT mean that it's compliant with the policy. As I understand it, there are three options for tools like this: * Limit the tool to trusted users, so that the analysis is not publicly available. This is the simplest option, but you should check with the TS admins whether this would be acceptable. * Run the tool on a host other than toolserver and don't use the toolserver databases as a data source. Then the toolserver privacy policy doesn't apply. * Get consent from the users whose data is being analyzed. This is impractical for investigating sockpuppets. The underlying source of the privacy policy is that the toolserver is associated with WIkimedia Deutschland, and German privacy law is not the same as U.S. privacy law. - Carl ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Privacy Violation?
On Sat, Apr 2, 2011 at 1:09 AM, Brett Hillebrand bretthillebr...@internode.on.net wrote: https://encrypted.google.com/search?q=This+message+and+it%27s+attachments+ma y+contain+confidential+information+ie=utf-8oe=utf-8aq=trls=org.mozilla:e n-GB:officialclient=firefox-a Actually its one of the most used email disclaimers in the world, especially in business. I use it because it's apparent unlike the majority of your emails, mine actually mean something. I think the shitter just got shat on? *Dances around playing a trumpet* This list is public. Your email is public. http://lists.wikimedia.org/pipermail/toolserver-l/2011-April/004022.html Please read your email disclaimer with that in mind, and you might see why MZMcBride laughed. -- John Vandenberg ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Privacy Violation?
Ive just adjusted the Normal edit time which was never really worked correctly anyway in order to salt the actual values to a non-standard format in order to prevent any privacy issue. On Fri, Apr 1, 2011 at 11:47 AM, Brett Hillebrand bretthillebr...@internode.on.net wrote: Nope.avi Also any further discussion of my disclaimer can be directed to myself and not the Toolserver mailing list to avoid off-topic clutter. I'm sure most sensible people would agree that people getting caught up over a disclaimer is quite frankly, pathetic beyond belief and detracts from the initial (on-topic) thread. I myself don't intend to participate in this sideshow any further. Cheers, Brett Hillebrand User:Promethean @ en_wiki ACC Developer This message and it's attachments may contain confidential information that is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. -Original Message- From: toolserver-l-boun...@lists.wikimedia.org [mailto:toolserver-l-boun...@lists.wikimedia.org] On Behalf Of Platonides Sent: Saturday, 2 April 2011 2:13 AM To: toolserver-l@lists.wikimedia.org Subject: Re: [Toolserver-l] Privacy Violation? Brett Hillebrand wrote: Well aware of that fact, but you seem to operate on the assumption that I can and would be arsed removing it just for this mailing list? Obviously common sense isn't so common. But all this detracts from what I actually raised earlier, but if some people have nothing better in their lives to do I'm all for a topical discussion about none other than, that's it folks, EMAIL DISCLAIMERS! No. You should not remove it just for this mailing list. You should remove it for all mailing lists you are in (unless the ml policy is to require disclaimers). That would be the polite thing to do, at least. http://en.wikipedia.org/wiki/Netiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Privacy Violation?
I would have zero clue how to disable google searching/indexing Im not sure I can do that, it may require a TS root On Fri, Apr 1, 2011 at 12:00 PM, Brett Hillebrand bretthillebr...@internode.on.net wrote: That’s addressed my concerns, though it might be worth disabling Google indexing of that directory if you have not. EG: https://webcache.googleusercontent.com/search?q=cache:HB2nGi5PQ7IJ:toolserver.org/~betacommand/UserCompare/Carmettu.html+cd=1hl=enct=clnkclient=firefox-asource=encrypted.google.comhttps://webcache.googleusercontent.com/search?q=cache:HB2nGi5PQ7IJ:toolserver.org/%7Ebetacommand/UserCompare/Carmettu.html+cd=1hl=enct=clnkclient=firefox-asource=encrypted.google.com Cheers, Brett Hillebrand User:Promethean @ en_wiki ACC Developer This message and it's attachments may contain confidential information that is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. *From:* John [mailto:phoenixoverr...@gmail.com] *Sent:* Saturday, 2 April 2011 2:32 AM *To:* toolserver-l@lists.wikimedia.org *Cc:* Brett Hillebrand *Subject:* Re: [Toolserver-l] Privacy Violation? Also I only keep the files about 30 days. (I regularly run a purge script that clears old files) On Fri, Apr 1, 2011 at 12:00 PM, John phoenixoverr...@gmail.com wrote: Ive just adjusted the Normal edit time which was never really worked correctly anyway in order to salt the actual values to a non-standard format in order to prevent any privacy issue. On Fri, Apr 1, 2011 at 11:47 AM, Brett Hillebrand bretthillebr...@internode.on.net wrote: Nope.avi Also any further discussion of my disclaimer can be directed to myself and not the Toolserver mailing list to avoid off-topic clutter. I'm sure most sensible people would agree that people getting caught up over a disclaimer is quite frankly, pathetic beyond belief and detracts from the initial (on-topic) thread. I myself don't intend to participate in this sideshow any further. Cheers, Brett Hillebrand User:Promethean @ en_wiki ACC Developer This message and it's attachments may contain confidential information that is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. -Original Message- From: toolserver-l-boun...@lists.wikimedia.org [mailto:toolserver-l-boun...@lists.wikimedia.org] On Behalf Of Platonides Sent: Saturday, 2 April 2011 2:13 AM To: toolserver-l@lists.wikimedia.org Subject: Re: [Toolserver-l] Privacy Violation? Brett Hillebrand wrote: Well aware of that fact, but you seem to operate on the assumption that I can and would be arsed removing it just for this mailing list? Obviously common sense isn't so common. But all this detracts from what I actually raised earlier, but if some people have nothing better in their lives to do I'm all for a topical discussion about none other than, that's it folks, EMAIL DISCLAIMERS! No. You should not remove it just for this mailing list. You should remove it for all mailing lists you are in (unless the ml policy is to require disclaimers). That would be the polite thing to do, at least. http://en.wikipedia.org/wiki/Netiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines
Re: [Toolserver-l] Privacy Violation?
It's a 48 point scale with a sliding base value that changes on a daily basis. With enough time and data the base values could be figured out, but for all real purposes it's obviscated. Using a pure time delta would not work, most reports involve three or more accounts and deltas just don't really work for that. As it stands the time values are shifted an unknown value. Any other method would make it either useless or would require a massive rewrite of code On Friday, April 1, 2011, Daniel Schwen li...@schwen.de wrote: You could instead just output a correlation-factor for the two edittime curves (integrate the product for example). That would reduce the amount visible data drastically, making it very hard to tell anything about the editing habits of each individual. Daniel ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Static dump of German Wikipedia
On 9/24/10, Marcin Cieslak sa...@saper.info wrote: There are static dumps available here: http://download.wikimedia.org/dewiki/ Is there any problem with using them? I think they are from June 2008. A fresh static dump would be good. -- John Vandenberg ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] New mailing list: newprojects
would it be possible to sign up toolserver-l to that list? that way we can keep abreast John On Mon, Aug 23, 2010 at 4:05 PM, Andrew Steinborn mege...@arandomblog.co.cc wrote: On 8/22/2010 9:29 PM, Casey Brown wrote: It seems that no one actually announced the creation of the newprojects mailing list yet! The mailing list[1] is an announcement-only list for new Wikimedia wikis[2]. The way it works is that the addwiki.php[3] script that sysadmins use to create the wikis automatically sends a mail to the list, so (provided there are no bugs with the script) subscribers will get an e-mail when every Wikimedia wiki is created. This list should be especially useful for people who need to know when new wikis are created so that they can update their tools or scripts. Of course, people who are just interested in knowing about new wikis are welcomed to subscribe too. :-) [1]https://lists.wikimedia.org/mailman/listinfo/newprojects [2]http://meta.wikimedia.org/wiki/Special:SiteMatrix [3]http://wikitech.wikimedia.org/view/Add_a_wiki Good, this will help ease us on new projects. (and the ts-admins, as they don't need a user to report in jira now.) ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Exposing data about deleted revisions
How about requiring a password/code to go along with rev_id in order to use the tool (similar to the move to commons process? Delta On Sunday, August 8, 2010, Mike.lifeguard mike.lifegu...@gmail.com wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 10-08-08 10:54 AM, DaB. wrote: Hello, At Sunday 08 August 2010 15:47:25 DaB. wrote: I wanted to get an OK (or not) to return the page title, and timestamp for a given deleted revid. It might also be helpful to return the username. in theorie that would be no problem as long as you would respect the ar_deleted-field. But in practice it is not that easy, because many revisions, which would oversighted today, were simply deleted in past (I guess enwp is similar to dewp here). So I can not allow such a webtool were you insert the rev_id and get the page_name back. But as far as I understand you, the main-usage for your webtool would be to fix a corrupt database for a bot; so why not just fix the database with data from the toolserver, without providing the data to the world (that would be ok for me)? Sincerly, DaB. Well, it is useful information to be able to get for sysops... hence the bug report against MediaWiki. Hopefully the software will give such information directly - it is needed. But in reality, I was asked to do it as a web tool, and it was just easier for me that way. The process needing information will be on another server, so a GET is obviously very simple to do. I'll look at other ways of accomplishing this if you insist. - -Mike -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) iEYEARECAAYFAkxev4kACgkQst0AR/DaKHufWACfaSvwrmDuhvwe1h3wfTSUcBaD VcgAoLagCyB0lZ/oC7XJFqMaeOrrFEFw =J2NE -END PGP SIGNATURE- ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] SxWiki
Does it set a user agent? On Wednesday, February 17, 2010, Ja Ga jaga_...@yahoo.com wrote: Is anyone else having problems where login() fails via SxWiki? I've used it to update a user page for about a year now, and for the first time, it's failing. - Jason ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Linux/Solaris
Ill take a look and log into willow tonight to see what if anything would break if I moved to solaris. Is there any particular place that we need to report these differences that may need adjusted or things need added? Betacommand On Mon, Dec 28, 2009 at 1:36 PM, Michał hole...@gmail.com wrote: 2009/12/28 River Tarnell river.tarn...@wikimedia.de: (...) So: if the Linux login server were to go away tomorrow, what (if anything) would you miss? just VIM under vi command ;) -- Michał Hołek Połtyn ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] [Wikitech-l] Wikimedia IRC Group Contacts looking for a developer
Im a computer programmer and ill see what I can do Betacommand On 12/4/09, Rjd0060 rjd0060.w...@gmail.com wrote: On Fri, Dec 4, 2009 at 3:55 PM, Aryeh Gregor simetrical+wikil...@gmail.comsimetrical%2bwikil...@gmail.com wrote: On Fri, Dec 4, 2009 at 3:47 PM, Rjd0060 rjd0060.w...@gmail.com wrote: Sean and a couple of others did write one which was used for a couple years. It has been broken since July due to some changes to the toolserver (I believe). What was the old URL? We could look into the possibility of reviving it. The old system was located at http://stable.toolserver.org/wmfgcbot/request. -- Ryan User:Rjd0060 ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] How to get in contact with the toolserver admins?
yeah, thats the correct address, what did you need? 2009/9/21 Delphine Ménard notafi...@gmail.com Hi, I've tried a few times to get through to the TS admins, but either I have the wrong address, or they're all on holidays :) is ts-adm...@toolserver.org the right address? Thank you, Delphine -- ~notafish NB. This gmail address is used for mailing lists. Personal emails will get lost. Intercultural musings: Ceci n'est pas une endive - http://blog.notanendive.org ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] How to get in contact with the toolserver admins?
https://jira.toolserver.org/browse/TS?report=com.atlassian.jira.plugin.system.project:openissues-panelis the place to file a bug issue for this 2009/9/21 Delphine Ménard notafi...@gmail.com Hello, On Mon, Sep 21, 2009 at 18:18, John Doe phoenixoverr...@gmail.com wrote: yeah, thats the correct address, what did you need? I've lost/messed up my password, and need to either get a new one, or retrieve my info. user: notafish. Thanks! Delphine -- ~notafish NB. This gmail address is used for mailing lists. Personal emails will get lost. Intercultural musings: Ceci n'est pas une endive - http://blog.notanendive.org ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] s1 maintenance
Great news, thanks for the hard work On Fri, Jul 31, 2009 at 11:35 AM, River Tarnell ri...@loreley.flyingparchment.org.uk wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 hi, at some point either today or over the weekend i will be reimporting s1. the server holding s1 will be reinstalled at the same time. there will be a few hours of downtime while the new database is imported, then some replication lag. - river. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (HP-UX) iEYEARECAAYFAkpzDysACgkQIXd7fCuc5vLBhgCeL+W3m6bdLYJKU4pxmL8X6Tax nqIAniBi5hCTamr/v933mEAy0MLhNxLC =UOp1 -END PGP SIGNATURE- ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Re: [Toolserver-l] The Norwegian toolserver
A donation to a chapter within one jurisdiction is not something that is easily moved to another chapter in another jurisdiction. In this specific case there were a need for a solution and, well, little response from other. One admin from the nowp community managed to get a deal both on a server and hosting and got it up and running. Sometimes it is simply more efficient to get a working solution, then to wait for something to happen. John Daniel Kinzler wrote: I would prefer to pool our efforts and resources into making the existing toolserver more useful and more powerful. But then, as a toolserver admin an employee of WMDE, I'm biased :) Anyway, the most efficient and, at least for us, easiest way to contribute would be a donation to wmde appropriated to be spent on the toolserver project. In the past there has been some confusion about how to best do this, we are working on sorting this out now. If anyone is interested in donating money or hardware or some other assets, please contact me. If you feel like setting up your own, we are happy to cooperate. But be warned that it not only takes money, but it also takes a lot of time and effort to manage something like this (thanks river!). -- daniel Lars Aronsson schrieb: Earlier this spring, there was some talk, perhaps within the newly founded Wikimedia Norway chapter, to set up a common server in Norway for analysing database dumps and running bot scripts, i.e. a toolserver with everything except the database replication. Did this happen? Are there a bunch of such servers around the world today? Is there a list of such servers? Should we encourage people to do this, or should we try to concentrate work (and pool resources) to the (real / German) toolserver? Concentrating to fewer servers has the advantage that people can get a single account there, and join each project that is already there. Distributing over multiple, independent servers has the advantage of offloading the central server. It might also seem like an attractive project for a new Wikimedia chapter, since a server of their own looks like an achievement in itself. But it is also a waste of resources to maintain separate servers, if these resources could instead be pooled. ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Re: [Toolserver-l] The Norwegian toolserver
There are several other reasons. The uptime of the cluster in Amsterdam isn't that good, an other site would probably not be much better, but it could be alive while the TS' in Amsterdam are dead. Also, there are probably legal reasons for using a local server for some type of material, especial regarding privacy but probably also due to copyright. If something is within the laws about privacy in Norway it is necessary to know who gets access to the data, which we do not know in Amsterdam. Another example is a server for a chapter-only website, with read only access after logon for members. And at last, sometime it seems like the wmde-admins simply ain't responsive. Why that is so I don't know, but it is nearly impossible to run a project when you can't get in touch with the server admins. John Daniel Kinzler wrote: Adam Dodek Michalik schrieb: 2009/7/29 Andrew Garrett agarr...@wikimedia.org: The German toolserver is in the same rack as the European proxies, but it's not better because edits and API requests have to go to Tampa. So it seems it's not any faster to run bots form German Toolserver than from our own, local one, as long as you don't use the database - am I right? Many people use TS to run their bots on it - including myself. Wouldn't some local TSs help balance the load? More servers to run bots on would be a good thing. From a technical point of view, it would be better to have all of them in the same cluster, so user accounts and secondary services (svn, jira, etc) can be shared and administrative overhead is minimized. The only reasons *not* to do that are political/financial. IF those could be resolved, that would be great. If not, then yes, having another place to run bots is still good. -- daniel ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Re: [Toolserver-l] The Norwegian toolserver
Perhaps there could be some kind of central management of some kind. One thing is distribution of the open databases. It should not be necessary to set up replication for each and every toolserver. Some kind of central authentication so access can be federated perhaps, yet authorization should be enforced locally. But then perhaps we could use the same facility if the internal access rules on the various servers could be more stringent, that is a Norwegian server is for Norwegian use only - even if its located in the cluster. More like a webhotel with server hosting for chapters. Now, make it even more general and say virtual servers for the chapters own use and make them off-limit for other bot operators. Still, note that such a server, virtual or not, has to be under complete control of the individual chapter. Even sharing backup tapes could be troublesome. I would suggest though that we should set up some means of exchanging info between the different projects of that kind - to my knowledge, there'S the boxes in poland, now in norway, and wmde's toolserver. Do you know of more? What would be a good way to communicate? Yet another mailing list? I don't think another mailing list is necessary. If a toolserver-box is used for something else that need higher confidentiality then it should go on a local chapter list or something similar. -- daniel John ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Re: [Toolserver-l] The Norwegian toolserver
It should not be necessary to set up replication _manually_ for each and every toolserver. More or less... ;) John (my typos are mine!) John at Darkstar wrote: Perhaps there could be some kind of central management of some kind. One thing is distribution of the open databases. It should not be necessary to set up replication for each and every toolserver. Some kind of central authentication so access can be federated perhaps, yet authorization should be enforced locally. But then perhaps we could use the same facility if the internal access rules on the various servers could be more stringent, that is a Norwegian server is for Norwegian use only - even if its located in the cluster. More like a webhotel with server hosting for chapters. Now, make it even more general and say virtual servers for the chapters own use and make them off-limit for other bot operators. Still, note that such a server, virtual or not, has to be under complete control of the individual chapter. Even sharing backup tapes could be troublesome. I would suggest though that we should set up some means of exchanging info between the different projects of that kind - to my knowledge, there'S the boxes in poland, now in norway, and wmde's toolserver. Do you know of more? What would be a good way to communicate? Yet another mailing list? I don't think another mailing list is necessary. If a toolserver-box is used for something else that need higher confidentiality then it should go on a local chapter list or something similar. -- daniel John ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Re: [Toolserver-l] The Norwegian toolserver
Yes, its the one. I'm not sure if its imposed any restrictions on user accounts, but I don't think so. The server is sponsored by a company selling PC's and related equipment, and it is located in a facility for the municipality and city Tønsberg in Norway. The admin (Laaknor) who made the deal works there. You may contact the user himself at http://no.wikipedia.org/wiki/User:Laaknor http://meta.wikimedia.org/wiki/User:Laaknor John Erling Blad Wikimedia Norway Casey Brown wrote: On Wed, Jul 29, 2009 at 12:07 PM, Lars Aronssonl...@aronsson.se wrote: Aha, so there is a Norwegian toolserver? To what extent is it sponsored by the chapter? Can Swedish users get accounts? As far as I know, it's this: http://toolserver.no/ and anyone who requests an account can get one (not just Norwegians or Skandinavians). ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Re: [Toolserver-l] Looking for utility to perform text search in dump
awb does but wont work on the ts On Sat, Jul 25, 2009 at 8:46 AM, Simon Walker stwalkers...@googlemail.comwrote: Does AWB not do something along those lines? 2009/7/25 Danny B. wikipedia.dann...@email.cz Hello, I'm looking for any kind of tool which would take the XML dump (most probably the pages-meta-current.xml.bz2, at least the pages-articles.xml.bz2) and would return the list of page titles (or alternatively/configurably page ids) of pages containing given string. Does anybody have such (kind of) tool and is willing to share? Both command line or webpage interface are OK. Thank you. Danny B. ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l -- Regards, Simon Walker User:Stwalkerster on all public Wikimedia Foundation wikis Administrator on the English Wikipedia Developer of Helpmebot, the ACC tool, and Nubio 2 FAQ repository ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Re: [Toolserver-l] you have been selected to participate in our customer satisfaction survey
On 2/5/09, River Tarnell ri...@loreley.flyingparchment.org.uk wrote: hi, if you have a free moment, and are a Toolserver user, please fill out this short survey about the Toolserver: http://toolserver.org/~river/survey.txt the more people who reply, the more we will know what needs to be improved. Where should we send the completed survey? -- John Vandenberg ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Re: [Toolserver-l] making sure your bots are always running: introducing phoenix
On Sat, Oct 18, 2008 at 7:26 AM, Daniel Kinzler [EMAIL PROTECTED] wrote: Hi all We have all seen the problem that some script or bot we have come to rely upon suddenly dies. Or fails to restart when the toolserver is rebooted. Putting something into cron to be run on @reboot sadly doesn't always work, for example because the home directory may not yet be mounted when cron runs reboot jobs. We should have a per-user initialisation script that are all run during startup by rc.local. So, after a short discussion on IRC, i wrote a script to take care of this. I called if phoenix, it's available in the system path on nightshade and hemlock. Phonix just starts whatever command you give to it, but it first checks if that command is already running. If it is already running, phoenix does nothing. So, just call phonix from cron every few minutes to make sure your bot is restarted when it dies. For example, if you want to run 'mybot', call this every few minutes from cron: phoenix /tmp/yourname-mybot /home/mydir/bin/mybot someparam The path /tmp/yourname-mybot is the base fir the PID and output files - output fill be written to /tmp/yourname-mybot.out, the processes pid will be stored in /tmp/yourname-mybot.pid. The second parameter, /home/mydir/bin/mybot, is the program to run. Anything following that are parameters to pass to this program. Please try it out and tell me about any problems! phoenix also prints a short help message when called without any parameters. -- daniel PS: I'm sure this wheel has been invented before... any pointers? [[init]] is the original program given this task, and is still often used for this purpose. The wiki page lists other tools that have been written to help with this. svscan from [[daemontools]] is a good one. -- John Vandenberg ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/toolserver-l