[Toolserver-l] Toolserver wiki

2014-02-10 Thread John
One of two things needs to happen, we need to disable new account creation
for anons, or we need to setup some anti-spam features, (abuse filter and
title blacklist) Right now most of the edits are just spam

John
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] CommonsDelinker

2014-01-21 Thread John
I am interested in getting this bot fixed, however I dont know what the
current issues are. If I can get read into the issues Ill gladly lend a
hand and get the bot back to fully functional

John
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] labs migration and htaccess

2013-12-23 Thread John
I am finishing up the move and want to redirect all incoming links (which
use the exact same structure) from the toolserver to labs. Ive tried
several things from IRC, but am getting nowhere. does anyone have an
existing .htaccess that does this?

Thanks
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] labs migration and htaccess

2013-12-23 Thread John
Thanks worked like a charm

On Mon, Dec 23, 2013 at 6:55 PM, Tim Landscheidt t...@tim-landscheidt.dewrote:

 (anonymous) wrote:

  I am finishing up the move and want to redirect all incoming links (which
  use the exact same structure) from the toolserver to labs. Ive tried
  several things from IRC, but am getting nowhere. does anyone have an
  existing .htaccess that does this?

 If you migrated your whole ~/public_html:

 | Redirect /~timl/ http://tools.wmflabs.org/$YOUR_TOOL/

 If you just want to pick individual subdirectories:

 | Redirect /~timl/wikilint/ http://tools.wmflabs.org/wikilint/

 Tim


 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] sql command

2013-12-18 Thread John
I am in the process of migrating to labs and the command sql performs
differently between the two platforms, Can I get the source for the
toolserver version of it so that we can make the labs version work the same.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Toolserver blocked/ignored on WMF servers?

2013-11-25 Thread John
Are you sending a user agent?

On Mon, Nov 25, 2013 at 10:34 AM, Danny B. toolserver.dann...@email.czwrote:

 Trying to wget some stuff from Wikipedia. It has been working for many
 years - cron was doing it 4 times a day. Now it no longer works either if
 ran from nightshade or from willow, either by cron or from commandline.

 When running wget with defaults, it requests IPv6, the result is ERROR
 504: Gateway Time-out.
 When running wget with -4 switch, it requests IPv4, the result is ERROR
 503: Service Unavailable.

 Problem occurs since November 11th. I just realized it today... :-/

 I thought it might be wget issue, so I tried links and curl. No luck
 as well.

 Anybody knows, what's going on?

 Thanks.


 Danny B.

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Cron

2013-09-06 Thread John
Looks like cron is down again
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Cron

2013-09-06 Thread John
The last email I have is from around 0100 utc Thursday. I've also seen that
reports that I have are not being updated either

On Friday, September 6, 2013, DaB. wrote:

 Hello,
 Am 06.09.2013 22:23, schrieb John:
  Looks like cron is down again

 works for me.

 Sincerely,
 DaB.


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Pywikipedia - xmlreader.py script

2013-08-04 Thread John
xmlreader.py is a library not a stand alone script.

On Sun, Aug 4, 2013 at 2:47 PM, Automatik Wikipedia automati...@yahoo.frwrote:

 Hi,

 I would like to use the script xmlreader.py of Pywikipedia, but I have not
 all the informations to use it correctly. Maybe you could help me because
 it seems this script is used on the Toolserver.

 I suppose this script is the equivalent with XML of replace.py without
 replace but just using the search option. Does anyone know what the
 parameter to define the text to search on the XML dump files? If there an
 other important parameter except this and the parameter 'filename'
 (example: the 'regex' parameter of replace.py could be maybe used here to
 search with a regexp)?

 If I'm wrong on my explanations, please tell me.

 Thanks by advance,

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] SQL S1

2013-06-03 Thread John
I am getting a ERROR 2003 (HY000): when trying to connect.

John
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Two questions about pywikipedia

2013-05-17 Thread John
I always include:
import sys
import os
sys.path.append(PATH_TO_PYWIKIFOLDER)
in all my scripts before I try to import wikipedia that should fix your
issue


On Fri, May 17, 2013 at 6:29 PM, Alex Brollo alex.bro...@gmail.com wrote:

 As I told, I'm driving a pywikipedia bot (Alebot) into willow; I installed
 pywikipedia at $HOME, I set

 PYTHONPATH=/home/alebot/pywikipedia [,.]

 into .environment file, and I am reviewing at my best python scripts to
 run them by qsub/qcronsub.

 Most of my scripts obviously need a statement:

 import wikipedia [,.]

 My questions:
 1. Do I really need to install pywikipedia into $HOME?
 2. My scripts run happily outside SGE, but when I try to run them under
 SGE I get an error:
 ImportError: No module named wikipedia

 I didn't find doc for this ImportError (I suppose, PYTHONPATH is wrong).

 Where am I going wrong?

 Alex



 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Can't login to willow

2013-05-11 Thread John
Im getting cron errors, It looks like the file system disappeared

On Sat, May 11, 2013 at 7:39 PM, Hersfold hersfoldw...@gmail.com wrote:

 I'm also seeing the login errors. Web services are down as well; I get 404
 errors on all my pages.

 
 User:Hersfold
 hersfoldw...@gmail.com


 On 5/11/2013 7:09 PM, Casey Brown wrote:

 On Sat, May 11, 2013 at 7:03 PM, Shubinator shubinat...@gmail.com
 wrote:

 SSHing into willow doesn't work; SSH apparently doesn't think my key
 would be accepted by willow. I logged into willow three hours ago and
 it worked fine. Anyone else seeing issues?

 I've been experiencing issues as well. I tried to login around 2 hours
 ago and it still doesn't work now.

 --
 Casey Brown (Cbrown1023)
 caseybrown.org

 __**_
 Toolserver-l mailing list 
 (Toolserver-l@lists.wikimedia.**orgToolserver-l@lists.wikimedia.org
 )
 https://lists.wikimedia.org/**mailman/listinfo/toolserver-lhttps://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list: https://wiki.toolserver.org/**
 view/Mailing_list_etiquettehttps://wiki.toolserver.org/view/Mailing_list_etiquette



 __**_
 Toolserver-l mailing list 
 (Toolserver-l@lists.wikimedia.**orgToolserver-l@lists.wikimedia.org
 )
 https://lists.wikimedia.org/**mailman/listinfo/toolserver-lhttps://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list: https://wiki.toolserver.org/**
 view/Mailing_list_etiquettehttps://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] enwiki_p corruption

2013-04-29 Thread John
enwiki_p needs dumped and re-imported. select count(*) from imagelinks
where img_to = 'Flag_of_Seattle.svg'; returns 69 when it should  return 2



John
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Replag

2013-04-24 Thread John
I see s1 and s5 are extremely lagged status.toolserver shows no issues. Is
this being looked into?
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] I can't login any more

2013-04-23 Thread John
What is your TS account name?

On Tuesday, April 23, 2013, Alex Brollo wrote:

 Thanks, but server closes connection as soon as I try to login - both with
 PuTTY and by WinSCP.

 No matter; I don't want to waster your time any more; I'll search for help
 y some friends into it.wikisource.

 Alex



 2013/4/23 Tim Landscheidt t...@tim-landscheidt.de javascript:_e({},
 'cvml', 't...@tim-landscheidt.de');

 Alex Brollo alex.bro...@gmail.com javascript:_e({}, 'cvml',
 'alex.bro...@gmail.com'); wrote:

  I've a Toolserver account - I remember registration procedure just like
 a
  terrible nightmare and I survived only thanks to lots of luck.

  Now, server refuses connection. I use Pageant, usually login is very
 simple
  - I load my key, then I open Putty, I post my username and all runs. But
  now it doesn't run any more. How can I get some help?

 Is this still current?  Apparently, there was some outage
 that was fixed at about 15:00Z.

 Tim


 ___
 Toolserver-l mailing list 
 (Toolserver-l@lists.wikimedia.orgjavascript:_e({}, 'cvml', 
 'Toolserver-l@lists.wikimedia.org');
 )
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette



___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Issues

2013-04-06 Thread John
I know we had maintenance about 12 hours ago, but I am unable to launch any
of a half dozen IRC bots, reba and other toolserver IRC bots seem to be
having similar issues.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Tool request

2013-03-22 Thread John
non-free media

On Fri, Mar 22, 2013 at 3:11 PM, Magnus Manske
magnusman...@googlemail.com wrote:
 Why would you want to upload downsized images if you can just have MediaWiki
 generate downsized thumbnails?


 On Fri, Mar 22, 2013 at 7:05 PM, John phoenixoverr...@gmail.com wrote:

 This is slightly outside the scope of this mailing list, But could
 someone write a web tool that someone can pass a filename, lang,
 project and the script then gets the associated image, lets the user
 modify the size (and has a few pre-configured resolutions including
 0.1MP ) then download it so it can be re-uploaded (or uploaded via
 upload by url if the wiki has it enabled.)

 I know this would help a lot of users.

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette



 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Tool request

2013-03-22 Thread John
waiting isnt an issue I have just seen multiple request for tools like this

On Fri, Mar 22, 2013 at 4:58 PM, Theopolisme theopolismew...@gmail.com wrote:
 I
 can probably take this on if you can wait a few days.


 On Fri, Mar 22, 2013 at 2:14 PM, John phoenixoverr...@gmail.com wrote:

 non-free media

 On Fri, Mar 22, 2013 at 3:11 PM, Magnus Manske
 magnusman...@googlemail.com wrote:
  Why would you want to upload downsized images if you can just have
  MediaWiki
  generate downsized thumbnails?
 
 
  On Fri, Mar 22, 2013 at 7:05 PM, John phoenixoverr...@gmail.com wrote:
 
  This is slightly outside the scope of this mailing list, But could
  someone write a web tool that someone can pass a filename, lang,
  project and the script then gets the associated image, lets the user
  modify the size (and has a few pre-configured resolutions including
  0.1MP ) then download it so it can be re-uploaded (or uploaded via
  upload by url if the wiki has it enabled.)
 
  I know this would help a lot of users.
 
  ___
  Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
  https://lists.wikimedia.org/mailman/listinfo/toolserver-l
  Posting guidelines for this list:
  https://wiki.toolserver.org/view/Mailing_list_etiquette
 
 
 
  ___
  Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
  https://lists.wikimedia.org/mailman/listinfo/toolserver-l
  Posting guidelines for this list:
  https://wiki.toolserver.org/view/Mailing_list_etiquette

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette




 --
 Theo Patt, graphic designer, web developer, and photographer extraordinaire

 if email == yes
compose(t...@theopatt.com)

 elif stalk == yes
goto(theopatt.com)



 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] enwiki_p

2013-03-22 Thread John
I was just doing some investigating and discovered that we still have
the cur table (it was removed in mediawiki v1.5) and that the jobs
table isnt visible.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] No keys/indexes on wiki databases?

2013-03-16 Thread John
You are only seeing views, not the actual tables. There are the standard
index plus a few TS specific indexes

On Saturday, March 16, 2013, Maciej Jaros wrote:

  Hi.

 I've notice that there are no keys and so probably no indexes on
 toolserver databases. Is this intentional?
 I've used below queries - both show no keys/indexes on revision table:

 SHOW COLUMNS FROM plwiki_p.revision;

 SHOW INDEX FROM plwiki_p.revision;

 I've also exported the whole schema and see no indexes at all... The same
 for random wiki on s2 - nlwiki_p.

 At first I thought this might be do to the replication, but even with
 replication you need to select some stuff and only insert latest data. And
 besides those are read-only databases so selecting should occur far more
 frequently then inserting and so indexing is crucial for performance. Is it
 not?

 Why am I asking this? Well from a month or so I received a lot of query
 kills which should never be killed. Why they should never be killed?
 Because they are (or should be) working only on indexes:

- revision.rev_id - should be PRIMARY KEY
 - revision.rev_page - should be KEY / FOREIGN KEY

 My query is:

 SELECT /* SLOW_OK */ MIN(rev_id) as first_rev_id
   FROM revision
   WHERE rev_page IN 
 (2,4,6,8,12,13,15,16,18,20,21,22,23,24,25,26,28,29,...)
   GROUP BY rev_page

 I admit the IN list is rather large, but still...

 Regards,
 Nux.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] database lag issues

2013-03-09 Thread John
s1-rr-a-wd: 51s [-]; s1-user: 15h 8m 30s [-]; s1-user-wd: 53s [-];
s2-rr: 12h 29m 38s [-]; s2-user: 12h 29m 38s [-]; s2-user-c: error;
s2-user-wd: 17h 5m 27s [-]; s3-user-wd: 9m 47s [-]
s4-user-wd: 1d 5h 43m 16s [-]; s5-user-c: error; s6-user: 12s [-];
s6-user-wd: 28m 11s [-]; s7-user-wd: 51s [-]

is the report that I just got, is there any particular reason that we
have 15+ hour lags on s1,2,4 ? status just lists s5 during re-import.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Possible LDAP outtime this morning, major disruption

2013-03-01 Thread John
Looks like this is causing a serious TS wide outage

On Fri, Mar 1, 2013 at 7:39 AM, Federico Leva (Nemo) nemow...@gmail.com wrote:
 Just tested because same LDAP problems are happening right now:
 ts-adm...@wikimedia.de: 554 Sorry, no mailbox here by that name.
 But toolserver.org works.

 Nemo


 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] enwiki_p

2013-02-22 Thread John
There have been multiple reports of corruption and at least 4 open
tickets in JIRA about issues with enwiki's database issues going back
about a year. The most notable corruption can be seen in the
user_editcount field. On some users I have seen it as far as 500 edits
higher than their actual count... Not sure how that is occurring.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Crons overflow/server overload on Willow (other)

2013-01-11 Thread John
I dont think so,most of these are custom bots written using pywiki. I
would just suggest trouting the users

On Fri, Jan 11, 2013 at 12:09 PM, Danny B. wikipedia.dann...@email.cz wrote:
 Sounds like the right time for another rule about pywikipedia bots like we
 have the one about interwiki bots.

 Danny B.

 -- Původní zpráva --
 Od: Wolfgang ten Weges kon...@aliceadsl.fr
 Datum: 11. 1. 2013
 Předmět: Re: [Toolserver-l] Crons overflow/server overload on Willow (other)


 Le 11/01/2013 15:12, Wolfgang ten Weges a écrit :
 Hello,

 I just noticed that my welcome crons have stopped running.
 Looking at top, it seems that the server's CPU is fully used, all
 the time. Includes several instances of :
 -user rez : ~/pywikipedia/zzfawikipatroler.py,
 ~/pywikipedia/zzavanegary.py, ~/pywikipedia/zznavbox.py
 -user javadyou : ~/pywikipedia/radeh7.py

 adding :
 -user shuaib : 94 processes of ~/pywikipedia/welcomeur.py

 Wolfgang/darkoneko

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette


 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] S1

2012-11-17 Thread John
do we have an updated ETA on a non-corrupt s1?

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


Re: [Toolserver-l] dump of attribution information

2012-10-24 Thread John
That information is gathered upon your request and not all of it is
stored in the database in a easily accessible manor. You might ask
Magnus to run it across all files on commons, and send that to you,
but otherwise just slowly use his tool

On Wed, Oct 24, 2012 at 4:00 PM, Luca Libonati luca.libon...@gmail.com wrote:
 Hello all,
 I'm trying to retrive image and attribution information related to wikimedia
 commons images.
 As an example, I'm using the following url:
 http://toolserver.org/~magnus/commonsapi.php?image=Hoodoos_in_the_Bryce_Canyon_National_Park.jpg

 The issue is that server takes some times to provide information. Is not
 really fast.
 I dont't if this happen since I'm calling the server from italy.

 Is there any faster local server?
 If not, is there any dump (xml or sql) that I can download?

 Thank you.
 Luca

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


[Toolserver-l] Query killer and replag

2012-10-14 Thread John
Either tsbot or the Query killer are broken I just got an email about
a killed query (Not the issue) and query killer said the lag was
around 14000 seconds while tsbot and the relag graph are showing
almost no lag.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


Re: [Toolserver-l] Query killer and replag

2012-10-14 Thread John
a MySQL-query of yours was killed because you didn't mark it as
SLOW_OK and it have run for 191 seconds which was longer than allowed.
You can find the query below. Please have also a look at [1] to find
information how you can avoid killings of your queries. Maybe you can
optimze the query too?
The replication lag at kill-time was 16220s.

Sincerly,
Query-Killer.
This eMail was sent automaticaly, please don't reply.

select page_title, page_len, rev_text_id from page left join revision
on page_latest = rev_id where page_is_redirect =0 and page_namespace
=0 and page_len  200 ORDER BY rev_timestamp LIMIT 17520

(enwiki)

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


Re: [Toolserver-l] Query killer and replag

2012-10-14 Thread John
I do some post query processing and only need about 100 results, I
check them and either fix them or whitelist them, the size of the
whitelist is 17420 items.

On Sun, Oct 14, 2012 at 8:50 AM, Platonides platoni...@gmail.com wrote:
 On 14/10/12 13:53, John wrote:
 Either tsbot or the Query killer are broken I just got an email about
 a killed query (Not the issue) and query killer said the lag was
 around 14000 seconds while tsbot and the relag graph are showing
 almost no lag.

 The enwiki db has pretty much no lag in the user server, but a lag of 5h
 in the round-robin one (yes, that's quite strange).


 BTW, may I ask why are you using 17520 as limit? Seems an odd choice.




 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list: 
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


Re: [Toolserver-l] [Wikitech-l] Toolserver is not opening for GU:WP

2012-09-28 Thread John
Im ccing Tparis on this, it should be running without issue

On Fri, Sep 28, 2012 at 9:33 AM, Harsh Kothari
harshkothari...@gmail.com wrote:
 when it will start working??

 Thanks
 Harsh
 On 28-Sep-2012, at 12:31 AM, John wrote:

 ccing both lists, dab just rebooted s3 which is probably the cause

 On Thu, Sep 27, 2012 at 12:28 PM, Jeremy Baron jer...@tuxmachine.com wrote:
 On Sep 27, 2012 12:19 PM, Harsh Kothari harshkothari...@gmail.com wrote:
 Toolserver is not responding on GU:WP.. So that members of Gujarati
 Wikipedia cannot see the stats of Gu:Wp..
 See this link is not opening


 http://toolserver.org/~tparis/pcount/index.php?name=Harsh4101991lang=guwiki=wikipedia

 So Kindly do something to resolve this problem.

 Forwarded to toolserver-l. Please send followups there.

 -Jeremy
 ___
 Wikitech-l mailing list
 wikitec...@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/wikitech-l

 ___
 Wikitech-l mailing list
 wikitec...@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/wikitech-l


 ___
 Wikitech-l mailing list
 wikitec...@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/wikitech-l

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


Re: [Toolserver-l] Web services are down

2012-08-28 Thread John
works for me

On Tue, Aug 28, 2012 at 10:01 PM, Hersfold hersfoldw...@gmail.com wrote:
 I'm getting a 502 Bad Gateway error when trying to access any of the
 toolserver websites, except for the wiki which appears to simply time out.
 status.toolserver.org says it's up, could someone check into this?

 --
 
 User:Hersfold
 hersfoldw...@gmail.com


 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


[Toolserver-l] http://status.toolserver.org/ Down

2012-08-11 Thread John
It looks like http://status.toolserver.org/ is down
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Replag

2012-08-06 Thread John
Due to the server outage in tampa replication needs restarted
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Login servers

2012-06-08 Thread John
I know this may seem like whining but Nightshade was pulled out of service
due to hardware issues. DaB pulled yarrow in as a linux test server, (since
river left solaris maintenance is difficult), Right now willow (our only
remaining login server) is extremely over stressed, I am seeing core dumps,
seg-faults and many other symptoms on a more and more frequent basis. The
banning of interwiki bots has done a small favor in reducing the stress.
Yet we continue to add more accounts and use more resources on an already
overloaded server. Is there an eta on getting Nightshade back in operation?
and possibly adding yarrow as a login server? If there are things holding
back this process is there anything that us users in userland can do to
help expedite this process?

John
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Bugzilla database replication

2012-06-07 Thread John
https://bugzilla.wikimedia.org/show_bug.cgi?id=28339 has been just sitting
their stale for quite a while. I know as a toolserver user, that there is a
potential for a lot of useful tools. Who do I need to bribe or murder in
order to facilitate this process?

John
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Account approval

2012-06-02 Thread John
Yes service is that slow, and I am surprised that 5 accounts where created.
Right now we are down a login server (Nightshade) and have seen overload
symptoms on poor willow (our only other login server). Until nightshade can
be brought back into commission I think adding more stress to an already
overloaded server is not advisable.

John

On Sat, Jun 2, 2012 at 10:34 PM, Stephen James hazard...@yahoo.com wrote:

 The account approval requests tracker is getting messy. *18* created
 and *5* resolved over the last 30 days. I created a request on May 8, and
 have emailed ts-admins since (with no reply) over a week now. I've had no
 comments to my request, and am wondering if the service is usually this
 slow. I am aware that we are not obliged to get accounts, as it is a free
 service offered (etc.), but I believe that cleaning up the backlog would be
 good.

 Hazard-SJ

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Dumps

2012-05-05 Thread John
I was taking a look at our dumps in user-store and none of them are
compressed, and I was socked about that. I know a lot of people use
pywikipedia to parse the dumps, and I know it can handle the bz2 files. any
reason we dont just make them all bz2?

John
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] UnicodeEncodeError

2012-04-03 Thread John
Can we get a example line?

On Tuesday, April 3, 2012, Alchimista alchimist...@gmail.com wrote:

 Hi,
 I'm having an UnicodeEncodeError, something like: UnicodeEncodeError:
'ascii' codec can't encode characters in position 28-29: ordinal not in
range(128) on print or wikipedia.output() statments when running scripts
submitted on submit@ with qcronsub. Some time ago I've asked for help on
irc, and was told that was an undocumented error, and pointed a solution,
because has far as i remember, my LC_ALL wasn't defined. I now have set upt
qcronsub to run the following sh script:

 #! /bin/sh

 LC_ALL=en_US.UTF-8 /usr/bin/python /home/alchimista/aleph/avbot.py
-botnick:'Aleph Bot'  -ownernick:Alchimista -newbie:100  /dev/null

 It worked for some weeks, but now is back again. How can i fix it?
 --
 Alchimista
 http://pt.wikipedia.org/wiki/Utilizador:Alchimista


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] S1 replag

2012-03-25 Thread John
I know the schema change on S1 started the mass lag, is their any eta on
getting caught back up?
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Query execution was interrupted

2012-01-31 Thread John
It's not a CPU issue. Some queries can prevent replag

On Tuesday, January 31, 2012, emijrp emi...@gmail.com wrote:
 And why, instead kill them (that breaks the execution), aren't they put
to the lowest CPU priority 0.1% until replag is low?

 2012/1/31 Petr Onderka gsv...@gmail.com

 Hi,

 the email that you received should have a link to [1] that has the
 full explanation.

 In short, if the replag is low, SLOW_OK queries will never be killed.
 If the replag is high, SLOW_OK queries will be killed, but they are
 allowed to run for a longer time than normal queries.

 Petr Onderka
 [[User:Svick]]

 [1]:
https://wiki.toolserver.org/view/Database_access#Slow_queries_and_the_query_killer

 On Tue, Jan 31, 2012 at 21:10, emijrp emi...@gmail.com wrote:
  Hi;
 
  I'm getting that error when querying English Wikipedia. I add /*
SLOW_OK */
  to my queries. What is the sense of adding SLOW_OK if my queries are
being
  killed anyway?
 
  Regards,
  emijrp
 
  ___
  Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
  https://lists.wikimedia.org/mailman/listinfo/toolserver-l
  Posting guidelines for this list:
  https://wiki.toolserver.org/view/Mailing_list_etiquette

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
https://wiki.toolserver.org/view/Mailing_list_etiquette


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Toolserver outage,

2011-12-21 Thread John
Because no one is online in IRC, im sending an email. All running bots are
down, SSH into willow/nightshade/wolfsbane are all non-functioning.

John
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] CrontabCr

2011-11-25 Thread John
Mine is betacommand

John
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] CrontabCr

2011-11-25 Thread John
Not sure what was changed but it looks like everything is back to normal.
Has anyone checked to see if willow came from the US? And if it was just
taking a holiday?

John
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] CrontabCr

2011-11-24 Thread John
Ive been using crontab reliably  for a long time. I havent modified my
crontab recently. At about 0230UTC 24 November crontab stopped working
correctly on willow. My scripts no longer work correctly and I am not
getting any emails from cron. Anyone have any idea what the issue is?

John
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] cronie daemon down in willow and nightshade

2011-11-05 Thread John
I've been getting crontab emails less than 5 minutes ago

On Saturday, November 5, 2011, Platonides platoni...@gmail.com wrote:
 Seems the daemon of cronie is not running in willow nor nightshade.
 Listing the processes with cron name, there's only /usr/sbin/cron which
 seems to be the daemon for sun crontab.
 From clematis process list (where cronie does continue running, so jobs
 sent from submit were probably not affected), it seems the daemon which
 should be running is /opt/ts/sbin/crond.


 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Hiphop php

2011-09-12 Thread John
The toolserver runs a Solaris

John

On Mon, Sep 12, 2011 at 1:44 PM, Mike Dupont jamesmikedup...@googlemail.com
 wrote:

 Hi there,
 I have been asked to help with the porting of media wiki to hiphopphp and
 setting up an example,
 it requires a large amount of cpu and disk and would like to know if we can
 use the toolserver for development? This is for compiling and testing, not a
 full deployment, I would like to see if it can be run with some form of
 stability.
 Ideally we would have a debian based GNU/Linux os for running on.
 thanks,
 mike

 --
 James Michael DuPont
 Member of Free Libre Open Source Software Kosova http://flossk.org

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] user_properties privacy issues

2011-06-25 Thread John
gender is already public if set.

John

On Sat, Jun 25, 2011 at 8:05 PM, Maarten Dammers maar...@mdammers.nlwrote:

 Hi everyone,

 I just noticed

 https://secure.wikimedia.org/wikipedia/commons/wiki/Commons:Village_pump#User_preferences
 so I wondered where the data comes from. I checked the commonswiki_p
 database and it looks like user_properties is visible now. I always
 considered the user_properties information privacy sensitive
 information. It contains the gender, language and timezone of every
 user. Information I'm sure a lot of people don't want to have exposed.
 Please remove this table from the view.

 Maarten


 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Changes to TS structures affecting ACC's IP recording

2011-06-09 Thread John Vandenberg
This is also causing problems with para's geoip tool, which is used on
the projects.

http://toolserver.org/~para/geoip.fcgi

-- 
John Vandenberg

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


Re: [Toolserver-l] Scheduling a pywikipedia bot

2011-04-21 Thread John
Ive been using pywiki and cronie together without any issues. Diego you
have used more harddrive space than you are allowed, du -h -d1 will give you
a nice breakdown of where your space is. you only have 250mb by default

On Thu, Apr 21, 2011 at 11:49 PM, Diego Grez diegog...@gmail.com wrote:

 Like Like Like!
 I never figured out of to get pywikipedia to run automatically, and now my
 shell throws me a disk quota exceeded message. ¬¬

 Diego


 2011/4/22 MZMcBride z...@mzmcbride.com

 Junaid P V wrote:
  I am trying to schedule a pywikipedia bot, but could not do it..
 
  I get the error:
  import wikipedia
  ImportError: No module named wikipedia
 
  How can I specify working directory for the program. I googled and tried
  several arguments but not worked.
  (It is first time I try to schedule a job)
 
  Could someone help me?

 What are you using to schedule the bot? cron? You probably just need to
 set your PYTHONPATH somewhere.

 For pywikipedia, this means that if your pywikipedia directory is at
 /home/user/scripts/pywikipedia, you'd put something like this in cron:

 0 1 2 3 4 PYTHONPATH=$HOME/scripts/pywikipedia python $HOME/vandalize.py

 If you're using qsub, you can set PYTHONPATH in an .environment file in
 your
 home directory.

 There might be a purely Pythonic way to do this as well. Just google
 around
 a bit and you should be able to figure it out.

 MZMcBride



 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette



 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] recent issues

2011-04-11 Thread John
I have noticed within the last 7 days or so several issues that have cropped
up without any real source. I am wondering if this is isolated or if others
are having unusual issues. The two main issues that I have seen is that
sendmail functionality either recently changed or broke.  Ive had a script
that emails me logs every day at 0100UTC via a python wrapper to sendmail,
however the last emails that I received where for the 6th and after that all
I received was error messages, (one about no recipient, and the second about
encoding ) even though the last time that file was march 3rd. Ive gone head
and fixed those issues. I also have had an issue with a db query that I've
been running since July 2009 with just a few minor teaks which used to
execute in 5-10 minutes its now taking over an hour for the same query to
run (this started happening within the last 24 hours). Has anyone else
experienced similar issues or things breaking or is it just me?

Betacommand
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Privacy Violation?

2011-04-01 Thread John
He has not, and the data collected via user-compare is generated solely via
data collected from the API and almost exclusively used for  SPI
http://en.wikipedia.org/wiki/Wikipedia:Sockpuppet_investigations where
gathering and analyzing this data is standard practice. Had I been using
non-public data (anything generated from the sql databases that normal users
do not have access to) I would agree that there may be privacy issues,
however every piece of data that is used for that tool comes from the
en.wikipedia.org API.


Betacommand
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Privacy Violation?

2011-04-01 Thread John
All that the tool does is merge [[Special:Contributions]] of multiple users
and shows pages that multiple accounts have edited in common. Im really not
sure how that could be considered a privacy issue.

Betacommand

On Fri, Apr 1, 2011 at 7:28 AM, Carl (CBM) cbm.wikipe...@gmail.com wrote:

 On Fri, Apr 1, 2011 at 7:21 AM, Daniel Kinzler dan...@brightbyte.de
 wrote:
  The fact that you are using public data for your analysis does NOT mean
 that
  it's compliant with the policy.

 As I understand it, there are three options for tools like this:

 * Limit the tool to trusted users, so that the analysis is not
 publicly available.  This is the simplest option, but you should check
 with the TS admins whether this would be acceptable.

 * Run the tool on a host other than toolserver and don't use the
 toolserver databases as a data source. Then the toolserver privacy
 policy doesn't apply.

 * Get consent from the users whose data is being analyzed. This is
 impractical for investigating sockpuppets.

 The underlying source of the privacy policy is that the toolserver is
 associated with WIkimedia Deutschland, and German privacy law is not
 the same as U.S. privacy law.

 - Carl

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Privacy Violation?

2011-04-01 Thread John Vandenberg
On Sat, Apr 2, 2011 at 1:09 AM, Brett Hillebrand
bretthillebr...@internode.on.net wrote:
 https://encrypted.google.com/search?q=This+message+and+it%27s+attachments+ma
 y+contain+confidential+information+ie=utf-8oe=utf-8aq=trls=org.mozilla:e
 n-GB:officialclient=firefox-a

 Actually its one of the most used email disclaimers in the world, especially
 in business. I use it because it's apparent unlike the majority of your
 emails, mine actually mean something. I think the shitter just got shat on?
 *Dances around playing a trumpet*

This list is public.

Your email is public.
http://lists.wikimedia.org/pipermail/toolserver-l/2011-April/004022.html

Please read your email disclaimer with that in mind, and you might see
why MZMcBride laughed.

--
John Vandenberg

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


Re: [Toolserver-l] Privacy Violation?

2011-04-01 Thread John
Ive just adjusted the Normal edit time which was never really worked
correctly anyway in order to salt the actual values to a non-standard format
in order to prevent any privacy issue.

On Fri, Apr 1, 2011 at 11:47 AM, Brett Hillebrand 
bretthillebr...@internode.on.net wrote:

 Nope.avi

 Also any further discussion of my disclaimer can be directed to myself and
 not the Toolserver mailing list to avoid off-topic clutter. I'm sure most
 sensible people would agree that people getting caught up over a disclaimer
 is quite frankly, pathetic beyond belief and detracts from the initial
 (on-topic) thread.

 I myself don't intend to participate in this sideshow any further.

 Cheers,

 Brett Hillebrand
 User:Promethean @ en_wiki
 ACC Developer

 This message and it's attachments may contain confidential information that
 is intended only for the individual named. If you are not the named
 addressee you should not disseminate, distribute or copy this e-mail.
 Please
 notify the sender immediately by e-mail if you have received this e-mail by
 mistake and delete this e-mail from your system. E-mail transmission cannot
 be guaranteed to be secure or error-free as information could be
 intercepted, corrupted, lost, destroyed, arrive late or incomplete, or
 contain viruses. The sender therefore does not accept liability for any
 errors or omissions in the contents of this message, which arise as a
 result
 of e-mail transmission.


 -Original Message-
 From: toolserver-l-boun...@lists.wikimedia.org
 [mailto:toolserver-l-boun...@lists.wikimedia.org] On Behalf Of Platonides
 Sent: Saturday, 2 April 2011 2:13 AM
 To: toolserver-l@lists.wikimedia.org
 Subject: Re: [Toolserver-l] Privacy Violation?

 Brett Hillebrand wrote:
  Well aware of that fact, but you seem to operate on the assumption that I
  can and would be arsed removing it just for this mailing list? Obviously
  common sense isn't so common. But all this detracts from what I actually
  raised earlier, but if some people have nothing better in their lives to
 do
  I'm all for a topical discussion about none other than, that's it folks,
  EMAIL DISCLAIMERS!

 No. You should not remove it just for this mailing list. You should
 remove it for all mailing lists you are in (unless the ml policy is to
 require disclaimers).
 That would be the polite thing to do, at least.
 http://en.wikipedia.org/wiki/Netiquette

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette


 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Privacy Violation?

2011-04-01 Thread John
I would have zero clue how to disable google searching/indexing Im not sure
I can do that, it may require a TS root

On Fri, Apr 1, 2011 at 12:00 PM, Brett Hillebrand 
bretthillebr...@internode.on.net wrote:

 That’s addressed my concerns, though it might be worth disabling Google
 indexing of that directory if you have not.



 EG:


 https://webcache.googleusercontent.com/search?q=cache:HB2nGi5PQ7IJ:toolserver.org/~betacommand/UserCompare/Carmettu.html+cd=1hl=enct=clnkclient=firefox-asource=encrypted.google.comhttps://webcache.googleusercontent.com/search?q=cache:HB2nGi5PQ7IJ:toolserver.org/%7Ebetacommand/UserCompare/Carmettu.html+cd=1hl=enct=clnkclient=firefox-asource=encrypted.google.com



 Cheers,



 Brett Hillebrand

 User:Promethean @ en_wiki

 ACC Developer



 This message and it's attachments may contain confidential information that
 is intended only for the individual named. If you are not the named
 addressee you should not disseminate, distribute or copy this e-mail. Please
 notify the sender immediately by e-mail if you have received this e-mail by
 mistake and delete this e-mail from your system. E-mail transmission cannot
 be guaranteed to be secure or error-free as information could be
 intercepted, corrupted, lost, destroyed, arrive late or incomplete, or
 contain viruses. The sender therefore does not accept liability for any
 errors or omissions in the contents of this message, which arise as a result
 of e-mail transmission.



 *From:* John [mailto:phoenixoverr...@gmail.com]
 *Sent:* Saturday, 2 April 2011 2:32 AM

 *To:* toolserver-l@lists.wikimedia.org
 *Cc:* Brett Hillebrand

 *Subject:* Re: [Toolserver-l] Privacy Violation?



 Also I only keep the files about 30 days. (I regularly run a purge script
 that clears old files)

 On Fri, Apr 1, 2011 at 12:00 PM, John phoenixoverr...@gmail.com wrote:

 Ive just adjusted the Normal edit time which was never really worked
 correctly anyway in order to salt the actual values to a non-standard format
 in order to prevent any privacy issue.



 On Fri, Apr 1, 2011 at 11:47 AM, Brett Hillebrand 
 bretthillebr...@internode.on.net wrote:

 Nope.avi

 Also any further discussion of my disclaimer can be directed to myself and
 not the Toolserver mailing list to avoid off-topic clutter. I'm sure most
 sensible people would agree that people getting caught up over a disclaimer
 is quite frankly, pathetic beyond belief and detracts from the initial
 (on-topic) thread.

 I myself don't intend to participate in this sideshow any further.


 Cheers,

 Brett Hillebrand
 User:Promethean @ en_wiki
 ACC Developer

 This message and it's attachments may contain confidential information that
 is intended only for the individual named. If you are not the named
 addressee you should not disseminate, distribute or copy this e-mail.
 Please
 notify the sender immediately by e-mail if you have received this e-mail by
 mistake and delete this e-mail from your system. E-mail transmission cannot
 be guaranteed to be secure or error-free as information could be
 intercepted, corrupted, lost, destroyed, arrive late or incomplete, or
 contain viruses. The sender therefore does not accept liability for any
 errors or omissions in the contents of this message, which arise as a
 result
 of e-mail transmission.


 -Original Message-
 From: toolserver-l-boun...@lists.wikimedia.org

 [mailto:toolserver-l-boun...@lists.wikimedia.org] On Behalf Of Platonides
 Sent: Saturday, 2 April 2011 2:13 AM
 To: toolserver-l@lists.wikimedia.org
 Subject: Re: [Toolserver-l] Privacy Violation?

 Brett Hillebrand wrote:
  Well aware of that fact, but you seem to operate on the assumption that I
  can and would be arsed removing it just for this mailing list? Obviously
  common sense isn't so common. But all this detracts from what I actually
  raised earlier, but if some people have nothing better in their lives to
 do
  I'm all for a topical discussion about none other than, that's it folks,
  EMAIL DISCLAIMERS!

 No. You should not remove it just for this mailing list. You should
 remove it for all mailing lists you are in (unless the ml policy is to
 require disclaimers).
 That would be the polite thing to do, at least.
 http://en.wikipedia.org/wiki/Netiquette

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette


 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette





 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines

Re: [Toolserver-l] Privacy Violation?

2011-04-01 Thread John
It's a 48 point scale with a sliding base value that changes on a
daily basis. With enough time and data the base values could be
figured out, but for all real purposes it's obviscated. Using a pure
time delta would not work, most reports involve three or more accounts
and deltas just don't really work for that. As it stands the time
values are shifted an unknown value. Any other method would make it
either useless or would require a massive rewrite of code

On Friday, April 1, 2011, Daniel Schwen li...@schwen.de wrote:
 You could instead just output a correlation-factor for the two
 edittime curves (integrate the product for example). That would reduce
 the amount visible data drastically, making it very hard to tell
 anything about the editing habits of each individual.
 Daniel

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list: 
 https://wiki.toolserver.org/view/Mailing_list_etiquette


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


Re: [Toolserver-l] Static dump of German Wikipedia

2010-09-23 Thread John Vandenberg
On 9/24/10, Marcin Cieslak sa...@saper.info wrote:
 There are static dumps available here:

 http://download.wikimedia.org/dewiki/

 Is there any problem with using them?

I think they are from June 2008.

A fresh static dump would be good.

--
John Vandenberg

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


Re: [Toolserver-l] New mailing list: newprojects

2010-08-23 Thread John Doe
would it be possible to sign up toolserver-l to that list? that way we can
keep abreast

John

On Mon, Aug 23, 2010 at 4:05 PM, Andrew Steinborn mege...@arandomblog.co.cc
 wrote:

  On 8/22/2010 9:29 PM, Casey Brown wrote:
  It seems that no one actually announced the creation of the
  newprojects mailing list yet!
 
  The mailing list[1] is an announcement-only list for new Wikimedia
  wikis[2].  The way it works is that the addwiki.php[3] script that
  sysadmins use to create the wikis automatically sends a mail to the
  list, so (provided there are no bugs with the script) subscribers will
  get an e-mail when every Wikimedia wiki is created.
 
  This list should be especially useful for people who need to know when
  new wikis are created so that they can update their tools or scripts.
  Of course, people who are just interested in knowing about new wikis
  are welcomed to subscribe too. :-)
 
  [1]https://lists.wikimedia.org/mailman/listinfo/newprojects
  [2]http://meta.wikimedia.org/wiki/Special:SiteMatrix
  [3]http://wikitech.wikimedia.org/view/Add_a_wiki
 
 Good, this will help ease us on new projects. (and the ts-admins, as
 they don't need a user to report in jira now.)

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Exposing data about deleted revisions

2010-08-08 Thread John Doe
How about requiring a password/code to go along with rev_id in order
to use the tool (similar to the move to commons process?

Delta

On Sunday, August 8, 2010, Mike.lifeguard mike.lifegu...@gmail.com wrote:
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 On 10-08-08 10:54 AM, DaB. wrote:
 Hello,
 At Sunday 08 August 2010 15:47:25 DaB. wrote:
 I wanted to get an OK (or not) to return the page title, and timestamp
 for a given deleted revid. It might also be helpful to return the
 username.

 in theorie that would be no problem as long as you would respect the
 ar_deleted-field.
 But in practice it is not that easy, because many revisions, which would
 oversighted today, were simply deleted in past (I guess enwp is similar to
 dewp here).
 So I can not allow such a webtool were you insert the rev_id and get the
 page_name back. But as far as I understand you, the main-usage for your
 webtool would be to fix a corrupt database for a bot; so why not just fix the
 database with data from the toolserver, without providing the data to the
 world (that would be ok for me)?

 Sincerly,
 DaB.

 Well, it is useful information to be able to get for sysops... hence the
 bug report against MediaWiki. Hopefully the software will give such
 information directly - it is needed.

 But in reality, I was asked to do it as a web tool, and it was just
 easier for me that way. The process needing information will be on
 another server, so a GET is obviously very simple to do. I'll look at
 other ways of accomplishing this if you insist.

 - -Mike
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v1.4.10 (GNU/Linux)

 iEYEARECAAYFAkxev4kACgkQst0AR/DaKHufWACfaSvwrmDuhvwe1h3wfTSUcBaD
 VcgAoLagCyB0lZ/oC7XJFqMaeOrrFEFw
 =J2NE
 -END PGP SIGNATURE-

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list: 
 https://wiki.toolserver.org/view/Mailing_list_etiquette


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


Re: [Toolserver-l] SxWiki

2010-02-17 Thread John Doe
Does it set a user agent?

On Wednesday, February 17, 2010, Ja Ga jaga_...@yahoo.com wrote:
 Is anyone else having problems where login() fails via SxWiki?  I've used it 
 to update a user page for about a year now, and for the first time, it's 
 failing.

 - Jason



___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Linux/Solaris

2009-12-28 Thread John Doe
Ill take a look and log into willow tonight to see what if anything would
break if I moved to solaris. Is there any particular place that we need to
report these differences that may need adjusted or things need added?

Betacommand

On Mon, Dec 28, 2009 at 1:36 PM, Michał hole...@gmail.com wrote:

 2009/12/28 River Tarnell river.tarn...@wikimedia.de:
 (...)
  So: if the Linux login server were to go away tomorrow, what (if
 anything)
  would you miss?

 just VIM under vi command ;)

 --
 Michał Hołek Połtyn

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] [Wikitech-l] Wikimedia IRC Group Contacts looking for a developer

2009-12-04 Thread John Doe
Im a computer programmer and ill see what I can do
Betacommand

On 12/4/09, Rjd0060 rjd0060.w...@gmail.com wrote:
 On Fri, Dec 4, 2009 at 3:55 PM, Aryeh Gregor
 simetrical+wikil...@gmail.comsimetrical%2bwikil...@gmail.com
 wrote:

 On Fri, Dec 4, 2009 at 3:47 PM, Rjd0060 rjd0060.w...@gmail.com wrote:
  Sean and a couple of others did write one which was used for a couple
  years.  It has been broken since July due to some changes to the
 toolserver
  (I believe).

 What was the old URL?  We could look into the possibility of reviving it.


 The old system was located at http://stable.toolserver.org/wmfgcbot/request.

 --
 Ryan
 User:Rjd0060


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


Re: [Toolserver-l] How to get in contact with the toolserver admins?

2009-09-21 Thread John Doe
yeah, thats the correct address, what did you need?

2009/9/21 Delphine Ménard notafi...@gmail.com

 Hi, I've tried a few times to get through to the TS admins, but either
 I have the wrong address, or they're all on holidays :)

 is ts-adm...@toolserver.org the right address?

 Thank you,

 Delphine

 --
 ~notafish

 NB. This gmail address is used for mailing lists. Personal emails will
 get lost.
 Intercultural musings: Ceci n'est pas une endive -
 http://blog.notanendive.org

 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] How to get in contact with the toolserver admins?

2009-09-21 Thread John Doe
https://jira.toolserver.org/browse/TS?report=com.atlassian.jira.plugin.system.project:openissues-panelis
the place to file a bug issue for this

2009/9/21 Delphine Ménard notafi...@gmail.com

 Hello,

 On Mon, Sep 21, 2009 at 18:18, John Doe phoenixoverr...@gmail.com wrote:
  yeah, thats the correct address, what did you need?

 I've lost/messed up my password, and need to either get a new one, or
 retrieve my info.

 user: notafish.

 Thanks!

 Delphine
 --
 ~notafish

 NB. This gmail address is used for mailing lists. Personal emails will
 get lost.
 Intercultural musings: Ceci n'est pas une endive -
 http://blog.notanendive.org

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] s1 maintenance

2009-07-31 Thread John Doe
Great news, thanks for the hard work



On Fri, Jul 31, 2009 at 11:35 AM, River Tarnell 
ri...@loreley.flyingparchment.org.uk wrote:

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 hi,

 at some point either today or over the weekend i will be reimporting s1.
  the
 server holding s1 will be reinstalled at the same time.  there will be a
 few
 hours of downtime while the new database is imported, then some replication
 lag.

- river.
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v1.4.9 (HP-UX)

 iEYEARECAAYFAkpzDysACgkQIXd7fCuc5vLBhgCeL+W3m6bdLYJKU4pxmL8X6Tax
 nqIAniBi5hCTamr/v933mEAy0MLhNxLC
 =UOp1
 -END PGP SIGNATURE-

 ___
 Toolserver-l mailing list
 Toolserver-l@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l

___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l


Re: [Toolserver-l] The Norwegian toolserver

2009-07-29 Thread John at Darkstar
A donation to a chapter within one jurisdiction is not something that is
easily moved to another chapter in another jurisdiction.

In this specific case there were a need for a solution and, well, little
response from other. One admin from the nowp community managed to get a
deal both on a server and hosting and got it up and running.

Sometimes it is simply more efficient to get a working solution, then to
wait for something to happen.

John

Daniel Kinzler wrote:
 I would prefer to pool our efforts and resources into making the existing
 toolserver more useful and more powerful. But then, as a toolserver admin an
 employee of WMDE, I'm biased :)
 
 Anyway, the most efficient and, at least for us, easiest way to contribute 
 would
 be a donation to wmde appropriated to be spent on the toolserver project. In 
 the
 past there has been some confusion about how to best do this, we are working 
 on
 sorting this out now. If anyone is interested in donating money or hardware or
 some other assets, please contact me.
 
 If you feel like setting up your own, we are happy to cooperate. But be warned
 that it not only takes money, but it also takes a lot of time and effort to
 manage something like this (thanks river!).
 
 -- daniel
 
 Lars Aronsson schrieb:
 Earlier this spring, there was some talk, perhaps within the newly 
 founded Wikimedia Norway chapter, to set up a common server in 
 Norway for analysing database dumps and running bot scripts, i.e. 
 a toolserver with everything except the database replication.

 Did this happen? Are there a bunch of such servers around the 
 world today?  Is there a list of such servers?  Should we 
 encourage people to do this, or should we try to concentrate work 
 (and pool resources) to the (real / German) toolserver?

 Concentrating to fewer servers has the advantage that people can 
 get a single account there, and join each project that is already 
 there.  Distributing over multiple, independent servers has the 
 advantage of offloading the central server.  It might also seem 
 like an attractive project for a new Wikimedia chapter, since a 
 server of their own looks like an achievement in itself.  But it 
 is also a waste of resources to maintain separate servers, if 
 these resources could instead be pooled.


 
 
 ___
 Toolserver-l mailing list
 Toolserver-l@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 

___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l


Re: [Toolserver-l] The Norwegian toolserver

2009-07-29 Thread John at Darkstar
There are several other reasons.

The uptime of the cluster in Amsterdam isn't that good, an other site
would probably not be much better, but it could be alive while the TS'
in Amsterdam are dead.

Also, there are probably legal reasons for using a local server for some
type of material, especial regarding privacy but probably also due to
copyright. If something is within the laws about privacy in Norway it is
necessary to know who gets access to the data, which we do not know in
Amsterdam. Another example is a server for a chapter-only website, with
read only access after logon for members.

And at last, sometime it seems like the wmde-admins simply ain't
responsive. Why that is so I don't know, but it is nearly impossible to
run a project when you can't get in touch with the server admins.

John

Daniel Kinzler wrote:
 Adam Dodek Michalik schrieb:
 2009/7/29 Andrew Garrett agarr...@wikimedia.org:
 The German toolserver is in the same rack as the European proxies, but
 it's not better because edits and API requests have to go to Tampa.
 So it seems it's not any faster to run bots form German Toolserver
 than from our own, local one, as long as you don't use the database -
 am I right? Many people use TS to run their bots on it - including
 myself. Wouldn't some local TSs help balance the load?

 
 More servers to run bots on would be a good thing. From a technical point of
 view, it would be better to have all of them in the same cluster, so user
 accounts and secondary services (svn, jira, etc) can be shared and
 administrative overhead is minimized.
 
 The only reasons *not* to do that are political/financial. IF those could be
 resolved, that would be great. If not, then yes, having another place to run
 bots is still good.
 
 -- daniel
 
 ___
 Toolserver-l mailing list
 Toolserver-l@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 

___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l


Re: [Toolserver-l] The Norwegian toolserver

2009-07-29 Thread John at Darkstar
Perhaps there could be some kind of central management of some kind.

One thing is distribution of the open databases. It should not be
necessary to set up replication for each and every toolserver.

Some kind of central authentication so access can be federated perhaps,
yet authorization should be enforced locally.

But then perhaps we could use the same facility if the internal access
rules on the various servers could be more stringent, that is a
Norwegian server is for Norwegian use only - even if its located in the
cluster. More like a webhotel with server hosting for chapters. Now,
make it even more general and say virtual servers for the chapters own
use and make them off-limit for other bot operators.

Still, note that such a server, virtual or not, has to be under complete
control of the individual chapter. Even sharing backup tapes could be
troublesome.

 I would suggest though that we should set up some means of exchanging info
 between the different projects of that kind - to my knowledge, there'S the 
 boxes
 in poland, now in norway, and wmde's toolserver. Do you know of more? What 
 would
 be a good way to communicate? Yet another mailing list?

I don't think another mailing list is necessary. If a toolserver-box is
used for something else that need higher confidentiality then it should
go on a local chapter list or something similar.

 -- daniel

John

___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l


Re: [Toolserver-l] The Norwegian toolserver

2009-07-29 Thread John at Darkstar
It should not be necessary to set up replication _manually_ for each and
every toolserver.

More or less... ;)

John (my typos are mine!)

John at Darkstar wrote:
 Perhaps there could be some kind of central management of some kind.
 
 One thing is distribution of the open databases. It should not be
 necessary to set up replication for each and every toolserver.
 
 Some kind of central authentication so access can be federated perhaps,
 yet authorization should be enforced locally.
 
 But then perhaps we could use the same facility if the internal access
 rules on the various servers could be more stringent, that is a
 Norwegian server is for Norwegian use only - even if its located in the
 cluster. More like a webhotel with server hosting for chapters. Now,
 make it even more general and say virtual servers for the chapters own
 use and make them off-limit for other bot operators.
 
 Still, note that such a server, virtual or not, has to be under complete
 control of the individual chapter. Even sharing backup tapes could be
 troublesome.
 
 I would suggest though that we should set up some means of exchanging info
 between the different projects of that kind - to my knowledge, there'S the 
 boxes
 in poland, now in norway, and wmde's toolserver. Do you know of more? What 
 would
 be a good way to communicate? Yet another mailing list?
 
 I don't think another mailing list is necessary. If a toolserver-box is
 used for something else that need higher confidentiality then it should
 go on a local chapter list or something similar.
 
 -- daniel
 
 John
 
 ___
 Toolserver-l mailing list
 Toolserver-l@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 

___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l


Re: [Toolserver-l] The Norwegian toolserver

2009-07-29 Thread John at Darkstar
Yes, its the one. I'm not sure if its imposed any restrictions on user
accounts, but I don't think so.

The server is sponsored by a company selling PC's and related equipment,
and it is located in a facility for the municipality and city Tønsberg
in Norway. The admin (Laaknor) who made the deal works there.

You may contact the user himself at
http://no.wikipedia.org/wiki/User:Laaknor
http://meta.wikimedia.org/wiki/User:Laaknor

John Erling Blad
Wikimedia Norway

Casey Brown wrote:
 On Wed, Jul 29, 2009 at 12:07 PM, Lars Aronssonl...@aronsson.se wrote:
 Aha, so there is a Norwegian toolserver?  To what extent is it
 sponsored by the chapter?  Can Swedish users get accounts?
 
 As far as I know, it's this: http://toolserver.no/ and anyone who
 requests an account can get one (not just Norwegians or
 Skandinavians).
 

___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l


Re: [Toolserver-l] Looking for utility to perform text search in dump

2009-07-25 Thread John Doe
awb does but wont work on the ts

On Sat, Jul 25, 2009 at 8:46 AM, Simon Walker
stwalkers...@googlemail.comwrote:

 Does AWB not do something along those lines?

 2009/7/25 Danny B. wikipedia.dann...@email.cz

 Hello,

 I'm looking for any kind of tool which would take the XML dump (most
 probably the pages-meta-current.xml.bz2, at least the
 pages-articles.xml.bz2) and would return the list of page titles (or
 alternatively/configurably page ids) of pages containing given string.

 Does anybody have such (kind of) tool and is willing to share? Both
 command line or webpage interface are OK.

 Thank you.


 Danny B.

 ___
 Toolserver-l mailing list
 Toolserver-l@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l




 --
 Regards,

 Simon Walker
 User:Stwalkerster on all public Wikimedia Foundation wikis
 Administrator on the English Wikipedia
 Developer of Helpmebot, the ACC tool, and Nubio 2 FAQ repository

 ___
 Toolserver-l mailing list
 Toolserver-l@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l


___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l


Re: [Toolserver-l] you have been selected to participate in our customer satisfaction survey

2009-02-05 Thread John Vandenberg
On 2/5/09, River Tarnell ri...@loreley.flyingparchment.org.uk wrote:
 hi,

 if you have a free moment, and are a Toolserver user, please fill out this
 short survey about the Toolserver:

   http://toolserver.org/~river/survey.txt

 the more people who reply, the more we will know what needs to be improved.

Where should we send the completed survey?

--
John Vandenberg

___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l


Re: [Toolserver-l] making sure your bots are always running: introducing phoenix

2008-10-17 Thread John Vandenberg
On Sat, Oct 18, 2008 at 7:26 AM, Daniel Kinzler [EMAIL PROTECTED] wrote:
 Hi all

 We have all seen the problem that some script or bot we have come to rely upon
 suddenly dies. Or fails to restart when the toolserver is rebooted. Putting
 something into cron to be run on @reboot sadly doesn't always work, for 
 example
 because the home directory may not yet be mounted when cron runs reboot jobs.

We should have a per-user initialisation script that are all run
during startup by rc.local.

 So, after a short discussion on IRC, i wrote a script to take care of this. I
 called if phoenix, it's available in the system path on nightshade and 
 hemlock.

 Phonix just starts whatever command you give to it, but it first checks if 
 that
 command is already running. If it is already running, phoenix does nothing. 
 So,
 just call phonix from cron every few minutes to make sure your bot is 
 restarted
 when it dies.

 For example, if you want to run 'mybot', call this every few minutes from 
 cron:

  phoenix /tmp/yourname-mybot /home/mydir/bin/mybot someparam

 The path /tmp/yourname-mybot is the base fir the PID and output files - output
 fill be written to /tmp/yourname-mybot.out, the processes pid will be stored 
 in
 /tmp/yourname-mybot.pid.

 The second parameter, /home/mydir/bin/mybot, is the program to run. Anything
 following that are parameters to pass to this program.


 Please try it out and tell me about any problems! phoenix also prints a short
 help message when called without any parameters.

 -- daniel

 PS: I'm sure this wheel has been invented before... any pointers?

[[init]] is the original program given this task, and is still often
used for this purpose. The wiki page lists other tools that have been
written to help with this.

svscan from [[daemontools]] is a good one.

--
John Vandenberg

___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l