Re: [Toolserver-l] Toolserver wiki
I wish I could help, anyway that I may ? On Oct 13, 2013 6:34 AM, Federico Leva (Nemo) nemow...@gmail.com wrote: I don't see a conclusion to this thread, did the discussion move elsewhere? Of course the whole wiki has to be archived. There are only 323 content pages (an apt number, considering bug 323!) and 1500 pages in total, so importing them all on a Toolserver: pseudo-namespace on wikitech is trivial (possibly even Special:Import may suffice); it can be made into an actual namespace by any shell user. Ideally, however, this would be done by a shell user importing logs and files too. Nemo __**_ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.**orgToolserver-l@lists.wikimedia.org ) https://lists.wikimedia.org/**mailman/listinfo/toolserver-lhttps://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/** view/Mailing_list_etiquettehttps://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Patricia Pintilie pintilieemp...@gmail.com
Have you fixed the cron and nodes problems? On May 26, 2013 4:56 AM, seth email_metawiki_...@wg-karlsruhe.de wrote: Hi! On 24.05.2013 21:37, Patricia Pintilie wrote: On May 24, 2013 4:37 AM, seth wrote: The right answer should have been 4. (So she must be a wit^Wbot.) *duck* I responded with a 4 to jeremy seth. Y are u being such a jerk to me u don't know me bro, take a chill pill Sorry, I apparently didn't make clear enough that my post was meant ironically. It was meant to be a joke and not an offence. ...and I guess, there's no need to continue this on the list. bye seth ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Patricia Pintilie pintilieemp...@gmail.com
I responded with a 4 to jeremy seth. Y are u being such a jerk to me u don't know me bro, take a chill pill On May 24, 2013 4:37 AM, seth email_metawiki_...@wg-karlsruhe.de wrote: Hi! 2013-05-23 20:12, Patricia Pintilie wrote: 2013-05-23 09:49, Hersfold Wikipedia hersfoldw...@gmail.com wrote: 2013-23-05 10:34, Daniel Schwen wrote: 2013-23-05 08:07, Jeremy Baron jer...@tuxmachine.com wrote: 2013-05-23 07:30, Patricia Pintilie pintilieemp...@gmail.com wrote: General chat • Re: Navigating Multiboot GRUB2 menu entries successfully. http://forum.porteus.org/** viewtopic.php?t=2195p=15042#**p15042http://forum.porteus.org/viewtopic.php?t=2195p=15042#p15042 Hi Patricia, Are you human? Please send me the square root of 16. Thanks! At this point it doesn't even matter anymore. None of her posts so far made any sense or contributed in a meaningful way. Please block. 2013-05-23 08:07, Jeremy Baron jer...@tuxmachine.com wrote: +1. Only two of her emails I can pull up on my phone have been even potentially constructive; all of the more recent ones are nonsense or outright spam. I am not spam and a beautiful human being. Altho my replied might not make sense to some I am on many email lists so pardon if u are not understanding me, it maybe that information is for the ones that know what to do with the information. Its Hard to block a smooth operator such as myself. Keep up the good corrections I Pray all is well with my Wikiedians. Best Regards-MILASTARX-TS The right answer should have been 4. (So she must be a wit^Wbot.) *duck* bye seth __**_ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.**orgToolserver-l@lists.wikimedia.org ) https://lists.wikimedia.org/**mailman/listinfo/toolserver-lhttps://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/** view/Mailing_list_etiquettehttps://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Patricia Pintilie pintilieemp...@gmail.com
You would think if I wrote on the whole mailing list there is obviously a reason for it On May 26, 2013 3:44 AM, K. Peachey p858sn...@gmail.com wrote: On Sat, May 25, 2013 at 5:37 AM, Patricia Pintilie pintilieemp...@gmail.com wrote: I responded with a 4 to jeremy seth. Y are u being such a jerk to me u don't know me bro, take a chill pill Because your posting out of context, random and ill-relevant replies across the whole mailing list? ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Patricia Pintilie pintilieemp...@gmail.com
I am not spam and a beautiful human being. Altho my replied might not make sense to some I am on many email lists so pardon if u are not understanding me, it maybe that information is for the ones that know what to do with the information. Its Hard to block a smooth operator such as myself. Keep up the good corrections I Pray all is well with my Wikiedians. Best Regards-MILASTARX-TS On May 23, 2013 9:49 AM, Hersfold Wikipedia hersfoldw...@gmail.com wrote: +1. Only two of her emails I can pull up on my phone have been even potentially constructive; all of the more recent ones are nonsense or outright spam. User:Hersfold hersfoldw...@gmail.com Sent from my Windows Phone From: Daniel Schwen Sent: 5/23/2013 10:34 To: Wikimedia Toolserver Subject: Re: [Toolserver-l] Patricia Pintilie pintilieemp...@gmail.com At this point it doesn't even matter anymore. None of her posts so far made any sense or contributed in a meaningful way. Please block. On Thu, May 23, 2013 at 8:07 AM, Jeremy Baron jer...@tuxmachine.com wrote: On May 23, 2013 7:30 AM, Patricia Pintilie pintilieemp...@gmail.com wrote: General chat • Re: Navigating Multiboot GRUB2 menu entries successfully. http://forum.porteus.org/viewtopic.php?t=2195p=15042#p15042 Hi Patricia, Are you human? Please send me the square root of 16. Thanks! -Jeremy ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Encoding issue using SGE
Your welcome if I had any part in helping you out. On May 23, 2013 2:31 PM, Hercule Hercule hercule.wikipe...@gmail.com wrote: The addition of console_encoding = 'utf-8' in my user-config.py solved the issue. Thanks everybody for your help 2013/5/23 Hercule Hercule hercule.wikipe...@gmail.com I added export LANG LANG=fr_FR.UTF-8 in the script, but it still make incorrect comments. I add enclosed the sh file, if it can help 2013/5/23 Lars Aronsson l...@aronsson.se On 05/23/2013 02:40 PM, Hercule Hercule wrote: I already tried to add export LANG=fr_FR.UTF-8 but I then have an alert : LANG=fr_FR.UTF-8 is not an identifier LANG=fr_FR.UTF-8 at the top of the shell don't change anything. The syntax export A=B is from bash, a common login shell. However, most scripts are traditionally written in #!/bin/sh where the syntax requires export A and A=B to be written as two separate statements. (Knowledge from the 1980s.) -- Lars Aronsson (l...@aronsson.se) Aronsson Datateknik - http://aronsson.se __**_ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.**orgToolserver-l@lists.wikimedia.org ) https://lists.wikimedia.org/**mailman/listinfo/toolserver-lhttps://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/** view/Mailing_list_etiquettehttps://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Toolserver db outperformed by labs
The problem starts at the servers abilities to categorize each discrepancy. If it cant it dumps without hesitating. Overloading the server is one thing it wont do to itself on both negative and positive sides. When server programs start having issues their discrepancies affect the servers log which affects the servers progress in its own job. If u have one server give it 2 input and output nodes ONLY otherwise all ur programs will back the server db up. On May 23, 2013 5:40 PM, Platonides platoni...@gmail.com wrote: Today^W Yesterday, I was asked about some file numbers, which involved subcategory traversing, which is an inefficient problem. It seemed a good problem for comparing toolserver and labs. And toolserver db sucks: willow: 31m5.157s (user 0m4.038s) labs: 0m4.271s (user 2.488) Toolserver was *436 times slower*. Surely, the labs server is better (in hardware) than the one in TS. I don't know how many scripts were hitting the TS db, while the labs one would be almost-idle. Still, it seems a really big gap. Do we have something wrongly configured? Did mariadb somehow massively improve vs mysql? Are some parameters too small? Is it just a problem that the mysql servers are underprovisioned of ram? ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Encoding issue using SGE
General chat • Re: Navigating Multiboot GRUB2 menu entries successfully.
http://forum.porteus.org/viewtopic.php?t=2195p=15042#p15042
On May 23, 2013 3:12 AM, Merlijn van Deen valhall...@arctus.nl wrote:
Hi Hercule,
On 23 May 2013 00:38, Hercule Hercule hercule.wikipe...@gmail.com wrote:
python /home/hercule/template.py Lien Lien/Conversion automatique
-cat:Page utilisant Lien pour un article existant -summary:[Bot] :
transformation de liens avec le modèle {{Lien}} en lien interne, suite à
la
création de l'article correspondant -assubst -pt:0 -always
mutt -s Fin de LienFr hercule /home/hercule/logs/LienFr.log
If you have saved the file in the utf-8 encoding (which the edit
summary suggests), try using (on one line)
LANG=en_GB.UTF-8 python /home/hercule/template.py ...
or (on two lines)
export LANG=en_GB.UTF-8
python /home/hercule/template.py ...
Basically, you have to tell pywikipedia which encoding you have used
for the shell arguments - in your case UTF-8. Otherwise it will use
latin-1 as default, which results in the mojibake you saw.
Merlijn
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list:
https://wiki.toolserver.org/view/Mailing_list_etiquette
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list:
https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] TS web broken
General chat • Re: Navigating Multiboot GRUB2 menu entries successfully. http://forum.porteus.org/viewtopic.php?t=2195p=15042#p15042 On May 23, 2013 2:14 AM, Dr. Trigon dr.tri...@surfeu.ch wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Luckily those externals are important just for 1 script (catimages.py) at the moment, so if you checkout the code except those 2 externals, you should be fine - don't worry! ;) In fact I was thinking about doing a svnsync from https://svn.toolserver.org/svnroot/drtrigon to sf.net. DaB, Nosy, ... could you give me a short hint or feadback wheather this would be good idea? This is NOT a step to migrate from TS to labs, BUT during the last few weeks and months SVN was not THAT reliable as I'd like to see (and may be other developers too)... I assume this is related to the ha-nodes... but that's just a guess. Thanks and Greetings DrTrigon On 23.05.2013 04:34, Hazard-SJ wrote: Yes, and SVN has some externals for Pywikibot (trunk version). It's been down for a while. Hazard-SJ *From:* Johannes Kroll jkr...@lavabit.com *To:* Wikimedia Toolserver toolserver-l@lists.wikimedia.org *Sent:* Wednesday, May 22, 2013 2:49 AM *Subject:* Re: [Toolserver-l] TS web broken On Tue, 21 May 2013 22:13:10 +0200 (CEST) Marlen Caemmerer marlen.caemme...@wikimedia.de mailto:marlen.caemme...@wikimedia.de wrote: Hello, fortunatelly I was able to fix web very quick. With thanks to DaB and Merlissimo we just got SGE back too and it seems everything is running as before. Cheers Marlen/nosy What about http://svn.toolserver.org/? http://svn.toolserver.org/? ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org mailto:Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.13 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iEUEARECAAYFAlGdwdUACgkQAXWvBxzBrDBbiwCXZige5ANkvXJhVcChnaY65Xw0 2gCaAxaKV+7BJQNKmdUo3hkR13qhUbI= =gzr3 -END PGP SIGNATURE- ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Introducing the new toolserver admin
General chat • Re: Navigating Multiboot GRUB2 menu entries successfully. http://forum.porteus.org/viewtopic.php?t=2195p=15042#p15042 On May 22, 2013 12:50 PM, Silke Meyer silke.me...@wikimedia.de wrote: Hi all! Let me introduce Alexander Mette, the new toolserver admin who came to support DaB. and Nosy! Welcome! As soon as he is a bit more in touch with the toolserver, he would like to meet you in an office hour. (Will be announced separately.) You can reach him via e-mail as alexander.me...@wikimedia.de and on IRC as amette. Cheers, Silke -- Silke Meyer Internes IT-Management und Projektmanagement Toolserver Wikimedia Deutschland e.V. | Obentrautstr. 72 | 10963 Berlin Tel. (030) 219 158 260 http://wikimedia.de Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] SGE fail to run any of my tasks, they error out as cgroup change of group failed
General chat • Re: Navigating Multiboot GRUB2 menu entries successfully. http://forum.porteus.org/viewtopic.php?t=2195p=15042#p15042 On May 22, 2013 12:02 PM, Dr. Trigon dr.tri...@surfeu.ch wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Thanks for that! (btw. ;) -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.13 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iEYEARECAAYFAlGc+f0ACgkQAXWvBxzBrDDyRwCgmDHayk3D162RF/TFbgDun7lp gJIAmwXxA6FDsTD7AAv09eNIP5JKMR/o =5H9i -END PGP SIGNATURE- ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Status of the toolserver
General chat • Re: Navigating Multiboot GRUB2 menu entries successfully. http://forum.porteus.org/viewtopic.php?t=2195p=15042#p15042 On May 20, 2013 5:44 PM, DaB. w...@daniel.baur4.info wrote: Hello all, At Tuesday 21 May 2013 00:42:31 DaB. wrote: Is SVN supposed to be down still? yes, there is a minor problem with ngnix I haven’t time to fix yet. Also there is a harmless error-message about quota at login. I will try to fix the SVN-problem tomorrow. Sincerely, DaB. -- Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885 ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Running Pywikipedia (rewrite) bots on Tools Labs
Hello, Yes Please send my manual. asap.thanks. On May 16, 2013 1:15 PM, Russell Blau russb...@imapmail.org wrote: For any users interested in migrating Pywikipedia-based bots from the Toolserver to the new Labs platform, or just interested in using Labs to run bots, I've written a page[1] describing the steps I took to get my bots running under the rewrite branch. If someone who uses trunk has gotten their bot(s) running on Labs, feel free to add instructions for that process, too. [1] https://wikitech.wikimedia.org/wiki/User:Russell_Blau/Using_pywikibot_on_Labs -- Russell Blau russb...@imapmail.org ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Status of the toolserver
Sure On May 14, 2013 2:53 PM, Marc A. Pelletier m...@uberbox.org wrote: On 05/13/2013 05:01 PM, DaB. wrote: The problem is that both ha-nodes run Solaris and all roots are no Solaris- experts what makes it hard for us to find errors or in this case impossible. There is a former colleague or mine with whom I've kept contact that is a serious high-grade guru with Solaris. Would you like me to put him in contact with you guys? Maybe he can give a hand or lend expertise? -- Marc ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Status of the toolserver
Linux is your best bet. Also Errors 404 401 are non responsive. I can connect to all servers but on 2 of them msg/nickserver/password is the 401 404 error stub. See if this information helps you if not write me back Best Regards [MILASTARX]:[TS] On May 13, 2013 6:02 PM, DaB. w...@daniel.baur4.info wrote: Hello all, as you have surely noticed the toolserver is even more unstable and unreliable than normal at the moment. The reason is that our ha-nodes are not longer working as intended and neither Nosy nor I are able to fix this. A quick word was ha-nodes are: The ha stands for high available and we have 2 servers for that. Some services at the toolserver are so important that a downtime is unacceptable (like /home, LDAP or the DNS) and for this reasons these services life at the ha-nodes. If one server goes down or crashes then the other can continue to operate all services with no or little interruption time and without working by a root. That worked great as long as River was here and not-so-good in the last months, but now it is totally broken. The problem is that both ha-nodes run Solaris and all roots are no Solaris- experts what makes it hard for us to find errors or in this case impossible. We have setup a very ugly workaround, but it is not stable and so the downtime of important services cause downtime for the hole toolserver – and more work for the roots. We can only think of one solution: Replacing the solaris at the ha-nodes with linux. But this can not start before Friday and it will take some time until everything is moved over. It will also cause some hours of complete downtime while /home is copied (we will separately announce this). In best case when Whitsun is over everything will be working again, in worst case it will need 2 weeks (I will be away between 21 and 26 for the general meeting of WMDE). The repairing of the ha-nodes has top priority, so everything else will be delayed (linux-update, database-reimports, account-creation (for VERY important ones send me a mail), etc.). If you have questions, please send them to the ML. Sincerely, DaB. -- Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885 ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Toolserver limitation to come?
On May 2, 2013 3:08 AM, Marlen Caemmerer marlen.caemme...@wikimedia.de wrote: Hey, On Wed, 1 May 2013, Ryan Lane wrote: On Wed, May 1, 2013 at 5:03 PM, Tim Landscheidt t...@tim-landscheidt.de wrote: | [...] There were never answers to this, so I bring it up here again: 1. How were almost /all/ of the problems the TS have had with replication caused by that redundancy and trying to keep it synced? Ryan, repeaters are from the root of a program inwhich start the initial setup. Thanks for this question :) - I also want to know. From my perspective it does not look like this and even the data inconsistencies appear when we have no commons copy on a mysql instance. And: DaB experimented with federated tables for commons too and we decided to not do this since it does not perform from the start. Probably nowadays when I planned something new in this area (which does not seem to make sense for TS) I'd really give Galera a try - http://codership.com/content/using-galera-cluster 2. What limitation will the Toolserver have at some point? As to #2: From what I've been told this has to do with future sharding plans for the databases, and due to a change in how we'll be doing replication. Of course, I've heard this in passing. For answers to both of these questions you'll need to talk to binasher and/or notpeter on IRC, as they are the ones doing the database work. Thanks for telling... Cheers Marlen/nosy ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Toolserver limitation to come?
a rel=license href=http://creativecommons.org/licenses/by/3.0/;img
alt=Creative Commons License style=border-width:0 src=
http://i.creativecommons.org/l/by/3.0/88x31.png; //abr /This work is
licensed under a a rel=license href=
http://creativecommons.org/licenses/by/3.0/;Creative Commons Attribution
3.0 Unported License/a.
On May 1, 2013 8:49 PM, Ryan Lane rl...@wikimedia.org wrote:
On Wed, May 1, 2013 at 5:03 PM, Tim Landscheidt
t...@tim-landscheidt.dewrote:
Hi,
at the office hour yesterday
(cf.
http://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-office/20130430.txt):
| [...]
| Coren multichill: The long story short; replicating
| databases is happening soon (Within the month)
| Replicating multiple copies of commons and wikidata
| isn't going to happen that way; it needs to be built
| into application logic or using federated tables.
| Almost /all/ of the problems the TS have had with
| replication were caused by that redundancy and
| trying to keep it synced.
| multichill Coren: So you're basically saying Toollabs is
| useless for me
| Platonides {{ref needed}}
| Coren We're all more than happy to help you (and any other
| maintainer) with adapting your tools to work in that
| setup.
| scfc_de Coren: In that case, Tools will not be able to
| replace Toolserver.
| giftpfla1ze what are federated tables btw?
| Ryan_Lane AFAIK toolserver will also have this limitation
| at some point
| scfc_de Ryan_Lane: What do you mean?
| [...]
There were never answers to this, so I bring it up here
again:
1. How were almost /all/ of the problems the TS have had
with replication caused by that redundancy and trying
to keep it synced?
2. What limitation will the Toolserver have at some point?
As to #2: From what I've been told this has to do with future sharding
plans for the databases, and due to a change in how we'll be doing
replication. Of course, I've heard this in passing. For answers to both of
these questions you'll need to talk to binasher and/or notpeter on IRC, as
they are the ones doing the database work.
- Ryan
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list:
https://wiki.toolserver.org/view/Mailing_list_etiquette
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list:
https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Toolserver limitation to come?
Remove wiki offline
Do not allow diffrent languages on same feeds
Delete unused accounts
Delete dangerous information
Acknowledge that the sole creator could be anyone, and expects more order
in a hectic database with too much junk being reedited over and over.
Once its written correctly do not allow repeaters to do over incorrectly
work that was ligit.
Figure out how many angles are approaching the database.
This toolserver can cause havoc or can contain order depends on proper
knowledge used in operating it.
Thanks
MILASTAR.TS.RO
On May 1, 2013 9:17 PM, Patricia Pintilie pintilieemp...@gmail.com
wrote:
a rel=license href=http://creativecommons.org/licenses/by/3.0/;img
alt=Creative Commons License style=border-width:0 src=
http://i.creativecommons.org/l/by/3.0/88x31.png; //abr /This work is
licensed under a a rel=license href=
http://creativecommons.org/licenses/by/3.0/;Creative Commons Attribution
3.0 Unported License/a.
On May 1, 2013 8:49 PM, Ryan Lane rl...@wikimedia.org wrote:
On Wed, May 1, 2013 at 5:03 PM, Tim Landscheidt
t...@tim-landscheidt.dewrote:
Hi,
at the office hour yesterday
(cf.
http://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-office/20130430.txt):
| [...]
| Coren multichill: The long story short; replicating
| databases is happening soon (Within the month)
| Replicating multiple copies of commons and wikidata
| isn't going to happen that way; it needs to be built
| into application logic or using federated tables.
| Almost /all/ of the problems the TS have had with
| replication were caused by that redundancy and
| trying to keep it synced.
| multichill Coren: So you're basically saying Toollabs is
| useless for me
| Platonides {{ref needed}}
| Coren We're all more than happy to help you (and any other
| maintainer) with adapting your tools to work in that
| setup.
| scfc_de Coren: In that case, Tools will not be able to
| replace Toolserver.
| giftpfla1ze what are federated tables btw?
| Ryan_Lane AFAIK toolserver will also have this limitation
| at some point
| scfc_de Ryan_Lane: What do you mean?
| [...]
There were never answers to this, so I bring it up here
again:
1. How were almost /all/ of the problems the TS have had
with replication caused by that redundancy and trying
to keep it synced?
2. What limitation will the Toolserver have at some point?
As to #2: From what I've been told this has to do with future sharding
plans for the databases, and due to a change in how we'll be doing
replication. Of course, I've heard this in passing. For answers to both of
these questions you'll need to talk to binasher and/or notpeter on IRC, as
they are the ones doing the database work.
- Ryan
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list:
https://wiki.toolserver.org/view/Mailing_list_etiquette
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list:
https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Wikidata tables
Waterfall the Anamorphic Development. On Apr 19, 2013 4:14 AM, Patricia Pintilie pintilieemp...@gmail.com wrote: Ok so how about we recocnize what the overal goal is first . Then establish the point that its trying to convay. Only then can we meet in the middle and set a plan in motion. I can only assist when a plan of action is clear with a definite plan without it im lost on where to begin. It seems as if im doing my natural instinct research then I get mail from the people im reading about... Very interesting this is because im left to think my mind is linked to the problems at hand. TS is my old signature, my server os will pull up my IP searches. Which leads me to believe this is why I am always being brought up in the middle of these outstanding conversations you guys are having lol. Please send detailed instructions as to how I can help,there should be a file known as Mila.eu also known as ro.eula. Find it and run whatever it has, thanks. -patiently waiting your responce. -MilaStarX-TS On Apr 19, 2013 3:29 AM, Platonides platoni...@gmail.com wrote: On 19/04/13 01:19, DaB. wrote: as you may know there is a rev_text_id-field in the revision-table. This field points to the text-table where the actual text is – or should be. Because the WMF doesn’t store the text here, but only a pointer (DB://cluster25/11458305 for example). If you query different wikis you will see that most of them point to the same cluster or one with a number short by. That says me (and I was also told so before) that all text of all wmf-projects are stored together. The task would now to separate wikidata from the rest – but the storage-area has no clue from where a text is which makes the separating very hard. And there is another problem: Deleted texts are also in this area, so even more filtering would be needed. I very doubt that this situation will change at the TS and I also doubt that it will be different for WikiLabs. So I guess your best bet is the API here. Sincerely, DaB. I think the only hope would be if wikidata was stored under its own cluster (for easier differenciation) and at least one server of that group (the master?) only had that (so toolserver could get its binlogs). ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Wikidata tables
Imagine Magnus all the files are being looked over to determine human, machine, and non used accounts. Each needs to be looked over then proper deletion will clean out making more room. Problematic yes but will help if this is taken care of the right way now. On Apr 18, 2013 5:45 AM, Magnus Manske magnusman...@googlemail.com wrote: Huh. That could be ... problematic in the future. Thanks, Magnus On Thu, Apr 18, 2013 at 10:21 AM, Lydia Pintscher lydia.pintsc...@wikimedia.de wrote: On Thu, Apr 18, 2013 at 9:52 AM, Magnus Manske magnusman...@googlemail.com wrote: Just wondering what the status of exposing all wikidata tables on the toolserver is. Currently, there are a few wb_* tables with item labels, descriptions, aliases, and language links. But the tables (whatever they are called) containing item-to-item connections appear to be missing. Maybe because they were added later? As far as I know they're only saved in JSON where usually the article text is stored and not in separate tables. Cheers Lydia -- Lydia Pintscher - http://about.me/lydia.pintscher Community Communications for Wikidata Wikimedia Deutschland e.V. Obentrautstr. 72 10963 Berlin www.wikimedia.de Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Output files
What outputs are you refering to because there is diffrent ways to handle them. On Apr 17, 2013 7:09 PM, Avocato avocatom...@gmail.com wrote: Hello all. I use this wayhttps://wiki.toolserver.org/view/Submit.toolserver.org#resource_definition@scriptfor running crons. I make a file named *something.sh *for example, encluding the following: *#!/bin/sh #$ -j y #$ -o /dev/null cd pywikipedia python anyscript.py* Then, I put a cron like: *00 21 * * * cronsub -s something % sh $HOME/something.sh* The problem is that I want my crons to stop producing output files at home folder inside my account, I don't want it to produce outputs at all. How can I do that? -- *User:Avocato--* ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Output files
Are u able to create new folders in home? On Apr 17, 2013 7:18 PM, Avocato avocatom...@gmail.com wrote: I mean this files which are always automatically created when I run my crons. I find it in my home folder. 2013/4/18 Patricia Pintilie pintilieemp...@gmail.com What outputs are you refering to because there is diffrent ways to handle them. On Apr 17, 2013 7:09 PM, Avocato avocatom...@gmail.com wrote: Hello all. I use this wayhttps://wiki.toolserver.org/view/Submit.toolserver.org#resource_definition@scriptfor running crons. I make a file named *something.sh *for example, encluding the following: *#!/bin/sh #$ -j y #$ -o /dev/null cd pywikipedia python anyscript.py* Then, I put a cron like: *00 21 * * * cronsub -s something % sh $HOME/something.sh* The problem is that I want my crons to stop producing output files at home folder inside my account, I don't want it to produce outputs at all. How can I do that? -- *User:Avocato--* ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette -- *User:Avocato--* ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
