Re: [Toolserver-l] Future of the toolserver

[Mike Dupont]

On Tue, Sep 25, 2012 at 8:27 AM,  wrote:

> , I cloned my applet page on github as backup


also who is backing up github? please share important urls.
thanks
mike


-- 
James Michael DuPont
Member of Free Libre Open Source Software Kosova http://flossk.org
Saving wikipedia(tm) articles from deletion http://SpeedyDeletion.wikia.com
Contributor FOSM, the CC-BY-SA map of the world http://fosm.org
Mozilla Rep https://reps.mozilla.org/u/h4ck3rm1k3
Free Software Foundation Europe Fellow http://fsfe.org/support/?h4ck3rm1k3
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Future of the toolserver

[ralf]

On Tue, Sep 25, 2012 at 12:51:50AM +0200, DaB. wrote:
> will request a change of the budget at the general meeting at November, so 
> there will be a vote about. If this vote should fail (and we get no money for 
> new hardware), I am going to retire from my job as root at 30. December 2012.

I support your decision and am looking forward to a solution
of WMDE mismanagement, in general. In fact, after the last
weekend, I cloned my applet page on github as backup, though
their line is throttled down. Now can come what may!

Best wishes,
ralf


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] qcronsub warning: "Please add the os this job can run on by adding parameter -l arch='*'|sol|lx"

[Merlissimo]

Hi,
i added this warning today (according to prior agreement with DaB.) when 
a job is submitted without arch resource. This has two reasons:


# First next week the default setting will change from "solaris only" to 
"all servers". This was announced in July 
()


# Secondly due to some server problems of the last two days many jobs 
need a longer runtime which lead to higher load on willow. Last night 
some jobs waited up to hours until willow was available again although 
other servers had unused cpu and memory at the same time.


In most cases you can simply add " -l arch='*' " as argument to 
qcronsub/qsub without any problems. Most scripts should run on solaris 
and linux, but perhaps you should test it before to be sure. If your job 
is currently only executable on solaris you must add "-l arch=sol" 
before the default setting will change next week. For more information 
check .


I also noticed that on user-store outage on sunday only one job was 
waiting some hours because of the missing resource "fs-user-store", but 
many people complained about their failed jobs. When your job needs a 
special resource check if that is requestable on 
. 
SGE will execute your job only when the requested resource is available. 
If you job is already running and a needed resource is gone you can also 
exit you script with code "99". This requeues your job when the resource 
is available again.


@Krinkle You got the message while i was hacking the live jsv script, I 
simply copied the runtime warning message and then changed it. This was 
so easy that i save myself to disable jsv while rewriting.


Currently in total there is enough cpu and memory free for all user 
scripts. SGE jobs are executed on five different servers and more server 
could be added easily. The main problem is the load distribution because 
many users do not use SGE which is bad on a shared system and leads to 
overload on few servers. So please use cronie on host submit and 
qsub/qcronsub to submit jobs to sge instead of running them on a special 
server directly. Toolserver hardware is getting older and server may go 
away suddenly because of problems. With sge you do not have to care 
about it.


Merlissimo

P.S.: I want to thank DaB. for his engagement to get more money for 
hardware on toolserver cluster next year. I also think this is really 
needed especially for the database servers. You can follow the 
discussion on 
.


Am 24.09.2012 18:31, schrieb Krinkle:

On Sep 24, 2012, at 6:20 PM, Platonides  wrote:


On 24/09/12 18:07, Krinkle wrote:

Can someone decode this? What is this?

-- Krinkle


Begin forwarded message:


*From: *r...@toolserver.org  (Cron Daemon)
*Subject: **Cron  qcronsub -N dbbot_wm -m n -j y -b
y -l h_rt=INFINITY -l virtual_free=90M "$HOME/bots/dbbot-wm-start.sh"*
*Date: *September 24, 2012 6:05:07 PM GMT+02:00
*To: *krin...@toolserver.org 

warning: Please add maximum runtime by adding parameter -l
arch=sol|lx


The text asks you to place a time limit. The parameter (embedded in
posix colors despite not being output to a terminal) to specify if it
needs a linux or solaris server.

However, if I try to execute it, I get a much saner message:
$ qcronsub -N dbbot_wm -m n -j y -b y -l h_rt=INFINITY -l
virtual_free=90M "/home/krinkle/bots/dbbot-wm-start.sh"

Unable to run job: Script not executable: /home/krinkle/bots/dbbot-wm-start.sh.
Exiting.
warning: Please add the os this job can run on by adding parameter -l 
arch='*'|sol|lx
For more information read documentation at 
https://wiki.toolserver.org/view/Job_scheduling


As this is a php script, your parameter would be «-l arch='*'»



Yes, I've added `-l arch='*'` to it already a minute ago.

Warnings are gone, not sure why it nagged about maximum runtime, it already has 
INFINITY.

I'm not sure why arch=x isn't the default though, or maybe it is but outputs 
the warning anyway?
A warning like that may be useful, but do consider that cronie from submit will 
send e-mails for it.

-- Krinkle
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette



___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Future of the toolserver

[DaB.]

Hello all,

in these days WMDE (the chapter that finance the toolserver) is discussing the 
budget for the next year (2013); you can find it at [1]. At the moment there is 
no money for new toolserver-hardware in this budget and the CEO Pavel Richter 
is unwilling to change this ([2] in german) – because he fears that there will 
be a Wikilabs in 2014. It is not possible for me to run the toolserver for 
another year with the current hardware – you all know why. For this reason I 
will request a change of the budget at the general meeting at November, so 
there will be a vote about. If this vote should fail (and we get no money for 
new hardware), I am going to retire from my job as root at 30. December 2012.
I'm not longer able to tolerant the behavior of the german chapter and the WMF 
in matter of the toolserver; I do this for free and for fun, and it is not 
longer fun.

Sincerely,
DaB.

P.S: If you are in a board of a chapter that gives money to WMDE for the 
toolserver: Make sure that it will be spend for hardware. 

[1] 
http://meta.wikimedia.org/wiki/Wikimedia_Deutschland/2013_annual_plan_draft/en
[2] 
meta.wikimedia.org/wiki/Talk:Wikimedia_Deutschland/2013_annual_plan_draft/de#Toolserver

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Fwd: Fwd: Learning Git/Gerrit? Answer poll to choose tutorial date

[Lewis Cawte]

 Original Message 
Subject:Fwd: Learning Git/Gerrit? Answer poll to choose tutorial date
Date:   Mon, 24 Sep 2012 15:42:07 -0400
From:   Sumana Harihareswara 
Organisation:   Wikimedia Foundation
To: 	Lewis Cawte , Jon Robson 
, Maarten Dammers 
, Butch Bustria 
, Yuvi Panda 




Would you mind helping me out by forwarding/reposting this to relevant
Wikimedia communities? Tool/bot makers, people who want to learn to hack
MediaWiki, mobile developers, etc.

Thanks!
-Sumana


 Original Message 
Subject: Learning Git/Gerrit? Answer poll to choose tutorial date
Date: Mon, 24 Sep 2012 15:39:25 -0400
From: Sumana Harihareswara 
Organization: Wikimedia Foundation
To: Wikimedia developers 

Git, Gerrit, and You! A Tutorial

Where:  IRC/SIP/SSH

We want all our developers to feel comfortable with Git, git-review, and
Gerrit. So saper is leading a hands-on online training:
https://www.mediawiki.org/wiki/Project:WikiProject_Extensions/MediaWiki_Workshops/Git_/_Gerrit_Tutorial
. Check [[Git/Workshop]] for testing access to the conference & lab setup.

Saper will be available for 3 hours, and there'll be a break in the
middle. Absolute beginners with Git might want to stay for the whole
three hours; people with some experience won't need as long.

Answer this poll to help saper choose a date: 17:30 UTC on 26 September,
27 September, 2 October, or 3 October.

http://www.doodle.com/pbdbrcrh5gdpvrfu

If you want to attend, please also answer this question: how much do you
already know?

http://www.doodle.com/zhn7buksgrg8e8rx

Thanks for doing this, saper.

--
Sumana Harihareswara
Engineering Community Manager
Wikimedia Foundation





___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Trouble with shell file encoding

[Hercule Hercule]

Hello,

I'm not sure to have understood what I did, but I changed the encoding
of the batch file with SCP (from UTF-8 to 1252) and now it works fine.

Thanks for your help.

Regards

Hercule

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Very slow connections to the sql servers

[Platonides]

I am seeing my tools very slow connecting to the sql servers, such as
taking 33 or 79 seconds
just for figuring out the right server and connecting to it, and even
failing with «Can't connect to
MySQL server on 'sql-s4-rr.toolserver.org'» (not only on this server)

Are sql servers overloaded? Is it a problem with willow? Should we give
a kick to the tcp stack?

This anomaly is also visible from the command line, varying from immediate
connection to slow one:

$ time mysql -h sql-s4-rr.toolserver.org  -e 'SELECT VERSION()'
+---+
| VERSION() |
+---+
| 5.1.59|
+---+

real0m0.098s
user0m0.003s
sys 0m0.009s

# Shouldn't it always so quick?

$ time mysql -h sql-s4-rr.toolserver.org  -e 'SELECT VERSION()'
+---+
| VERSION() |
+---+
| 5.1.59|
+---+

real0m4.803s
user0m0.003s
sys 0m0.009s

$ time mysql -h sql-s4-rr.toolserver.org  -e 'SELECT VERSION()'
+---+
| VERSION() |
+---+
| 5.1.59|
+---+

real0m1.619s
user0m0.003s
sys 0m0.009s

$ time mysql -h sql-s4-rr.toolserver.org  -e 'SELECT VERSION()'
+---+
| VERSION() |
+---+
| 5.1.59|
+---+

real0m4.222s
user0m0.003s
sys 0m0.009s

$ time mysql -h sql-s4-rr.toolserver.org  -e 'SELECT VERSION()'
+---+
| VERSION() |
+---+
| 5.1.59|
+---+

real0m15.434s
user0m0.003s
sys 0m0.008s

 $ time mysql -h sql-s3-rr.toolserver.org  -e 'SELECT VERSION()'
+---+
| VERSION() |
+---+
| 5.1.59|
+---+

real0m13.463s
user0m0.003s
sys 0m0.009s

$ time mysql -h sql-s3-rr.toolserver.org  -e 'SELECT VERSION()'
+---+
| VERSION() |
+---+
| 5.1.59|
+---+

real0m2.356s
user0m0.003s
sys 0m0.009s

$ time mysql -h sql-s3-rr.toolserver.org  -e 'SELECT VERSION()'
+---+
| VERSION() |
+---+
| 5.1.59|
+---+

real0m1.850s
user0m0.003s
sys 0m0.008s

$ time mysql -h sql-s3-rr.toolserver.org  -e 'SELECT VERSION()'
+---+
| VERSION() |
+---+
| 5.1.59|
+---+

real0m24.724s
user0m0.003s
sys 0m0.008s


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] qcronsub warning: "Please add maximum runtime"

[Krinkle]

On Sep 24, 2012, at 6:20 PM, Platonides  wrote:

> On 24/09/12 18:07, Krinkle wrote:
>> Can someone decode this? What is this?
>> 
>> -- Krinkle
>> 
>> 
>> Begin forwarded message:
>> 
>>> *From: *r...@toolserver.org  (Cron Daemon)
>>> *Subject: **Cron  qcronsub -N dbbot_wm -m n -j y -b
>>> y -l h_rt=INFINITY -l virtual_free=90M "$HOME/bots/dbbot-wm-start.sh"*
>>> *Date: *September 24, 2012 6:05:07 PM GMT+02:00
>>> *To: *krin...@toolserver.org 
>>> 
>>> warning: Please add maximum runtime by adding parameter -l
>>> arch=sol|lx
> 
> The text asks you to place a time limit. The parameter (embedded in
> posix colors despite not being output to a terminal) to specify if it
> needs a linux or solaris server.
> 
> However, if I try to execute it, I get a much saner message:
> $ qcronsub -N dbbot_wm -m n -j y -b y -l h_rt=INFINITY -l
> virtual_free=90M "/home/krinkle/bots/dbbot-wm-start.sh"
>> Unable to run job: Script not executable: 
>> /home/krinkle/bots/dbbot-wm-start.sh.
>> Exiting.
>> warning: Please add the os this job can run on by adding parameter -l 
>> arch='*'|sol|lx
>> For more information read documentation at 
>> https://wiki.toolserver.org/view/Job_scheduling
> 
> As this is a php script, your parameter would be «-l arch='*'»
> 

Yes, I've added `-l arch='*'` to it already a minute ago.

Warnings are gone, not sure why it nagged about maximum runtime, it already has 
INFINITY.

I'm not sure why arch=x isn't the default though, or maybe it is but outputs 
the warning anyway?
A warning like that may be useful, but do consider that cronie from submit will 
send e-mails for it.

-- Krinkle
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] qcronsub warning: "Please add maximum runtime"

[Platonides]

On 24/09/12 18:07, Krinkle wrote:
> Can someone decode this? What is this?
> 
> -- Krinkle
> 
> 
> Begin forwarded message:
> 
>> *From: *r...@toolserver.org  (Cron Daemon)
>> *Subject: **Cron  qcronsub -N dbbot_wm -m n -j y -b
>> y -l h_rt=INFINITY -l virtual_free=90M "$HOME/bots/dbbot-wm-start.sh"*
>> *Date: *September 24, 2012 6:05:07 PM GMT+02:00
>> *To: *krin...@toolserver.org 
>>
>> warning: Please add maximum runtime by adding parameter -l
>> arch=sol|lx

The text asks you to place a time limit. The parameter (embedded in
posix colors despite not being output to a terminal) to specify if it
needs a linux or solaris server.

However, if I try to execute it, I get a much saner message:
$ qcronsub -N dbbot_wm -m n -j y -b y -l h_rt=INFINITY -l
virtual_free=90M "/home/krinkle/bots/dbbot-wm-start.sh"
> Unable to run job: Script not executable: 
> /home/krinkle/bots/dbbot-wm-start.sh.
> Exiting.
> warning: Please add the os this job can run on by adding parameter -l 
> arch='*'|sol|lx
> For more information read documentation at 
> https://wiki.toolserver.org/view/Job_scheduling

As this is a php script, your parameter would be «-l arch='*'»

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] qcronsub warning: "Please add maximum runtime"

[Krinkle]

Can someone decode this? What is this?

-- Krinkle


Begin forwarded message:

> From: r...@toolserver.org (Cron Daemon)
> Subject: Cron  qcronsub -N dbbot_wm -m n -j y -b y -l 
> h_rt=INFINITY -l virtual_free=90M "$HOME/bots/dbbot-wm-start.sh"
> Date: September 24, 2012 6:05:07 PM GMT+02:00
> To: krin...@toolserver.org
> 
> warning: Please add maximum runtime by adding parameter -l 
> arch=sol|lx

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Web servers unresponsive

[DaB.]

Hello,
At Monday 24 September 2012 17:06:54 DaB. wrote:
> Can you kill them?

The Query-Killer did already.

> 
> I always connect to login.toolserver.org. How do I change to rosemary?

You can't connect to rosemary with SSH; but you don't need. You can either use 
mysql (see Platonides' mail) or mytop (which works better for this in my 
eyes).

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Web servers unresponsive

[Platonides]

On 24/09/12 15:03, emijrp wrote:
> Can you kill them?
> 
> I always connect to login.toolserver.org .
> How do I change to rosemary?

rosemary is a sql server.

You'd do something like this:

> $ mysql -h rosemary
>
> mysql> show full processlist;
> +---++-+--+-+--+---+---+
> | Id| User   | Host| db   | Command | 
> Time | State | Info  |
> +---++-+--+-+--+---+---+
> | 142886093 | platonides | willow.toolserver.org:62886 | NULL | Query   |
> 0 | NULL  | show full processlist |
> +---++-+--+-+--+---+---+
> 1 row in set (0.00 sec)
>
> mysql> kill 142886093;

Of course, you would have some problems doing it when you can't even
connect to the server :)

I had the same problem on Saturday with s2-rr, even after killing all
php.fcgi instances on the webservers (the ones from which those 15
connections could have originated), the server wasn't allowing me to
connect.


While we're blaming the sql servers, I had a script failing this night
with «Lost connection to MySQL server at 'reading initial communication
packet', system error: 0 (sql-s3-rr.toolserver.org)» but it is working
to now.


Regards

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Web servers unresponsive

[emijrp]

Can you kill them?

I always connect to login.toolserver.org. How do I change to rosemary?

2012/9/24 DaB. 

> Hello,
> At Monday 24 September 2012 14:28:26 DaB. wrote:
> > oursql.ProgrammingError: (1226, "User 'emijrp' has exceeded the
> > 'max_user_connections' resource (current value: 15)", None)
>
> it is way more helpful when you tell me the cluster ;-).
>
> AFAIS you have 15 long-running-tasks at rosemary at the moment.
>
> Sincerely,
> DaB.
>
>
> --
> Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>



-- 
Emilio J. Rodríguez-Posada. E-mail: emijrp AT gmail DOT com
Pre-doctoral student at the University of Cádiz (Spain)
Projects: AVBOT  |
StatMediaWiki
| WikiEvidens  |
WikiPapers
| WikiTeam 
Personal website: https://sites.google.com/site/emijrp/
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Restarted query-killer

[DaB.]

Hello all,

last night reboots on hemlock killed the query-killer. I just restarted it. 
You if you get a bunch of mails from it now, there is nothing to worry.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Web servers unresponsive

[DaB.]

Hello,
At Monday 24 September 2012 14:28:26 DaB. wrote:
> oursql.ProgrammingError: (1226, "User 'emijrp' has exceeded the
> 'max_user_connections' resource (current value: 15)", None)

it is way more helpful when you tell me the cluster ;-).

AFAIS you have 15 long-running-tasks at rosemary at the moment.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Web servers unresponsive

[emijrp]

I'm having issues while running scripts.

oursql.ProgrammingError: (1226, "User 'emijrp' has exceeded the
'max_user_connections' resource (current value: 15)", None)

I don't see any other script in my top. Perhaps zombie queries from the
last hours issues?

2012/9/23 DaB. 

> Hello again,
> At Sunday 23 September 2012 23:47:18 DaB. wrote:
> > I restored the web-access now. As far as I see hemlock lost its external
> > array  and became out of memory around 2:30 UTC. I have no idea why this
> > influence our webserver. I rebooted hemlock to free the memory and
> > restarted the webserver on ortelius and wolfsbane; the webpages are back
> > AFAIS.
> > What is not working at the moment is the user-store and our backup,
> > because  both are on the external array of hemlock. Also not working is
> > munin, which is handled by hemlock. I will try to fix all this, but I
> > guess I need nosy for that (and in the worst case Mark in the colo).
>
> just an update: Nosy came online and fixed the partitions so they were
> recognized again by hemlock. Than we rebooted hemlock to check if
> everything
> was working again, and that failed. So we fixed it again (what needed
> another
> reboot) and manually fixed the non-working stuff.
> So in short: Everything should work again now (as long as hemlock will not
> be
> rebooted). I will try to investigate why Zeus (our webserver-program) was
> not
> working without hemlock in the next day. We also will have a maintenance-
> window later this week (will tell details in another mail) to fix hemlock
> properly.
>
> Sincerely,
> DaB.
>
>
> --
> Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>



-- 
Emilio J. Rodríguez-Posada. E-mail: emijrp AT gmail DOT com
Pre-doctoral student at the University of Cádiz (Spain)
Projects: AVBOT  |
StatMediaWiki
| WikiEvidens  |
WikiPapers
| WikiTeam 
Personal website: https://sites.google.com/site/emijrp/
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Trouble with shell file encoding

[Hercule Hercule]

I used set to configure LC_ALL and LANG. Now, when I run "set" in the
terminal (from putty) I have

LANG=fr_FR.UTF-8
LC_ALL=fr_FR.UTF-8

The command line "cronie -l" give

LC_ALL=fr_FR.UTF-8
44 11 * * * newtask -p batch /home/hercule/batch/LienHu.sh

and I have no more error when saving.

The command line "tail -f LienHu.sh" give

#!/bin/bash
#-*- coding: utf-8 -*-
#!/usr/bin/python
python /home/hercule/template.py "Ideig" "Ideig/Automatikus törlés"
-cat:"Lapok láthatatlanná vált ideig sablonnal" -summary:"Bot: {{Ideig}}
sablonhívás törlése a cikk létrehozása következtében" -assubst -pt:0
-lang:hu -always
python /home/hercule/template.py "Linkiw" "Linkiw/Automatikus törlés"
-cat:"Lapok láthatatlanná vált linkiw sablonnal" -summary:"Bot: {{Linkiw}}
sablonhívás törlése a cikk létrehozása következtében" -assubst -pt:0
-lang:hu -always
python /home/hercule/template.py "Piroslink" "Piroslink/Automatikus
lecserélés" -cat:"Lapok felesleges piroslink sablonnal" -summary:"Bot:
{{Piroslink}} sablonhívás lecserélése a cikk létrehozása következtében"
-assubst -lang:hu -always
python /home/hercule/template.py "Piroslink*" "Piroslink*/Automatikus
lecserélés" -cat:"Lapok felesleges piroslink sablonnal" -summary:"Bot:
{{Piroslink*}} sablonhívás lecserélése a cikk létrehozása következtében"
-assubst -lang:hu -alwayspython /home/hercule/template.py "Ideig"
"Ideig/Automatikus törlés" -cat:"Lapok láthatatlanná vált ideig sablonnal"
-summary:"Bot: {{Ideig}} sablonhívás törlése a cikk létrehozása
következtében" -assubst -pt:0 -lang:hu -always
python /home/hercule/template.py "Linkiw" "Linkiw/Automatikus törlés"
-cat:"Lapok láthatatlanná vált linkiw sablonnal" -summary:"Bot: {{Linkiw}}
sablonhívás törlése a cikk létrehozása következtében" -assubst -pt:0
-lang:hu -always
python /home/hercule/template.py "Piroslink" "Piroslink/Automatikus
lecserélés" -cat:"Lapok felesleges piroslink sablonnal" -summary:"Bot:
{{Piroslink}} sablonhívás lecserélése a cikk létrehozása következtében"
-assubst -lang:hu -always
python /home/hercule/template.py "Piroslink*" "Piroslink*/Automatikus
lecserélés" -cat:"Lapok felesleges piroslink sablonnal" -summary:"Bot:
{{Piroslink*}} sablonhívás lecserélése a cikk létrehozása következtében"
-assubst -lang:hu -always

Now, I just wait that the cron is launch, and the result is wrong on
hu.wikipedia :
http://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91%3AOliv0&diff=12371170&oldid=12371163

I see no error messages anymore, but there is still a problem of encoding
while using cronie

Regards

Hercule

2012/9/24 DaB. 

> Hello,
> At Monday 24 September 2012 12:46:52 DaB. wrote:
> > I have tried the cronie solutions, (with LC_ALL=fr_FR.UTF-8 on cronie)
> but
> > there is a message when saving :
> >
> > couldn't set locale correctly
> > couldn't set locale correctly
> > cronie: installing new crontab
> >
> > For the export in the script, it fail with message
> >
> > /home/hercule/batch/LienHu.sh: LANG=fr_FR.utf8: n'est pas un
> identificateur
>
> As you can see (the error-message is in French) the export worked somewhere
> :-).
>
> Please notice 4 things:
> -LC_ALL and LANG is not the same (see [1] for details).
> -fr_FR.utf8 is wrong most times, use fr_FR.UTF-8
> -Use "#!/bin/bash" in shell-scripts at the 1 line
> -Please tell us always WHERE something failed (on which box).
>
> Sincerely,
> DaB.
>
> [1] http://pubs.opengroup.org/onlinepubs/007908799/xbd/envvar.html
>
> --
> Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Trouble with shell file encoding

[DaB.]

Hello,
At Monday 24 September 2012 12:46:52 DaB. wrote:
> I have tried the cronie solutions, (with LC_ALL=fr_FR.UTF-8 on cronie) but
> there is a message when saving :
> 
> couldn't set locale correctly
> couldn't set locale correctly
> cronie: installing new crontab
> 
> For the export in the script, it fail with message
> 
> /home/hercule/batch/LienHu.sh: LANG=fr_FR.utf8: n'est pas un identificateur

As you can see (the error-message is in French) the export worked somewhere 
:-).

Please notice 4 things:
-LC_ALL and LANG is not the same (see [1] for details).
-fr_FR.utf8 is wrong most times, use fr_FR.UTF-8
-Use "#!/bin/bash" in shell-scripts at the 1 line
-Please tell us always WHERE something failed (on which box).

Sincerely,
DaB.

[1] http://pubs.opengroup.org/onlinepubs/007908799/xbd/envvar.html

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Trouble with shell file encoding

[Hercule Hercule]

I have tried the cronie solutions, (with LC_ALL=fr_FR.UTF-8 on cronie) but
there is a message when saving :

couldn't set locale correctly
couldn't set locale correctly
cronie: installing new crontab

For the export in the script, it fail with message

/home/hercule/batch/LienHu.sh: LANG=fr_FR.utf8: n'est pas un identificateur

or

/home/hercule/batch/LienHu.sh: LANG=hu_HU.UTF-8: is not an identifier

I have also tried the command line

export LANG=fr_FR.utf8

in the terminal but it doesn't change anything.

I don't understand where the problem comes from.

Hercule

2012/9/24 Danny B. 

> >  Původní zpráva 
> > Od: Hercule Hercule 
> > Předmět: [Toolserver-l] Trouble with shell file encoding
> > Datum: 24.9.2012 10:20:55
> > 
> > Hello,
> >
> > I have some troubles with a script I run on hu.wikipedia.
> >
> > I have created a script, which name is LienHu.sh and content is
> >
> > #-*- coding: utf-8 -*-
> > #!/usr/bin/python
> > python /home/hercule/template.py "Ideig" "Ideig/Automatikus törlés"
> > -cat:"Lapok láthatatlanná vált ideig sablonnal" -summary:"Bot: {{Ideig}}
> > sablonhívás törlése a cikk létrehozása következtében" -assubst -pt:0
> > -lang:hu -always
> > python /home/hercule/template.py "Linkiw" "Linkiw/Automatikus törlés"
> > -cat:"Lapok láthatatlanná vált linkiw sablonnal" -summary:"Bot:
> {{Linkiw}}
> > sablonhívás törlése a cikk létrehozása következtében" -assubst -pt:0
> > -lang:hu -always
> > python /home/hercule/template.py "Piroslink" "Piroslink/Automatikus
> > lecserélés" -cat:"Lapok felesleges piroslink sablonnal" -summary:"Bot:
> > {{Piroslink}} sablonhívás lecserélése a cikk létrehozása következtében"
> > -assubst -lang:hu -always
> > python /home/hercule/template.py "Piroslink*" "Piroslink*/Automatikus
> > lecserélés" -cat:"Lapok felesleges piroslink sablonnal" -summary:"Bot:
> > {{Piroslink*}} sablonhívás lecserélése a cikk létrehozása következtében"
> > -assubst -lang:hu -always
> >
> > This file is encoded in UTF-8
> >
> > When I run the command line
> >
> > ./LienHu.sh in my folder I have a correct execution (see
> >
> http://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91:Oliv0&diff=12370416&oldid=12370415
> >  )
> >
> > But when I run it with cronie :
> >
> > 9 8 * * * newtask -p batch /home/hercule/batch/LienHu.sh
> >
> > There are problems with text encoding (see
> >
> http://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91:Oliv0&diff=12370388&oldid=12370384
> >  )
> >
> > I need help to solve this file encoding problem.
> >
> > Regards
> >
> > Antoine alias Hercule
>
> Somebody suggested me in past to put
>
> LC_ALL=en_US.UTF-8
>
> as the very first line in crontab. So I did and no longer have issues.
>
>
> Kind regards
>
>
> Danny B.
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Trouble with shell file encoding

[Danny B .]

>  Původní zpráva 
> Od: Hercule Hercule 
> Předmět: [Toolserver-l] Trouble with shell file encoding
> Datum: 24.9.2012 10:20:55
> 
> Hello,
> 
> I have some troubles with a script I run on hu.wikipedia.
> 
> I have created a script, which name is LienHu.sh and content is
> 
> #-*- coding: utf-8 -*-
> #!/usr/bin/python
> python /home/hercule/template.py "Ideig" "Ideig/Automatikus törlés"
> -cat:"Lapok láthatatlanná vált ideig sablonnal" -summary:"Bot: {{Ideig}}
> sablonhívás törlése a cikk létrehozása következtében" -assubst -pt:0
> -lang:hu -always
> python /home/hercule/template.py "Linkiw" "Linkiw/Automatikus törlés"
> -cat:"Lapok láthatatlanná vált linkiw sablonnal" -summary:"Bot: {{Linkiw}}
> sablonhívás törlése a cikk létrehozása következtében" -assubst -pt:0
> -lang:hu -always
> python /home/hercule/template.py "Piroslink" "Piroslink/Automatikus
> lecserélés" -cat:"Lapok felesleges piroslink sablonnal" -summary:"Bot:
> {{Piroslink}} sablonhívás lecserélése a cikk létrehozása következtében"
> -assubst -lang:hu -always
> python /home/hercule/template.py "Piroslink*" "Piroslink*/Automatikus
> lecserélés" -cat:"Lapok felesleges piroslink sablonnal" -summary:"Bot:
> {{Piroslink*}} sablonhívás lecserélése a cikk létrehozása következtében"
> -assubst -lang:hu -always
> 
> This file is encoded in UTF-8
> 
> When I run the command line
> 
> ./LienHu.sh in my folder I have a correct execution (see
> http://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91:Oliv0&diff=12370416&oldid=12370415
>  )
> 
> But when I run it with cronie :
> 
> 9 8 * * * newtask -p batch /home/hercule/batch/LienHu.sh
> 
> There are problems with text encoding (see
> http://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91:Oliv0&diff=12370388&oldid=12370384
>  )
> 
> I need help to solve this file encoding problem.
> 
> Regards
> 
> Antoine alias Hercule

Somebody suggested me in past to put

LC_ALL=en_US.UTF-8

as the very first line in crontab. So I did and no longer have issues.


Kind regards


Danny B.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Trouble with shell file encoding

[Wolfgang ten Weges]

Hi ;

There's probably a global way to this, but you can add the following 
line locally before the first python line of your script (I have fr, put 
your local equivalent instead) :


export LANG="fr_FR.UTF-8"

it *should* do the trick.

Wolfgang ten Weges / DarkoNeko

Le 24/09/2012 10:20, Hercule Hercule a écrit :

Hello,

I have some troubles with a script I run on hu.wikipedia.

I have created a script, which name is LienHu.sh and content is

#-*- coding: utf-8 -*-
#!/usr/bin/python
python /home/hercule/template.py "Ideig" "Ideig/Automatikus törlés" 
-cat:"Lapok láthatatlanná vált ideig sablonnal" -summary:"Bot: 
{{Ideig}} sablonhívás törlése a cikk létrehozása következtében" 
-assubst -pt:0 -lang:hu -always
python /home/hercule/template.py "Linkiw" "Linkiw/Automatikus törlés" 
-cat:"Lapok láthatatlanná vált linkiw sablonnal" -summary:"Bot: 
{{Linkiw}} sablonhívás törlése a cikk létrehozása következtében" 
-assubst -pt:0 -lang:hu -always
python /home/hercule/template.py "Piroslink" "Piroslink/Automatikus 
lecserélés" -cat:"Lapok felesleges piroslink sablonnal" -summary:"Bot: 
{{Piroslink}} sablonhívás lecserélése a cikk létrehozása 
következtében" -assubst -lang:hu -always
python /home/hercule/template.py "Piroslink*" "Piroslink*/Automatikus 
lecserélés" -cat:"Lapok felesleges piroslink sablonnal" -summary:"Bot: 
{{Piroslink*}} sablonhívás lecserélése a cikk létrehozása 
következtében" -assubst -lang:hu -always


This file is encoded in UTF-8

When I run the command line

./LienHu.sh in my folder I have a correct execution (see 
http://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91:Oliv0&diff=12370416&oldid=12370415 )


But when I run it with cronie :

9 8 * * * newtask -p batch /home/hercule/batch/LienHu.sh

There are problems with text encoding (see 
http://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91:Oliv0&diff=12370388&oldid=12370384 )


I need help to solve this file encoding problem.

Regards

Antoine alias Hercule


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Trouble with shell file encoding

[Hercule Hercule]

Hello,

I have some troubles with a script I run on hu.wikipedia.

I have created a script, which name is LienHu.sh and content is

#-*- coding: utf-8 -*-
#!/usr/bin/python
python /home/hercule/template.py "Ideig" "Ideig/Automatikus törlés"
-cat:"Lapok láthatatlanná vált ideig sablonnal" -summary:"Bot: {{Ideig}}
sablonhívás törlése a cikk létrehozása következtében" -assubst -pt:0
-lang:hu -always
python /home/hercule/template.py "Linkiw" "Linkiw/Automatikus törlés"
-cat:"Lapok láthatatlanná vált linkiw sablonnal" -summary:"Bot: {{Linkiw}}
sablonhívás törlése a cikk létrehozása következtében" -assubst -pt:0
-lang:hu -always
python /home/hercule/template.py "Piroslink" "Piroslink/Automatikus
lecserélés" -cat:"Lapok felesleges piroslink sablonnal" -summary:"Bot:
{{Piroslink}} sablonhívás lecserélése a cikk létrehozása következtében"
-assubst -lang:hu -always
python /home/hercule/template.py "Piroslink*" "Piroslink*/Automatikus
lecserélés" -cat:"Lapok felesleges piroslink sablonnal" -summary:"Bot:
{{Piroslink*}} sablonhívás lecserélése a cikk létrehozása következtében"
-assubst -lang:hu -always

This file is encoded in UTF-8

When I run the command line

./LienHu.sh in my folder I have a correct execution (see
http://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91:Oliv0&diff=12370416&oldid=12370415
 )

But when I run it with cronie :

9 8 * * * newtask -p batch /home/hercule/batch/LienHu.sh

There are problems with text encoding (see
http://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91:Oliv0&diff=12370388&oldid=12370384
 )

I need help to solve this file encoding problem.

Regards

Antoine alias Hercule
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette