Re: [Toolserver-l] Batch image manipulation tools running into Labs

[Alex Brollo]

I apologyze, I sent my mail to wrong list me stupid, damned hurry.

Alex


2014-02-05 Alex Brollo :

> I'd like to build a simple application to:
> 1. extract images from one or more  pdf file/files converting them into
> tiff/jpg images;
> 2.  autocrop them (to remove a white margin), then split them, since
> images are two-pages scans that need to be splitted into single-page images;
> 3a . load the resulting images into a zip file or
> 3b. wrap them again into a pdf file with a lossless compression.
>
> Presently I'm doing the job using a local routine into my PC, and I use
> nconvert for step 1, and python (with PIL) for steps 2-3a.
>
> I better would like to to this job into Labs; the best being, to addo
> routines to grab files from an URL and to load them into Internet Archive.
>
> Just to avoid "rediscovering the wheel", is someone doing something
> similar into Labs?
>
> If the wheel has to be built ;-) , which tools have I to (painfully) study
> and test?
>
> Can I install nconvert for linux into my account for personal use?
>
> Alex (from it.wikisource)
>
>
>
>
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Batch image manipulation tools running into Labs

[Alex Brollo]

I'd like to build a simple application to:
1. extract images from one or more  pdf file/files converting them into
tiff/jpg images;
2.  autocrop them (to remove a white margin), then split them, since images
are two-pages scans that need to be splitted into single-page images;
3a . load the resulting images into a zip file or
3b. wrap them again into a pdf file with a lossless compression.

Presently I'm doing the job using a local routine into my PC, and I use
nconvert for step 1, and python (with PIL) for steps 2-3a.

I better would like to to this job into Labs; the best being, to addo
routines to grab files from an URL and to load them into Internet Archive.

Just to avoid "rediscovering the wheel", is someone doing something similar
into Labs?

If the wheel has to be built ;-) , which tools have I to (painfully) study
and test?

Can I install nconvert for linux into my account for personal use?

Alex (from it.wikisource)
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Retirement as root at 3. January 2014

[Alex Brollo]

Let's we go and backup my layman files.

A great thanks by Alebot :-(

Alex


2013/11/16 DaB. 

> Hello all,
>
> as I announced before I will retire in a few weeks. To give you all a
> exact date and so some dependability in planing, I hereby announce to
> retire as root at
>
> FRIDAY, 3. January 2014 24:00 MEZ.
>
> I will use most of this day for clean-up, so if you want something you
> should contact me the day before. After the date I will not be able to
> re-new accounts, add ssh-keys or clean-up /tmp-partitions (so Wolfsbane
> will become unavailable more often). If you need something after the
> date, please try to reach Nosy or Amette during their work-hours.
>
> Two days later my normal account will expire, which will end my work for
> the Toolserver. I will send a last mail to you all than.
>
>
> Sincerely,
> DaB.
>
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] TS and/vs. Labs

[Alex Brollo]

Thanks, I listed into labs-l and I logged into  #wikimedia-labs , I hope I
will get help  presently I found blocking issues bot in compat and in
core, I'll ask there.

Everyway, I keep my Toolserver account alive :-)

Alex


2013/8/11 Silke Meyer 

> Hi Alex,
>
> cool that you are having a go for Tool Labs. I really recommend the
> #wikimedia-labs channel. People help each other a lot. I consider it
> newby-friendly. Also on labs-l, I asked a lot of things myself and always
> got helpful replies.
>
> Cheers, Silke
>
>
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] TS and/vs. Labs

[Alex Brollo]

I don't know precisely what's happening, my skill & knowledge is barely
sufficient to have a vague idea of what I'm doing; I just began to explore
Labs  I can only say thanks to DaB for opportunity and help that I
fastly got when needed.

Alex


2013/8/10 Magnus Manske 

> If you're asking "is it safe to move tools to Labs", my experience so far
> say "yes". I can't speak for all unique toolserver features, though.
>
> Cheers,
> Magnus
>
>
> On Sat, Aug 10, 2013 at 10:36 AM, Dr. Trigon  wrote:
>
>> -BEGIN PGP SIGNED MESSAGE-
>> Hash: SHA1
>>
>> Hello DaB!
>>
>> Could you please give me a short update - the end of 2013 is
>> approaching, what is the current state for TS resp. Labs?
>>
>> Thanks and Greetings
>> DrTrigon
>> -BEGIN PGP SIGNATURE-
>> Version: GnuPG v1.4.13 (GNU/Linux)
>> Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
>>
>> iEYEARECAAYFAlIGCboACgkQAXWvBxzBrDAKPwCgjsEcGfRtbKaw/eDwTxNhUFfo
>> XgwAoLzV6J+TCdJZ3lvwvkqsMWihQmr+
>> =1dN+
>> -END PGP SIGNATURE-
>>
>> ___
>> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
>> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
>> Posting guidelines for this list:
>> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
>
>
>
> --
> undefined
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Linux/Solaris Lua on Toolserver: is it possible?

[Alex Brollo]

Oppps... I only "work" (work is something too much for what I do... o_O )
logging into willow, that's Solaris if I'm not going wrong. . No matter,
I'll browse toolserver wiki to see as I can login into a Linux server,  and
if I'll find troubles I'll ask for help.

Thanks.
Alex


2013/5/31 DaB. 

> Hello,
> At Friday 31 May 2013 15:21:23 DaB. wrote:
> > What about building a Lua bot framework or - at least - install Lua into
> > Toolserver?
>
> the linux hosts have already lua-packages installed AFAIS. Feel free to
> play
> with it.
>
> Sincerely,
> DaB.
>
>
> --
> Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Linux/Solaris Lua on Toolserver: is it possible?

[Alex Brollo]

While painfully studying one more language :-( (Lua... ) I saw that it can
run into any SO and that it has CGI interface (tell me if I'm wrong).

What about building a Lua bot framework or - at least - install Lua into
Toolserver? Is it a crazy idea? Perhaps using the same language in two
settings (modules and server scripst) could be useful.

Alex brollo
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] My fading out

[Alex Brollo]

Recently I needed help, and I got it from DaB - a kind and fast support.
I can't say but thanks, DaB.

Alex


2013/5/29 Marlen Caemmerer 

> Hello,
>
>
>
>
>>  > less and less work for the Toolserver until I am not longer visible. I
>>> > announce that this early because I think it is fair for you to know
>>> that
>>> > will happen and I like not just to vanish like some roots before.
>>> > > [...]
>>>
>>> JFC, what a bunch of self-pitying bullshit.
>>>
>>>
> It might seem so but I dont know if anyone can imagine how frustrating
> this administration can be.
> One tries to repair something but already when you want to start something
> else is broken and you first go fix it.
> This happens since I am working on TS.
> I guess DaB has the same problem and if this was my spare time project I
> probably would have quit before.
>
> As far as I know DaB put a lot of this time into TS.
>
>
>
>>  You used your
>>> Toolserver privileges at least in the last year mainly for
>>> political campaigning.  You neither fixed the simple issues
>>> nor planned ahead for example the Solaris to Linux migration
>>> that then had to be done in a jiffy, but actively blocked
>>> any offer of help.
>>>
>>
>>
> Well finally I think it really was a good idea to force a road map for
> this project.
> Forcing this worked I think best from the community side.
>
> Fixing all these little issues is really sometimes harder then it might
> look from the outside.
>
>
>  Everybody has the right to leave, but don't try to put the
>>> blame on others.  The Toolserver users have had a *lot* of
>>> patience with you and your quirks.
>>>
>>
>> And I’m thankful for the patience.
>>
>
> I dont think there will be any other admin that does make no mistakes here.
> The infrastructure of TS is quite flat and not always much redundancy so
> users will notice.
> Additionally the system has such a lot of little things working together
> that this just happens.
>
> And yes, it makes sense to build something new from the start as Kolossos
> said.
>
> Thank you, DaB for volunteering here so patiently.
>
>
> Kind regards
> Marlen/nosy
>
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Two questions about pywikipedia

[Alex Brollo]

Let's try .

OK! I didn't try this previously. Under qsub .environment PYTHONPATH  is
ignored.

Thanks!

Alex


2013/5/18 John 

> I always include:
> import sys
> import os
> sys.path.append("PATH_TO_PYWIKIFOLDER")
> in all my scripts before I try to import wikipedia that should fix your
> issue
>
>
> On Fri, May 17, 2013 at 6:29 PM, Alex Brollo wrote:
>
>> As I told, I'm driving a pywikipedia bot (Alebot) into willow; I
>> installed pywikipedia at $HOME, I set
>>
>> PYTHONPATH=/home/alebot/pywikipedia [,.]
>>
>> into .environment file, and I am reviewing at my best python scripts to
>> run them by qsub/qcronsub.
>>
>> Most of my scripts obviously need a statement:
>>
>> import wikipedia [,.]
>>
>> My questions:
>> 1. Do I really need to install pywikipedia into $HOME?
>> 2. My scripts run happily outside SGE, but when I try to run them under
>> SGE I get an error:
>> ImportError: No module named wikipedia
>>
>> I didn't find doc for this ImportError (I suppose, PYTHONPATH is wrong).
>>
>> Where am I going wrong?
>>
>> Alex
>>
>>
>>
>> ___
>> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
>> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
>> Posting guidelines for this list:
>> https://wiki.toolserver.org/view/Mailing_list_etiquette
>>
>
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Two questions about pywikipedia

[Alex Brollo]

As I told, I'm driving a pywikipedia bot (Alebot) into willow; I installed
pywikipedia at $HOME, I set

PYTHONPATH=/home/alebot/pywikipedia [,.]

into .environment file, and I am reviewing at my best python scripts to run
them by qsub/qcronsub.

Most of my scripts obviously need a statement:

import wikipedia [,.]

My questions:
1. Do I really need to install pywikipedia into $HOME?
2. My scripts run happily outside SGE, but when I try to run them under SGE
I get an error:
ImportError: No module named wikipedia

I didn't find doc for this ImportError (I suppose, PYTHONPATH is wrong).

Where am I going wrong?

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] sge scheduler problem (was: SGE thinks hosts are overloaded while the latter are idling)

[Alex Brollo]

I too can't run, as Alebot,  a very simple IRC script (that needs longrun);
qstat states that it remains into a qw status, and qstat -j tells something
exoteric mentioning "overload".

I'll follow this thread to see if the issue will be solved.

Alex


2013/5/17 Merlissimo 

> That is a sge scheduler problem.
>
> I could not commend your sge ticket because jira does not accept my jira
> token. The load limit is set ok because we use np_load_* values which is
> the load divided by the number of cores on this host. So e.g. sge stop
> scheduling jobs on nightshade if host load is more than 20. So i think
> increasing this value does not make sense.
>
> You output below contains load adjustments:
>   queue instance 
> "longrun-lx@yarrow.toolserver.**org"
> dropped because it is overloaded: np_load_short=3.215000 (= 0.015000 + 0.8
> * 16.00 with nproc=4) >= 3.1
> means that there is a normalized host load of 0.015000 on yarrow and 16
> jobs are started within the last 4,5 minutes (=load_adjustment_time). sge
> temporary (for the first 4,5 minutes of a job lifetime) adds some expected
> load for new jobs to be not overloaded in future. Most new jobs normally
> needs some starting until they really use all need resources. This prevents
> scheduling to much jobs at once to one execd client.
>
> But as you can also see in real there are no new jobs. This is problem the
> response from master:
>
> $qping -info damiana 536 qmaster 1
> 05/17/2013 07:03:14:
> SIRM version: 0.1
> SIRM message id:  1
> start time:   05/15/2013 23:47:49 (1368661669)
> run time [s]: 112525
> messages in read buffer:  0
> messages in write buffer: 0
> nr. of connected clients: 8
> status:   1
> info: MAIN: E (112524.48) | signaler000: E (112523.98)
> | event_master000: E (0.27) | timer000: E (4.27) | worker000: E (7.05) |
> worker001: E (8.93) | listener000: E (1.03) | scheduler000: E (8.93) |
> listener001: E (5.03) | WARNING
>
> All theads are in error state including the scheduler thread. So the
> schedular does not accept status updates send by all execd and so it does
> not know about finished jobs and load updates. Thats why you see on qstat
> output an (not existing) overload problem and no running jobs (although
> some old long running jobs are still running).
>
> I think this could be solved by restarting the master scheduler process.
> That is why i (as sge operator) send a kill command to the scheduler on
> damiana and hoped that the ha_cluster automatically restarts this
> process/service. But this is sadly not the case. So we have to wait until a
> ts admin can restart this service manually.
>
> In between submitting new jobs will return an error, sorry for that.
> All running or queued jobs are not affected and will keep running or
> queued.
>
> Merlissimo
>
> Am 17.05.2013 03:41, schrieb Tim Landscheidt:
>
>> Hi,
>>
>> a "qstat -j" of a simple job yields inter alia:
>>
>> | scheduling info:queue instance "longrun-sol@willow.**
>> toolserver.org " dropped because it
>> is temporarily not available
>> | queue instance "
>> short-sol@willow.toolserver.**org "
>> dropped because it is temporarily not available
>> | queue instance "medium-lx@mayapple.**
>> toolserver.org " dropped because it
>> is temporarily not available
>> | queue instance "longrun3-sol@willow.**
>> toolserver.org " dropped because it
>> is temporarily not available
>> | queue instance "longrun2-sol@clematis.**
>> toolserver.org " dropped because
>> it is disabled
>> | queue instance "longrun2-sol@hawthorn.**
>> toolserver.org " dropped because
>> it is disabled
>> | queue instance "medium-sol@ortelius.**
>> toolserver.org " dropped because it
>> is overloaded: np_load_short=0.791601 (= 0.391601 + 0.8 * 2.00 with
>> nproc=4) >= 0.75
>> | queue instance "
>> medium-lx@yarrow.toolserver.**org "
>> dropped because it is overloaded: np_load_short=1.215000 (= 0.015000 + 0.8
>> * 6.00 with nproc=4) >= 1.2
>> | queue instance "medium-lx@nightshade.**
>> toolserver.org " dropped because it
>> is overloaded: np_load_short=1.227500 (= 0.127500 + 0.8 * 11.00 with
>> nproc=8) >= 1.2
>> | queue instance "medium-sol@wolfsbane.**
>> toolserver.org " dropped because it
>> is overloaded: np_load_short=0.778613 (= 0.078613 + 0.8 * 7.00 with
>> nproc=8) >= 0.75
>> | queue instance "short-sol@wolfsbane.**
>> toolserver.org " dropped because it
>> is overloaded: np_load_short=1.278613 (= 0.078613 + 0.8 * 12.00 with
>> nproc=8) >= 1.2
>> | queue instance "short-sol@ortelius.**
>> toolserver.org " dropped because it
>> is overloaded: np_load_short=1.391601 (= 0.391601

Re: [Toolserver-l] Status of the toolserver

[Alex Brollo]

Just a flash feedback - some ours again I could login again, but qstat gave
an error message while crontab was running regularly; now qstat runs again.

Presently is running under Alebot account a IRC script only, that can be
considered a test routine; have I to stop it, to make server update easier?

Alex


2013/5/13 DaB. 

> Hello all,
>
> as you have surely noticed the toolserver is even more unstable and
> unreliable
> than normal at the moment. The reason is that our ha-nodes are not longer
> working as intended and neither Nosy nor I are able to fix this.
>
> A quick word was ha-nodes are: The "ha" stands for "high available" and we
> have 2 servers for that. Some services at the toolserver are so important
> that
> a downtime is unacceptable (like /home, LDAP or the DNS) and for this
> reasons
> these services life at the ha-nodes. If one server goes down or crashes
> then
> the other can continue to operate all services with no or little
> interruption
> time and without working by a root. That worked great as long as River was
> here and not-so-good in the last months, but now it is totally broken.
> The problem is that both ha-nodes run Solaris and all roots are no Solaris-
> experts what makes it hard for us to find errors or in this case
> impossible. We
> have setup a very ugly workaround, but it is not stable and so the
> downtime of
> important services cause downtime for the hole toolserver – and more work
> for
> the roots.
>
> We can only think of one solution: Replacing the solaris at the ha-nodes
> with
> linux. But this can not start before Friday and it will take some time
> until
> everything is moved over. It will also cause some hours of complete
> downtime
> while /home is copied (we will separately announce this). In best case when
> Whitsun is over everything will be working again, in worst case it will
> need 2
> weeks (I will be away between 21 and 26 for the general meeting of WMDE).
> The repairing of the ha-nodes has top priority, so everything else will be
> delayed (linux-update, database-reimports, account-creation (for VERY
> important ones send me a mail), etc.).
>
> If you have questions, please send them to the ML.
>
> Sincerely,
> DaB.
>
> --
> Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Can't login to willow

[Alex Brollo]

Thanks for working around the issue.

This is what I get my email:

"! could not obtain latest contract for PID 6482: No such process Sun May
12 05:30:04 2013" (seven times, with growing PIDs )

and

Your "cron" job on willow couldn't be run
can't change directory to your home directory.
Your commands will not be executed.
The error was "No such file or directory" (seven times)

I can't login as Alebot.

Alex brollo








2013/5/12 DaB. 

> Hello,
> At Sunday 12 May 2013 02:48:40 DaB. wrote:
> > Is this a side effect of the maintenance?
>
> the server oh which we had setup the temporary solution yesterday crashed
> today. During the last 2.5h I tried to restarted the nfs-server but I was
> not
> successful and I am out of ideas now. Because Nosy didn't documented what
> she
> did yesterday I can not just repeat it and we have to wait until she is
> available again. Until Nosy fix the problem again, the toolserver will be
> out-
> of-order – I know that that sucks but I can not change it.
>
> Sincerely,
> DaB.
>
>
> --
> Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] I can't login any more

[Alex Brollo]

Problem solved (thanks DaB., and thanks to all from you)

Alex


2013/4/24 Patricia Pintilie 

> I can't either its almost how it gets stuck
> On Apr 24, 2013 10:38 AM, "Platonides"  wrote:
>
>> On 24/04/13 16:25, Alex Brollo wrote:
>> > Thanks - really I felt that I should get the renew notice but I
>> > obviously missed/deleted the mail; I've been confused from some
>> > toolserver stop-and-go notices, and from some messages by other user,
>> > with login troubles.
>> >
>> > Yes, you are true: I found the notice "Your account will expire
>> > tomorrow" into the group of deleted mails I apologyze for  your
>> > wasted time.
>> >
>> > Me stupid.
>> >
>> > Alex
>>
>> Being busy is different than being stupid. Plus this was easy to
>> determine, don't worry.
>>
>> ___
>> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
>> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
>> Posting guidelines for this list:
>> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] I can't login any more

[Alex Brollo]

Thanks - really I felt that I should get the renew notice but I obviously
missed/deleted the mail; I've been confused from some toolserver
stop-and-go notices, and from some messages by other user, with login
troubles.

Yes, you are true: I found the notice "Your account will expire tomorrow"
into the group of deleted mails I apologyze for  your wasted time.

Me stupid.

Alex


2013/4/24 Platonides 

> On 24/04/13 10:54, K. Peachey wrote:
> > IIRC that should still log you in, but you get a "You account has been
> > disabled message" and your web folder should show a "this account has
> > expired" message.
>
> I'm sorry, but it does seem disabled: http://toolserver.org/~alebot/
>
> Your account was set to expire on on 2013-04-05 (15800). Open a jira bug
> (or otherwise bug a toolserver admin) to request it is enabled again.
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] I can't login any more

[Alex Brollo]

My username into toolserver is Alebot; I regularly renew my account
following email notification, I searched my mail box for any missed message
but I didn't found it; but my mail box is overcrowded and often I delete
dozens of messages - I can't exclude a stupid  mistake by me.

Alex brollo


2013/4/24 Platonides 

> On 24/04/13 00:15, Alex Brollo wrote:
> > Thanks, but server closes connection as soon as I try to login - both
> > with PuTTY and by WinSCP.
> >
> > No matter; I don't want to waster your time any more; I'll search for
> > help y some friends into it.wikisource.
> >
> > Alex
>
> What's your username? Did your perhaps allow your account to expire?
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] I can't login any more

[Alex Brollo]

Thanks, but server closes connection as soon as I try to login - both with
PuTTY and by WinSCP.

No matter; I don't want to waster your time any more; I'll search for help
y some friends into it.wikisource.

Alex



2013/4/23 Tim Landscheidt 

> Alex Brollo  wrote:
>
> > I've a Toolserver account - I remember registration procedure just like a
> > terrible nightmare and I survived only thanks to lots of luck.
>
> > Now, server refuses connection. I use Pageant, usually login is very
> simple
> > - I load my key, then I open Putty, I post my username and all runs. But
> > now it doesn't run any more. How can I get some help?
>
> Is this still current?  Apparently, there was some outage
> that was fixed at about 15:00Z.
>
> Tim
>
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] I can't login any more

[Alex Brollo]

I've a Toolserver account - I remember registration procedure just like a
terrible nightmare and I survived only thanks to lots of luck.

Now, server refuses connection. I use Pageant, usually login is very simple
- I load my key, then I open Putty, I post my username and all runs. But
now it doesn't run any more. How can I get some help?

Alex brollo
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Clean-up your homes

[Alex Brollo]

Alebot and it's horrible 100Gby space wasting has disappeared from the list,
I'm happy from this but it is all what I could do.
Isn't it possible to block user space at 1Gby? I'd like much more to be
blocked in my user space, tnah to cause another time so big troubles - I
guess other users do too.

Alex brollo

2011/9/9 DaB. 

> Hello again,
>
> short progress report: The situation was better arround Wednesday, but now
> the
> situation is bad again (not as bad as at Monday, but still bad). You here
> is
> the new who-uses-the-most-space-list:
>
> 3.0Gdispenser
> 3.1Gdanny_b
> 3.6Gflacus
> 3.7Ghydriz
> 3.9Grriver
> 4.9Gtparscal
> 5.1Gcbm
> 6.8Gwerdna
> 7.8Gmjbmr
> 8.0Ghippietrail
> 8.4Gvoj
> 8.7Gkolossos
> 9.6Gmyst
> 11G rsumi
> 12G wikitanvir
> 13G baptiste
> 17G dschwen
> 44G sk
> 61G daniel
> 92G grimlock
>
> The projects-directory increased by 100GB (that's the lion-share of the
> "bad"). So please if you run a MMP, please look at it too.
>
> Sincerly,
> DaB.
>
> --
> Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Clean-up your homes

[Alex Brollo]

I'm the driver of Alebot, I apologyze for a mistake that wasted a lot of
space; I misinterpreted the "1 giga limit" and I was confident that server
would not allow that a larger server space is used. :-(. I was wrong.

Now, I deleted all what I could. Can anyone of you take a look and to tell
me how much alebot is using now, if it's not a too annoying task? Thanks!

Alex brollo
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Python cgi safery issues

[Alex Brollo]

Thanks!

I'll read safety doc.
In brief, there's only a GET input from a link such this:

toolserver.org//cgi-bin/epg_start.py?sito=language_of_wikisource&pagina=name_of_the_page&titolo=title_of_the_page

and the output is only a zip file into public_html folder and a static html
page to see what's happening. I guess it would be simple to control the
content of three GET parameters and to stop the script if parameter content
is unsafe.

What are the minimal, safest settings for epg_start.py file? is it safe a
777 mode?

Alex brollo
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Python cgi safery issues

[Alex Brollo]

I know python much better than PHP, so I feel myself reasonably comfortable
with cgi python module dealing with simple tests of html queries. In the
meantime, I'm worried abut possible safety issues, so what is your
suggestion to fix any coding/setting mistake? Have I to publish here, or
into toolserver wiki, my code? As you guess, I'm not so deep into such
issues.

Thanks!

Alex brollo
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Fwd: Two Python libraries

[Alex Brollo]

Thanks Aaron! Sometimes thing are a little simpler than I guess... :(

Alex

-- Forwarded message --
From: Aaron Halfaker 
Date: 2011/6/7
Subject: Re: [Toolserver-l] Two Python libraries
To: toolserver-l@lists.wikimedia.org


Alex,

A good way to check if a library is available is to just try importing it
from the python CLI.

For example:
grphack@nightshade:~$ python
Python 2.7.1 (r271:86832, Jan  4 2011, 13:57:14)
[GCC 4.5.2] on sunos5
Type "help", "copyright", "credits" or "license" for more information.
>>> import lxml
>>> import genshi
>>>

Since I didn't get an ImportError, I know those two libraries are already
available.

-Aaron



-Aaron

On Tue, Jun 7, 2011 at 1:56 PM, Alex Brollo  wrote:

> While testing a way to convert it.source texts into ePub format, a friend
> asked me to know if  genshi <http://genshi.edgewall.org/wiki/Download> and
> lxml <http://pypi.python.org/pypi/lxml/>  (python libraries) are already
> installed and usable into toolserver. I told him that I didn't know... and
> even if I knew that they are installed, I had no idea about their access and
> use.
>
> I browsed a little into toolserver wiki, but I didn't find anything about
> shared python libraries. Can I have some help and direction by you? Thanks!
>
> Alex brollo
> <http://pypi.python.org/pypi/lxml/>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list:
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list:
https://wiki.toolserver.org/view/Mailing_list_etiquette
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Two Python libraries

[Alex Brollo]

While testing a way to convert it.source texts into ePub format, a friend
asked me to know if  genshi <http://genshi.edgewall.org/wiki/Download> and
lxml <http://pypi.python.org/pypi/lxml/>  (python libraries) are already
installed and usable into toolserver. I told him that I didn't know... and
even if I knew that they are installed, I had no idea about their access and
use.

I browsed a little into toolserver wiki, but I didn't find anything about
shared python libraries. Can I have some help and direction by you? Thanks!

Alex brollo
<http://pypi.python.org/pypi/lxml/>
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] A try to build a wikicaptcha and toolserver script sharing politics

[Alex Brollo]

>
> Looks interesting. Does the language matter for you? Because if python
> does not offer an advantage over php, I would recommend the later so
> that it'd be easier to merge into wikisource.
>

Yes, it matter; I hardly can write something in python, I have only very
vague notions of php and javascript, and I just posted my cgi "Hello world".
But I encourage any of you to catch my scripts and to feel free to develop
them as you like; I'm fully satisfied and bold from preliminary results, I
know that I can't develop  the whole project, so please don't expect running
results by me.

As I told into WMI, the Italian chapter, it's interesting that I found
source, some years ago, following the stumps of reCAPTCHA, then going into
Internet Archive and finally into it.source. A good example of a circular
path

Alex brollo
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] A try to build a wikicaptcha and toolserver script sharing politics

[Alex Brollo]

I'm going to run into toolserver some simple python + djvuLivre routines to
test the possibility to obtain a "wikicaptcha", built to be useful for
wikisource activity.

I'm far from sufficiently skilled to write all the project, in particular
the final user interface; but I'm not far to implement something like a
"voluntary wikicaptcha", t.i. to select controversial OCR interpretation of
words of a djvu file, and to present their image, extracted from image
layer, into a html form, so that a willing user could upload their "human
interpretation" and fix djvu text layer.

While asking if any of you is interested about, I wonder there would be any
wrong, or hurting toolserver politics, or raising safety issues, in
publishing the python code of such layman tries into toolserver wiki into a
subpage of my account, or otherwhere, so that any toolserver user could take
a look if curious or simply could take inspiration to develop the idea as
the idea IMHO deserves.

Alex brollo
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] A beginner's question

[Alex Brollo]

2011/2/6 Alex 

>
> Or just file a JIRA ticket to have it installed for everyone.
>

Some day I'll understand such a statement "file a JIRA ticket". By now,
aramaic is much be simpler. :-)

No matter I think that I'm the only one user in toolserver, going into
mysteries of djvu files while being so unskilled about unix environment. Any
other user who will need djvulibre, will know perfectly how to compile it,
and what a JIRA ticket is. :-)

(I see there's another Alex, I've to remember to sign with my whole nick...)

Alex brollo
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] A beginner's question

[Alex Brollo]

2011/2/6 Platonides 

> # You can then remove djvulibre-3.5.23 folder and djvulibre-3.5.23.tar.gz
>

After a mostly alarming torrent of exoteric output it runs! Thanks
Platonides!

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Help needed to choose and install DjvuLibre binary package [was: A beginner's question]

[Alex Brollo]

I posted this message without a descriptive subject line, I apologyze. I
only hope that posting it again under a better subject is a good idea.

I'd like to install into my toolserver account djvuLibre binaries. Unluckily
my knowlege of Unix is very primitive - approaching to nothing.

Is some of you willing to take a look to
http://djvu.sourceforge.net/index.html, and to tell me if Solaris 6
(sparc)djvulibre-3.5.5-solaris6-sparc.tar.gzbinary
package is the right one? and is a good idea to install it into
toolserver? finally, if it's a good idea: is there a simple "magic recipe"
to install that package in toolserve? I never installed binaries into a unix
environment

Thanks

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] A beginner's question

[Alex Brollo]

I'd like to install into my toolserver account djvuLibre binaries. Unluckily
my knowlege of Unix is very primitive - approaching to nothing.

Is some of you willing to take a look to
http://djvu.sourceforge.net/index.html, and to tell me if Solaris 6
(sparc)djvulibre-3.5.5-solaris6-sparc.tar.gz
binary package is the right one? and is a good idea to install it into
toolserver? finally, if it's a good idea: is there a simple "magic recipe"
to install that package in UNIX? I never installed binaries into a unix
environment

Thanks

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Beginner's questions :-(

[Alex Brollo]

>
> 2011/1/14 Dr. Trigon 
>
>> 
>>
>> has now to be runned this way:
>>
>> cronsub example.py
>>
>

I got terribly frustrated till I tried:

cronsub hello $HOME/hello.py  (and, better, cronsub -s hello $HOME/hello.py
runs too).

Ok, "Hello world" of job scheduling  runs. :-(


Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Beginner's questions :-(

[Alex Brollo]

2011/1/14 Dr. Trigon 

> 
> has now to be runned this way:
>
> cronsub example.py
>

GOT! Thank you. I'll always use this, for interactive, test use too (just to
turn it into a habit!). I used "python example.py" syntax since my test
scripts are really "naked", just one or two rows of code, usually wrong. :-)


> But when reading first [1] (even if its obsolete now) and then [2]
> you can see there is THE ADVANTAGE of having your script automatically
> re-started once the server re-starts (else your script is down until
> you start it again by hands).


GOT too! I read that a new call of a live script is simply ignored... but I
didn't understand the relationship between such a statement and its logical
conseguence: any cron call of a routine will be executed only is that
routine is dead! Thank you!

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Beginner's questions :-(

[Alex Brollo]

2011/1/14 Dr. Trigon 

> It should be (rather) simple once you got how 'crontab'/'cronjob's work.
>

This is my trouble. I read and read again Batch job  page, but I couldn't
find the right syntax for the simpler case: simply, how to run a
*single*script using batch job! Examples deal mainly with cron jobs:
but how can I
run a *single* script like, even in into an interactive way to test it, ie:

*python example.py*

Next question. I'd like to run again my irc.py python script, designed to
run into a screen forever. I can't understand why I'd wrap it into a
crontable: it has simply to run once. When it was running, I run it into a
screen simply with:

*python irc.py*

It simply listens at it.source #irc Recent changes channel, and writes
selected & parsed data into a public txt file (so I can see from web if it's
live or dead without logging into the server, and there's too a queue ready
for another cron script, who uses that txt file)

How should I run it into a screen, with new settings? Remember... I'd like
an idiot-proof suggestion. :-(

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Beginner's questions :-(

[Alex Brollo]

Ok, I got it. Simply a matter of using Ctrl-D again and again. As stated
into the help page on screens: "With the last screen closed you will log
out.", No screens and no login pending.

Now, let's begin again from scratch, using batch job scheduling only...

Thanks!

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Beginner's questions :-(

[Alex Brollo]

2011/1/13 chris 

> It's possible to have multiple screens up at one time. Are you
> terminating the screen before logout, or just disconnecting?
>
> ctrl-a-d dissconnects, ctrl-a-\ terminates screen.
>
> If you just disconnect from it, the screen will live on and be available
> for you at the next login.
>

Thanks Chris, nevertheless I remember you... I' need an idiot-proof
help.(Perhaps you are wondering: is toolserver a good place for an idiot?
Yes, I just am asking the same question to myself...:-( )

The problem is: how can access into live screens, since they aren't named,
to press that ctrl-a \?  There's some help to enter into them, but it is
written into a "basic linuxian" ... and man page of screen, as you ca
imagine, doesn't help me.

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Beginner's questions :-(

[Alex Brollo]

I see alarming messages into my toolserver terminal.

1. You are already logged inthen some items like:
 pts:/33:80 (pts/35)

2 introducing screen -list I see another list of four items, like:
21068.pts-24.willow

or like
12976.alex

I too got a "There are stopped jobs" after exit, but such a message
disappeared al last try.

What have I to do? Such logins and screens will be deleted since inactive?
have I to worry about? Please, if you'll suggest something that I'd do, use
a "idiot-proof" language. :-( :-(

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] .environment file

[Alex Brollo]

2011/1/6 River Tarnell 

> Hash: SHA1
>
> Hi,
>
> It's now possible to set environment variables in your $HOME/.environment
> file,
> as a series of NAME=value pairs, for example:
>
> PYTHONPATH=$HOME/pylib
>
> This will affect interactive logins, cron jobs and SGE jobs, but currently
> not
> web server CGI scripts.
>
>- river.
>

This promises to be useful. This evening I'll stop my #irc bot and I'll
review the code of the the other script (which didn't survive the SGE
migration. :-( Then  I'll begin again to test scripts "by scratch", using
new setting for jobs only.

I am running at my limits, please be patient in case of mistakes.

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Two beginner questions

[Alex Brollo]

Far from being interested about #irc protocol in general, my interest is
focused on irc.wikimedia.org read-only channels, and on parameter segment of
specific rows of specific channels (but I see that all channels follow a
similar pattern).

My idea is to use my very basic listening bot to select rows, to parse
parameters and to write them on a file. End of irc bot work. Another cron
script will read (and delete) output file and operate on the list of
new/edited pages. Consider that tasks I'm implementing do not require an
immediate revision of pages by the bot; on the contrary, it's more
efficient, IMHO, to wait some time after an human user edit, since often
human editors don't use PreView and find something to fix as they see the
result of their edit.

So, considering only the last edit of a page in an interval of 10-15
minutes, many unuseful edits by bot can be avoided.

It's something very far from "async programming", I guess: a primitive
approach, but IMHO it should run.

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Two beginner questions

[Alex Brollo]

2010/12/10 MZMcBride 

>
> Gahhh, this list. Nobody suggested just using Python's Twisted?[1] So much
> easier than trying to write your own script in Python using sockets and
> manual pongs and all that jazz.
>


Once more, it's amazing to see how different meanings can have the word
"easier". :-)
Recently I tried to follow the suggestion of an expert, encouraging me to
use NetBeans for jthon... "easier" than my old beloved Idle interface for
basic python  I hardly survived. :-P

You are so largely overestimating my abstract knowledge of such stuff...
:-(
Nevertheless, my rough, basic, DIY routines run, and they do "magic" jobs!
:-)
So I presume easier, for me, to go on step by step with rough, brief, banal
scripts...

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Two beginner questions

[Alex Brollo]

2010/12/10 Giftpflanze 

>
> > Gahhh, this list. Nobody suggested just using Python's Twisted?[1] So
> > much easier than trying to write your own script in Python using
> > sockets and manual pongs and all that jazz.
>
I'm going to drag as deep as I can into http://krondo.com/?p=1209. Thanks
for suggestion. This will help me into the second step: and now that I have
my clean parsed #irc message... how can I use it for my tasks, sometimes
simple, sometimes far from simple, while listening for other messages? I'd
try a DIY (do it yourself)  way... but I guess that it's not so an exotic
problem, nad that's much better to study a little bit.



> Here’s my RE that parses the RC IRC message in all aspects I know of:
>
> The first line splits the server line into the actual IRC message and
> the channel (i.e. wiki) it is coming from. The sending nick is ignored
> since noone is allowed to talk at all and because it may change.
>
> The second splits the message into its 6 constituent parts. That works
> for every single line at the moment (sometimes a detail changes and we
> are left with a mess), be it even a log entry and not an ordinary edit,
> because the surrounding markup is present at every line. Sometimes the
> message is too long for the IRC format (which allows for 512 bytes
> including the final \r\n), so beware of cut off lines.
>
> The REs are in the re_syntax(n) Tcl-style format (since this is taken
> from my MediaWiki Tcl Library [~gifti/bot/irc.tcl]) but can easily be
> adopted to other languages I assume. I use \003 and \002 instead of
> direct ASCII for better readability and transportability. Consider that
> the color codes are sometimes with leading zeros, sometimes not.
>
> regexp {:[^ ]+ PRIVMSG #([^ ]+) :(.*?)} $line -> channel message
>
> regexp {\00314\[\[\00307(.*)\00314\]\]\0034 (.*)\00310 \00302(.*)\003
> \0035\*\003 \00303(.*)\003 \0035\*\003 \(*\002*\+*([^)]*)\002*\)*
> \00310(.*?)\003*} $message -> title action url user bytes comment


VERY interesting, thank you!

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Two beginner questions

[Alex Brollo]

Ok. I've my listening bot; at the beginning I've been  a little confused by
irc color codes, but I realized that they can be used to parse effectively
#irc messages.

Just the time to mount my "irc color-based parser" then I'll be ready to use
data enough for now I presume.

Then I'll read again your posts, to see if I can understand them (I only
used some keyword to browse the web searching what I need...)

Thank you again.

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Two beginner questions

[Alex Brollo]

2010/12/9 Platonides 

> Alex Brollo wrote:
> > 2. The script bring into life a python bot, who reads RecentChanges at
> > 10 minutes intervals by a cron routine. Is perhaps more efficient a #irc
> > bot listening it.wikisource #irc channel for recent changes in your
> > opinion?
>
> Yes. Specially since you presumably want to get *all* RecentChanges
> which makes the 10 minutes value arbitrary.


Thanks to all from you.  My 10 minutes interval readings were only a trick
to skip over  my "continuously listening" unskillness. I'll study a little
bit the socket stuff and your code, then - I guess - I'll ask you again for
details/troubles. :-)

Consider that I'm VERY slow when learning new routines and presently
I've no idea about what precisely is "a socket". :-)

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Two beginner questions

[Alex Brollo]

2010/12/9 Bryan Tong Minh 

> On Thu, Dec 9, 2010 at 4:54 PM, Alex Brollo  wrote:
> > Then I tried to move to batch job sheduling, but... my script gives an
> > error: now the server dislikes sys.path row. Why? I obviously have to
> study
> > more: but what/where have I sto study? :-(
> >
> Please give the specific error message. It is hard to believe that the
> error is "the server dislikes sys.path".
>

:-)
It gives an error for that line, precisely mentioning sys.path. I didn't
save the message, but I can try to reproduce it.

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Two beginner questions

[Alex Brollo]

1. I'm testing my skill and I run my script under cron. The python script
begin with these rows (and it runs):


# -*- coding: utf-8 -*-
#!/usr/bin/python

import os,sys

if not sys.platform=="win32":
sys.path.append('/home/alebot/pywikipedia')
os.chdir("/home/alebot/scripts")


Then I tried to move to batch job sheduling, but... my script gives an
error: now the server dislikes sys.path row. Why? I obviously have to study
more: but what/where have I sto study? :-(

2. The script bring into life a python bot, who reads RecentChanges at 10
minutes intervals by a cron routine. Is perhaps more efficient a #irc bot
listening it.wikisource #irc channel for recent changes in your opinion?
Where can I find a good python script to read #irc channels?

Thanks - I apologize for so banal questions.

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Newbie question: definition of a "heavy job" for toolserver

[Alex Brollo]

2010/11/17 River Tarnell 

>
> You shouldn't worry too much about resource use as long as it's not
> excessive.
> We (TS admins) will let you know if you seem to be using too many
> resources.


This is exactly what I'd like to know. :-)


> > Feel free to send me your best link to a tutorial "Unix for dummies".
>
> I usually recommend the book "Understanding UNIX" by Stan Kelly-Bootle, but
> unfortunately it's out of print, and it also doesn't answer this particular
> question.  (But it does tell you just about everything else you'd want to
> know.)
>

Thanks. There are lots of tutorials online, presently I'm very proud to
banal goals like changing PATH by python and running my first bash "Hello
world" script. Just to let you know how much dummy I am.

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Newbie question: definition of a "heavy job" for toolserver

[Alex Brollo]

2010/11/17 River Tarnell 

> Alex Brollo:
> > My question is: how many pywikipedia readings/editing per hour are a
> "heavy"
> > toolserver job?
>
> We don't usually measure resource use in "pywikipedia readings/editing per
> hour" ;-) The most common indicators of resource use are CPU time and
> memory.
>

My premise was "A newbie question" :-P

Ok. Have I some Unix tool to evaluate server resource used running a script?
And - if such a tool exists and if it will give back some exoteric result to
me - how can I evaluate it in terms of "heaviness"? I guess the best
solution: to paste and copy here the result if any, and to ask you again.
:-)

Feel free to send me your best link to a tutorial "Unix for dummies".

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Newbie question: definition of a "heavy job" for toolserver

[Alex Brollo]

Hi all, I'm a new and very ntimidited toolserver user :-)
Presently I'm doing some "Hello world" tests only, as I told in a previuos
message,  but I'd like to run from toolserver my pywikipedia bot, Alebot,
that is a rather busy one (
http://stats.wikimedia.org/wikisource/EN/BotActivityMatrix.htm).

Alebot reads at intervals itwikisource RecentChanges, selects new edits by
type, contributor and namespace, reads new or edited pages and "does
things". Such things often are nothing, often imply ad edit of one
wikisource page, sometimes are more complex, implying some more
readings/editing of some different, related  pages (max 3-4
readings/editing, reading/updating of local pickle files).

My question is: how many pywikipedia readings/editing per hour are a "heavy"
toolserver job?

Alex
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] SGE can now be used for *all* tools

[Alex Brollo]

2010/11/16 River Tarnell 

>
> This policy has now changed, and SGE can be used for all jobs, including
> long-running jobs.  This effectively obsoletes Phoenix and similar tools,
> since
> SGE with cronsub provides the same functionality.
>

Thanks. A question. I'm a new toolserver user, presently working at a long
list of personal "Hello world" tests. Next scheduled "Hello world"  was cron
test. Is your suggestion to step over cron, and to try to learn SGE from the
beginning?

Alex brollo
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette