Re: [Toolserver-l] operating systems and web servers

On Tue, Jun 7, 2011 at 5:22 AM, River Tarnell wrote: > ZFS snapshots are nice, but OTOH ZFS can't remove storage from a pool or > do any kind of online relayout, both of which are standard features in > VxVM (and I assume in Linux LVM as well, although I have no experience > of it.) Linux LVM can

Re: [Toolserver-l] A strange thing in huwiki database

On Thu, Mar 17, 2011 at 7:56 PM, OQ wrote: > No, no they shouldn't. > Being an autoincrement field you shouldn't be using rev_id like that. Why not? Some kind of tie-breaker is needed when ordering, if you want the order to be well-defined (which is needed for, e.g., IndexPager in MediaWiki). r

Re: [Toolserver-l] Needs of important ressources

On Fri, Mar 4, 2011 at 2:37 PM, Seb35 wrote: > Thanks for all these responses, we will ask the next time before renting a > server for such a purpose. Account approval can sometimes take a while, often weeks. If you're thinking you'll likely use the toolserver in the future, you might want to ap

Re: [Toolserver-l] A beginner's question

On Sat, Feb 5, 2011 at 7:06 PM, Alex Brollo wrote: > Some day I'll understand such a statement "file a JIRA ticket". By now, > aramaic is much be simpler. :-) לישנא דארמאי לא קשיא לחדא. :) ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.or

Re: [Toolserver-l] /mnt/user-store is full

On Wed, Dec 22, 2010 at 3:36 PM, Gerald A wrote: > It looks like a huge volume, so it makes sense that it would take some time > to complete. Yes. It's spent almost the whole time so far in /aux0/user-store/osm_hillshading, which looks to be millions of tiny files split up over tens of thousands

Re: [Toolserver-l] /mnt/user-store is full

On Wed, Dec 22, 2010 at 8:31 AM, Darkdadaah wrote: > Hi, it looks like the user-store is completely full: > >>df > hemlock:/aux0/user-store > 3904398336 3904398336 0 100% /mnt/user-store > > > It requires cleaning and sorting (especially the dumps that are all over the

Re: [Toolserver-l] General maintenance notice: December 6th

On Mon, Nov 29, 2010 at 11:27 AM, River Tarnell wrote: > Start time: Monday, 6th December, 12AM UTC > End time: Monday, 6th December, 8AM UTC (estimated) Are these reversed or what? ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https

Re: [Toolserver-l] Please respect the rev_deleted-field

On Mon, Sep 27, 2010 at 4:17 PM, DaB. wrote: > I tried it today. It morphs a 1.36s query (simple count-query on my username > on dewiki_p) into something I canceled after 2 minutes (I tried both: if- > selecting and where-clause). What exactly did you try? You'd need to change indexes on the und

Re: [Toolserver-l] Please respect the rev_deleted-field

On Mon, Sep 27, 2010 at 2:55 PM, Ilmari Karonen wrote: > Why do we even include those rows in the default views?  I don't think > most people expect to get deleted rows on a simple query on the revision > table, given that this was never the case under the old system (when > they were moved to the

Re: [Toolserver-l] ts-admins language

On Tue, Jun 29, 2010 at 7:53 AM, Marcus Buck wrote: > This "common language" is spoken by less than a quarter of the world > population. If we only count decent English it's more like 10%. But it's spoken by everyone on this list and everyone with a toolserver account. German is spoken by a much

Re: [Toolserver-l] User account expired?

On Wed, Jun 2, 2010 at 11:00 PM, Mike.lifeguard wrote: > Given that river appears on your list, I think the script might have a > bug :) Roots all have two accounts, one for administration and one for tools. This way, compromising a root's tool doesn't give you root access. The admin account sta

Re: [Toolserver-l] Server switch for s3/s4/s6, Monday morning UTC

On Wed, Mar 31, 2010 at 4:02 PM, Mashiah Davidson wrote: > This figure of 1/8 resources is inaccurate. First, the limit is set > just to one table, not for all tables user create. Second, when Golem > supposes it will need 4 GB it assumes worst case. Third, Golem at a > time works with just one se

Re: [Toolserver-l] Server switch for s3/s4/s6, Monday morning UTC

On Mon, Mar 29, 2010 at 3:53 PM, Mashiah Davidson wrote: > This disables my tool to be functional. Why can't it just use MyISAM or InnoDB tables instead of MEMORY? That would slow it down, but it should still work. A lot of the reads will still be from memory anyway, although writes might be sl

Re: [Toolserver-l] Conversion of nightshade to Solaris - discussion

On Thu, Mar 25, 2010 at 3:58 PM, Mike.lifeguard wrote: > I think the most important reason to do this is that it makes > administration easier for you - could you explain how that's the case, > for people who are unfamiliar with system administration? All the commands for managing system startup,

Re: [Toolserver-l] commonswiki updates

On Mon, Mar 8, 2010 at 1:29 PM, Platonides wrote: > You may need per-table tablespaces, but i think it worked. According to , the process still basically involves shutting down the server so that the file is clean (no outstanding t

Re: [Toolserver-l] commonswiki updates

On Mon, Mar 8, 2010 at 10:20 AM, Platonides wrote: > Maybe some file-transfering magic can be done to add the index in the > other dbs by copying it from rosemary? No, file-copying doesn't work with InnoDB. You can only copy the full contents of all databases on the server, not even a single dat

Re: [Toolserver-l] commonswiki updates

On Tue, Mar 2, 2010 at 5:13 AM, Daniel Kinzler wrote: > In the next few days, I will be adding a new index to the globalimagelinks > table > in the commonswiki database. creating this index will take a couple of hours, > and the table will be locked during that time. This also means that > repli

Re: [Toolserver-l] Getting lengths of old revisions

On Wed, Feb 17, 2010 at 10:02 PM, Derrick Coetzee wrote: >             'User-Agent: Mozilla/5.0' . "\n" . Do not lie in your User-Agent. If your script causes any significant load, and a Wikimedia sysadmin notices it pretending to be a browser, they wouldn't be able to do much except block the e

Re: [Toolserver-l] what's the best way to convert SVGs to PNGs on the toolserver?

On Mon, Feb 15, 2010 at 6:53 PM, Ryan Kaldari wrote: > I'm currently working on some tools to allow web-based creation of various > types of maps for people that aren't comfortable editing SVG files. These > tools will allow users to select a base map, choose which territories they > want to shade

Re: [Toolserver-l] max_user_connections limit

On Thu, Feb 11, 2010 at 11:32 AM, Ja Ga wrote: > I'm sorry to say this, but I chose not to use jira as last time I did that I > was completely ignored for two weeks and received no assistance whatsoever.  > I'll try it again with the next problem. Now we have a paid sysadmin, so you might see a

Re: [Toolserver-l] Changes to expired accounts web hosting

On Fri, Feb 5, 2010 at 3:53 PM, River Tarnell wrote: > I don't think this is a good idea.  The GPL is one of the most restrictive > open source licenses and using it automatically could hinder reuse later.  A > better choice might be something like the CDDL or MPL, which are also > copyleft. Usin

Re: [Toolserver-l] Changes to expired accounts web hosting

On Thu, Feb 4, 2010 at 9:53 PM, Martin Peeks wrote: > The default copyright stance, unless a licence specifies otherwise, is > "All Rights Reserved". I don't think we have the right to enforce a > licence that is all about freedom unless a user opts-in. We have the right to require anything we li

Re: [Toolserver-l] Changes to expired accounts web hosting

On Thu, Feb 4, 2010 at 9:38 PM, Martin Peeks wrote: > However, I feel that toolserver users should retain the *freedom* to > choose how to license projects. Perhaps the docs and so on ought to be > adjusted to emphasise the importance and value of free licensing, but > there should be no automatic

Re: [Toolserver-l] Changes to expired accounts web hosting

On Thu, Feb 4, 2010 at 9:21 PM, K. Peachey wrote: > I have no idea how TS works, or what features are available to users, > but what about a SVN/GIT/* version control system that people can use > to store the work that they want publically available since as you > mention the talk of unix permissi

Re: [Toolserver-l] Linux/Solaris

On Mon, Dec 28, 2009 at 3:13 PM, Mike.lifeguard wrote: > Which admins? I know River is very experienced with Solaris - but are > the other sysadmins more experienced with Solaris than linux as well? No. All of us except River are more experienced with Linux. However, River does more work than t

Re: [Toolserver-l] [Wikitech-l] Wikimedia IRC Group Contacts looking for a developer

On Fri, Dec 4, 2009 at 3:47 PM, Rjd0060 wrote: > Sean and a couple of others did write one which was used for a couple > years.  It has been broken since July due to some changes to the toolserver > (I believe). What was the old URL? We could look into the possibility of reviving it. __

Re: [Toolserver-l] user-store maintenance

On Tue, Sep 8, 2009 at 3:52 AM, Andrew Dunbar wrote: > OK. There seems to be some permission problems though. I can't create a new > file > at /mnt/user-store/ This should be fixed now. ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)

Re: [Toolserver-l] /mnt/user-store/

On Tue, Sep 8, 2009 at 3:48 AM, Andrew Dunbar wrote: > /mnt/user-store/ has accidentally been mounted at /mnt/user-store/user-store/ This seems to have been fixed? ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia

Re: [Toolserver-l] problem with long running selects on toolserver.* tables

On Thu, Sep 3, 2009 at 3:23 AM, Daniel Kinzler wrote: > Actually, I think the problem is not an UPDATE or INSERT, the problem is that > I > use mysqldump to make a copy and then import the resulting dump - which starts > by *dropping* the table and re-creating it. Apparently, the DROP is not > per

Re: [Toolserver-l] How to determine if script runs in the toolserver cluster?

On Wed, Sep 2, 2009 at 2:23 PM, River Tarnell wrote: > there is no --fqdn option either.  hostname on Solaris does not accept > any options. I ended up using this in my .bash_aliases: if ([ `uname` = 'Linux' ] && (hostname --fqdn | grep toolserver &>/dev/null)) \ || ([ `uname` = 'SunOS' ] && (che

Re: [Toolserver-l] problem with long running selects on toolserver.* tables

On Wed, Sep 2, 2009 at 7:52 AM, Daniel Kinzler wrote: > Today we had a problem with the toolserver.namespace table being blocked on > sql-s1. After some digging, I think I have identified the cause: there was a > very long running solect on that table. By itself, that wouldn't be a problem. > But o

Re: [Toolserver-l] an idea

On Thu, Aug 27, 2009 at 11:54 AM, Merlijn van Deen wrote: > I would not be too certain about that. For example, buffer overflows are > generally only a security problem when they happen in suid-root programs - > this is why programs designed to be suid root have thorough checks on such > problems.

Re: [Toolserver-l] an idea

On Thu, Aug 27, 2009 at 4:14 AM, Leszek Krupinski wrote: > Daemon? Why not just sudo? Or Solaris roles or whatever they're called, on the Solaris machines. (Whatever it is pfexec does.) MySQL wouldn't even need that; just assign the account the right to view process lists and kill processes. On

Re: [Toolserver-l] Voluteering

On Fri, Aug 21, 2009 at 4:40 AM, Fahad Sadah wrote: > How does one volunteer to become a toolserver admin, or, if there are > too many security/trust problems, any other helpful job? If you want to become a toolserver root, e-mail River with your qualifications. You're expected to have a consider

Re: [Toolserver-l] JIRA and Fisheye down?

On Thu, Aug 6, 2009 at 3:41 AM, James R. wrote: > I was just trying to access https://jira.toolserver.org/ and > https://fisheye.toolserver.org/ and I'm getting a "problem loading page: the > server at jira.toolserver.org is taking too long to respond" error. > > Is there any planned downtime which

Re: [Toolserver-l] Unplaned reboot of nightshade

On Thu, Aug 6, 2009 at 2:53 AM, Robin Fink wrote: > Sorry for using the mailing list for my problem, but jira seems not to > work at the moment. River had to take down the web zone on amaranth, it should be up again today sometime. > Since your reboot, access to sql-s2 is not possible. The proble

Re: [Toolserver-l] The Norwegian toolserver

On Wed, Aug 5, 2009 at 7:09 AM, Tim Landscheidt wrote: > Why? If a chapter can pay a hosting company for their servi- > ces with a donation, they should be able to pay WMDE for > their services as well. There is no need to "move a donation > to another jurisdiction". My understanding (IANAL anywhe

Re: [Toolserver-l] where's enwiki_p on s1?

On Tue, Aug 4, 2009 at 2:31 PM, DaB. wrote: > the truth is that we don't know it. If all goes well, it take a few days (I > think River meant "days" insteadt of "hours") to reimport a cluster. Should we > say next time "It need 1 month" and then after maybe 4 days "We are back > ealier!" (the Scott

Re: [Toolserver-l] where's enwiki_p on s1?

On Tue, Aug 4, 2009 at 11:33 AM, Andrew Garrett wrote: > This is totally unproductive, unwelcome and unnecessary. Please go > away if this is the sum of your contribution to this list. Just because we're volunteers providing a free service doesn't mean we shouldn't reasonably expect criticism if w

Re: [Toolserver-l] Little Project Idea

On Sat, Jun 27, 2009 at 3:40 AM, Lars Dɪᴇᴄᴋᴏᴡ 迪拉斯 wrote: > This is of course bullshit of the highest degree. It's certainly a > permanent problem, and no amount of retrying will get me around the > ban. The response body should say something like this: > > . . . > > Can anyone with access to the ap

Re: [Toolserver-l] Problem

On Thu, Jun 11, 2009 at 6:04 PM, Platonides wrote: > Then you should provide the script. He did: http://toolserver.org/~sk/checkwiki/checkwiki.pl ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinf

Re: [Toolserver-l] Status of the latest hardware order

On Mon, May 18, 2009 at 10:47 AM, James Hare wrote: > And additionally, I personally find FreeBSD to be a superior operating > system. In my experienced it just plain works better. River thinks the same about Solaris. The point is that most toolserver users probably don't -- they're used to Linu

Re: [Toolserver-l] Status of the latest hardware order

On Mon, May 18, 2009 at 10:34 AM, River Tarnell wrote: > so, we're currently testing FreeBSD on vandale to see how it compares to > Linux; > if we did decide to move, all the Linux servers would be changed to FreeBSD, > leaving only two operating systems, like we have at the moment.  if we don't

Re: [Toolserver-l] Toolserver paid accounts

On Fri, Apr 3, 2009 at 6:05 AM, Stephen Bain wrote: > Das war doch nur ein Aprilscherz :) Wow, I'm sad. I actually fell for this. I really need to be more paranoid on March 31 my time. ___ Toolserver-l mailing list Toolserver-l@lists.wikimedia.org ht

Re: [Toolserver-l] WikiMiniAtlas

On Sun, Feb 15, 2009 at 7:37 AM, River Tarnell wrote: > we already have this, although using a slightly more sophisticated permissions > scheme than that: > >https://wiki.toolserver.org/view/Stable_server . . . what permissions scheme *does* it use? __

Re: [Toolserver-l] rebooted nightshade

On Sun, Feb 1, 2009 at 3:59 AM, Marco Schuster wrote: > I guess this would effectively disable all those memory-eating interwiki bots > ;) There's only 8G of RAM on nightshade. Make it a 2G limit, maybe, or 4G, but one non-root user using anything more than that seems unreasonable. On Sun, Feb

Re: [Toolserver-l] rebooted nightshade

On Sat, Jan 31, 2009 at 6:57 PM, Ilmari Karonen wrote: > Come to think of it, shouldn't the toolserver have some resource use > limits that would stop things like this from happening? A single > non-root user running a fork bomb or anything similar really shouldn't > be able to bring down the ent

Re: [Toolserver-l] potential abuse by 84.114.164.84

On Mon, Jan 12, 2009 at 5:35 AM, Nicolas Dumazet wrote: > It seems to be a set of tools: crawler, parsers, indexers... To allow > a search. In short, an experimental search engine. Or a wannabe > commercial engine maybe, given that a .net domain is registered: > http://www.paxle.net/ > > ... > > T

Re: [Toolserver-l] Switchboard/FastCGI on new webserver

On Sun, Dec 14, 2008 at 9:54 AM, Kalan wrote: > On Sun, Dec 14, 2008 at 21:45, Aryeh Gregor > wrote: >> So how do you store your passwords, such that the web server can read >> them to connect to the database but can't read them to serve the files >> containing the

Re: [Toolserver-l] Switchboard/FastCGI on new webserver

On Sun, Dec 14, 2008 at 4:08 AM, Bryan Tong Minh wrote: > It would of course be a good idea, but any PHP(f) file that is world > readable and has passwords in it is inherently a security leak. So how do you store your passwords, such that the web server can read them to connect to the database bu

Re: [Toolserver-l] SQL queries

On Thu, Nov 27, 2008 at 10:22 AM, Ilmari Karonen <[EMAIL PROTECTED]> wrote: > I was going to disagree with you, but it does seem there's something > weird going on. Compare these queries: > > mysql> SELECT page_namespace, page_title FROM page WHERE page_title LIKE > '%fnord%' AND page_namespace=0;

Re: [Toolserver-l] mysqldump

On Mon, Oct 6, 2008 at 8:54 PM, Daniel Schwen <[EMAIL PROTECTED]> wrote: > Cross-database queries I know, but cross-server queries are new to me. Is that > even possible? Ah, I see. The databases are on different servers. I don't know how you'd be able to do that, no, not without a lot of manual

Re: [Toolserver-l] mysqldump

On Mon, Oct 6, 2008 at 4:15 PM, Mauro Girotto <[EMAIL PROTECTED]> wrote: > I need to make a query between itwiki_p (sql-s2) and enwiki_p > (sql-s1). Is it possible? I think I need to download an ufficial dump > and make query on my pc. Why can't you just run the query across databases? What query

Re: [Toolserver-l] Local indexes

On Mon, Sep 15, 2008 at 8:54 PM, Darren Hardy <[EMAIL PROTECTED]> wrote: > I think that the problem, at least with this specific query, is with > the query structure. page_namespace and rev_user are both already > indexed in the page and revision tables, but the query planner doesn't > optimize the

Re: [Toolserver-l] Local indexes

On Mon, Sep 15, 2008 at 1:48 PM, Victor Vasiliev <[EMAIL PROTECTED]> wrote: > Is it possible to locally create some indexes specific for toolserver? > As for now, it will help to seriously speed up most tools. E.g. index > (rev_user,rev_page) will speed up all editcounters, which usually uses > que