Re: [Wikitech-l] 100% open source stack (was Re: Bugzilla Vs other trackers.)

2010-01-08 Thread Domas Mituzas
What was wrong with LVM snapshots? Performance? in zfs every write is 'copy on write', so snapshots have 'zero' cost, and multiple snapshots can use same data. in LVM every snapshot is standalone and has all the information it needs. also LVM doesn't have snapshot-based replication, and

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Jamie Morken
Hello, Is the bandwidth used really a big problem? Bandwidth is pretty cheap these days, and given Wikipedia's total draw, I suspect the occasional dump download isn't much of a problem. I am not sure about the cost of the bandwidth, but the wikipedia image dumps are no longer

Re: [Wikitech-l] Bugzilla Vs other trackers.

2010-01-08 Thread Ilmari Karonen
Roan Kattouw wrote: 2010/1/7 Trevor Parscal tpars...@wikimedia.org: Hmmm... Not being able to distinguish the difference between a bug tracker and a wiki based on the skins being similar is a point of view I have a hard time understanding. Having read quite a few bug reports written in

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Bryan Tong Minh
On Fri, Jan 8, 2010 at 4:31 PM, Jamie Morken jmor...@shaw.ca wrote: Bittorrent is simply a more efficient method to distribute files, especially if the much larger wikipedia image files were made available again.  The last dump from english wikipedia including images is over 200GB but is

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Aryeh Gregor
On Fri, Jan 8, 2010 at 10:31 AM, Jamie Morken jmor...@shaw.ca wrote: I am not sure about the cost of the bandwidth, but the wikipedia image dumps are no longer available on the wikipedia dump anyway.  I am guessing they were removed partly because of the bandwidth cost, or else image

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Gregory Maxwell
On Fri, Jan 8, 2010 at 10:56 AM, Aryeh Gregor simetrical+wikil...@gmail.com wrote: On Fri, Jan 8, 2010 at 10:31 AM, Jamie Morken jmor...@shaw.ca wrote: I am not sure about the cost of the bandwidth, but the wikipedia image dumps are no longer available on the wikipedia dump anyway.  I am

[Wikitech-l] CSS/javascript injection for AJAX requests

2010-01-08 Thread Carl (CBM)
I noticed today that livepreview does not pick up the dynamically-generated CSS from the SyntaxHighlight_Geshi extension. The same problem occurs in liquidthreads: when you add a comment with a Geshi call in it, the CSS will not be picked up when the comment is initially saved. The first full

[Wikitech-l] Boing Boing applauds stats.grok.se!

2010-01-08 Thread David Gerard
http://www.boingboing.net/2010/01/07/wikibumps.html - d. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Foundation-l] Boing Boing applauds stats.grok.se!

2010-01-08 Thread William Pietri
On 01/08/2010 09:02 AM, David Gerard wrote: http://www.boingboing.net/2010/01/07/wikibumps.html And the poster, who is a Boing Boing guest editor, is one of our own, an English Wikipedia contributor since 2004: http://en.wikipedia.org/wiki/User:Jokestress William

Re: [Wikitech-l] [Foundation-l] Boing Boing applauds stats.grok.se!

2010-01-08 Thread Domas Mituzas
On Jan 8, 2010, at 7:02 PM, David Gerard wrote: http://www.boingboing.net/2010/01/07/wikibumps.html Currently we're in talks with WM-DE, so they will provision some storage for long-term archives of raw data, and we will probably add image view statistics then. Good stuff, right? Domas

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Tomasz Finc
William Pietri wrote: On 01/07/2010 01:40 AM, Jamie Morken wrote: I have a suggestion for wikipedia!! I think that the database dumps including the image files should be made available by a wikipedia bittorrent tracker so that people would be able to download the wikipedia backups including

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Robert Rohde
On Fri, Jan 8, 2010 at 8:24 AM, Gregory Maxwell gmaxw...@gmail.com wrote: s/terabyte/several terabytes/  My copy is not up to date, but it's not smaller than 4. Top most versions of Commons files are about 4.9 TB, files on enwiki but not Commons add another 200 GB or so. -Robert Rohde

Re: [Wikitech-l] Bugzilla Vs other trackers.

2010-01-08 Thread Tei
On Thu, Jan 7, 2010 at 8:39 AM, Peter Gervai grin...@gmail.com wrote: .. Wouldn't be nice. First, it's an attitude thing: we want (and have to) promote open stuff. Second, it isn't nice to show something to the users they cannot use themselves. It's kind of against or basic principle of you

Re: [Wikitech-l] Bugzilla Vs other trackers.

2010-01-08 Thread Max Semenik
On 08.01.2010, 22:42 Tei wrote: It will be a good idea to pass the memo to the guys that design the notability rules. http://ioquake3.org/2009/02/20/ioquake3-entry-deleted-from-wikipedia/ Since most (all?) opensource proyects are webonly, and don't get in the press, are on some obscure

Re: [Wikitech-l] Bugzilla Vs other trackers.

2010-01-08 Thread Bryan Tong Minh
On Fri, Jan 8, 2010 at 8:42 PM, Tei oscar.vi...@gmail.com wrote: On Thu, Jan 7, 2010 at 8:39 AM, Peter Gervai grin...@gmail.com wrote: .. Wouldn't be nice. First, it's an attitude thing: we want (and have to) promote open stuff. Second, it isn't nice to show something to the users they cannot

Re: [Wikitech-l] Bugzilla Vs other trackers.

2010-01-08 Thread Aryeh Gregor
On Fri, Jan 8, 2010 at 2:42 PM, Tei oscar.vi...@gmail.com wrote: It will be a good idea to pass the memo to the guys that design the notability rules. http://ioquake3.org/2009/02/20/ioquake3-entry-deleted-from-wikipedia/ Notability is decided by each wiki individually. The policies of the

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Bilal Abdul Kader
I think having access to them on Commons repository is much easier to handle. A subset should be good enough. Having 11 TB of images needs huge research capabilities in order to handle all of them and work with all of them. Maybe a special API or advanced API functions would allow people enough

Re: [Wikitech-l] Boing Boing applauds stats.grok.se!

2010-01-08 Thread Lars Aronsson
David Gerard wrote: http://www.boingboing.net/2010/01/07/wikibumps.html On sv.wikipedia there is a gadget that creates a stats tab on each page. That's very useful. Why don't more languages of Wikipedia have that gadget installed? -- Lars Aronsson (l...@aronsson.se) Aronsson Datateknik -

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Aryeh Gregor
On Fri, Jan 8, 2010 at 3:28 PM, Bilal Abdul Kader bila...@gmail.com wrote: I think having access to them on Commons repository is much easier to handle. A subset should be good enough. Having 11 TB of images needs huge research capabilities in order to handle all of them and work with all of

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Domas Mituzas
Well, if there were an rsyncd you could just fetch the ones you wanted arbitrarily. rsyncd is fail for large file mass delivery, and it is fail when exposed to masses. Domas ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Robert Rohde
Can someone articulate what the use case is? Is there someone out there who could use a 5 TB image archive but is disappointed it doesn't exist? Seems rather implausible. If not, then I assume that everyone is really after only some subset of the files. If that's the case we should try to

Re: [Wikitech-l] Boing Boing applauds stats.grok.se!

2010-01-08 Thread Robert Rohde
On Fri, Jan 8, 2010 at 12:38 PM, Lars Aronsson l...@aronsson.se wrote: David Gerard wrote: http://www.boingboing.net/2010/01/07/wikibumps.html On sv.wikipedia there is a gadget that creates a stats tab on each page. That's very useful. Why don't more languages of Wikipedia have that gadget

Re: [Wikitech-l] Unified gadgets (was: stats.grok.se)

2010-01-08 Thread Lars Aronsson
Robert Rohde wrote: Local admins control the installation of gadgets. On Enwiki the process is at: http://en.wikipedia.org/wiki/Wikipedia:Gadget Exactly! This is poor design. I have an account (through SUL) on the Ukrainian Wikipedia because I sometimes add interwiki links there. I want the

Re: [Wikitech-l] Unified gadgets (was: stats.grok.se)

2010-01-08 Thread Casey Brown
On Fri, Jan 8, 2010 at 4:14 PM, Lars Aronsson l...@aronsson.se wrote: Exactly! This is poor design. I have an account (through SUL) on the Ukrainian Wikipedia because I sometimes add interwiki links there. I want the same gadgets there, but I don't speak Ukrainian and I can't go around

Re: [Wikitech-l] CSS/javascript injection for AJAX requests

2010-01-08 Thread Paul Copperman
The styles and js are already available in the parser output in -mHeadItems. Should be trivial to expose them through the API via action=parse. So I've put this on bugzilla, see https://bugzilla.wikimedia.org/show_bug.cgi?id=22061 P.Copp On Fri, Jan 8, 2010 at 5:42 PM, Carl (CBM)

Re: [Wikitech-l] Bugzilla Vs other trackers.

2010-01-08 Thread Platonides
Tei wrote: It will be a good idea to pass the memo to the guys that design the notability rules. http://ioquake3.org/2009/02/20/ioquake3-entry-deleted-from-wikipedia/ Since most (all?) opensource proyects are webonly, and don't get in the press, are on some obscure area of the web where

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Platonides
Gregory Maxwell wrote: Er. I've maintained a non-WMF disaster recovery archive for a long time, though its no longer completely current since the rsync went away and web fetching is lossy. And the box run out of disk space. We could try until it fills again, though. A sysadmin fixing images

Re: [Wikitech-l] 100% open source stack (was Re: Bugzilla Vs other trackers.)

2010-01-08 Thread Tim Starling
Platonides wrote: What were the reasons for replacing lighttpd with Sun Java System Web Server ? Probably the same reason that the toolserver uses Confluence instead of MediaWiki. -- Tim Starling ___ Wikitech-l mailing list

Re: [Wikitech-l] 100% open source stack (was Re: Bugzilla Vs other trackers.)

2010-01-08 Thread John Vandenberg
On Sat, Jan 9, 2010 at 12:10 PM, Tim Starling tstarl...@wikimedia.org wrote: Platonides wrote: What were the reasons for replacing lighttpd with Sun Java System Web Server ? Probably the same reason that the toolserver uses Confluence instead of MediaWiki. It only contains one page, which

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Anthony
On Fri, Jan 8, 2010 at 10:56 AM, Aryeh Gregor simetrical+wikil...@gmail.comsimetrical%2bwikil...@gmail.com wrote: The sensible bandwidth-saving way to do it would be to set up an rsync daemon on the image servers, and let people use that. The bandwidth-saving way to do things would be to

Re: [Wikitech-l] downloading wikipedia database dumps

2010-01-08 Thread Anthony
On Fri, Jan 8, 2010 at 9:06 PM, Gregory Maxwell gmaxw...@gmail.com wrote: Yea, well, you can't easily eliminate all the internal points of failure. someone with root loses control of their access and someone nasty wipes everything is really hard to protect against with online systems. Isn't

Re: [Wikitech-l] 100% open source stack (was Re: Bugzilla Vs other trackers.)

2010-01-08 Thread Tim Starling
John Vandenberg wrote: On Sat, Jan 9, 2010 at 12:10 PM, Tim Starling tstarl...@wikimedia.org wrote: Platonides wrote: What were the reasons for replacing lighttpd with Sun Java System Web Server ? Probably the same reason that the toolserver uses Confluence instead of MediaWiki. It only