Re: [gentoo-user] terrible performance with btrfs on LVM2 using a WD 2TB green drive
Am 15.03.2011 07:50, schrieb Matthew Marlowe: > >> My problem is that LVM2 is not supported in parted which is the >> recommended tool to deal with this. >> >> I suspect I only need to map the individual PE to a particular start >> sector on each drive, not btrfs, but then there is stripe/block sizes to >> consider as well ... WD also are recommending 1mb sector boundaries for >> best performance - I can see a reinstall coming up :) >> > > I have on my workstation: > 2 WD 2TB Black Drives > 5 WD 2TB RE4 Drives > > Some notes: > - The black drives have horrible reliability, poor sector remapping, and have > certain standard drive features to make them unusable in raid. I would not > buy them again. I'm not sure how similar the green drives are. Green drives also seem to be affected: http://doug.warner.fm/d/blog/2009/11/Western-Digital-15TB-Green-Drives-Not-your-Linux-Software-RAID signature.asc Description: OpenPGP digital signature
Re: [gentoo-user] Re: terrible performance with btrfs on LVM2 using a WD 2TB green drive
On 03/15/2011 04:26:44 PM, James wrote: > Bill Kenworthy iinet.net.au> writes: > > > H, I've been contemplating btrfs on some new installs > with the eventual goal of a CEPH network file system, on top > of ext4 and/or btrfs. Is this issue just with the drivers, or > related to btrfs too? > But beware of the bug I've reported last Saturday which is revealed by /bin/cp if you have >= coreutils-8.10 installed. Only the 2.6.38 kernel (from today) has fixed this for btrfs but AFAIK not for ext4, yet. Helmut. -- Helmut Jarausch Lehrstuhl fuer Numerische Mathematik RWTH - Aachen University D 52056 Aachen, Germany
Re: [gentoo-user] terrible performance with btrfs on LVM2 using a WD 2TB green drive
On Wednesday 16 March 2011 09:53:37 Florian Philipp wrote: > Am 15.03.2011 07:50, schrieb Matthew Marlowe: > >> My problem is that LVM2 is not supported in parted which is the > >> recommended tool to deal with this. > >> > >> I suspect I only need to map the individual PE to a particular start > >> sector on each drive, not btrfs, but then there is stripe/block sizes > >> to > >> consider as well ... WD also are recommending 1mb sector boundaries > >> for > >> best performance - I can see a reinstall coming up :) > > > > I have on my workstation: > > 2 WD 2TB Black Drives > > 5 WD 2TB RE4 Drives > > > > Some notes: > > - The black drives have horrible reliability, poor sector remapping, and > > have certain standard drive features to make them unusable in raid. I > > would not buy them again. I'm not sure how similar the green drives > > are. > > Green drives also seem to be affected: > http://doug.warner.fm/d/blog/2009/11/Western-Digital-15TB-Green-Drives-Not-y > our-Linux-Software-RAID I have 6 Green drives (WDC WD15EARS) in a RAID5 and I have not seen any issues. Only issue I saw was 1 drive with "reallocated" sectors as also mentioned by one of the commenters on that page. Replaced that drive and no further problems so far. I did, however, spent time to align the sectors correctly for the Raid- partitions, striping, LVM blocksize and the mkfs-statements. Without those, performance was really bad. I would prefer to see proper support for 4K-sector-size drives. -- Joost
Re: [gentoo-user] Automation: Ripping DVDs to disk
On Wednesday 09 March 2011 18:27:59 Stroller wrote: > I've got a Perl script to wrapper `dvdbackup && mkisofs`, reduce typing a > little and do some error-checking. It tries to preserve some of the DVD > metadata (TITLE &c), and you might find it handy if handing off > disk-swapping to your teenage progeny. My script is currently too ugly for > me to distribute widely - as soon as I finished I realised I want to > rewrite it from scratch - but I think it's fairly robust and if you want a > copy for your personal use only then email me off-list. In the next version > I'd like to remove the "unskippable" flag from all titles / chapters, as it > seems a little daft to have ripped all one's DVDs to a network RAID array, > and yet still have to suffer the dumb FBI warnings. All the Windows rippers > do this, so I assume it's possible to implement, but I have no idea how > difficult. Hi Stroller, I also would like to have a copy of your perl-script for this. It would make my life a lot easier trying to convert my dvd-collection. As for the "unskippable" flag, I wonder if the other tools "rebuild" the menu structure and remove it that way. I have in the past played with making dvd- menus myself and it wasn't too hard. (following the howtos) Thanks in advance, Joost
Re: [gentoo-user] Automation: Ripping DVDs to disk
On 16/3/2011, at 12:44pm, Joost Roeleveld wrote: > On Wednesday 09 March 2011 18:27:59 Stroller wrote: >> I've got a Perl script to wrapper `dvdbackup && mkisofs`, reduce typing a >> little and do some error-checking. ... In the next version >> I'd like to remove the "unskippable" flag from all titles / chapters, as it >> seems a little daft to have ripped all one's DVDs to a network RAID array, >> and yet still have to suffer the dumb FBI warnings. All the Windows rippers >> do this, so I assume it's possible to implement, but I have no idea how >> difficult. > ... > As for the "unskippable" flag, I wonder if the other tools "rebuild" the menu > structure and remove it that way. I have in the past played with making dvd- > menus myself and it wasn't too hard. (following the howtos) That one can make DVD menus with GUI Linux applications indicates that it must be possible to make such changes. I would imagine (or at least hope) that it's not so much a case of rebuilding the menus from scratch, but just as case of flipping a single bit - the equivalent in a binary-file of changing "skippable=no" to "yes" in a text file. What programs have you used to make DVD menus in the past? Stroller.
Re: [gentoo-user] Automation: Ripping DVDs to disk
On Wednesday 16 March 2011 13:54:57 Stroller wrote: > On 16/3/2011, at 12:44pm, Joost Roeleveld wrote: > > On Wednesday 09 March 2011 18:27:59 Stroller wrote: > >> I've got a Perl script to wrapper `dvdbackup && mkisofs`, reduce > >> typing a little and do some error-checking. ... In the next version > >> I'd like to remove the "unskippable" flag from all titles / chapters, > >> as it seems a little daft to have ripped all one's DVDs to a network > >> RAID array, and yet still have to suffer the dumb FBI warnings. All > >> the Windows rippers do this, so I assume it's possible to implement, > >> but I have no idea how difficult. > > > > ... > > As for the "unskippable" flag, I wonder if the other tools "rebuild" the > > menu structure and remove it that way. I have in the past played with > > making dvd- menus myself and it wasn't too hard. (following the howtos) > > That one can make DVD menus with GUI Linux applications indicates that it > must be possible to make such changes. I would imagine (or at least hope) > that it's not so much a case of rebuilding the menus from scratch, but just > as case of flipping a single bit - the equivalent in a binary-file of > changing "skippable=no" to "yes" in a text file. > > What programs have you used to make DVD menus in the past? DVD Author, there are some howto's for it on the web, including on on the gentoo forums: http://forums.gentoo.org/viewtopic.php?t=117709 I don't know how that menu works, but if anyone knows which file contains it, we might be able to edit that bit. If anyone knows how to create the "dvd-author" xml-config-files from an existing DVD, I'm sure, with some clever scripting, we can amend that particular flag. It is in my todo-list, but it doesn't have a very high priority at the moment. -- Joost
Re: [gentoo-user] Automation: Ripping DVDs to disk
On Wednesday 16 March 2011 15:17:14 Joost Roeleveld wrote: > On Wednesday 16 March 2011 13:54:57 Stroller wrote: > > On 16/3/2011, at 12:44pm, Joost Roeleveld wrote: > > > On Wednesday 09 March 2011 18:27:59 Stroller wrote: > > >> I've got a Perl script to wrapper `dvdbackup && mkisofs`, reduce > > >> typing a little and do some error-checking. ... In the next > > >> version > > >> I'd like to remove the "unskippable" flag from all titles / > > >> chapters, > > >> as it seems a little daft to have ripped all one's DVDs to a > > >> network > > >> RAID array, and yet still have to suffer the dumb FBI warnings. > > >> All > > >> the Windows rippers do this, so I assume it's possible to > > >> implement, > > >> but I have no idea how difficult. > > > > > > ... > > > As for the "unskippable" flag, I wonder if the other tools "rebuild" > > > the menu structure and remove it that way. I have in the past > > > played with making dvd- menus myself and it wasn't too hard. > > > (following the howtos) > > > > That one can make DVD menus with GUI Linux applications indicates that > > it > > must be possible to make such changes. I would imagine (or at least > > hope) > > that it's not so much a case of rebuilding the menus from scratch, but > > just as case of flipping a single bit - the equivalent in a binary-file > > of changing "skippable=no" to "yes" in a text file. > > > > What programs have you used to make DVD menus in the past? > > DVD Author, there are some howto's for it on the web, including on on the > gentoo forums: > http://forums.gentoo.org/viewtopic.php?t=117709 > > I don't know how that menu works, but if anyone knows which file contains > it, we might be able to edit that bit. > > If anyone knows how to create the "dvd-author" xml-config-files from an > existing DVD, I'm sure, with some clever scripting, we can amend that > particular flag. It is in my todo-list, but it doesn't have a very high > priority at the moment. > > -- > Joost Stroller (and others), While having a quick search, I found the following page: http://old.nabble.com/dvdunauthor-xml-file-dump,-then-import-to-dvdauthor-with- errors...-td20324985.html This may be usefull to someone with good script-fu? :) -- Joost
Re: [gentoo-user] Automation: Ripping DVDs to disk
On Wed, Mar 16, 2011 at 7:44 AM, Joost Roeleveld wrote: > As for the "unskippable" flag, I wonder if the other tools "rebuild" the menu > structure and remove it that way. I have in the past played with making dvd- > menus myself and it wasn't too hard. (following the howtos) It is the UOP flag (user operation prohibition). Most "DVD copier" programs who make whole copies of discs (like K9Copy or DVD 9to5 in linux or DVDShrink on Windows) remove this flag and the region restrictions, too. The DVD's author can define actions for every type of button press on the remote control, or prohibit them. Sometimes they work-around the removal of UOPs by defining the keys with invalid actions so even if the prohibition is removed, the key still doesn't work. In that case it's probably more difficult to fix it yourself. A list of the UOP flags is here: http://www.dvd-replica.com/DVD/cmd-7.php
[gentoo-user] Re: terrible performance with btrfs on LVM2 using a WD 2TB green drive
Bill Kenworthy iinet.net.au> writes: > > How is btrfs , from the "driver's seat"? > I have had one instance of a more serious corruption caused by > some bug in btrfs that needed the latest btrfsck from git to fix > offline - later kernels do not suffer from this apparently. Interesting... BTRFS > Otherwise I have been hammering it as a dirvish backup server and except > for speed its fine - and I wont be able to confirm that the speed issue > is btrfs's fault until I get the partitioning correct - and dirvish is > somewhat unique in what it does so it could be a special case. I found the 4k sectors problem. Weird. btrfs should be fast thanks for all the responses, james
[gentoo-user] xorg-server 1.9.4: keybord very slow in consoles
Hi list, I have a problem with configuring xorg-server 1.9.4. It starts and works OK. But just after it has started, the keyboard begins to work very slowly in all virtual consoles that were open prior to X. If I login in a new virtual console, the keyboard works well until I enter into an interactive tool (man, less). After that - the same behavior. I installed xorg in according to these instructions [1], then added InputClass definitions from this thread [2]. Please suggest what I could have done wrong. xorg.conf - http://pastebin.com/Wwmy1eFf Xorg.0.log - http://pastebin.com/5aqCLKnH make.conf - http://pastebin.com/7St3T1ec http://pastebin.com/YpCm9puZ emerge --info - http://pastebin.com/NZUQYqhh kernel .config - http://pastebin.com/E6Syb7Ay Laptop ASUS WJ7. [1] - http://www.gentoo.org/doc/en/xorg-config.xml [2] - http://www.gossamer-threads.com/lists/gentoo/user/226332?do=post_view_threaded -- Regards, Alex
Re: [gentoo-user] Switching to a hardened profile and back again
On 3/15/2011 2:05 PM, Grant wrote: > A dev is asking me to switch to a hardened profile in order to test a > fix. I'm happy to go through the process, but is there a chance my > laptop could be unusable after the switch? If that happens I'll be in > real trouble. Will I be able to switch back to a non-hardened profile > afterward? I plan to follow this guide: > > http://www.gentoo.org/proj/en/hardened/hardenedfaq.xml#hardenedprofile First off, is there a reason you want to switch back to non-hardened? I run hardened on all my machines by default; almost every package in portage is now hardened-aware and builds/runs correctly. For those few that don't, there's paxctl and/or softmode (looking at you, openoffice) I've gone both ways with no real issues; though admittedly not on the same machine :) I'm assuming you're including a switch to a hardened kernel as part of this. That's the biggest possible source of problems: if you have a PAX-enabled kernel then all of your binaries need to be built by the hardened tool chain, or there is a decent chance they'll fail. Definitely follow the FAQ for the details, but the basic process should be: * switch profiles -> hardened * emerge gcc glibc binutils * emerge @system * emerge @world * build then boot hardened kernel * * boot non-hardened kernel * switch profiles -> non-hardened * emerge gcc glibc binutils * emerge @system * emerge @world Note that the emerge @world emerges are definitely overkill time-wise but much, much safer and simpler unless you are very aware of what you're doing, what the packages are doing, how hardened's features interact, etc. Also, when building your PAX kernel, MAKE SURE YOU INCLUDE SOFTMODE SUPPORT That way, if something misbehaves and you can't fix it you can enable soft mode and PAX will stop killing things on you. > BTW, are emerge -e world and emerge -e system both necessary? I > thought emerge -e world would rebuild everything. IIRC, @system is not in @world unless you put it there yourself. (This might depend on your portage version, though). --Mike
Re: [gentoo-user] xorg-server 1.9.4: keybord very slow in consoles
16 марта 2011 г., 22:05:32, Alexey Mishustin пишет: > Hi list, > I have a problem with configuring xorg-server 1.9.4. > It starts and works OK. But just after it has started, the keyboard begins > to work very slowly in all virtual consoles that were open prior to X. Not only slowly. Also, there is no cursor. It doesn't blink. But if I press keys and then several times press Enter, the command that I pressed appears, then slowly computes. It looks like this: (I'm pressing `pwd` not seeing cursor and pressing letters) # # #pwd # /etc # Also, it's impossible to scroll with Shift+PgUp. Weird! > If I login in a new virtual console, the keyboard works well until I enter > into an interactive tool (man, less). After that - the same behavior. > I installed xorg in according to these instructions [1], then added > InputClass definitions from this thread [2]. > Please suggest what I could have done wrong. > xorg.conf - http://pastebin.com/Wwmy1eFf > Xorg.0.log - http://pastebin.com/5aqCLKnH > make.conf - http://pastebin.com/7St3T1ec > http://pastebin.com/YpCm9puZ > emerge --info - http://pastebin.com/NZUQYqhh > kernel .config - http://pastebin.com/E6Syb7Ay > Laptop ASUS WJ7. > [1] - http://www.gentoo.org/doc/en/xorg-config.xml > [2] - > http://www.gossamer-threads.com/lists/gentoo/user/226332?do=post_view_threaded -- Regards, Alex
Re: [gentoo-user] xorg-server 1.9.4: keybord very slow in consoles
On Wednesday 16 March 2011 19:05:32 Alexey Mishustin wrote: > Hi list, > > I have a problem with configuring xorg-server 1.9.4. > > It starts and works OK. But just after it has started, the keyboard begins > to work very slowly in all virtual consoles that were open prior to X. > > If I login in a new virtual console, the keyboard works well until I enter > into an interactive tool (man, less). After that - the same behavior. > > I installed xorg in according to these instructions [1], then added > InputClass definitions from this thread [2]. > > Please suggest what I could have done wrong. > > xorg.conf - http://pastebin.com/Wwmy1eFf > Xorg.0.log - http://pastebin.com/5aqCLKnH > make.conf - http://pastebin.com/7St3T1ec > http://pastebin.com/YpCm9puZ > emerge --info - http://pastebin.com/NZUQYqhh > kernel .config - http://pastebin.com/E6Syb7Ay > > Laptop ASUS WJ7. > > [1] - http://www.gentoo.org/doc/en/xorg-config.xml > [2] - > http://www.gossamer-threads.com/lists/gentoo/user/226332?do=post_view_thre > aded Alex, you have defined both your keyboard and mouse as InputDevice under Section "ServerLayout", but then later on you specify them both as InputClass. Comment out the InputDevice sections or remove them completely as shown in thread [2] above. HTH. -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Re: Gentoo Live 11.0
On Tue, Mar 15, 2011 at 11:52:25PM +, James wrote > OK Mark and Neil. I got the picture. I'll flush > this out as I do seem to still have some > 32bit apps on the 64bit AMD systems. Most likely > I can get rid of these. WINE, which runs some Windows apps, will not build on a 64-bit system without multilib support. I found that out "the hard way" after installing pure 64-bit on my machine. Rather than wipe+reinstall, I ended up installing a 32-bit Gentoo guest under qemu-kvm, and installed WINE on that. -- Walter Dnes
Re: [gentoo-user] Switching to a hardened profile and back again
On Wednesday 16 March 2011 19:54:53 Mike Edenfield wrote: > IIRC, @system is not in @world unless you put it there yourself. (This > might depend on your portage version, though). I'm sure I once saw a comment in a portage version that @system was being included in @world to preserve earlier behaviour. -- Rgds Peter
Re: [gentoo-user] xorg-server 1.9.4: keybord very slow in consoles
3/16/2011, "Mick" вы писали: >On Wednesday 16 March 2011 19:05:32 Alexey Mishustin wrote: >> Hi list, >> >> I have a problem with configuring xorg-server 1.9.4. >> >> It starts and works OK. But just after it has started, the keyboard begins >> to work very slowly in all virtual consoles that were open prior to X. >> >> If I login in a new virtual console, the keyboard works well until I enter >> into an interactive tool (man, less). After that - the same behavior. >> >> I installed xorg in according to these instructions [1], then added >> InputClass definitions from this thread [2]. >> >> Please suggest what I could have done wrong. >> >> xorg.conf - http://pastebin.com/Wwmy1eFf >> Xorg.0.log - http://pastebin.com/5aqCLKnH >> make.conf - http://pastebin.com/7St3T1ec >> http://pastebin.com/YpCm9puZ >> emerge --info - http://pastebin.com/NZUQYqhh >> kernel .config - http://pastebin.com/E6Syb7Ay >> >> Laptop ASUS WJ7. >> >> [1] - http://www.gentoo.org/doc/en/xorg-config.xml >> [2] - >> http://www.gossamer-threads.com/lists/gentoo/user/226332?do=post_view_thre >> aded > >Alex, you have defined both your keyboard and mouse as InputDevice under >Section "ServerLayout", but then later on you specify them both as InputClass. Aha... I'll try tonight, when at home. Thank you! -- Regards, Alex