Re: [gentoo-user] terrible performance with btrfs on LVM2 using a WD 2TB green drive

2011-03-16 Thread Florian Philipp
Am 15.03.2011 07:50, schrieb Matthew Marlowe:
> 
>> My problem is that LVM2 is not supported in parted which is the
>> recommended tool to deal with this.
>>
>> I suspect I only need to map the individual PE to a particular start
>> sector on each drive, not btrfs, but then there is stripe/block sizes to
>> consider as well ... WD also are recommending 1mb sector boundaries for
>> best performance - I can see a reinstall coming up :)
>>
>  
> I have on my workstation:
> 2 WD 2TB Black Drives
> 5 WD 2TB RE4 Drives
> 
> Some notes:
> - The black drives have horrible reliability, poor sector remapping, and have 
> certain standard drive features to make them unusable in raid.  I would not 
> buy them again. I'm not sure how similar the green drives are.

Green drives also seem to be affected:
http://doug.warner.fm/d/blog/2009/11/Western-Digital-15TB-Green-Drives-Not-your-Linux-Software-RAID



signature.asc
Description: OpenPGP digital signature


Re: [gentoo-user] Re: terrible performance with btrfs on LVM2 using a WD 2TB green drive

2011-03-16 Thread Helmut Jarausch
On 03/15/2011 04:26:44 PM, James wrote:
> Bill Kenworthy  iinet.net.au> writes:
> 
> 
> H, I've been contemplating btrfs on some new installs
> with the eventual goal of a CEPH network file system, on top
> of ext4 and/or btrfs. Is this issue just with the drivers, or 
> related to btrfs too? 
> 

But beware of the bug I've reported last Saturday which
is revealed by  /bin/cp  if you have  >= coreutils-8.10
installed.
Only the 2.6.38 kernel (from today) has fixed this for btrfs
but AFAIK not for ext4, yet.

Helmut.


-- 
Helmut Jarausch
Lehrstuhl fuer Numerische Mathematik
RWTH - Aachen University
D 52056 Aachen, Germany



Re: [gentoo-user] terrible performance with btrfs on LVM2 using a WD 2TB green drive

2011-03-16 Thread Joost Roeleveld
On Wednesday 16 March 2011 09:53:37 Florian Philipp wrote:
> Am 15.03.2011 07:50, schrieb Matthew Marlowe:
> >> My problem is that LVM2 is not supported in parted which is the
> >> recommended tool to deal with this.
> >> 
> >> I suspect I only need to map the individual PE to a particular start
> >> sector on each drive, not btrfs, but then there is stripe/block sizes
> >> to
> >> consider as well ... WD also are recommending 1mb sector boundaries
> >> for
> >> best performance - I can see a reinstall coming up :)
> > 
> > I have on my workstation:
> > 2 WD 2TB Black Drives
> > 5 WD 2TB RE4 Drives
> > 
> > Some notes:
> > - The black drives have horrible reliability, poor sector remapping, and
> > have certain standard drive features to make them unusable in raid.  I
> > would not buy them again. I'm not sure how similar the green drives
> > are.
> 
> Green drives also seem to be affected:
> http://doug.warner.fm/d/blog/2009/11/Western-Digital-15TB-Green-Drives-Not-y
> our-Linux-Software-RAID

I have 6 Green drives (WDC WD15EARS) in a RAID5 and I have not seen any 
issues.
Only issue I saw was 1 drive with "reallocated" sectors as also mentioned by 
one of the commenters on that page.
Replaced that drive and no further problems so far.

I did, however, spent time to align the sectors correctly for the Raid-
partitions, striping, LVM blocksize and the mkfs-statements.
Without those, performance was really bad.

I would prefer to see proper support for 4K-sector-size drives.

--
Joost



Re: [gentoo-user] Automation: Ripping DVDs to disk

2011-03-16 Thread Joost Roeleveld
On Wednesday 09 March 2011 18:27:59 Stroller wrote:
> I've got a Perl script to wrapper `dvdbackup && mkisofs`, reduce typing a
> little and do some error-checking. It tries to preserve some of the DVD
> metadata (TITLE &c), and you might find it handy if handing off
> disk-swapping to your teenage progeny. My script is currently too ugly for
> me to distribute widely - as soon as I finished I realised I want to
> rewrite it from scratch - but I think it's fairly robust and if you want a
> copy for your personal use only then email me off-list. In the next version
> I'd like to remove the "unskippable" flag from all titles / chapters, as it
> seems a little daft to have ripped all one's DVDs to a network RAID array,
> and yet still have to suffer the dumb FBI warnings. All the Windows rippers
> do this, so I assume it's possible to implement, but I have no idea how
> difficult.

Hi Stroller,

I also would like to have a copy of your perl-script for this. It would make 
my life a lot easier trying to convert my dvd-collection.

As for the "unskippable" flag, I wonder if the other tools "rebuild" the menu 
structure and remove it that way. I have in the past played with making dvd-
menus myself and it wasn't too hard. (following the howtos)

Thanks in advance,

Joost



Re: [gentoo-user] Automation: Ripping DVDs to disk

2011-03-16 Thread Stroller

On 16/3/2011, at 12:44pm, Joost Roeleveld wrote:

> On Wednesday 09 March 2011 18:27:59 Stroller wrote:
>> I've got a Perl script to wrapper `dvdbackup && mkisofs`, reduce typing a
>> little and do some error-checking. ... In the next version
>> I'd like to remove the "unskippable" flag from all titles / chapters, as it
>> seems a little daft to have ripped all one's DVDs to a network RAID array,
>> and yet still have to suffer the dumb FBI warnings. All the Windows rippers
>> do this, so I assume it's possible to implement, but I have no idea how
>> difficult.
> ...
> As for the "unskippable" flag, I wonder if the other tools "rebuild" the menu 
> structure and remove it that way. I have in the past played with making dvd-
> menus myself and it wasn't too hard. (following the howtos)

That one can make DVD menus with GUI Linux applications indicates that it must 
be possible to make such changes. I would imagine (or at least hope) that it's 
not so much a case of rebuilding the menus from scratch, but just as case of 
flipping a single bit - the equivalent in a binary-file of changing 
"skippable=no" to "yes" in a text file.

What programs have you used to make DVD menus in the past?

Stroller.




Re: [gentoo-user] Automation: Ripping DVDs to disk

2011-03-16 Thread Joost Roeleveld
On Wednesday 16 March 2011 13:54:57 Stroller wrote:
> On 16/3/2011, at 12:44pm, Joost Roeleveld wrote:
> > On Wednesday 09 March 2011 18:27:59 Stroller wrote:
> >> I've got a Perl script to wrapper `dvdbackup && mkisofs`, reduce
> >> typing a little and do some error-checking. ... In the next version
> >> I'd like to remove the "unskippable" flag from all titles / chapters,
> >> as it seems a little daft to have ripped all one's DVDs to a network
> >> RAID array, and yet still have to suffer the dumb FBI warnings. All
> >> the Windows rippers do this, so I assume it's possible to implement,
> >> but I have no idea how difficult.
> > 
> > ...
> > As for the "unskippable" flag, I wonder if the other tools "rebuild" the
> > menu structure and remove it that way. I have in the past played with
> > making dvd- menus myself and it wasn't too hard. (following the howtos)
> 
> That one can make DVD menus with GUI Linux applications indicates that it
> must be possible to make such changes. I would imagine (or at least hope)
> that it's not so much a case of rebuilding the menus from scratch, but just
> as case of flipping a single bit - the equivalent in a binary-file of
> changing "skippable=no" to "yes" in a text file.
> 
> What programs have you used to make DVD menus in the past?

DVD Author, there are some howto's for it on the web, including on on the 
gentoo forums:
http://forums.gentoo.org/viewtopic.php?t=117709

I don't know how that menu works, but if anyone knows which file contains it, 
we might be able to edit that bit.

If anyone knows how to create the "dvd-author" xml-config-files from an 
existing 
DVD, I'm sure, with some clever scripting, we can amend that particular flag.
It is in my todo-list, but it doesn't have a very high priority at the moment.

--
Joost



Re: [gentoo-user] Automation: Ripping DVDs to disk

2011-03-16 Thread Joost Roeleveld
On Wednesday 16 March 2011 15:17:14 Joost Roeleveld wrote:
> On Wednesday 16 March 2011 13:54:57 Stroller wrote:
> > On 16/3/2011, at 12:44pm, Joost Roeleveld wrote:
> > > On Wednesday 09 March 2011 18:27:59 Stroller wrote:
> > >> I've got a Perl script to wrapper `dvdbackup && mkisofs`, reduce
> > >> typing a little and do some error-checking. ... In the next
> > >> version
> > >> I'd like to remove the "unskippable" flag from all titles /
> > >> chapters,
> > >> as it seems a little daft to have ripped all one's DVDs to a
> > >> network
> > >> RAID array, and yet still have to suffer the dumb FBI warnings.
> > >> All
> > >> the Windows rippers do this, so I assume it's possible to
> > >> implement,
> > >> but I have no idea how difficult.
> > > 
> > > ...
> > > As for the "unskippable" flag, I wonder if the other tools "rebuild"
> > > the menu structure and remove it that way. I have in the past
> > > played with making dvd- menus myself and it wasn't too hard.
> > > (following the howtos)
> > 
> > That one can make DVD menus with GUI Linux applications indicates that
> > it
> > must be possible to make such changes. I would imagine (or at least
> > hope)
> > that it's not so much a case of rebuilding the menus from scratch, but
> > just as case of flipping a single bit - the equivalent in a binary-file
> > of changing "skippable=no" to "yes" in a text file.
> > 
> > What programs have you used to make DVD menus in the past?
> 
> DVD Author, there are some howto's for it on the web, including on on the
> gentoo forums:
> http://forums.gentoo.org/viewtopic.php?t=117709
> 
> I don't know how that menu works, but if anyone knows which file contains
> it, we might be able to edit that bit.
> 
> If anyone knows how to create the "dvd-author" xml-config-files from an
> existing DVD, I'm sure, with some clever scripting, we can amend that
> particular flag. It is in my todo-list, but it doesn't have a very high
> priority at the moment.
> 
> --
> Joost

Stroller (and others),

While having a quick search, I found the following page:
http://old.nabble.com/dvdunauthor-xml-file-dump,-then-import-to-dvdauthor-with-
errors...-td20324985.html

This may be usefull to someone with good script-fu? :)

--
Joost



Re: [gentoo-user] Automation: Ripping DVDs to disk

2011-03-16 Thread Paul Hartman
On Wed, Mar 16, 2011 at 7:44 AM, Joost Roeleveld  wrote:
> As for the "unskippable" flag, I wonder if the other tools "rebuild" the menu
> structure and remove it that way. I have in the past played with making dvd-
> menus myself and it wasn't too hard. (following the howtos)

It is the UOP flag (user operation prohibition). Most "DVD copier"
programs who make whole copies of discs (like K9Copy or DVD 9to5 in
linux or DVDShrink on Windows) remove this flag and the region
restrictions, too.

The DVD's author can define actions for every type of button press on
the remote control, or prohibit them. Sometimes they work-around the
removal of UOPs by defining the keys with invalid actions so even if
the prohibition is removed, the key still doesn't work. In that case
it's probably more difficult to fix it yourself.

A list of the UOP flags is here:
http://www.dvd-replica.com/DVD/cmd-7.php



[gentoo-user] Re: terrible performance with btrfs on LVM2 using a WD 2TB green drive

2011-03-16 Thread james
Bill Kenworthy  iinet.net.au> writes:

> > How is btrfs , from the "driver's seat"?

>  I have had  one instance of a more serious corruption caused by 
> some bug in btrfs that needed the latest btrfsck from git to fix 
> offline - later kernels do not suffer from this apparently.

Interesting...
BTRFS


> Otherwise I have been hammering it as a dirvish backup server and except
> for speed its fine - and I wont be able to confirm that the speed issue
> is btrfs's fault until I get the partitioning correct - and dirvish is
> somewhat unique in what it does so it could be a special case.

I found the 4k sectors problem.
Weird.

btrfs should be
fast


thanks
for all
the responses,


james






[gentoo-user] xorg-server 1.9.4: keybord very slow in consoles

2011-03-16 Thread Alexey Mishustin
Hi list,

I have a problem with configuring xorg-server 1.9.4.

It starts and works OK. But just after it has started, the keyboard begins to 
work very slowly in all virtual consoles that were open prior to X.

If I login in a new virtual console, the keyboard works well until I enter into 
an interactive tool (man, less). After that - the same behavior.

I installed xorg in according to these instructions [1], then added InputClass 
definitions from this thread [2].

Please suggest what I could have done wrong.

xorg.conf - http://pastebin.com/Wwmy1eFf
Xorg.0.log - http://pastebin.com/5aqCLKnH
make.conf - http://pastebin.com/7St3T1ec
http://pastebin.com/YpCm9puZ
emerge --info - http://pastebin.com/NZUQYqhh
kernel .config - http://pastebin.com/E6Syb7Ay

Laptop ASUS WJ7.

[1] - http://www.gentoo.org/doc/en/xorg-config.xml
[2] - 
http://www.gossamer-threads.com/lists/gentoo/user/226332?do=post_view_threaded

--
Regards, Alex




Re: [gentoo-user] Switching to a hardened profile and back again

2011-03-16 Thread Mike Edenfield
On 3/15/2011 2:05 PM, Grant wrote:
> A dev is asking me to switch to a hardened profile in order to test a
> fix.  I'm happy to go through the process, but is there a chance my
> laptop could be unusable after the switch?  If that happens I'll be in
> real trouble.  Will I be able to switch back to a non-hardened profile
> afterward?  I plan to follow this guide:
> 
> http://www.gentoo.org/proj/en/hardened/hardenedfaq.xml#hardenedprofile

First off, is there a reason you want to switch back to non-hardened? I
run hardened on all my machines by default; almost every package in
portage is now hardened-aware and builds/runs correctly. For those few
that don't, there's paxctl and/or softmode (looking at you, openoffice)

I've gone both ways with no real issues; though admittedly not on the
same machine :)

I'm assuming you're including a switch to a hardened kernel as part of
this. That's the biggest possible source of problems: if you have a
PAX-enabled kernel then all of your binaries need to be built by the
hardened tool chain, or there is a decent chance they'll fail.

Definitely follow the FAQ for the details, but the basic process should be:

* switch profiles -> hardened
* emerge gcc glibc binutils
* emerge @system
* emerge @world
* build then boot hardened kernel

* 

* boot non-hardened kernel
* switch profiles -> non-hardened
* emerge gcc glibc binutils
* emerge @system
* emerge @world

Note that the emerge @world emerges are definitely overkill time-wise
but much, much safer and simpler unless you are very aware of what
you're doing, what the packages are doing, how hardened's features
interact, etc.

Also, when building your PAX kernel,

MAKE SURE YOU INCLUDE SOFTMODE SUPPORT

That way, if something misbehaves and you can't fix it you can enable
soft mode and PAX will stop killing things on you.

> BTW, are emerge -e world and emerge -e system both necessary?  I
> thought emerge -e world would rebuild everything.

IIRC, @system is not in @world unless you put it there yourself. (This
might depend on your portage version, though).

--Mike



Re: [gentoo-user] xorg-server 1.9.4: keybord very slow in consoles

2011-03-16 Thread Alexey Mishustin
16 марта 2011 г., 22:05:32, Alexey Mishustin пишет:

> Hi list,

> I have a problem with configuring xorg-server 1.9.4.

> It starts and works OK. But just after it has started, the keyboard begins
> to work very slowly in all virtual consoles that were open prior to X.

Not only slowly.

Also, there is no cursor. It doesn't blink. But if I press keys and then 
several times press Enter, the command that I pressed appears, then slowly 
computes.
It looks like this:

(I'm pressing `pwd` not seeing cursor and pressing letters)
#
#
#pwd
#
/etc
#

Also, it's impossible to scroll with Shift+PgUp.

Weird!

> If I login in a new virtual console, the keyboard works well until I enter
> into an interactive tool (man, less). After that - the same behavior.

> I installed xorg in according to these instructions [1], then added
> InputClass definitions from this thread [2].

> Please suggest what I could have done wrong.

> xorg.conf - http://pastebin.com/Wwmy1eFf
> Xorg.0.log - http://pastebin.com/5aqCLKnH
> make.conf - http://pastebin.com/7St3T1ec
> http://pastebin.com/YpCm9puZ
> emerge --info - http://pastebin.com/NZUQYqhh
> kernel .config - http://pastebin.com/E6Syb7Ay

> Laptop ASUS WJ7.

> [1] - http://www.gentoo.org/doc/en/xorg-config.xml
> [2] -
> http://www.gossamer-threads.com/lists/gentoo/user/226332?do=post_view_threaded

--
Regards, Alex




Re: [gentoo-user] xorg-server 1.9.4: keybord very slow in consoles

2011-03-16 Thread Mick
On Wednesday 16 March 2011 19:05:32 Alexey Mishustin wrote:
> Hi list,
> 
> I have a problem with configuring xorg-server 1.9.4.
> 
> It starts and works OK. But just after it has started, the keyboard begins
> to work very slowly in all virtual consoles that were open prior to X.
> 
> If I login in a new virtual console, the keyboard works well until I enter
> into an interactive tool (man, less). After that - the same behavior.
> 
> I installed xorg in according to these instructions [1], then added
> InputClass definitions from this thread [2].
> 
> Please suggest what I could have done wrong.
> 
> xorg.conf - http://pastebin.com/Wwmy1eFf
> Xorg.0.log - http://pastebin.com/5aqCLKnH
> make.conf - http://pastebin.com/7St3T1ec
> http://pastebin.com/YpCm9puZ
> emerge --info - http://pastebin.com/NZUQYqhh
> kernel .config - http://pastebin.com/E6Syb7Ay
> 
> Laptop ASUS WJ7.
> 
> [1] - http://www.gentoo.org/doc/en/xorg-config.xml
> [2] -
> http://www.gossamer-threads.com/lists/gentoo/user/226332?do=post_view_thre
> aded

Alex, you have defined both your keyboard and mouse as InputDevice under 
Section "ServerLayout", but then later on you specify them both as InputClass.

Comment out the InputDevice sections or remove them completely as shown in 
thread [2] above.

HTH.
-- 
Regards,
Mick


signature.asc
Description: This is a digitally signed message part.


Re: [gentoo-user] Re: Gentoo Live 11.0

2011-03-16 Thread Walter Dnes
On Tue, Mar 15, 2011 at 11:52:25PM +, James wrote

> OK Mark and Neil. I got the picture. I'll flush
> this out as I do seem to still have some
> 32bit apps on the 64bit AMD systems. Most likely
> I can get rid of these.

  WINE, which runs some Windows apps, will not build on a 64-bit system
without multilib support.  I found that out "the hard way" after
installing pure 64-bit on my machine.  Rather than wipe+reinstall, I
ended up installing a 32-bit Gentoo guest under qemu-kvm, and installed
WINE on that.

-- 
Walter Dnes 



Re: [gentoo-user] Switching to a hardened profile and back again

2011-03-16 Thread Peter Humphrey
On Wednesday 16 March 2011 19:54:53 Mike Edenfield wrote:

> IIRC, @system is not in @world unless you put it there yourself. (This
> might depend on your portage version, though).

I'm sure I once saw a comment in a portage version that @system was being 
included in @world to preserve earlier behaviour.

-- 
Rgds
Peter



Re: [gentoo-user] xorg-server 1.9.4: keybord very slow in consoles

2011-03-16 Thread Alexey Mishustin
3/16/2011, "Mick"  вы писали:

>On Wednesday 16 March 2011 19:05:32 Alexey Mishustin wrote:
>> Hi list,
>> 
>> I have a problem with configuring xorg-server 1.9.4.
>> 
>> It starts and works OK. But just after it has started, the keyboard begins
>> to work very slowly in all virtual consoles that were open prior to X.
>> 
>> If I login in a new virtual console, the keyboard works well until I enter
>> into an interactive tool (man, less). After that - the same behavior.
>> 
>> I installed xorg in according to these instructions [1], then added
>> InputClass definitions from this thread [2].
>> 
>> Please suggest what I could have done wrong.
>> 
>> xorg.conf - http://pastebin.com/Wwmy1eFf
>> Xorg.0.log - http://pastebin.com/5aqCLKnH
>> make.conf - http://pastebin.com/7St3T1ec
>> http://pastebin.com/YpCm9puZ
>> emerge --info - http://pastebin.com/NZUQYqhh
>> kernel .config - http://pastebin.com/E6Syb7Ay
>> 
>> Laptop ASUS WJ7.
>> 
>> [1] - http://www.gentoo.org/doc/en/xorg-config.xml
>> [2] -
>> http://www.gossamer-threads.com/lists/gentoo/user/226332?do=post_view_thre
>> aded
>
>Alex, you have defined both your keyboard and mouse as InputDevice under 
>Section "ServerLayout", but then later on you specify them both as InputClass.

Aha... I'll try tonight, when at home. Thank you!

--
Regards, Alex