[OpenIndiana-discuss] linux disk filter
Hi all, I am writing a linux kernel module to filter the disk IO. And I am facing the problems below: 1. When the system start, how can I set my module be loaded before the file system? If the file system is loaded first, maybe some disk IO will be out of filter before my module loaded. 2. When the system shutdown, how can I set my module be unloaded after the system? The same, I need to make sure there will be no disk IO after my module unloaded. 3. For the system running, the filter data will be transferred from the module to the user application. When the system shutdown, and the application was close. Then, how can I save my filter data and I can load this data after the machine reboot? Please comment, thx. -- Best Rgds, Encore Deng Mobile: (86) 134 161 259 40 BizCONLine Limited Member company of Incu-Tech Programme, HKSTP Tel: 3483 2050 Unit 222A, 2/F,Enterprise Place (Bldg 9), No. 5 Science Park West Avenue, Hong Kong Science Park, Shatin, N.T. 佛山公司地址:南海区瀚天科技城8号楼15层I105 佛山公司电话:0757-86989295 Cloud Backup with Continuity Assurance ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] linux disk filter
Hi, erm. This list is dedicated to OpenIndiana, which is NOT a flavour of linux. While userland may look similar in many aspects, the kernel most definitely does not, so even if you may get lucky and find someone who can help you, I'd suggest you look for a linux-oriented mailing list and ask there - I don't know much about linux, I'd start looking at kernel.org, maybe there's some pointers there. good luck Michael On Fri, Apr 19, 2013 at 8:11 AM, DengEncore encored...@bizconline.comwrote: Hi all, I am writing a linux kernel module to filter the disk IO. And I am facing the problems below: 1. When the system start, how can I set my module be loaded before the file system? If the file system is loaded first, maybe some disk IO will be out of filter before my module loaded. 2. When the system shutdown, how can I set my module be unloaded after the system? The same, I need to make sure there will be no disk IO after my module unloaded. 3. For the system running, the filter data will be transferred from the module to the user application. When the system shutdown, and the application was close. Then, how can I save my filter data and I can load this data after the machine reboot? Please comment, thx. -- Best Rgds, Encore Deng Mobile: (86) 134 161 259 40 BizCONLine Limited Member company of Incu-Tech Programme, HKSTP Tel: 3483 2050 Unit 222A, 2/F,Enterprise Place (Bldg 9), No. 5 Science Park West Avenue, Hong Kong Science Park, Shatin, N.T. 佛山公司地址:南海区瀚天科技城8号楼15层I105 佛山公司电话:0757-86989295 Cloud Backup with Continuity Assurance ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss -- Michael Schuster http://recursiveramblings.wordpress.com/ ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] zpool vdev membership misreported
jrw@valinor:~$ pfexec zpool attach media c2d1 c3d1 invalid vdev specification use '-f' to override the following errors: /dev/dsk/c3d1s0 is part of active ZFS pool rpool. Please see zpool(1M). Yet I do not see c3d1 in zpool status. Initially I had 4 disks total, all Seagate SATA drives, two separate plain two-disk mirrors. I added a couple more disks, but havn't yet added them to a pool. I noticed that the device identifiers changed (which I did not expect). I broke the mirror on the media pool (i can't remember whey I did that). Since that time I have been getting that message which seems to mean somehow the disk is halfway stuck in the mirror. Should I just issue the -f override? Am I asking for trouble if i do? jrw@valinor:~$ zpool status pool: media state: ONLINE scan: scrub repaired 0 in 3h38m with 0 errors on Sun Feb 17 04:44:29 2013 config: NAMESTATE READ WRITE CKSUM media ONLINE 0 0 0 c2d1 ONLINE 0 0 0 errors: No known data errors pool: rpool state: ONLINE scan: scrub in progress since Fri Apr 19 01:47:19 2013 27.1M scanned out of 75.9G at 3.87M/s, 5h34m to go 0 repaired, 0.03% done config: NAMESTATE READ WRITE CKSUM rpool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c2d0s0 ONLINE 0 0 0 c3d0s0 ONLINE 0 0 0 errors: No known data errors jrw@valinor:~$ echo | pfexec format Searching for disks...done AVAILABLE DISK SELECTIONS: 0. c2d0 Unknown-Unknown-0001 cyl 60797 alt 2 hd 255 sec 63 /pci@0,0/pci-ide@11/ide@0/cmdk@0,0 1. c2d1 ST950056- 5YX1J9E-0001-465.76GB /pci@0,0/pci-ide@11/ide@0/cmdk@1,0 2. c3d0 ST950056- 5YX1R0Z-0001-465.76GB /pci@0,0/pci-ide@11/ide@1/cmdk@0,0 3. c3d1 Unknown-Unknown-0001 cyl 60797 alt 2 hd 255 sec 63 /pci@0,0/pci-ide@11/ide@1/cmdk@1,0 4. c7d0 ST950056- 5YX1FJF-0001-465.76GB Media3 /pci@0,0/pci-ide@14,1/ide@0/cmdk@0,0 5. c7d1 ST950056- 5YX1Q39-0001-465.76GB Media4 /pci@0,0/pci-ide@14,1/ide@0/cmdk@1,0 Specify disk (enter its number): Specify disk (enter its number): -- Justin ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] IPNAT redirection.
Actually in the real system I am trying to forward a port from an external address (on the internet, the address I hid) to an internal RDP server (port 3389 tcp) ... but for testing I forwarded to an internal IMAP server iprb0 is the external interface, bge0 is the internal. I added bge0 to see if it was a problem with my external connection. I enabled the telnet server on the local machine and used ipnat to redirect 143 to 23 and that worked ... I was just surprised that I couldn't connect to any port on another host. Anyway, to cut your explanation down, you are basically saying that I cannot do port forwarding with ipnat? Jon ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] IPNAT redirection.
more specific addresses to forward: root@oldfluffy:/etc/ipf# ipnat -l List of active MAP/Redirect filters: rdr iprb0 n.n.62.35/32 port 143 - 192.168.0.12 port 143 tcp rdr bge0 192.168.0.65/32 port 143 - 192.168.0.12 port 143 tcp List of active sessions: RDR 192.168.0.12 143 - -n.n.62.35143 [n.n.180.45 34032] and even if I change the port so there is no possibility of conflict: root@oldfluffy:/etc/ipf# ipnat -l List of active MAP/Redirect filters: rdr iprb0 n.n.62.35/32 port 144 - 192.168.0.12 port 143 tcp rdr bge0 192.168.0.65/32 port 144 - 192.168.0.12 port 143 tcp List of active sessions: RDR 192.168.0.12 143 - - n.n.62.35144 [n.n.180.45 36138] neither worked ... I can only assume that I can't port forward in this way, and will just go back to using delegate. Jon On 19 April 2013 10:22, Jonathan Adams t12nsloo...@gmail.com wrote: Actually in the real system I am trying to forward a port from an external address (on the internet, the address I hid) to an internal RDP server (port 3389 tcp) ... but for testing I forwarded to an internal IMAP server iprb0 is the external interface, bge0 is the internal. I added bge0 to see if it was a problem with my external connection. I enabled the telnet server on the local machine and used ipnat to redirect 143 to 23 and that worked ... I was just surprised that I couldn't connect to any port on another host. Anyway, to cut your explanation down, you are basically saying that I cannot do port forwarding with ipnat? Jon ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] IPNAT redirection.
Jon, I redirect ports fine using nat. I'm trying to understand what's different between your and my setup. For example in my ipnat.conf file I have: rdr bge0 0.0.0.0/0 port 2022 - 10.101.1.9 port 22 tcp/udp Where bge0 is my external nic (bge1 is my internal nic). BTW, I use 0.0.0.0/0 so it automatically picks up my external nic's ip address (I've have pseudo-dynamic IP from my ISP). Gary On 04/19/2013 05:22 AM, Jonathan Adams wrote: Actually in the real system I am trying to forward a port from an external address (on the internet, the address I hid) to an internal RDP server (port 3389 tcp) ... but for testing I forwarded to an internal IMAP server iprb0 is the external interface, bge0 is the internal. I added bge0 to see if it was a problem with my external connection. I enabled the telnet server on the local machine and used ipnat to redirect 143 to 23 and that worked ... I was just surprised that I couldn't connect to any port on another host. Anyway, to cut your explanation down, you are basically saying that I cannot do port forwarding with ipnat? Jon ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] IPNAT redirection.
On 19 April 2013 11:45, Gary Gendel g...@genashor.com wrote: Jon, I redirect ports fine using nat. I'm trying to understand what's different between your and my setup. For example in my ipnat.conf file I have: rdr bge0 0.0.0.0/0 port 2022 - 10.101.1.9 port 22 tcp/udp Where bge0 is my external nic (bge1 is my internal nic). BTW, I use 0.0.0.0/0 so it automatically picks up my external nic's ip address (I've have pseudo-dynamic IP from my ISP). I originally used 0.0.0.0/0 but was wondering if it was capturing packets coming through so limited to the external IP address ... I use ipnat happily on another machine for transparent proxying: # redirect all port 80 transactions to squid rdr internal2 any port 80 - 192.168.0.82 port 3128 # NAT all port 443 (https) to the external address directly. map external2 from any to 83.138.182.145 port = 443 - 94.136.227.100/32 and that works a charm. I modified ipf.conf to allow and log everything ... then lines from ipmon are: 19/04/2013 12:53:30.895801 iprb0 @0:2 p n.n.180.45,46135 - 192.168.0.12,143 PR tcp len 20 40 -R IN NAT 19/04/2013 12:53:30.895818 bge0 @0:1 p n.n.180.45,46135 - 192.168.0.12,143 PR tcp len 20 40 -R OUT 19/04/2013 12:53:32.799328 iprb0 @0:2 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S IN NAT 19/04/2013 12:53:32.799344 bge0 @0:1 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S OUT 19/04/2013 12:53:36.176407 iprb0 @0:2 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S IN NAT 19/04/2013 12:53:36.176423 bge0 @0:1 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S OUT 19/04/2013 12:53:42.239530 bge0 @0:1 p 192.168.0.20,138 - 192.168.0.255,138 PR udp len 20 267 IN mbcast 19/04/2013 12:53:42.935736 iprb0 @0:2 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S IN NAT 19/04/2013 12:53:42.935752 bge0 @0:1 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S OUT but if I snoop from 192.168.0.12 there are no packets coming in. strange ... I'm sure I'm just missing something little. Jon ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] IPNAT redirection.
We've all been there. :( On 04/19/2013 08:08 AM, Jonathan Adams wrote: ignore me, i'm just being stupid! on the accelerated host I needed to add the route to the external server :( On 19 April 2013 12:58, Jonathan Adams t12nsloo...@gmail.com wrote: On 19 April 2013 11:45, Gary Gendel g...@genashor.com wrote: Jon, I redirect ports fine using nat. I'm trying to understand what's different between your and my setup. For example in my ipnat.conf file I have: rdr bge0 0.0.0.0/0 port 2022 - 10.101.1.9 port 22 tcp/udp Where bge0 is my external nic (bge1 is my internal nic). BTW, I use 0.0.0.0/0 so it automatically picks up my external nic's ip address (I've have pseudo-dynamic IP from my ISP). I originally used 0.0.0.0/0 but was wondering if it was capturing packets coming through so limited to the external IP address ... I use ipnat happily on another machine for transparent proxying: # redirect all port 80 transactions to squid rdr internal2 any port 80 - 192.168.0.82 port 3128 # NAT all port 443 (https) to the external address directly. map external2 from any to 83.138.182.145 port = 443 - 94.136.227.100/32 and that works a charm. I modified ipf.conf to allow and log everything ... then lines from ipmon are: 19/04/2013 12:53:30.895801 iprb0 @0:2 p n.n.180.45,46135 - 192.168.0.12,143 PR tcp len 20 40 -R IN NAT 19/04/2013 12:53:30.895818 bge0 @0:1 p n.n.180.45,46135 - 192.168.0.12,143 PR tcp len 20 40 -R OUT 19/04/2013 12:53:32.799328 iprb0 @0:2 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S IN NAT 19/04/2013 12:53:32.799344 bge0 @0:1 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S OUT 19/04/2013 12:53:36.176407 iprb0 @0:2 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S IN NAT 19/04/2013 12:53:36.176423 bge0 @0:1 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S OUT 19/04/2013 12:53:42.239530 bge0 @0:1 p 192.168.0.20,138 - 192.168.0.255,138 PR udp len 20 267 IN mbcast 19/04/2013 12:53:42.935736 iprb0 @0:2 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S IN NAT 19/04/2013 12:53:42.935752 bge0 @0:1 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S OUT but if I snoop from 192.168.0.12 there are no packets coming in. strange ... I'm sure I'm just missing something little. Jon ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] IPNAT redirection.
I kinda assumed that the packets would have been translated to be from the machine on the firewall ... it was only after snooping from the firewall that I noticed the originator ... I'm going to have to delegate because I don't trust the windows server to know anything about the outside world. Ahh well ... another thing to write up on the internal wiki. Thanks everyone. On 19 April 2013 13:10, Gary Gendel g...@genashor.com wrote: We've all been there. :( On 04/19/2013 08:08 AM, Jonathan Adams wrote: ignore me, i'm just being stupid! on the accelerated host I needed to add the route to the external server :( On 19 April 2013 12:58, Jonathan Adams t12nsloo...@gmail.com wrote: On 19 April 2013 11:45, Gary Gendel g...@genashor.com wrote: Jon, I redirect ports fine using nat. I'm trying to understand what's different between your and my setup. For example in my ipnat.conf file I have: rdr bge0 0.0.0.0/0 port 2022 - 10.101.1.9 port 22 tcp/udp Where bge0 is my external nic (bge1 is my internal nic). BTW, I use 0.0.0.0/0 so it automatically picks up my external nic's ip address (I've have pseudo-dynamic IP from my ISP). I originally used 0.0.0.0/0 but was wondering if it was capturing packets coming through so limited to the external IP address ... I use ipnat happily on another machine for transparent proxying: # redirect all port 80 transactions to squid rdr internal2 any port 80 - 192.168.0.82 port 3128 # NAT all port 443 (https) to the external address directly. map external2 from any to 83.138.182.145 port = 443 - 94.136.227.100/32 and that works a charm. I modified ipf.conf to allow and log everything ... then lines from ipmon are: 19/04/2013 12:53:30.895801 iprb0 @0:2 p n.n.180.45,46135 - 192.168.0.12,143 PR tcp len 20 40 -R IN NAT 19/04/2013 12:53:30.895818 bge0 @0:1 p n.n.180.45,46135 - 192.168.0.12,143 PR tcp len 20 40 -R OUT 19/04/2013 12:53:32.799328 iprb0 @0:2 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S IN NAT 19/04/2013 12:53:32.799344 bge0 @0:1 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S OUT 19/04/2013 12:53:36.176407 iprb0 @0:2 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S IN NAT 19/04/2013 12:53:36.176423 bge0 @0:1 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S OUT 19/04/2013 12:53:42.239530 bge0 @0:1 p 192.168.0.20,138 - 192.168.0.255,138 PR udp len 20 267 IN mbcast 19/04/2013 12:53:42.935736 iprb0 @0:2 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S IN NAT 19/04/2013 12:53:42.935752 bge0 @0:1 p n.n.180.45,46607 - 192.168.0.12,143 PR tcp len 20 52 -S OUT but if I snoop from 192.168.0.12 there are no packets coming in. strange ... I'm sure I'm just missing something little. Jon __**_ OpenIndiana-discuss mailing list OpenIndiana-discuss@**openindiana.orgOpenIndiana-discuss@openindiana.org http://openindiana.org/**mailman/listinfo/openindiana-**discusshttp://openindiana.org/mailman/listinfo/openindiana-discuss __**_ OpenIndiana-discuss mailing list OpenIndiana-discuss@**openindiana.orgOpenIndiana-discuss@openindiana.org http://openindiana.org/**mailman/listinfo/openindiana-**discusshttp://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] vdev reliability was: Recommendations for fast storage
Am 19.04.2013 11:22, schrieb openindiana-discuss-requ...@openindiana.org: Message: 1 Date: Thu, 18 Apr 2013 16:03:32 -0500 From: Timothy Coalsontsc...@mst.edu To: Discussion list for OpenIndiana openindiana-discuss@openindiana.org Subject: Re: [OpenIndiana-discuss] vdev reliability was: Recommendations for fast storage Message-ID: CAK_=tazsbkcbbhie8czhqo2q+840s-sowajpykoppxc0gej...@mail.gmail.com Content-Type: text/plain; charset=ISO-8859-1 On Thu, Apr 18, 2013 at 10:24 AM, Sebastian Gablersequoiamo...@gmx.netwrote: One of Elling's posts cited by another poster did take that into account, but the graphs don't load due to url changes (and they seem to have the wrong MIME type with the fixed URL, I ended up using wget): https://blogs.oracle.com/relling/entry/a_story_of_two_mttdl Thanks for pointing at that. I stand corrected with my previous statement about Richard's MTTDL model excluding BER/UER. Asking Richard Elling to accept my apology. Timothy, how do you manage to get these pngs? I get as far as extracting some links to them, but loading these links results in resets consistently. Help appreciated. BR Sebastian ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] zpool vdev membership misreported
Justin, More than likely c3d1 contain a label from an old pool. If you run 'zdb -l /dev/dsk/c3d1s0' you should be able to if one exists. If does contain information for an old pool then using the '-f' option when attaching will solve your problem and relabel the device with the new pool information. You could also do a 'zpool import' to see if c3d1 shows up with information about an exported pool. Thanks, George On 4/19/13 5:20 AM, Justin Warwick wrote: jrw@valinor:~$ pfexec zpool attach media c2d1 c3d1 invalid vdev specification use '-f' to override the following errors: /dev/dsk/c3d1s0 is part of active ZFS pool rpool. Please see zpool(1M). Yet I do not see c3d1 in zpool status. Initially I had 4 disks total, all Seagate SATA drives, two separate plain two-disk mirrors. I added a couple more disks, but havn't yet added them to a pool. I noticed that the device identifiers changed (which I did not expect). I broke the mirror on the media pool (i can't remember whey I did that). Since that time I have been getting that message which seems to mean somehow the disk is halfway stuck in the mirror. Should I just issue the -f override? Am I asking for trouble if i do? jrw@valinor:~$ zpool status pool: media state: ONLINE scan: scrub repaired 0 in 3h38m with 0 errors on Sun Feb 17 04:44:29 2013 config: NAMESTATE READ WRITE CKSUM media ONLINE 0 0 0 c2d1 ONLINE 0 0 0 errors: No known data errors pool: rpool state: ONLINE scan: scrub in progress since Fri Apr 19 01:47:19 2013 27.1M scanned out of 75.9G at 3.87M/s, 5h34m to go 0 repaired, 0.03% done config: NAMESTATE READ WRITE CKSUM rpool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c2d0s0 ONLINE 0 0 0 c3d0s0 ONLINE 0 0 0 errors: No known data errors jrw@valinor:~$ echo | pfexec format Searching for disks...done AVAILABLE DISK SELECTIONS: 0. c2d0 Unknown-Unknown-0001 cyl 60797 alt 2 hd 255 sec 63 /pci@0,0/pci-ide@11/ide@0/cmdk@0,0 1. c2d1 ST950056- 5YX1J9E-0001-465.76GB /pci@0,0/pci-ide@11/ide@0/cmdk@1,0 2. c3d0 ST950056- 5YX1R0Z-0001-465.76GB /pci@0,0/pci-ide@11/ide@1/cmdk@0,0 3. c3d1 Unknown-Unknown-0001 cyl 60797 alt 2 hd 255 sec 63 /pci@0,0/pci-ide@11/ide@1/cmdk@1,0 4. c7d0 ST950056- 5YX1FJF-0001-465.76GB Media3 /pci@0,0/pci-ide@14,1/ide@0/cmdk@0,0 5. c7d1 ST950056- 5YX1Q39-0001-465.76GB Media4 /pci@0,0/pci-ide@14,1/ide@0/cmdk@1,0 Specify disk (enter its number): Specify disk (enter its number): -- Justin ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] zpool vdev membership misreported
On 2013-04-19 11:20, Justin Warwick wrote: I broke the mirror on the media pool (i can't remember whey I did that). Since that time I have been getting that message which seems to mean somehow the disk is halfway stuck in the mirror. Agreeing with George's answer, I'd like to inquire: how did you break the mirror? The state you describe seems like physical removal of one disk (c3d1) and then detachment of an absent component from the remaining live mirror, turning that into a single-disk pool, and then physical addition of the old disk back into the system. Due to name and/or guid conflict, this disk does not get imported as a pool. Maybe due to having the same GUID as a live pool, it is considered part of one - mistakenly in fact. BTW, interesting corner case for our recent discussion of the possible enhancements to detection and import of rpool (i.e. for removable media, or to switch HDDs between SATA and IDE legacy modes easily). Speaking of which, your cXdY disks on pci-ide bus seem to be in IDE legacy mode. Is this intentional (or are they really IDE)? You know this is sub-optimal for SATA, right?.. though use of this mode may be dictated by other causes (compatibilities with dual-booted OSes, missing SATA drivers in illumos, etc.) Cheers, //Jim ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] vdev reliability was: Recommendations for fast storage
On Fri, Apr 19, 2013 at 8:14 AM, Sebastian Gabler sequoiamo...@gmx.netwrote: On Thu, Apr 18, 2013 at 10:24 AM, Sebastian Gablersequoiamo...@gmx.net wrote: One of Elling's posts cited by another poster did take that into account, but the graphs don't load due to url changes (and they seem to have the wrong MIME type with the fixed URL, I ended up using wget): https://blogs.oracle.com/**relling/entry/a_story_of_two_**mttdlhttps://blogs.oracle.com/relling/entry/a_story_of_two_mttdl Thanks for pointing at that. I stand corrected with my previous statement about Richard's MTTDL model excluding BER/UER. Asking Richard Elling to accept my apology. Timothy, how do you manage to get these pngs? I get as far as extracting some links to them, but loading these links results in resets consistently. Help appreciated. One of the wrong URLs is this: http://blogs.sun.com/relling/resource/X4500-MTTDL-models-raidz2.png Note that the blog URL is blogs.oracle.com, not blogs.sun.com, so, do this: $ wget http://blogs.oracle.com/relling/resource/X4500-MTTDL-models-raidz2.png--no-check-certificate It redirects to https, and oracle's certificate has problems, hence the --no-check-certificate. Unfortunately, entering the URL in a browser treats the PNG data as text, hence using wget (or curl, or your preferred method of downloading a URL). Tim ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] vdev reliability was: Recommendations for fast storage
[catching up...] On Apr 19, 2013, at 6:14 AM, Sebastian Gabler sequoiamo...@gmx.net wrote: Am 19.04.2013 11:22, schrieb openindiana-discuss-requ...@openindiana.org: Message: 1 Date: Thu, 18 Apr 2013 16:03:32 -0500 From: Timothy Coalsontsc...@mst.edu To: Discussion list for OpenIndiana openindiana-discuss@openindiana.org Subject: Re: [OpenIndiana-discuss] vdev reliability was: Recommendations for fast storage Message-ID: CAK_=tazsbkcbbhie8czhqo2q+840s-sowajpykoppxc0gej...@mail.gmail.com Content-Type: text/plain; charset=ISO-8859-1 On Thu, Apr 18, 2013 at 10:24 AM, Sebastian Gablersequoiamo...@gmx.netwrote: One of Elling's posts cited by another poster did take that into account, but the graphs don't load due to url changes (and they seem to have the wrong MIME type with the fixed URL, I ended up using wget): https://blogs.oracle.com/relling/entry/a_story_of_two_mttdl Thanks for pointing at that. I stand corrected with my previous statement about Richard's MTTDL model excluding BER/UER. Asking Richard Elling to accept my apology. No worries. Unfortunately, Oracle totally hosed the older Sun blogs. I do have on my todo list the task of updating these and reposting on a site with better longevity, not controlled by the lawnmower. -- richard Timothy, how do you manage to get these pngs? I get as far as extracting some links to them, but loading these links results in resets consistently. Help appreciated. BR Sebastian ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss -- richard.ell...@richardelling.com +1-760-896-4422 ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] vdev reliability was: Recommendations for fast storage
[catching up... comment below] On Apr 18, 2013, at 2:03 PM, Timothy Coalson tsc...@mst.edu wrote: On Thu, Apr 18, 2013 at 10:24 AM, Sebastian Gabler sequoiamo...@gmx.netwrote: Am 18.04.2013 16:28, schrieb openindiana-discuss-request@**openindiana.orgopenindiana-discuss-requ...@openindiana.org : Message: 1 Date: Thu, 18 Apr 2013 12:17:47 + From: Edward Ned Harvey (openindiana)openindiana@**nedharvey.comopenindi...@nedharvey.com To: Discussion list for OpenIndiana openindiana-discuss@**openindiana.orgopenindiana-discuss@openindiana.org Subject: Re: [OpenIndiana-discuss] Recommendations for fast storage Message-ID: D1B1A95FBDCF7341AC8EB0A97FCCC**4773BBF3411@SN2PRD0410MB372.** namprd04.prod.outlook.comd1b1a95fbdcf7341ac8eb0a97fccc4773bbf3...@sn2prd0410mb372.namprd04.prod.outlook.com Content-Type: text/plain; charset=us-ascii From: Timothy Coalson [mailto:tsc...@mst.edu] Did you also compare the probability of bit errors causing data loss without a complete pool failure? 2-way mirrors, when one device completely dies, have no redundancy on that data, and the copy that remains must be perfect or some data will be lost. I had to think about this comment for a little while to understand what you were saying, but I think I got it. I'm going to rephrase your question: If one device in a 2-way mirror becomes unavailable, then the remaining device has no redundancy. So if a bit error is encountered on the (now non-redundant) device, then it's an uncorrectable error. Question is, did I calculate that probability? Answer is, I think so. Modelling the probability of drive failure (either complete failure or data loss) is very complex and non-linear. Also dependent on the specific model of drive in question, and the graphs are typically not available. So what I did was to start with some MTBDL graphs that I assumed to be typical, and then assume every data-loss event meant complete drive failure. The thing is... Bit Errors can lead to corruption of files, or even to the loss of a whole pool, without having an additional faulted drive. Because Bit Errors do not necessarily lead to a drive error. The risk of a rebuild failing is proportional to the BER of the drives involved, and it scales by the amount of data moved, given that you don't have further redundancy left. I agree with previous suggestions made that scrubbing offers some degree of protection against that issue. It doesn't do away with the risk when dealing with Bit Errors in a situation that has all redundancy stripped for some reason. For this aspect, a second level of redundancy offers a clear benefit. AFAIU, that was the valid point of the poster raising the controversy about resilience of a single vdev with multiple redundancy vs. multiple vdevs with single redundancy. As much as scrubbing is concerned, it is true that it will reduce the risk of a bit error rearing precisely during rebuild. However, in cases where you will deliberately pull redundancy, i.e. for swapping drives with larger ones, you will want to have a valid backup, and thus you will have not have too much of WORN data. In either case, it is user-driven, that is not scrub by itself is pro-active, but it gives the user a tool to be proactive about WORN data which are indeed those primarily prone to bit rot. Yes, that was my point, bit errors when there is no remaining redundancy are unrecoverable. Thus, as long is it is likely that only 1 disk per vdev fails at a time, raid-z2 will survive these bit errors fine, while 2-way mirrors will lose data. One of Elling's posts cited by another poster did take that into account, but the graphs don't load due to url changes (and they seem to have the wrong MIME type with the fixed URL, I ended up using wget): https://blogs.oracle.com/relling/entry/a_story_of_two_mttdl He linearized the bit error rate part, also. Beware the different scale on the graphs - at any rate, his calculation arrived at 3 orders of magnitude difference, with raid-z2 as better than 2-way mirrors for MTTDL for equivalent usable space (if I'm reading those correctly). Yes. 2-way mirror is a single-parity protection scheme and raidz2 is a double-parity protection scheme. Scrubbing introduces a question about the meaning of bit error rate - how different is the uncorrectable bit error rate on newly written data, versus the bit error rate on data that has been read back in successfully (additional qualifier: multiple times)? Regular scrubs can change the MTTDL dramatically if these probabilities are significantly different, because the first probability only applies to data written since the most recent scrub, which can drop a few orders of magnitude from the calculation. Pragmatically, it doesn't matter because the drive vendors do not publish the information. So you'll have to measure it yourself, which is not an easy task even if you
Re: [OpenIndiana-discuss] building a new box soon- HDD concerns and recommendations for virtual serving
On 17/04/2013 8:25 PM, Aneurin Price wrote: On 17 April 2013 03:53, Carl Brewer c...@bl.echidna.id.au wrote: Further to my original post, I have a new (desktop, I know ... but I am on a tight budget) Intel MB with an i5-3750 CPU and 32 GB of desktop RAM. Booting the 151a7 live DVD shows that it thinks it's a 32 bit system (huh?). It regognises almost all the devices when I run the device manager, but doesn't see any HDD's. they're just not there at all. At boot time it says they're too big for a 32 bit kernel. Why is it booting a 32 bit kernel anyway? Maybe some BIOS thing I need to set? I booted the first (default) image that the live CD displays. I don't know why it always boots the 32-bit version (I have a hard time imagining why anyone would *ever* want to boot a 32-bit kernel on a 64-bit machine, let alone enough for it to be the default), but you can tell it not to: When you boot from the live cd, at the grub prompt choose the option to edit the boot command line, and change $ISADIR to amd64. That worked a treat, thank you As well as thinking it's 32 bit, it also doesn't see any drives at all. I have a single new Seagate 2TB (4k blocks?) ST2000DM001 in it that the live CD doesn't see at all. That's normal; the 32-bit environment can't access 2TB+ drives. If you boot the 64-bit kernel it'll see it just fine. BTW, is there a particular reason for the choice of Virtualbox over KVM? I may need to run quite a variety of guests, VB is pretty versatile and I know and am comfortable with it. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
