[OpenIndiana-discuss] LSI card and Zfs
Hi, I have MD1200 of three trays daisy chained and connected to Dell box. The Dell box has LSI-9207-8-e card which sees the dirves as jbod. But its not able to detect all drives. Few drives gives below error as failed to power up. The disks are all powered and are green. Any help to fix this ? Host runs OI-151a7 May 14 18:08:05 host1 genunix: [ID 353554 kern.warning] WARNING: Device /scsi_vhci/disk@g5000c50040d0d3f3 failed to power up. May 14 18:08:05 host1 genunix: [ID 353554 kern.warning] WARNING: Device /scsi_vhci/disk@g5000c50040d05c03 failed to power up. May 14 18:08:05 host1 genunix: [ID 353554 kern.warning] WARNING: Device /scsi_vhci/disk@g5000c50040d0a9d3 failed to power up. May 14 18:08:05 host1 genunix: [ID 353554 kern.warning] WARNING: Device /scsi_vhci/disk@g5000c50040c1e913 failed to power up. Regards, Ram ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] LSI card and Zfs
Thanks a ton. That helped. You really saved me. On Tue, May 14, 2013 at 7:13 PM, Sašo Kiselkov skiselkov...@gmail.comwrote: On 05/14/2013 02:51 PM, Ram Chander wrote: Hi, I have MD1200 of three trays daisy chained and connected to Dell box. The Dell box has LSI-9207-8-e card which sees the dirves as jbod. But its not able to detect all drives. Few drives gives below error as failed to power up. The disks are all powered and are green. Any help to fix this ? Host runs OI-151a7 May 14 18:08:05 host1 genunix: [ID 353554 kern.warning] WARNING: Device /scsi_vhci/disk@g5000c50040d0d3f3 failed to power up. May 14 18:08:05 host1 genunix: [ID 353554 kern.warning] WARNING: Device /scsi_vhci/disk@g5000c50040d05c03 failed to power up. May 14 18:08:05 host1 genunix: [ID 353554 kern.warning] WARNING: Device /scsi_vhci/disk@g5000c50040d0a9d3 failed to power up. May 14 18:08:05 host1 genunix: [ID 353554 kern.warning] WARNING: Device /scsi_vhci/disk@g5000c50040c1e913 failed to power up. This is a known issue with Dell HDD firmware. You need to disable power management in sd, like so: 1) first determine your drive vendor + product IDs: echo ::walk sd_state | ::grep '.!=0' | ::print struct sd_lun un_sd | \ ::print struct scsi_device sd_inq | ::print struct scsi_inquiry \ inq_vid inq_pid | mdb -k 2) then enter the vendor ID + product ID into /kernel/drv/sd.conf like so: sd-config-list = VENDORID PRODUCTID, power-condition:false; For instance, in my case I'm getting in step 1) inq_vid = [ SEAGATE ] inq_pid = [ ST2000NM0001 ] inq_vid = [ SEAGATE ] inq_pid = [ ST3300657SS ] ... So my sd.conf looks like this: sd-config-list = SEAGATE ST3300657SS, power-condition:false, SEAGATE ST2000NM0001, power-condition:false; After that just reboot and you should be good to go. Cheers, -- Saso ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] NFS exported dataset crashes the system
There could be corruption in that dir. Can you run a scrub on the pool zpool scrub pool On Tue, Apr 9, 2013 at 6:43 AM, Peter Wood peterwood...@gmail.com wrote: I've asked the ZFS discussion list for help on this but now I have more information and it looks like a bug in the drivers or something. I have number of Dell PE R710 and PE 2950 servers running OpenSolaris, OI 151a and OI 151a.7. All these systems are used as storage servers, clean OS install, no extra services running. The systems are NFS exporting a lot of ZFS datasets that are mounted on about ten CentOS-5.9 systems. The above setup has been working for 2+ years with no problem. Recently we bought two Supermicro systems: Supermicro X9DRH-iF Xeon E5-2620 @ 2.0 GHz 6-Core 128GB RAM LSI SAS9211-8i HBA 32x 3TB Hitachi HUS723030ALS640, SAS, 7.2K I installed OI151.a.7 on them and started migrating data from the old Dell servers (zfs send/receive). Things have been working great for about two months until I migrated one particular directory to one of the new Supermicro systems and after about two days the system crashed. No network connectivity, black console, no response to keyboard keys, no activity lights (no error lights either) on the chassis. The only way out is to hit the reset button. Nothing in the logs as far as I can tell. Log entries just stop when the system crashes. In the following two months I did a lot of testing and a lot of trips to the colo in the middle of the night and the observation is that regardless of the OS everything works on the Dell servers. As soon as I move that directory to any of the Supermicro servers with OI151.a.7 it will crash them within 2 hours up to 5 days. The Supermicro servers can be idle, exporting nothing, or can be exporting 15+ other directories with high IOPS and working for months with no problems but as soon as I have them export that directory they'll crash in 5 days the most. There is only one difference between that directory an all others exported directories. One of the client systems that mounts it and writes to it is an old Debian 5.0 system. No idea why that would crash a Supermicro system but not a Dell system. We worked directly with LSI developers and upgraded the firmware to some unpublished, prerelease development version to no avail. We disabled all power saving features and CPU C states in the BIOS and nothing changed. Any idea? Thanks a lot. -- Peter ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] Ucarp on OI
Hi, Does anyone able to run ucarp on OI for floating IP ? Any procedure to setup would be helpful. Thanks. Regards, Ram ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Aoe Client for OI
Yes this works fine. On Mon, Mar 11, 2013 at 2:11 PM, Volker A. Brandt v...@bb-c.de wrote: Hello Ram! There is some old stuff from Coraid: http://download.alyseo.com/pub/partners/Coraid/Drivers/ ...but I don't know how well it works. Regards -- Volker -- Volker A. Brandt Consulting and Support for Oracle Solaris Brandt Brandt Computer GmbH WWW: http://www.bb-c.de/ Am Wiesenpfad 6, 53340 Meckenheim, GERMANYEmail: v...@bb-c.de Handelsregister: Amtsgericht Bonn, HRB 10513 Schuhgröße: 46 Geschäftsführer: Rainer J.H. Brandt und Volker A. Brandt When logic and proportion have fallen sloppy dead ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Aoe Client for OI
iSCSI acts in network layer ( layer 3) and is IP dependent whereas AOE acts in ethernet layer. Aoe is much fatser compared to iSCSI. Correct me if am wrong. On Mon, Mar 11, 2013 at 2:58 PM, Nikola M. minik...@gmail.com wrote: On 03/11/13 09:31 AM, Ram Chander wrote: Hi, I am exporting drives on a linux box over Aoe. ( Ata over thernet ). How do I discover the drives on OI box. Is there any client avaiable. Am able to discover on another linux host. Please help. Why not just using iSCSI? ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Slow zfs writes
So it looks like re-distribution issue. Initially there were two Vdev with 24 disks ( disk 0-23 ) for close to year. After which which we added 24 more disks and created additional vdevs. The initial vdevs are filled up and so write speed declined. Now how to find files that are present in a Vdev or a disk. That way I can remove and re-copy back to distribute data. Any other way to solve this ? Total capacity of pool - 98Tb Used - 44Tb Free - 54 Tb root@host:# zpool iostat -v capacity operationsbandwidth pool alloc free read write read write --- - - - - - - test 54.0T 62.7T 52 1.12K 2.16M 5.78M raidz1 11.2T 2.41T 13 30 176K 146K c2t0d0 - - 5 18 42.1K 39.0K c2t1d0 - - 5 18 42.2K 39.0K c2t2d0 - - 5 18 42.5K 39.0K c2t3d0 - - 5 18 42.9K 39.0K c2t4d0 - - 5 18 42.6K 39.0K raidz1 13.3T 308G 13100 213K 521K c2t5d0 - - 5 94 50.8K 135K c2t6d0 - - 5 94 51.0K 135K c2t7d0 - - 5 94 50.8K 135K c2t8d0 - - 5 94 51.1K 135K c2t9d0 - - 5 94 51.1K 135K raidz1 13.4T 19.1T 9455 743K 2.31M c2t12d0 - - 3137 69.6K 235K c2t13d0 - - 3129 69.4K 227K c2t14d0 - - 3139 69.6K 235K c2t15d0 - - 3131 69.6K 227K c2t16d0 - - 3141 69.6K 235K c2t17d0 - - 3132 69.5K 227K c2t18d0 - - 3142 69.6K 235K c2t19d0 - - 3133 69.6K 227K c2t20d0 - - 3143 69.6K 235K c2t21d0 - - 3133 69.5K 227K c2t22d0 - - 3143 69.6K 235K c2t23d0 - - 3133 69.5K 227K raidz1 2.44T 16.6T 5103 327K 485K c2t24d0 - - 2 48 50.8K 87.4K c2t25d0 - - 2 49 50.7K 87.4K c2t26d0 - - 2 49 50.8K 87.3K c2t27d0 - - 2 49 50.8K 87.3K c2t28d0 - - 2 49 50.8K 87.3K c2t29d0 - - 2 49 50.8K 87.3K c2t30d0 - - 2 49 50.8K 87.3K raidz1 8.18T 10.8T 5295 374K 1.54M c2t31d0 - - 2131 58.2K 279K c2t32d0 - - 2131 58.1K 279K c2t33d0 - - 2131 58.2K 279K c2t34d0 - - 2132 58.2K 279K c2t35d0 - - 2132 58.1K 279K c2t36d0 - - 2133 58.3K 279K c2t37d0 - - 2133 58.2K 279K raidz1 5.42T 13.6T 5163 383K 823K c2t38d0 - - 2 61 59.4K 146K c2t39d0 - - 2 61 59.3K 146K c2t40d0 - - 2 61 59.4K 146K c2t41d0 - - 2 61 59.4K 146K c2t42d0 - - 2 61 59.3K 146K c2t43d0 - - 2 62 59.2K 146K c2t44d0 - - 2 62 59.3K 146K On Tue, Feb 12, 2013 at 6:39 AM, Jason Matthews ja...@broken.net wrote: I am going to offer to obvious advice... How full is your pool? Zpool performance degrades as the pool fills up and the tools don't tell you how close you are to the cliff -- you find the cliff on your own by falling off of it. As a rule of thumb, I keep production system less than 70% utilized. Here is a real life example. On a 14.5TB (configured) pool, I found the cliff with 250+GB still reported as free. The system continued to write to the pool but throughput dismal. Is your pool full? j. -Original Message- From: Ram Chander [mailto:ramqu...@gmail.com] Sent: Monday, February 11, 2013 4:48 AM To: Discussion list for OpenIndiana Subject: [OpenIndiana-discuss] Slow zfs writes Hi, My OI box is expreiencing slow zfs writes ( around 30 times slower ). iostat reports below error though pool is healthy. This is happening in past 4 days though no change was done to system. Is the hard disks faulty ? Please help. # zpool status -v root@host:~# zpool status -v pool: test state: ONLINE status: The pool is formatted using a legacy on-disk format. The pool can still be used, but some features are unavailable. action: Upgrade the pool using 'zpool upgrade'. Once this is done, the pool will no longer be accessible on software that does not support feature flags. config: NAME STATE READ WRITE CKSUM test ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 c2t0d0 ONLINE 0 0 0 c2t1d0 ONLINE
Re: [OpenIndiana-discuss] Zfs import fails
ONLINE c5t3d20 ONLINE c5t3d21 ONLINE c5t3d22 ONLINE c5t3d23 ONLINE c5t3d24 ONLINE raidz1-19 ONLINE c5t3d25 ONLINE c5t3d26 ONLINE c5t3d27 ONLINE c5t3d28 ONLINE c5t3d29 ONLINE raidz1-20 ONLINE c5t3d30 UNAVAIL corrupted data c5t3d31 UNAVAIL corrupted data c5t3d32 UNAVAIL corrupted data c5t3d33 UNAVAIL corrupted data c5t1d35 UNAVAIL corrupted data root@host:~# zpool import -FfX pool1 cannot import 'pool1': one or more devices is currently unavailable root@host:~# zpool import -f pool1 cannot import 'pool1': I/O error Destroy and re-create the pool from a backup source. On Wed, Feb 6, 2013 at 5:58 PM, Edward Ned Harvey (openindiana) openindi...@nedharvey.com wrote: From: Ram Chander [mailto:ramqu...@gmail.com] I had a zpool thats exported on another system and when i try to import, it fails. Any idea how to recover ? Start by proving there isn't some other problem. Import the pool again on the same system that did the export. Assuming you can successfully import, capture a zpool status and then export again and get back to your new system... Show us the zpool status for the pool while it's functional in the old system. Your error message said missing device. (one or more devices currently unavailable). Make sure you devfsadm -Cv on the new system, and make sure the new disks are all appearing. Your pool isn't based on partitions or slices, is it? If so, you'll have to specify the devices manually. (I think it's zpool import -d) What type of disk controllers do you have in the new old systems? Many HBA's will occupy some space for their config meta data on the drives, transparently to the OS. This makes the drives incompatible with other systems, other than similar compatible HBA's. Ideally, you'll have simple braindead SATA/SAS controllers on both the source and destination machines. Because they won't add any custom data to the drives; they just present the drive to the OS, simple as that. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Zfs import fails
format detects all 108 disks . I suspect it could be zfs issue. I ran out of options now. root@host1:~# format Searching for disks...done AVAILABLE DISK SELECTIONS: 0. c1t0d0 DELL-PERCH700-2.10 cyl 54665 alt 2 hd 255 sec 252 /pci@0,0/pci8086,340b@4/pci1028,1f17@0/sd@0,0 1. c5t1d0 Coraid-EtherDrive SRX42-V0.4-2.73TB /ethdrv/sd@1,0 2. c5t1d1 Coraid-EtherDrive SRX42-V0.4-2.73TB /ethdrv/sd@1,1 3. c5t1d2 Coraid-EtherDrive SRX42-V0.4-2.73TB /ethdrv/sd@1,2 4. c5t1d3 Coraid-EtherDrive SRX42-V0.4-2.73TB /ethdrv/sd@1,3 5. c5t1d4 Coraid-EtherDrive SRX42-V0.4-2.73TB /ethdrv/sd@1,4 etc root@host1~# devfsadm -Cv root@host1:~# On Thu, Feb 7, 2013 at 6:44 PM, Sašo Kiselkov skiselkov...@gmail.comwrote: You have an issue with conectivity to your drives on the Coraid HBA card. I suggest querying your HBA via its management tools to make sure you can discover all the drives on your network. Chances are, they're not all visible, which is why your pool is having trouble. -- Saso On 02/07/2013 01:49 PM, Ram Chander wrote: The drives are in Coraid connected to the server via Coraid 10G HBA card. Its exported and imported on the same host but after OS upgrade ( format OS disk and install again ). Before OS upgrade, zpool export was issued and when tried to import it faults as below. The pool is not functional in any system now. Tried -d /dev/dsk option but no luck. root@storage1:~# zpool import pool: pool1 id: 10136140719439709374 state: FAULTED status: The pool was last accessed by another system. action: The pool cannot be imported due to damaged devices or data. The pool may be active on another system, but can be imported using the '-f' flag. see: http://illumos.org/msg/ZFS-8000-EY config: pool1 FAULTED corrupted data raidz1-0 ONLINE c5t1d0 UNAVAIL corrupted data c5t1d1 UNAVAIL corrupted data c5t1d2 UNAVAIL corrupted data c5t1d3 UNAVAIL corrupted data c5t1d4 UNAVAIL corrupted data raidz1-1 ONLINE c5t1d5 UNAVAIL corrupted data c5t1d6 UNAVAIL corrupted data c5t1d7 UNAVAIL corrupted data c5t1d8 UNAVAIL corrupted data c5t1d9 UNAVAIL corrupted data raidz1-2 ONLINE c5t1d10 UNAVAIL corrupted data c5t1d11 UNAVAIL corrupted data c5t1d12 UNAVAIL corrupted data c5t1d13 UNAVAIL corrupted data c5t1d14 UNAVAIL corrupted data raidz1-3 ONLINE c5t1d15 UNAVAIL corrupted data c5t1d16 UNAVAIL corrupted data c5t1d17 UNAVAIL corrupted data c5t1d18 UNAVAIL corrupted data c5t1d19 UNAVAIL corrupted data raidz1-4 ONLINE c5t1d20 UNAVAIL corrupted data c5t1d21 UNAVAIL corrupted data c5t1d22 UNAVAIL corrupted data c5t1d23 UNAVAIL corrupted data c5t1d24 UNAVAIL corrupted data raidz1-5 ONLINE c5t1d25 UNAVAIL corrupted data c5t1d26 UNAVAIL corrupted data c5t1d27 UNAVAIL corrupted data c5t1d28 UNAVAIL corrupted data c5t1d29 UNAVAIL corrupted data raidz1-6 ONLINE c5t1d30 UNAVAIL corrupted data c5t1d31 UNAVAIL corrupted data c5t1d32 UNAVAIL corrupted data c5t1d33 UNAVAIL corrupted data c5t1d34 UNAVAIL corrupted data raidz1-7 ONLINE c5t2d0 UNAVAIL corrupted data c5t2d1 UNAVAIL corrupted data c5t2d2 UNAVAIL corrupted data c5t2d3 UNAVAIL corrupted data c5t2d4 UNAVAIL corrupted data raidz1-8 ONLINE c5t2d5 UNAVAIL corrupted data c5t2d6 UNAVAIL corrupted data c5t2d7 UNAVAIL corrupted data c5t2d8 UNAVAIL corrupted data c5t2d9 UNAVAIL corrupted data raidz1-9 ONLINE c5t2d10 UNAVAIL corrupted data c5t2d11 UNAVAIL corrupted data c5t2d12 UNAVAIL corrupted data c5t2d13 UNAVAIL corrupted data c5t2d14 UNAVAIL corrupted data raidz1-10 ONLINE c5t2d15 UNAVAIL corrupted data c5t2d16 UNAVAIL corrupted data c5t2d17 UNAVAIL corrupted data c5t2d18 UNAVAIL corrupted data c5t2d19 UNAVAIL corrupted data raidz1-11 ONLINE c5t2d20 UNAVAIL corrupted data c5t2d21 UNAVAIL corrupted data
Re: [OpenIndiana-discuss] Zfs import fails
Yes I changed OS from OI to OmniOS. May I know how did you recover ? On Thu, Feb 7, 2013 at 7:31 PM, Daryl Richards da...@isletech.net wrote: I've had pretty much exactly this issue in the past, switching from OI - FreeBSD.. It turned out that the partition tables (slices, GPT, whichever) where incompatible between the OSes. I don't know if you changed your OS or not, but I would see what you can about the partitions.. On 13-02-07 8:47 AM, Ram Chander wrote: format detects all 108 disks . I suspect it could be zfs issue. I ran out of options now. root@host1:~# format Searching for disks...done AVAILABLE DISK SELECTIONS: 0. c1t0d0 DELL-PERCH700-2.10 cyl 54665 alt 2 hd 255 sec 252 /pci@0,0/pci8086,340b@4/**pci1028,1f17@0/sd@0,0 1. c5t1d0 Coraid-EtherDrive SRX42-V0.4-2.73TB /ethdrv/sd@1,0 2. c5t1d1 Coraid-EtherDrive SRX42-V0.4-2.73TB /ethdrv/sd@1,1 3. c5t1d2 Coraid-EtherDrive SRX42-V0.4-2.73TB /ethdrv/sd@1,2 4. c5t1d3 Coraid-EtherDrive SRX42-V0.4-2.73TB /ethdrv/sd@1,3 5. c5t1d4 Coraid-EtherDrive SRX42-V0.4-2.73TB /ethdrv/sd@1,4 etc root@host1~# devfsadm -Cv root@host1:~# On Thu, Feb 7, 2013 at 6:44 PM, Sašo Kiselkov skiselkov...@gmail.com wrote: You have an issue with conectivity to your drives on the Coraid HBA card. I suggest querying your HBA via its management tools to make sure you can discover all the drives on your network. Chances are, they're not all visible, which is why your pool is having trouble. -- Saso On 02/07/2013 01:49 PM, Ram Chander wrote: The drives are in Coraid connected to the server via Coraid 10G HBA card. Its exported and imported on the same host but after OS upgrade ( format OS disk and install again ). Before OS upgrade, zpool export was issued and when tried to import it faults as below. The pool is not functional in any system now. Tried -d /dev/dsk option but no luck. root@storage1:~# zpool import pool: pool1 id: 10136140719439709374 state: FAULTED status: The pool was last accessed by another system. action: The pool cannot be imported due to damaged devices or data. The pool may be active on another system, but can be imported using the '-f' flag. see: http://illumos.org/msg/ZFS-**8000-EYhttp://illumos.org/msg/ZFS-8000-EY config: pool1 FAULTED corrupted data raidz1-0 ONLINE c5t1d0 UNAVAIL corrupted data c5t1d1 UNAVAIL corrupted data c5t1d2 UNAVAIL corrupted data c5t1d3 UNAVAIL corrupted data c5t1d4 UNAVAIL corrupted data raidz1-1 ONLINE c5t1d5 UNAVAIL corrupted data c5t1d6 UNAVAIL corrupted data c5t1d7 UNAVAIL corrupted data c5t1d8 UNAVAIL corrupted data c5t1d9 UNAVAIL corrupted data raidz1-2 ONLINE c5t1d10 UNAVAIL corrupted data c5t1d11 UNAVAIL corrupted data c5t1d12 UNAVAIL corrupted data c5t1d13 UNAVAIL corrupted data c5t1d14 UNAVAIL corrupted data raidz1-3 ONLINE c5t1d15 UNAVAIL corrupted data c5t1d16 UNAVAIL corrupted data c5t1d17 UNAVAIL corrupted data c5t1d18 UNAVAIL corrupted data c5t1d19 UNAVAIL corrupted data raidz1-4 ONLINE c5t1d20 UNAVAIL corrupted data c5t1d21 UNAVAIL corrupted data c5t1d22 UNAVAIL corrupted data c5t1d23 UNAVAIL corrupted data c5t1d24 UNAVAIL corrupted data raidz1-5 ONLINE c5t1d25 UNAVAIL corrupted data c5t1d26 UNAVAIL corrupted data c5t1d27 UNAVAIL corrupted data c5t1d28 UNAVAIL corrupted data c5t1d29 UNAVAIL corrupted data raidz1-6 ONLINE c5t1d30 UNAVAIL corrupted data c5t1d31 UNAVAIL corrupted data c5t1d32 UNAVAIL corrupted data c5t1d33 UNAVAIL corrupted data c5t1d34 UNAVAIL corrupted data raidz1-7 ONLINE c5t2d0 UNAVAIL corrupted data c5t2d1 UNAVAIL corrupted data c5t2d2 UNAVAIL corrupted data c5t2d3 UNAVAIL corrupted data c5t2d4 UNAVAIL corrupted data raidz1-8 ONLINE c5t2d5 UNAVAIL corrupted data c5t2d6 UNAVAIL corrupted data c5t2d7 UNAVAIL corrupted data c5t2d8 UNAVAIL corrupted data c5t2d9 UNAVAIL corrupted data raidz1-9 ONLINE c5t2d10 UNAVAIL corrupted data c5t2d11 UNAVAIL
[OpenIndiana-discuss] Zfs import fails
Hi, I had a zpool thats exported on another system and when i try to import, it fails. Any idea how to recover ? format shows all the disks. root@host:~# zpool import -FfX pool1 cannot import 'pool1': one or more devices is currently unavailable root@host:~# zpool import -f pool1 cannot import 'pool1': I/O error Destroy and re-create the pool from a backup source. Regards, Ram ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] HA or keepalived in OI / solaris
Hi, I want a floating IP that can switch between two servers for HA. Since keepalived is only for linux, is there anyother alternative in OI ? Regards, Ram ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Java7 on OI
I downloaded jre from below url and extracted. But when run, it gives below error. Anything should I install additional ? http://docs.oracle.com/javase/7/docs/webnotes/install/index.html root@hostl~/jre1.7.0_11/bin/amd64# ./java -version Error occurred during initialization of VM java/lang/NoClassDefFoundError: java/lang/Object root@storage2.digital:~/jre1.7.0_11/bin/amd64# ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] Java7 on OI
Hi, How to compile and install java7 ? Is there any pkg readily available ? Pls help Regards, Ram ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] Megasasct in OI
Hi, How to setup megasasctl in OI ? Or is there anyother equivalent to display hard disk errors ? Regards, Ram ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] loader.conf
Hi, Is there /boot/loader.conf in OI. I want to set below in the file, will it take effect ? If not where to specify ? vfs.zfs.zil_disable=0 vfs.zfs.txg.timeout=5 vfs.zfs.vdev.max_pending=4 Thanks. Regards, Ram ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Include driver and rebuild ISO
How to find HBA ? I got the driver loaded in usb , just need to get add_drv command working. I have perc h710 On Fri, Dec 21, 2012 at 8:27 PM, Edward Ned Harvey (openindiana) openindi...@nedharvey.com wrote: From: Ram Chander [mailto:ramqu...@gmail.com] I have downloaded OI ISO and want to include below driver and rebuild ISO. After extracting ISO, how do add this and rebuild ISO ? Any steps would be helpful. Thanks. You don't need to rebuild ISO. Here's what you do: Before you begin, see below, the command that says specific per-HBA The command I pasted is for a 3ware adapter (I can look up the model number if needed) and came from 9.5.4-Codeset-Complete.iso, and the specific command was posted on some discussion forum by a 3ware software developer, who said I'm the only person who knows this, and we were just instructed to stop developing for opensolaris, so we won't be developing new installers moving forward, and you're going to need this command to use the driver... You really best look inside the opensolaris installation package for your driver. They'll probably have a less manual way of installing it. But the notes below might be useful for you anyway - Even if the specifics are not useful to you, at least the general concept will be useful. So you can stop trying to figure out how to rebuild the ISO. ;-) Long story short: Boot from the live CD. In your live environment, install the driver. Then launch the OS installer. The driver should get automatically built into the boot loader for the OS, but if it doesn't, there's a command you can run in the live CD to force it. These are my notes for the systems that I did this on: Boot from the openindiana live CD. You're going to be glad you do this, so you can use copy/paste below. ;-) Open a terminal, sudo svcadm enable svc:/network/ssh:default Now, you can sftp or ssh into the machine username: jack password: jack Somehow, copy the tw file (which is the actual driver) to jack's home directory. If necessary, (for example, if driver is downloaded inside an iso file, such as was the case for my 3ware HBA) here is how to mount an ISO: sudo mkdir /mnt/cd sudo mount -F hsfs file.iso /mnt/cd Live CD environment, to get OS installed: Somehow, copy tw /kernel/drv/amd64/ sudo cp /mnt/cd/packages/drivers/opensolaris/amd64/tw /kernel/drv/amd64/ The following command is going to be specific per-HBA. sudo add_drv -m * 0666 root sys -i 'pci13c1,1003 pci13c1,1004 pci13c1,1005 pci13c1,1010' -c scsi tw Now you can install the OS. I don't know how critical the timing is for the commands below, but they need to be done after the filesystem is created, and before everything is closed. Or maybe they don't need to be done at all; I don't know. But I *do* know this is what I did, and it works, and it's repeatable. Timing may not be very critical, and these steps might actually be optional. When the installer gets to about 30% or so, do this: sudo cp /kernel/drv/amd64/tw /a/kernel/drv/amd64/ When it gets to around 75%, do this: sudo rm /a/var/run/AdDrEm.lck # (don't do this one) sudo add_drv -b /a -m * 0666 root sys -i 'pci13c1,1003 pci13c1,1004 pci13c1,1005 pci13c1,1010' -c scsi tw sudo bootadm update-archive -R /a You should be long since completed with the above commands, before the installer reaches 90% When the installer gives you the Reboot button... Reboot. Notice, it boots up but doesn't go through grub or anything. Shutdown, halt, or go to the Shutdown menu and un-select Skip boot menu on restart. Or use reboot -p This will force the system to completely reset, and go through BIOS, and grub. This should solidly confirm for you, that the system is able to load the necessary drivers during boot. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] OI install fails on dell R820
I have downloaded a driver from below and want to include it in a ISO - any idea how to include this and rebuild ISO ? http://blog.infrageeks.com/storage/software/mr_sas On Thu, Dec 20, 2012 at 8:39 PM, Edward Ned Harvey (openindiana) openindi...@nedharvey.com wrote: From: Ram Chander [mailto:ramqu...@gmail.com] I have 8 disks in Raid0 in Dell Poweredge R820. When tried to install latest OI (oi_151a), it fails with below error. Any pointers on how to install drivers and get OI installed ? No disks found. Additional drivers needed -Original Message- From: Ram Chander [mailto:ramqu...@gmail.com] It has Perc H710 card. Sounds very much like this thread: http://openindiana.org/pipermail/openindiana-discuss/2012-December/thread.html (Search for this thread:) oi151a7 fails to see disks with dell perc h310 solarg ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] Include driver and rebuild ISO
HI, I have downloaded OI ISO and want to include below driver and rebuild ISO. After extracting ISO, how do add this and rebuild ISO ? Any steps would be helpful. Thanks. http://blog.infrageeks.com/storage/software/mr_sas Regards, Ram ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] OI install fails on dell R820
Hi, I have 8 disks in Raid0 in Dell Poweredge R820. When tried to install latest OI (oi_151a), it fails with below error. Any pointers on how to install drivers and get OI installed ? No disks found. Additional drivers needed Regards, Ram ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] OI install fails on dell R820
It has Perc H710 card. On Thu, Dec 20, 2012 at 2:55 PM, Ram Chander ramqu...@gmail.com wrote: Hi, I have 8 disks in Raid0 in Dell Poweredge R820. When tried to install latest OI (oi_151a), it fails with below error. Any pointers on how to install drivers and get OI installed ? No disks found. Additional drivers needed Regards, Ram ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] OI on Dell R810
Hi, I have installed OI on Dell R810 hardware and it frequently gets auto rebooted atleast twice a day. sar shows cpu/disk/mem is all normal. This box acts as nfs server and doesnt do any heavy duty. Any idea what might be the issue. Also got to know that OI isnt tested on this hardware. No useful logs too when reboot happens. What might be the issue, Nic,/motherboard/cpu ? http://wiki.openindiana.org/oi/Servers root@hosti:/fkdigital# last -10 reboot rebootsystem boot Wed Oct 24 10:14 rebootsystem down Wed Oct 24 10:06 rebootsystem boot Tue Oct 23 16:26 rebootsystem down Tue Oct 23 16:15 rebootsystem boot Tue Oct 23 12:55 rebootsystem down Tue Oct 23 12:31 rebootsystem boot Tue Oct 23 11:43 rebootsystem down Tue Oct 23 11:30 rebootsystem boot Mon Oct 22 00:27 rebootsystem down Mon Oct 22 00:21 ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] OI on Dell R810
Below is the dmesg when it crashes . Oct 24 14:47:42 myhost unix: [ID 950921 kern.info] cpu20: x86 (chipid 0x0 GenuineIntel 206F2 family 6 model 47 step 2 clock 2660 MHz) Oct 24 14:47:42 myhost unix: [ID 950921 kern.info] cpu20: Intel(r) Xeon(r) CPU E7- 8837 @ 2.67GHz Oct 24 14:47:42 myhost unix: [ID 557947 kern.info] cpu20 initialization complete - online Oct 24 14:47:42 myhost unix: [ID 378719 kern.info] NOTICE: cpu_acpi: _PSS package evaluation failed for with status 5 for CPU 21. Oct 24 14:47:42 myhost unix: [ID 388705 kern.info] NOTICE: cpu_acpi: error parsing _PSS for CPU 21 Oct 24 14:47:42 myhost unix: [ID 928200 kern.info] NOTICE: SpeedStep support is being disabled due to errors parsing ACPI P-state objects exported by BIOS. Oct 24 14:47:42 myhost unix: [ID 950921 kern.info] cpu21: x86 (chipid 0x1 GenuineIntel 206F2 family 6 model 47 step 2 clock 2660 MHz) Oct 24 14:47:42 myhost unix: [ID 950921 kern.info] cpu21: Intel(r) Xeon(r) CPU E7- 8837 @ 2.67GHz Oct 24 14:47:42 myhost unix: [ID 557947 kern.info] cpu21 initialization complete - online Oct 24 14:47:42 myhost unix: [ID 378719 kern.info] NOTICE: cpu_acpi: _PSS package evaluation failed for with status 5 for CPU 22. Oct 24 14:47:42 myhost unix: [ID 388705 kern.info] NOTICE: cpu_acpi: error parsing _PSS for CPU 22 Oct 24 14:47:42 myhost unix: [ID 928200 kern.info] NOTICE: SpeedStep support is being disabled due to errors parsing ACPI P-state objects exported by BIOS. On Wed, Oct 24, 2012 at 2:36 PM, Ram Chander ramqu...@gmail.com wrote: Hi, I have installed OI on Dell R810 hardware and it frequently gets auto rebooted atleast twice a day. sar shows cpu/disk/mem is all normal. This box acts as nfs server and doesnt do any heavy duty. Any idea what might be the issue. Also got to know that OI isnt tested on this hardware. No useful logs too when reboot happens. What might be the issue, Nic,/motherboard/cpu ? http://wiki.openindiana.org/oi/Servers root@hosti:/fkdigital# last -10 reboot rebootsystem boot Wed Oct 24 10:14 rebootsystem down Wed Oct 24 10:06 rebootsystem boot Tue Oct 23 16:26 rebootsystem down Tue Oct 23 16:15 rebootsystem boot Tue Oct 23 12:55 rebootsystem down Tue Oct 23 12:31 rebootsystem boot Tue Oct 23 11:43 rebootsystem down Tue Oct 23 11:30 rebootsystem boot Mon Oct 22 00:27 rebootsystem down Mon Oct 22 00:21 ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Compile nss_ldap
The Ldap server is hosted on linux and couldnt find any ldap client that is compiled already for OI. Any other way to get client working is fine. Pls advice. On Mon, Aug 13, 2012 at 6:57 PM, Jim Klimov jimkli...@cos.ru wrote: 2012-08-13 14:31, Ram Chander пишет: Hi, Am trying to setup ldap client on OI. I get below error when tried to compile nss_ldap-265 ( downloaded from padl.com ). Can I pls have steps to compile it properly ? Am I missing something, or why doesn't an included ldap-client (software and SMF service) suit your needs? You did not find it, or you need something different/newer/better/etc.? It was in OpenSolaris since... forever, and I think it must be in OI as well. Quite documented it was for (Open)Solaris, so there should be no big troubles setting that up. //Jim Klimov ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] Jumpstart on OI
Hi, I want to install OI on bunch of clients by PXE. Is there a way like jumpstart on solaris ? Havent found detailed docs to setup. Any pointers would be useful. Thanks. Regards, Ram ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Setting up Ldap client
Sorry for late reply. I tried configuring ldapclient manually but no luck. I guess am missing something. Below is what I have. 1) ldap server IP = a.b.c.d 2) uri - ldaps://ldap.xx.Mycompany.com 3) I have cert file to authenticate to server - /etc/ssl/certs/cert.pem On debian clients, below are the files where ldap works fine. Pls guide on how to configure ldap client on OpenIndiana. I dono where to specify the cert,etc. $ cat /etc/ldap/ldap.conf BASE dc=Mycompany,dc=com URI ldaps://ldap.xx.Mycompany.com TLS_CACERT /etc/ssl/certs/cert.pem $ cat /etc/nss-ldapd.conf uid nslcd gid nslcd base dc=Mycompany,dc=com uri ldaps://ldap.xx.Mycompany.com $ cat /etc/pam_ldap.conf base dc=Mycompany,dc=com uri ldaps://ldap.xx.Mycompany.com ldap_version 3 pam_password crypt On Sun, Dec 25, 2011 at 5:47 PM, Chris Ridd chrisr...@mac.com wrote: On 25 Dec 2011, at 09:27, Ram Chander wrote: Hi, I am trying to setup ldap client and authentication on OpenIndiana but no success. I searched on internet but couldnt get proper steps. Can someone pls provide detailed steps on how to setup the same and which packages to install ? Is your directory server already running with all the right entries in? If not, get that working first. Once the server's working, I have a shell script I run on each Solaris client that sets up ldapclient in manual mode. Before running it make sure your /etc/nsswitch.ldap file contains a good value for hosts. It'll automatically get copied to /etc/nsswitch.conf by ldapclient. The shell script just runs: ldapclient -v manual \ -a defaultServerList=127.0.0.1 \ -a defaultSearchBase=o=MyCompany \ -a authenticationMethod=simple \ -a proxyDN=cn=Dummy,ou=System,o=MyCompany \ -a proxyPassword=dummy The last two proxy lines are necessary but not used. (A longstanding upstream misfeature.) This sets up the client to do anonymous searches for user/group/etc details. To test that config works, run things like /usr/bin/id and /usr/bin/getent. You should find that data is being returned from your LDAP server. It helps if you can set up some LDAP-only groups or something so that testing shows something obviously from LDAP. If not, run ldapclient uninit, and try ldapclient -v manual again with different args. Setting up authentication is a little more fiddly. Don't start this until you have ldapclient configured properly. You have to edit /etc/pam.conf and append service auth required pam_ldap.so.1 to each section. I think you also have to edit the previous line to service auth binding pam_unix_auth.so.1 server_policy, but I don't have a stock OI pam.conf file to hand to check. Here's the section for the login service in mine: login auth requisite pam_authtok_get.so.1 login auth required pam_dhkeys.so.1 login auth required pam_unix_cred.so.1 login auth bindingpam_unix_auth.so.1 server_policy login auth required pam_ldap.so.1 Changes to pam.conf take immediate effect. You may need to tweak sshd_config as well. Cheers, Chris ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Couldnt install Nagios client nsca
Tried it but doesnt print/log any error # /usr/sbin/nsca -c /etc/nsca.cfg # echo $? 0 On Sun, Dec 25, 2011 at 2:56 PM, Jeppe Toustrup openindi...@tenzer.dkwrote: On Sun, Dec 25, 2011 at 10:19, Ram Chander ramqu...@gmail.com wrote: /usr/sbin/nsca --daemon -c /etc/nsca.cfg ( doesnt start ) # telnet 0 5667 Trying 0.0.0.0... telnet: Unable to connect to remote host: Connection refused There are no errors on compilation. Have you tried to start nsca without the --daemon flag to see if it prints out any error messages? Perhaps there is a verbose/debug flag you can put in? (I am not very familiar with managing Nagios.) -- Venlig hilsen / Kind regards Jeppe Toustrup (aka. Tenzer) ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
