[zfs-discuss] partioned cache devices

2013-03-14 Thread Andrew Werchowiecki
Hi all,

I'm having some trouble with adding cache drives to a zpool, anyone got any 
ideas?

muslimwookie@Pyzee:~$ sudo zpool add aggr0 cache c25t10d1p2
Password:
cannot open '/dev/dsk/c25t10d1p2': I/O error
muslimwookie@Pyzee:~$

I have two SSDs in the system, I've created an 8gb partition on each drive for 
use as a mirrored write cache. I also have the remainder of the drive 
partitioned for use as the read only cache. However, when attempting to add it 
I get the error above.

Here's a zpool status:

  pool: aggr0
state: DEGRADED
status: One or more devices is currently being resilvered.  The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
  scan: resilver in progress since Thu Feb 21 21:13:45 2013
1.13T scanned out of 20.0T at 106M/s, 51h52m to go
74.2G resilvered, 5.65% done
config:

NAME STATE READ WRITE CKSUM
aggr0DEGRADED 0 0 0
  raidz2-0   DEGRADED 0 0 0
c7t5000C50035CA68EDd0ONLINE   0 0 0
c7t5000C5003679D3E2d0ONLINE   0 0 0
c7t50014EE2B16BC08Bd0ONLINE   0 0 0
c7t50014EE2B174216Dd0ONLINE   0 0 0
c7t50014EE2B174366Bd0ONLINE   0 0 0
c7t50014EE25C1E7646d0ONLINE   0 0 0
c7t50014EE25C17A62Cd0ONLINE   0 0 0
c7t50014EE25C17720Ed0ONLINE   0 0 0
c7t50014EE206C2AFD1d0ONLINE   0 0 0
c7t50014EE206C8E09Fd0ONLINE   0 0 0
c7t50014EE602DFAACAd0ONLINE   0 0 0
c7t50014EE602DFE701d0ONLINE   0 0 0
c7t50014EE20677C1C1d0ONLINE   0 0 0
replacing-13 UNAVAIL  0 0 0
  c7t50014EE6031198C1d0  UNAVAIL  0 0 0  cannot open
  c7t50014EE0AE2AB006d0  ONLINE   0 0 0  (resilvering)
c7t50014EE65835480Dd0ONLINE   0 0 0
logs
  mirror-1   ONLINE   0 0 0
c25t10d1p1   ONLINE   0 0 0
c25t9d1p1ONLINE   0 0 0

errors: No known data errors

As you can see, I've successfully added the 8gb partitions in a write caches. 
Interestingly, when I do a zpool iostat -v it shows the total as 111gb:

capacity operationsbandwidth
pool alloc   free   read  write   read  write
---  -  -  -  -  -  -
aggr020.0T  7.27T  1.33K139  81.7M  4.19M
  raidz2 20.0T  7.27T  1.33K115  81.7M  2.70M
c7t5000C50035CA68EDd0-  -566  9  6.91M   241K
c7t5000C5003679D3E2d0-  -493  8  6.97M   242K
c7t50014EE2B16BC08Bd0-  -544  9  7.02M   239K
c7t50014EE2B174216Dd0-  -525  9  6.94M   241K
c7t50014EE2B174366Bd0-  -540  9  6.95M   241K
c7t50014EE25C1E7646d0-  -549  9  7.02M   239K
c7t50014EE25C17A62Cd0-  -534  9  6.93M   241K
c7t50014EE25C17720Ed0-  -542  9  6.95M   241K
c7t50014EE206C2AFD1d0-  -549  9  7.02M   239K
c7t50014EE206C8E09Fd0-  -526 10  6.94M   241K
c7t50014EE602DFAACAd0-  -576 10  6.91M   241K
c7t50014EE602DFE701d0-  -591 10  7.00M   239K
c7t50014EE20677C1C1d0-  -530 10  6.95M   241K
replacing-  -  0922  0  7.11M
  c7t50014EE6031198C1d0  -  -  0  0  0  0
  c7t50014EE0AE2AB006d0  -  -  0622  2  7.10M
c7t50014EE65835480Dd0-  -595 10  6.98M   239K
logs -  -  -  -  -  -
  mirror  740K   111G  0 43  0  2.75M
c25t10d1p1   -  -  0 43  3  2.75M
c25t9d1p1-  -  0 43  3  2.75M
---  -  -  -  -  -  -
rpool7.32G  12.6G  2  4  41.9K  43.2K
  c4t0d0s0   7.32G  12.6G  2  4  41.9K  43.2K
---  -  -  -  -  -  -

Something funky is going on here...

Wooks
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] Sun X4200 Question...

2013-03-14 Thread Jim Klimov

On 2013-03-15 01:58, Gary Driggs wrote:

On Mar 14, 2013, at 5:55 PM, Jim Klimov  wrote:


However, recently the VM "virtual hardware" clocks became way slow.


Does NTP help correct the guest's clock?


Unfortunately no, neither guest NTP, ntpdate or rdate in crontabs,
nor VirtualBox timesync settings, alone or even combined for test
(though known to conflict) - nothing has definitely helped so far.

We also have some setups on rather not-loaded hardware where after
a few days of uptime the clock stalls to the point that it has a
groundhog day - rotating over the same 2-3 second range for hours,
until the VM is powered off and booted.

Conversely, we also have dozens of VMs (and a few hosts) where no
such problems occur. Weird stuff...

//Jim

___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] Sun X4200 Question...

2013-03-14 Thread Gary Driggs
On Mar 14, 2013, at 5:55 PM, Jim Klimov  wrote:

> However, recently the VM "virtual hardware" clocks became way slow.

Does NTP help correct the guest's clock?
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] Sun X4200 Question...

2013-03-14 Thread Jim Klimov

On 2013-03-11 21:50, Bob Friesenhahn wrote:

On Mon, 11 Mar 2013, Tiernan OToole wrote:


I know this might be the wrong place to ask, but hopefully someone can
point me in the right direction...
I got my hands on a Sun x4200. Its the original one, not the M2, and
has 2 single core Opterons, 4Gb RAM and 4 73Gb SAS Disks...
But, I dont know what to install on it... I was thinking of SmartOS,
but the site mentions Intel support for VT, but nothing for
AMD... The Opterons dont have VT, so i wont be using XEN, but the
Zones may be useful...


OpenIndiana or OmniOS seem like the most likely candidates.

You can run VirtualBox on OpenIndiana and it should be able to work
without VT extensions.


Also note that without the extensions VirtualBox has some quirks.
Most notably, lack of "acceleration" and support for virtual SMP.
But unlike some other virtualizers, it should work (does work for
us on a Thumper also with pre-VTx Opteron CPUs). However, recently
the VM "virtual hardware" clocks became way slow. I am at loss so
far, the forum was moderately helpful - probably the load on the
host and induced latencies have their role. But the problem does
happen on more modern hardware too, so VTx (lack of) shouldn't be
our reason...

//Jim

___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] Sun X4200 Question...

2013-03-14 Thread Heiko L.

> support for VT, but nothing for AMD... The Opterons dont have VT, so i wont
> be using XEN, but the Zones may be useful...

We use XEN/PV on X4200 for many years without problems.
dom0: X4200+openindiana+xvm
guests(PV): openindiana,linux/fedora,linux/debian 
(vmlinuz-2.6.32.28-xenU-32,vmlinuz-2.6.18-xenU64)


regards Heiko

___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss