Re: [zfs-discuss] zpool imports are slow when importing multiple storage pools

2008-10-07 Thread Jens Elkner
On Mon, Oct 06, 2008 at 05:08:13PM -0700, Richard Elling wrote:
> Scott Williamson wrote:
> > Speaking of this, is there a list anywhere that details what we can 
> > expect to see for (zfs) updates in S10U6?
> 
> The official release name is "Solaris 10 10/08"

Ooops - no beta this time?

Regards,
jel.
-- 
Otto-von-Guericke University http://www.cs.uni-magdeburg.de/
Department of Computer Science   Geb. 29 R 027, Universitaetsplatz 2
39106 Magdeburg, Germany Tel: +49 391 67 12768
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] zpool imports are slow when importing multiple storage pools

2008-10-06 Thread Richard Elling
Scott Williamson wrote:
> Speaking of this, is there a list anywhere that details what we can 
> expect to see for (zfs) updates in S10U6?

The official release name is "Solaris 10 10/08"
http://www.sun.com/software/solaris/10 
has links to "what's new" videos.
When the release is downloadable, full doc set will
be ready.
 -- richard


___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] zpool imports are slow when importing multiple storage pools

2008-10-06 Thread Scott Williamson
Speaking of this, is there a list anywhere that details what we can expect
to see for (zfs) updates in S10U6?

On Mon, Oct 6, 2008 at 2:44 PM, Richard Elling <[EMAIL PROTECTED]>wrote:

> Do you have a lot of snapshots?  If so, CR 6612830 could be contributing.
> Alas, many such fixes are not yet available in S10.
>  -- richard
>
>
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] zpool imports are slow when importing multiple storage pools

2008-10-06 Thread Richard Elling
Do you have a lot of snapshots?  If so, CR 6612830 could be contributing.
Alas, many such fixes are not yet available in S10.
 -- richard

Luke Schwab wrote:
> Hi,
> I am having a problem running zpool imports when we import multiple storage 
> pools at one time. Below are the details of the setup:
>
> - We are using a SAN with Sun 6140 storage arrays. 
> - Dual port HBA on each server is Qlogic running the QLC driver with Sun 
> mpxio(SFCSM) running. 
> - We have 400+ luns on the SAN. We can't split them up because the luns any 
> of the luns may be able to failover between the different servers. We are 
> running rather large farm where all servers need to see all the luns in case 
> of failover.
> -Running Solaris 10 U5 kernal. 
>
> Below are the times I see when importing pools from the SAN storage:
> 1 pool - 30 seconds
> 2 pools - 1 minute for both to finish
> 3 pools - 1 min 30 sec for all 3 to finish
> 4 pools - 2 minutes for all 4 to finish
>
> When I run more then one zpool import in parallel, I can see that all zpool 
> imports are queued up. The more pools I try to import, the longer the pools 
> take to import. For example, when importing 2 pools, the first pool takes 1 
> minute but then just a few seconds later the 2nd pool finishes its import. 
> When I import 3 pools, the first pool takes 1.5 minutes and then the other 
> two pools finish just after that.
>
> The problem we are seeing it that we need to failover up to 32 pools at one 
> time on a server and the imports end up timing out after 5-10 minutes because 
> we are trying to import too many pools at one time. 
>
> Is this a design choice with ZFS coding or a bug? Is there anything I can do 
> to increase my import times? We do have the same setup on one of our SANs 
> with only 10-20 luns instead of 400+ and the imports take only 1-3 seconds. 
> My guess here is that the large number of luns is effecting imports. But our 
> virtual farm design is broken if we can imported at least 30-40 luns in under 
> a minute on a given server.
>
> Any thoughts or questions would be great.
>
> Thanks,
> Luke
> --
> This message posted from opensolaris.org
> ___
> zfs-discuss mailing list
> zfs-discuss@opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>   

___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] zpool imports are slow when importing multiple storage pools

2008-10-06 Thread Tomas Ögren
On 06 October, 2008 - Luke Schwab sent me these 2,0K bytes:

> Is this a design choice with ZFS coding or a bug? Is there anything I
> can do to increase my import times? We do have the same setup on one
> of our SANs with only 10-20 luns instead of 400+ and the imports take
> only 1-3 seconds. My guess here is that the large number of luns is
> effecting imports. But our virtual farm design is broken if we can
> imported at least 30-40 luns in under a minute on a given server.

I believe it will scan all available devices (LUNs) for pool
information.. If you only want to scan a subset, you can for instance
make a new directory somewhere and put symlinks there to the real
devices, then 'zpool import -d /that/directory'  to only search there
for devices to consider.

/Tomas
-- 
Tomas Ögren, [EMAIL PROTECTED], http://www.acc.umu.se/~stric/
|- Student at Computing Science, University of Umeå
`- Sysadmin at {cs,acc}.umu.se
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


[zfs-discuss] zpool imports are slow when importing multiple storage pools

2008-10-06 Thread Luke Schwab
Hi,
I am having a problem running zpool imports when we import multiple storage 
pools at one time. Below are the details of the setup:

- We are using a SAN with Sun 6140 storage arrays. 
- Dual port HBA on each server is Qlogic running the QLC driver with Sun 
mpxio(SFCSM) running. 
- We have 400+ luns on the SAN. We can't split them up because the luns any of 
the luns may be able to failover between the different servers. We are running 
rather large farm where all servers need to see all the luns in case of 
failover.
-Running Solaris 10 U5 kernal. 

Below are the times I see when importing pools from the SAN storage:
1 pool - 30 seconds
2 pools - 1 minute for both to finish
3 pools - 1 min 30 sec for all 3 to finish
4 pools - 2 minutes for all 4 to finish

When I run more then one zpool import in parallel, I can see that all zpool 
imports are queued up. The more pools I try to import, the longer the pools 
take to import. For example, when importing 2 pools, the first pool takes 1 
minute but then just a few seconds later the 2nd pool finishes its import. When 
I import 3 pools, the first pool takes 1.5 minutes and then the other two pools 
finish just after that.

The problem we are seeing it that we need to failover up to 32 pools at one 
time on a server and the imports end up timing out after 5-10 minutes because 
we are trying to import too many pools at one time. 

Is this a design choice with ZFS coding or a bug? Is there anything I can do to 
increase my import times? We do have the same setup on one of our SANs with 
only 10-20 luns instead of 400+ and the imports take only 1-3 seconds. My guess 
here is that the large number of luns is effecting imports. But our virtual 
farm design is broken if we can imported at least 30-40 luns in under a minute 
on a given server.

Any thoughts or questions would be great.

Thanks,
Luke
--
This message posted from opensolaris.org
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss