Re: [zfs-discuss] Largest (in number of files) ZFS instance tested

2008-07-12 Thread Peter Tribble
On Sat, Jul 12, 2008 at 12:23 AM, Ian Collins <[EMAIL PROTECTED]> wrote: > Peter Tribble wrote: >> >> (The backup problem is the real stumbling block. And backup is an area ripe >> for disruptive innovation.) >> >> > Is down to volume of data, or many small files? Many small files. We could handle

Re: [zfs-discuss] Largest (in number of files) ZFS instance tested

2008-07-11 Thread Mike Gerdts
On Fri, Jul 11, 2008 at 3:59 PM, Bob Friesenhahn <[EMAIL PROTECTED]> wrote: > There are definitely issues with programs like 'ls' when listing a > directory with a million files since 'ls' sorts its output by default. > My Windows system didn't like it at all when accessing it with CIFS > and the f

Re: [zfs-discuss] Largest (in number of files) ZFS instance tested

2008-07-11 Thread Ian Collins
Peter Tribble wrote: > On Fri, Jul 11, 2008 at 5:33 PM, Sean Cochrane - Storage Architect > <[EMAIL PROTECTED]> wrote: >> What were the performance characteristics? >> > > Not brilliant... > > Although I suspect raid-z isn't exactly the ideal choice. Still, performance > generally is adequate

Re: [zfs-discuss] Largest (in number of files) ZFS instance tested

2008-07-11 Thread Peter Tribble
On Fri, Jul 11, 2008 at 5:33 PM, Sean Cochrane - Storage Architect <[EMAIL PROTECTED]> wrote: > > I need to find out what is the largest ZFS file system - in numbers of > files, NOT CAPACITY that has been tested. > > Looking to scale to billions of files and would like to know if anyone has > teste

Re: [zfs-discuss] Largest (in number of files) ZFS instance tested

2008-07-11 Thread Jonathan Edwards
On Jul 11, 2008, at 4:59 PM, Bob Friesenhahn wrote: >> >> Has anyone tested a ZFS file system with at least 100 million + >> files? >> What were the performance characteristics? > > I think that there are more issues with file fragmentation over a long > period of time than the sheer number of

Re: [zfs-discuss] Largest (in number of files) ZFS instance tested

2008-07-11 Thread Bob Friesenhahn
On Fri, 11 Jul 2008, Sean Cochrane - Storage Architect wrote: > I need to find out what is the largest ZFS file system - in numbers of files, > NOT CAPACITY that has been tested. In response to an earlier such question (from you?) I created a directory with a million files. I forgot about it s

Re: [zfs-discuss] Largest (in number of files) ZFS instance tested

2008-07-11 Thread Rich Teer
On Fri, 11 Jul 2008, Sean Cochrane - Storage Architect wrote: > I need to find out what is the largest ZFS file system - in numbers of files, > NOT CAPACITY that has been tested. > > Looking to scale to billions of files and would like to know if anyone has > tested anything close and what the pe

[zfs-discuss] Largest (in number of files) ZFS instance tested

2008-07-11 Thread Sean Cochrane - Storage Architect
I need to find out what is the largest ZFS file system - in numbers of files, NOT CAPACITY that has been tested. Looking to scale to billions of files and would like to know if anyone has tested anything close and what the performance ramifications are. Has anyone tested a ZFS file system w