On 19/02/2013 10:47, MJ wrote:
Which app are you running that is generating millions of tiny files in a single
directory? Regardless, in this case OpenBSD is not the right tool for the job.
You need either FreeBSD or a Solaris variant to handle this problem because you
need ZFS.
What limits does ZFS have?
---------------------------------------
The limitations of ZFS are designed to be so large that they will never be
encountered in any practical operation. ZFS can store 16 Exabytes in each
storage pool, file system, file, or file attribute. ZFS can store billions of
names: files or directories in a directory, file systems in a file system, or
snapshots of a file system. ZFS can store trillions of items: files in a file
system, file systems, volumes, or snapshots in a pool.
I'm not sure why ZFS hasn't yet been ported to OpenBSD, but if it were then
that would pretty much eliminate the need for my one and only FreeBSD box ;-)
On Feb 19, 2013, at 2:35 AM, Keith <ke...@scott-land.net> wrote:
Q. How do I make the default web folder /var/www/ capable of holding millions
of files (say 50GB worth of small 2kb-12kb files) so that I won't get inode
issues ?
The problem is that my server has the default disk layout as I didn't expect to
have millions of files (I though they would be stored in the DB). When I
started the app it generated all the files and I got out of space warnings. I
tried moving the folder containing the files and making a symlink back but that
didn't work because nginx is in a chroot.
The two option I think I have are.
1. Reinstall the OS and make a dedicated /var/www partition but how I increase
the inode limit I have no idea.
2. Make a new partition, format it, copy the files from the original partition
and swap them around and restart nginx. ( Do i run newfs with some option to
make more inodes ?)
Thanks
Keith.
It's a usenet indexing application called Newznab. It consists of two
parts, some php scripts that do the indexing that are generating the
pesky "nbz.gz" files and then there's the web front end.
This running on my home server / firewall and I think it's almost
working I just need to get the partitions sorted out and it should be
fine. I don't want to switch to FreeBSD for ZFS or introduce another
machine for a NFS Volume.
To be honest I didn't think indexing usenet would be such a big deal,
but it's a turning out to be quite a resource hog.
Keith