Hello, On Thu, 15 Nov 2012 10:53:05 +0100 JC PAROLA wrote: > > > 1/ Distributed Filesystem implies netwoks access, what is the > > > network bottleneck ? > > > (same question for MooseFS > > > http://www.moosefs.org/moosefs-faq.html#mailserver) > > > > This highly depends on your workload pattern. From our experience on > > a 16-nodes 1GBit HPC setup (15 data and meta servers + 16 clients) > > OrangeFS is reasonably good for a parallel data access and for large > > data chunks per transfer. > > Ok, you have 15 data server and 1 metadata server.
No, I have 15 hosts acting as both data and meta servers and 16 clients. > Are you using Heartbeat for redondancy of meta server ? No, I don't have any SAN to share between primary and backup servers. Data redundancy is achieved by regular backups of valuable data. We have no run-time redundancy however. > In case of failure on data server, you loose data ? Yes, all non-backed data will be lost. IIRC, orangefs-3.x will have built-in redundancy features and should be available at the end of first quarter next year. > > On lots of small files or small access data patterns performance > > degrades significantly; though work with a large number of small > > files may be improved with more metadata servers engaged. > > very good, it's very interessing. I don't find any documentation on > this tips on pvfs web site. OrangeFS has tons of built-in documents shipped with the package. You should also search through users and devel mail lists, they contain some valuable information. > therefore, metadata are distribured on metada server or replicate (for > hihg avability) > > > > From network you'll need not only bandwidth, but small latency. > > Perhaps, IB is your best friend. > > > What do you mean by IB ? I don't find IB in doc I mean the InfiniBand interconnect technology. > Thanks a lot. You're welcome. Best regards, Andrew Savchenko
pgpZPTS0aDIcj.pgp
Description: PGP signature
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
