Re: [9fans] ceph

2009-08-04 Thread Tim Newsham
2. do we have anybody successfully managing that much storage that is also spread across the nodes? And if so, what's the best practices out there to make the client not worry about where does the storage actually come from (IOW, any kind of proxying of I/O, etc)

Re: [9fans] ceph

2009-08-04 Thread erik quanstrom
Google? the exception that proves the rule? they emphatically don't go for posix semantics... why would purveryers of 9p give a rip about posix sematics? - erik

Re: [9fans] ceph

2009-08-04 Thread Steve Simon
Well, with Linux, at least you have a benefit of a gazillions of FS clients being available either natively or via FUSE. Do you have a link to a site which lists interesting FUSE filesystems, I am definitely not trying to troll, I am always intrigued by others ideas of how to reprisent

Re: [9fans] ceph

2009-08-04 Thread roger peppe
2009/8/4 erik quanstrom quans...@quanstro.net: Google? the exception that proves the rule? they emphatically don't go for posix semantics... why would purveryers of 9p give a rip about posix sematics? from ron: 10,000 machines, working on a single app, must have access to a common file

Re: [9fans] ceph

2009-08-04 Thread C H Forsyth
they emphatically don't go for posix semantics... what are posix semantics?

Re: [9fans] ceph

2009-08-04 Thread roger peppe
2009/8/4 C H Forsyth fors...@vitanuova.com: they emphatically don't go for posix semantics... what are posix semantics? perhaps wrongly, i'd assumed that the posix standard implied some semantics in defining its file API, and ron was referring to those. perhaps it defines less than i assume -

Re: [9fans] ceph

2009-08-04 Thread ron minnich
On Tue, Aug 4, 2009 at 2:55 AM, C H Forsythfors...@vitanuova.com wrote: they emphatically don't go for posix semantics... what are posix semantics? whatever today's customer happens to think they are. ron

Re: [9fans] ceph

2009-08-04 Thread Roman V Shaposhnik
On Mon, 2009-08-03 at 19:56 -0700, ron minnich wrote: 2. do we have anybody successfully managing that much storage that is also spread across the nodes? And if so, what's the best practices out there to make the client not worry about where does the storage actually come from

Re: [9fans] ceph

2009-08-04 Thread Roman V Shaposhnik
On Tue, 2009-08-04 at 10:55 +0100, C H Forsyth wrote: they emphatically don't go for posix semantics... what are posix semantics? I'll bite: http://www.opengroup.org/onlinepubs/009695399/ [ anything else that would take an FD as an argument ]

Re: [9fans] ceph

2009-08-04 Thread Roman V Shaposhnik
On Tue, 2009-08-04 at 09:43 +0100, Steve Simon wrote: Well, with Linux, at least you have a benefit of a gazillions of FS clients being available either natively or via FUSE. Do you have a link to a site which lists interesting FUSE filesystems, I am definitely not trying to troll, I am

Re: [9fans] ceph

2009-08-04 Thread Roman V Shaposhnik
On Mon, 2009-08-03 at 21:23 -1000, Tim Newsham wrote: 2. do we have anybody successfully managing that much storage that is also spread across the nodes? And if so, what's the best practices out there to make the client not worry about where does the storage actually come from

Re: [9fans] ceph

2009-08-04 Thread Tim Newsham
Hadoop and GFS are good examples and they work great for the single distributed application that is *written* with them in mind. Unfortunately, I can not stretch my imagination hard enough to see them as general purpose filesystems backing up data for gazillions of non-cooperative applications.

Re: [9fans] ceph

2009-08-03 Thread Roman V Shaposhnik
On Sat, 2009-08-01 at 08:47 -0700, ron minnich wrote: What are their requirements as far as POSIX is concerned? 10,000 machines, working on a single app, must have access to a common file store with full posix semantics and it all has to work like it were one machine (their desktop, of

Re: [9fans] ceph

2009-08-03 Thread roger peppe
2009/8/4 ron minnich rminn...@gmail.com:  2. do we have anybody successfully managing that much storage that is     also spread across the nodes? And if so, what's the best practices     out there to make the client not worry about where does the storage     actually come from (IOW, any kind

Re: [9fans] ceph

2009-08-01 Thread ron minnich
On Fri, Jul 31, 2009 at 10:53 PM, Roman Shaposhnikr...@sun.com wrote: What are your clients running? Linux What are their requirements as far as POSIX is concerned? 10,000 machines, working on a single app, must have access to a common file store with full posix semantics and it all has to

Re: [9fans] ceph

2009-07-31 Thread Roman Shaposhnik
On Jul 30, 2009, at 9:31 AM, sqweek wrote: 2009/7/30 Roman V Shaposhnik r...@sun.com: This is sort of off-topic, but does anybody have any experience with Ceph? http://ceph.newdream.net/ Good or bad war stories (and general thoughts) would be quite welcome. Not with ceph itself, but

Re: [9fans] ceph

2009-07-31 Thread ron minnich
I'm not a big fan of lustre. In fact I'm talking to someone who really wants 9p working well so he can have lustre on all but a few nodes, and those lustre nodes export 9p. ron

Re: [9fans] ceph

2009-07-31 Thread Roman Shaposhnik
On Jul 31, 2009, at 10:41 PM, ron minnich wrote: I'm not a big fan of lustre. In fact I'm talking to someone who really wants 9p working well so he can have lustre on all but a few nodes, and those lustre nodes export 9p. What are your clients running? What are their requirements as far as

Re: [9fans] ceph

2009-07-30 Thread sqweek
2009/7/30 Roman V Shaposhnik r...@sun.com: This is sort of off-topic, but does anybody have any experience with Ceph?   http://ceph.newdream.net/ Good or bad war stories (and general thoughts) would be quite welcome. Not with ceph itself, but the description and terminology they use remind

[9fans] ceph

2009-07-29 Thread Roman V Shaposhnik
This is sort of off-topic, but does anybody have any experience with Ceph? http://ceph.newdream.net/ Good or bad war stories (and general thoughts) would be quite welcome. Thanks, Roman.